Nov 04 10:43:39 devstack cinder-volume[76036]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Nov 04 10:43:39 devstack cinder-volume[76036]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Nov 04 10:43:39 devstack cinder-volume[76036]: we strongly recommend against using it for new projects. Nov 04 10:43:39 devstack cinder-volume[76036]: If you are already using Eventlet, we recommend migrating to a different Nov 04 10:43:39 devstack cinder-volume[76036]: framework. For more detail see Nov 04 10:43:39 devstack cinder-volume[76036]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Nov 04 10:43:39 devstack cinder-volume[76036]: import eventlet # noqa Nov 04 10:43:42 devstack cinder-volume[76036]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=76036) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Nov 04 10:43:42 devstack cinder-volume[76036]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=76036) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Nov 04 10:43:42 devstack cinder-volume[76036]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=76036) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Nov 04 10:43:43 devstack cinder-volume[76036]: INFO dbcounter [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] Registered counter for database cinder Nov 04 10:43:43 devstack cinder-volume[76036]: DEBUG oslo_db.sqlalchemy.engines [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76036) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 04 10:43:43 devstack cinder-volume[76036]: DEBUG dbcounter [-] [76036] Writer thread running {{(pid=76036) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Nov 04 10:43:43 devstack cinder-volume[76036]: INFO cinder.rpc [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Nov 04 10:43:43 devstack cinder-volume[76036]: INFO cinder.rpc [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Nov 04 10:43:43 devstack cinder-volume[76036]: DEBUG oslo_db.sqlalchemy.engines [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76036) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 04 10:43:43 devstack cinder-volume[76036]: INFO cinder.volume.manager [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] Determined volume DB was empty at startup. Nov 04 10:43:43 devstack cinder-volume[76036]: DEBUG cinder.volume.manager [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] Cinder Volume DB check: vol_db_empty=True {{(pid=76036) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Nov 04 10:43:43 devstack cinder-volume[76036]: INFO cinder.volume.manager [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] Service not found for updating active_backend_id, assuming default for driver init. Nov 04 10:43:43 devstack cinder-volume[76036]: WARNING stevedore.named [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 04 10:43:43 devstack cinder-volume[76036]: WARNING castellan.key_manager [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 04 10:43:43 devstack cinder-volume[76036]: WARNING cinder.keymgr.conf_key_mgr [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 04 10:43:43 devstack cinder-volume[76036]: DEBUG cinder.volume.drivers.lvm [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=76036) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:109}} Nov 04 10:43:43 devstack cinder-volume[76036]: DEBUG oslo_concurrency.processutils [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=76036) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_concurrency.processutils [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] CMD "cinder-rtstool verify" returned: 0 in 0.411s {{(pid=76036) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_db.sqlalchemy.engines [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76036) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 04 10:43:44 devstack cinder-volume[76036]: INFO cinder.rpc [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Nov 04 10:43:44 devstack cinder-volume[76036]: INFO cinder.rpc [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Nov 04 10:43:44 devstack cinder-volume[76036]: WARNING stevedore.named [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 04 10:43:44 devstack cinder-volume[76036]: WARNING castellan.key_manager [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 04 10:43:44 devstack cinder-volume[76036]: INFO cinder.volume.manager [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] Image-volume cache enabled for host devstack@lvmdriver-1. Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_db.sqlalchemy.engines [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76036) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 04 10:43:44 devstack cinder-volume[76036]: INFO oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] Starting 1 workers Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] Started child 76171 {{(pid=76036) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] Full set of CONF: {{(pid=76036) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] ******************************************************************************** {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] Configuration options gathered from: {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] ================================================================================ {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Nov 04 10:43:44 devstack cinder-volume[76171]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] allow_availability_zone_fallback = False {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] allow_compression_on_image_upload = False {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] allowed_direct_url_schemes = [] {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] api_rate_limit = True {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] auth_strategy = keystone {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] az_cache_duration = 3600 {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] backend_availability_zone = None {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] backend_host = None {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] backend_name = None {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] backend_stats_polling_interval = 60 {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] backup_api_class = cinder.backup.api.API {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] backup_name_template = backup-%s {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] backup_use_same_host = False {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] backup_use_temp_snapshot = False {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] chap_password = **** {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] chap_username = {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] cinder_internal_tenant_project_id = f776413d743c4a4c88b8631e5cd324b8 {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] cinder_internal_tenant_user_id = 7dbf5add13f947c28a1b157ef53a4306 {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] cloned_volume_same_az = True {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] cluster = None {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] compression_format = gzip {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] compute_api_class = cinder.compute.nova.API {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] config_dir = [] {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] config_source = [] {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] control_exchange = openstack {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] debug = True {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] default_availability_zone = None {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] default_group_type = None {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] default_volume_type = lvmdriver-1 {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] disk_geometry = None {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] driver_client_cert = None {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] driver_client_cert_key = None {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] driver_data_namespace = None {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] driver_ssl_cert_path = None {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] driver_ssl_cert_verify = False {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] driver_use_ssl = False {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] enable_force_upload = False {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] enable_new_services = True {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] enable_unsupported_driver = False {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] enabled_backends = ['lvmdriver-1'] {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] enforce_multipath_for_image_xfer = False {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] filter_function = None {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] glance_api_insecure = False {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] glance_api_servers = ['http://192.168.122.89/image'] {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] glance_api_ssl_compression = False {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] glance_ca_certificates_file = None {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] glance_catalog_info = image:glance:publicURL {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] glance_certfile = None {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] glance_keyfile = None {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] glance_num_retries = 3 {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] glance_request_timeout = None {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] goodness_function = None {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] graceful_shutdown_timeout = 5 {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] group_api_class = cinder.group.api.API {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] host = devstack {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] image_compress_on_upload = True {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] image_conversion_address_space_limit = 1 {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] image_conversion_cpu_limit = 60 {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] image_conversion_disable = False {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] image_upload_use_cinder_backend = False {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] image_upload_use_internal_tenant = False {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] image_volume_cache_enabled = False {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] image_volume_cache_max_count = 0 {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] image_volume_cache_max_size_gb = 0 {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] init_host_max_objects_retrieval = 0 {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] instance_format = [instance: %(uuid)s] {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] iscsi_target_flags = {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] iscsi_write_cache = on {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] iser_helper = tgtadm {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] iser_ip_address = 192.168.122.89 {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] iser_port = 3260 {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] log_color = False {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] log_config_append = None {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] log_dir = None {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:43:44 devstack cinder-volume[76171]: INFO cinder.volume.manager [None req-a06f275b-7a9b-49b4-bba7-de77e25c23d9 None None] Starting volume driver LVMVolumeDriver (3.0.0) Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] log_file = None {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] log_options = True {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:43:44 devstack cinder-volume[76171]: DEBUG oslo_concurrency.processutils [None req-a06f275b-7a9b-49b4-bba7-de77e25c23d9 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] log_rotate_interval = 1 {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] log_rotate_interval_type = days {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] log_rotation_type = none {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] max_age = 0 {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] max_logfile_count = 30 {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] max_logfile_size_mb = 200 {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] max_over_subscription_ratio = 20.0 {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] message_reap_interval = 86400 {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] message_ttl = 2592000 {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] migration_create_volume_timeout_secs = 300 {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] monkey_patch = False {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] monkey_patch_modules = [] {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] my_ip = 192.168.122.89 {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] no_snapshot_gb_quota = False {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] num_iser_scan_tries = 3 {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] num_shell_tries = 3 {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] num_volume_device_scan_tries = 3 {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] nvmeof_conn_info_version = 1 {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] nvmet_ns_id = 10 {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] nvmet_port_id = 1 {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] osapi_max_limit = 1000 {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] osapi_volume_ext_list = [] {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] osapi_volume_listen = 0.0.0.0 {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] osapi_volume_listen_port = 8776 {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] osapi_volume_use_ssl = False {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] osapi_volume_workers = None {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] per_volume_size_limit = -1 {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] periodic_fuzzy_delay = 60 {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] periodic_interval = 60 {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] project_id_regex = [0-9a-f\-]+ {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] public_endpoint = None {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] publish_errors = False {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] quota_backup_gigabytes = 1000 {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] quota_backups = 10 {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:43:44 devstack cinder-volume[76171]: DEBUG oslo_concurrency.processutils [None req-a06f275b-7a9b-49b4-bba7-de77e25c23d9 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.028s {{(pid=76171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] quota_gigabytes = 1000 {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] quota_groups = 10 {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] quota_snapshots = 10 {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:43:44 devstack cinder-volume[76171]: DEBUG oslo_concurrency.processutils [None req-a06f275b-7a9b-49b4-bba7-de77e25c23d9 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] quota_volumes = 10 {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] rate_limit_burst = 0 {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] rate_limit_except_level = CRITICAL {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] rate_limit_interval = 0 {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] reinit_driver_count = 3 {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] replication_device = **** {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] report_discard_supported = False {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] report_interval = 120 {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] reservation_clean_interval = 86400 {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] reservation_expire = 86400 {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] reserved_image_namespaces = [] {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] reserved_percentage = 0 {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] rpc_response_timeout = 120 {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] run_external_periodic_tasks = True {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] scst_target_driver = iscsi {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] scst_target_iqn_name = None {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] service_down_time = 720 {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] shell_completion = None {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] snapshot_name_template = snapshot-%s {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] snapshot_same_host = True {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] split_loggers = False {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] state_path = /opt/stack/data/cinder {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] storage_availability_zone = nova {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] storage_protocol = iSCSI {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] syslog_log_facility = LOG_USER {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] target_helper = lioadm {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] target_ip_address = 192.168.122.89 {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] target_port = 3260 {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] target_protocol = iscsi {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] target_secondary_ip_addresses = [] {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] trace_flags = None {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] transfer_api_class = cinder.transfer.api.API {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] transport_url = **** {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] until_refresh = 0 {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] use_chap_auth = False {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:43:44 devstack cinder-volume[76171]: DEBUG oslo_concurrency.processutils [None req-a06f275b-7a9b-49b4-bba7-de77e25c23d9 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.017s {{(pid=76171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] use_default_quota_class = True {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] use_journal = False {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:43:44 devstack cinder-volume[76171]: DEBUG oslo_concurrency.processutils [None req-a06f275b-7a9b-49b4-bba7-de77e25c23d9 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] use_json = False {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] use_multipath_for_image_xfer = False {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] use_stderr = False {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] use_syslog = False {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] verify_glance_signatures = enabled {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] volume_api_class = cinder.volume.api.API {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] volume_backend_name = None {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] volume_clear = zero {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] volume_clear_ionice = None {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] volume_clear_size = 0 {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] volume_copy_bps_limit = 0 {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] volume_dd_blocksize = 1M {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] volume_name_template = volume-%s {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] volume_service_inithost_offload = False {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] volume_usage_audit_period = month {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] zoning_mode = None {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] oslo_concurrency.disable_process_locking = False {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] os_brick.lightos_discovery_client_address = localhost {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] os_brick.wait_mpath_device_interval = 1 {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] keystone_authtoken.auth_section = None {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] keystone_authtoken.auth_type = password {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] keystone_authtoken.auth_version = None {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] keystone_authtoken.cache = None {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] keystone_authtoken.certfile = None {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] keystone_authtoken.delay_auth_decision = False {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] keystone_authtoken.http_connect_timeout = None {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] keystone_authtoken.include_service_catalog = True {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] keystone_authtoken.insecure = False {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] keystone_authtoken.interface = public {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] keystone_authtoken.keyfile = None {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] keystone_authtoken.memcache_password = **** {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] keystone_authtoken.memcache_secret_key = **** {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] keystone_authtoken.memcache_security_strategy = None {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] keystone_authtoken.memcache_username = None {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] keystone_authtoken.region_name = None {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] keystone_authtoken.service_token_roles_required = True {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] keystone_authtoken.service_type = None {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] keystone_authtoken.token_cache_time = 300 {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.89/identity {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] cache.backend = dogpile.cache.null {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] cache.backend_argument = **** {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] cache.backend_expiration_time = None {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] cache.config_prefix = cache.oslo {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] cache.debug_cache_backend = False {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] cache.enable_retry_client = False {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] cache.enable_socket_keepalive = False {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] cache.enabled = False {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] cache.expiration_time = 600 {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] cache.hashclient_dead_timeout = 60.0 {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] cache.hashclient_retry_attempts = 2 {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] cache.hashclient_retry_timeout = 1.0 {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] cache.memcache_dead_retry = 300 {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] cache.memcache_pool_maxsize = 10 {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] cache.memcache_pool_unused_timeout = 60 {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] cache.memcache_sasl_enabled = False {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] cache.memcache_servers = ['localhost:11211'] {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] cache.password = **** {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] cache.proxies = [] {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] cache.redis_db = 0 {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] cache.redis_sentinel_service_name = mymaster {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:43:44 devstack cinder-volume[76171]: DEBUG oslo_concurrency.processutils [None req-a06f275b-7a9b-49b4-bba7-de77e25c23d9 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.042s {{(pid=76171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] cache.redis_server = localhost:6379 {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] cache.retry_attempts = 2 {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] cache.retry_delay = 0.0 {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] cache.socket_keepalive_count = 1 {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:43:44 devstack cinder-volume[76171]: DEBUG oslo_concurrency.processutils [None req-a06f275b-7a9b-49b4-bba7-de77e25c23d9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=76171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] cache.socket_keepalive_idle = 1 {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] cache.socket_keepalive_interval = 1 {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] cache.socket_timeout = 1.0 {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] cache.tls_allowed_ciphers = None {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] cache.tls_cafile = None {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] cache.tls_certfile = None {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] cache.tls_enabled = False {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] cache.tls_keyfile = None {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] cache.username = None {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] coordination.backend_url = **** {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] database.asyncio_connection = **** {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] database.asyncio_slave_connection = **** {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] database.backend = sqlalchemy {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] database.connection = **** {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] database.connection_debug = 0 {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] database.connection_parameters = {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] database.connection_recycle_time = 3600 {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] database.connection_trace = False {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] database.db_inc_retry_interval = True {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] database.db_max_retries = 20 {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] database.db_max_retry_interval = 10 {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] database.db_retry_interval = 1 {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] database.max_overflow = 50 {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] database.max_pool_size = 5 {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] database.max_retries = 10 {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] database.mysql_sql_mode = TRADITIONAL {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] database.mysql_wsrep_sync_wait = None {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] database.pool_timeout = None {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] database.retry_interval = 10 {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] database.slave_connection = **** {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] database.sqlite_synchronous = True {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] database.synchronous_reader = True {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] database.use_db_reconnect = False {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] oslo_messaging_metrics.metrics_process_name = {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] oslo_messaging_tracing.insecure = False {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] profiler.connection_string = messaging:// {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] profiler.enabled = False {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] profiler.es_doc_type = notification {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] profiler.es_scroll_size = 10000 {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] profiler.es_scroll_time = 2m {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] profiler.filter_error_trace = False {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] profiler.hmac_keys = **** {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] profiler.sentinel_service_name = mymaster {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] profiler.socket_timeout = 0.1 {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] profiler.trace_requests = False {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] profiler.trace_sqlalchemy = False {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] profiler_jaeger.process_tags = {} {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] profiler_jaeger.service_name_prefix = None {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] profiler_otlp.service_name_prefix = None {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] oslo_policy.enforce_new_defaults = True {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] oslo_policy.policy_default_rule = default {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] oslo_policy.policy_file = policy.yaml {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] oslo_policy.remote_timeout = 60.0 {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] privsep_osbrick.capabilities = [21, 2] {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] privsep_osbrick.group = None {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] privsep_osbrick.helper_command = None {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] privsep_osbrick.log_daemon_traceback = False {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] privsep_osbrick.thread_pool_size = 4 {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] privsep_osbrick.user = None {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] cinder_sys_admin.group = None {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] cinder_sys_admin.helper_command = None {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] cinder_sys_admin.user = None {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] service_user.auth_section = None {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] service_user.auth_type = password {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:43:44 devstack sudo[76175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] service_user.cafile = None {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] service_user.certfile = None {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] service_user.collect_timing = False {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] service_user.insecure = False {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] service_user.keyfile = None {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] service_user.send_service_user_token = True {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] service_user.split_loggers = False {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:43:44 devstack sudo[76175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] service_user.timeout = None {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] service_user.tls_ciphers = None {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] service_user.tls_min_version = None {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] glance.auth_section = None {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] glance.auth_type = password {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] glance.certfile = None {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] glance.collect_timing = False {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] glance.insecure = False {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] glance.keyfile = None {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] glance.region_name = None {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] glance.split_loggers = False {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] glance.timeout = None {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] glance.tls_ciphers = None {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] glance.tls_min_version = None {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] backend_defaults.backend_availability_zone = None {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] backend_defaults.chap_password = **** {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] backend_defaults.chap_username = {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] backend_defaults.disk_geometry = None {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] backend_defaults.driver_client_cert = None {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] backend_defaults.driver_client_cert_key = None {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] backend_defaults.driver_data_namespace = None {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] backend_defaults.driver_ssl_cert_path = None {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] backend_defaults.driver_use_ssl = False {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] backend_defaults.enable_unsupported_driver = False {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] backend_defaults.extra_capabilities = {} {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] backend_defaults.filter_function = None {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] backend_defaults.goodness_function = None {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] backend_defaults.image_volume_cache_enabled = False {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] backend_defaults.iscsi_target_flags = {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] backend_defaults.iscsi_write_cache = on {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] backend_defaults.iser_helper = tgtadm {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] backend_defaults.iser_ip_address = 192.168.122.89 {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] backend_defaults.iser_port = 3260 {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] backend_defaults.lvm_mirrors = 0 {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] backend_defaults.lvm_share_target = False {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] backend_defaults.lvm_type = auto {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] backend_defaults.num_shell_tries = 3 {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] backend_defaults.nvmet_ns_id = 10 {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] backend_defaults.nvmet_port_id = 1 {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] backend_defaults.replication_device = **** {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] backend_defaults.report_discard_supported = False {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] backend_defaults.reserved_percentage = 0 {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] backend_defaults.scst_target_driver = iscsi {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] backend_defaults.scst_target_iqn_name = None {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] backend_defaults.storage_protocol = iSCSI {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] backend_defaults.target_helper = tgtadm {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] backend_defaults.target_ip_address = 192.168.122.89 {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] backend_defaults.target_port = 3260 {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] backend_defaults.target_protocol = iscsi {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] backend_defaults.trace_flags = None {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] backend_defaults.unique_fqdn_network = True {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] backend_defaults.use_chap_auth = False {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] backend_defaults.volume_backend_name = None {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] backend_defaults.volume_clear = zero {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] backend_defaults.volume_clear_ionice = None {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] backend_defaults.volume_clear_size = 0 {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] backend_defaults.volume_group = cinder-volumes {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] oslo_reports.file_event_handler = None {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] oslo_reports.file_event_handler_interval = 1 {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] oslo_reports.log_dir = None {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] lvmdriver-1.backend_availability_zone = None {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] lvmdriver-1.backend_host = None {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] lvmdriver-1.chap_password = **** {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] lvmdriver-1.chap_username = None {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] lvmdriver-1.chiscsi_conf = None {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] lvmdriver-1.disk_geometry = None {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] lvmdriver-1.driver_client_cert = None {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] lvmdriver-1.driver_client_cert_key = None {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] lvmdriver-1.driver_data_namespace = None {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] lvmdriver-1.driver_use_ssl = None {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] lvmdriver-1.extra_capabilities = None {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] lvmdriver-1.filter_function = None {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] lvmdriver-1.goodness_function = None {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] lvmdriver-1.iscsi_target_flags = None {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] lvmdriver-1.iscsi_write_cache = None {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] lvmdriver-1.iser_helper = None {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] lvmdriver-1.iser_ip_address = None {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] lvmdriver-1.iser_port = None {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] lvmdriver-1.iser_target_prefix = None {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] lvmdriver-1.lvm_conf_file = None {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] lvmdriver-1.lvm_mirrors = None {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] lvmdriver-1.lvm_share_target = None {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] lvmdriver-1.lvm_type = auto {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] lvmdriver-1.num_shell_tries = None {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] lvmdriver-1.nvmet_ns_id = None {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] lvmdriver-1.nvmet_port_id = None {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] lvmdriver-1.replication_device = **** {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] lvmdriver-1.report_discard_supported = None {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] lvmdriver-1.reserved_percentage = None {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] lvmdriver-1.scst_target_driver = None {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] lvmdriver-1.storage_protocol = None {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] lvmdriver-1.target_helper = lioadm {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] lvmdriver-1.target_ip_address = None {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] lvmdriver-1.target_port = 3260 {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] lvmdriver-1.target_protocol = iscsi {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] lvmdriver-1.trace_flags = None {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] lvmdriver-1.unique_fqdn_network = None {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] lvmdriver-1.use_chap_auth = None {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] lvmdriver-1.volume_clear = zero {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] lvmdriver-1.volume_clear_ionice = None {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] lvmdriver-1.volume_clear_size = None {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] lvmdriver-1.volumes_dir = None {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] oslo_messaging_rabbit.hostname = devstack {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] oslo_messaging_rabbit.ssl = False {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] oslo_messaging_rabbit.ssl_version = {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] oslo_messaging_notifications.driver = [] {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] oslo_messaging_notifications.retry = -1 {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] oslo_messaging_notifications.transport_url = **** {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] key_manager.fixed_key = **** {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] barbican.barbican_api_version = None {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] barbican.barbican_endpoint = None {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] barbican.barbican_endpoint_type = public {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] barbican.barbican_region_name = None {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] barbican.cafile = None {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] barbican.certfile = None {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] barbican.collect_timing = False {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] barbican.insecure = False {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] barbican.keyfile = None {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] barbican.number_of_retries = 60 {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] barbican.retry_delay = 1 {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] barbican.send_service_user_token = False {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] barbican.split_loggers = False {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] barbican.timeout = None {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] barbican.tls_ciphers = None {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] barbican.tls_min_version = None {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] barbican.verify_ssl = True {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] barbican.verify_ssl_path = None {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] barbican_service_user.auth_section = None {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] barbican_service_user.auth_type = None {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] barbican_service_user.cafile = None {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] barbican_service_user.certfile = None {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] barbican_service_user.collect_timing = False {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] barbican_service_user.insecure = False {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] barbican_service_user.keyfile = None {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] barbican_service_user.split_loggers = False {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] barbican_service_user.timeout = None {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] barbican_service_user.tls_ciphers = None {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] barbican_service_user.tls_min_version = None {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] vault.approle_role_id = **** {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] vault.approle_secret_id = **** {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] vault.auth_method = approle {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] vault.auth_path = None {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] vault.kv_mountpoint = secret {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] vault.kv_path = None {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] vault.kv_version = 2 {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] vault.namespace = None {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] vault.root_token_id = **** {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] vault.ssl_ca_crt_file = None {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] vault.timeout = 60.0 {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] vault.token_file = None {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] vault.token_role = None {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] vault.use_ssl = False {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:43:44 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] ******************************************************************************** {{(pid=76036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Nov 04 10:43:44 devstack sudo[76175]: pam_unix(sudo:session): session closed for user root Nov 04 10:43:44 devstack cinder-volume[76171]: DEBUG oslo_concurrency.processutils [None req-a06f275b-7a9b-49b4-bba7-de77e25c23d9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.309s {{(pid=76171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:43:44 devstack cinder-volume[76171]: DEBUG oslo_concurrency.processutils [None req-a06f275b-7a9b-49b4-bba7-de77e25c23d9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:43:45 devstack sudo[76326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 04 10:43:45 devstack sudo[76326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:43:45 devstack sudo[76326]: pam_unix(sudo:session): session closed for user root Nov 04 10:43:45 devstack cinder-volume[76171]: DEBUG oslo_concurrency.processutils [None req-a06f275b-7a9b-49b4-bba7-de77e25c23d9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.248s {{(pid=76171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:43:45 devstack cinder-volume[76171]: DEBUG oslo_concurrency.processutils [None req-a06f275b-7a9b-49b4-bba7-de77e25c23d9 None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=76171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 04 10:43:45 devstack cinder-volume[76171]: INFO cinder.brick.local_dev.lvm [None req-a06f275b-7a9b-49b4-bba7-de77e25c23d9 None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Nov 04 10:43:45 devstack cinder-volume[76171]: DEBUG oslo_concurrency.processutils [None req-a06f275b-7a9b-49b4-bba7-de77e25c23d9 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:43:45 devstack cinder-volume[76171]: DEBUG oslo_concurrency.processutils [None req-a06f275b-7a9b-49b4-bba7-de77e25c23d9 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.015s {{(pid=76171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:43:45 devstack cinder-volume[76171]: DEBUG oslo_concurrency.processutils [None req-a06f275b-7a9b-49b4-bba7-de77e25c23d9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:43:45 devstack sudo[76425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 04 10:43:45 devstack sudo[76425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:43:45 devstack sudo[76425]: pam_unix(sudo:session): session closed for user root Nov 04 10:43:45 devstack cinder-volume[76171]: DEBUG oslo_concurrency.processutils [None req-a06f275b-7a9b-49b4-bba7-de77e25c23d9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.261s {{(pid=76171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:43:45 devstack cinder-volume[76171]: DEBUG cinder.brick.local_dev.lvm [None req-a06f275b-7a9b-49b4-bba7-de77e25c23d9 None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=76171) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:567}} Nov 04 10:43:45 devstack cinder-volume[76171]: DEBUG oslo_concurrency.processutils [None req-a06f275b-7a9b-49b4-bba7-de77e25c23d9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:43:45 devstack sudo[76532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 04 10:43:45 devstack sudo[76532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:43:46 devstack sudo[76532]: pam_unix(sudo:session): session closed for user root Nov 04 10:43:46 devstack cinder-volume[76171]: DEBUG oslo_concurrency.processutils [None req-a06f275b-7a9b-49b4-bba7-de77e25c23d9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.538s {{(pid=76171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:43:46 devstack cinder-volume[76171]: DEBUG oslo_concurrency.processutils [None req-a06f275b-7a9b-49b4-bba7-de77e25c23d9 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:43:46 devstack cinder-volume[76171]: DEBUG oslo_concurrency.processutils [None req-a06f275b-7a9b-49b4-bba7-de77e25c23d9 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.046s {{(pid=76171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:43:46 devstack cinder-volume[76171]: DEBUG oslo_concurrency.processutils [None req-a06f275b-7a9b-49b4-bba7-de77e25c23d9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:43:46 devstack sudo[76771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 04 10:43:46 devstack sudo[76771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:43:46 devstack sudo[76771]: pam_unix(sudo:session): session closed for user root Nov 04 10:43:46 devstack cinder-volume[76171]: DEBUG oslo_concurrency.processutils [None req-a06f275b-7a9b-49b4-bba7-de77e25c23d9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.267s {{(pid=76171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:43:46 devstack cinder-volume[76171]: DEBUG oslo_concurrency.processutils [None req-a06f275b-7a9b-49b4-bba7-de77e25c23d9 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:43:46 devstack cinder-volume[76171]: DEBUG oslo_concurrency.processutils [None req-a06f275b-7a9b-49b4-bba7-de77e25c23d9 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.016s {{(pid=76171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:43:46 devstack cinder-volume[76171]: DEBUG oslo_concurrency.processutils [None req-a06f275b-7a9b-49b4-bba7-de77e25c23d9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=76171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:43:46 devstack sudo[76783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Nov 04 10:43:46 devstack sudo[76783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:43:46 devstack sudo[76783]: pam_unix(sudo:session): session closed for user root Nov 04 10:43:46 devstack cinder-volume[76171]: DEBUG oslo_concurrency.processutils [None req-a06f275b-7a9b-49b4-bba7-de77e25c23d9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.257s {{(pid=76171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:43:46 devstack cinder-volume[76171]: DEBUG oslo_concurrency.processutils [None req-a06f275b-7a9b-49b4-bba7-de77e25c23d9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:43:46 devstack sudo[76843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 04 10:43:46 devstack sudo[76843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:43:46 devstack sudo[76843]: pam_unix(sudo:session): session closed for user root Nov 04 10:43:46 devstack cinder-volume[76171]: DEBUG oslo_concurrency.processutils [None req-a06f275b-7a9b-49b4-bba7-de77e25c23d9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.261s {{(pid=76171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:43:46 devstack cinder-volume[76171]: DEBUG oslo_concurrency.processutils [None req-a06f275b-7a9b-49b4-bba7-de77e25c23d9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:43:46 devstack sudo[76871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 04 10:43:46 devstack sudo[76871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:43:47 devstack sudo[76871]: pam_unix(sudo:session): session closed for user root Nov 04 10:43:47 devstack cinder-volume[76171]: DEBUG oslo_concurrency.processutils [None req-a06f275b-7a9b-49b4-bba7-de77e25c23d9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.259s {{(pid=76171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:43:47 devstack cinder-volume[76171]: DEBUG oslo_concurrency.processutils [None req-a06f275b-7a9b-49b4-bba7-de77e25c23d9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:43:47 devstack sudo[76880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 04 10:43:47 devstack sudo[76880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:43:47 devstack sudo[76880]: pam_unix(sudo:session): session closed for user root Nov 04 10:43:47 devstack cinder-volume[76171]: DEBUG oslo_concurrency.processutils [None req-a06f275b-7a9b-49b4-bba7-de77e25c23d9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.298s {{(pid=76171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:43:47 devstack cinder-volume[76171]: DEBUG oslo_concurrency.processutils [None req-a06f275b-7a9b-49b4-bba7-de77e25c23d9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:43:47 devstack sudo[76963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 04 10:43:47 devstack sudo[76963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:43:47 devstack sudo[76963]: pam_unix(sudo:session): session closed for user root Nov 04 10:43:47 devstack cinder-volume[76171]: DEBUG oslo_concurrency.processutils [None req-a06f275b-7a9b-49b4-bba7-de77e25c23d9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.258s {{(pid=76171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:43:47 devstack cinder-volume[76171]: DEBUG oslo_concurrency.processutils [None req-a06f275b-7a9b-49b4-bba7-de77e25c23d9 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:43:47 devstack cinder-volume[76171]: DEBUG oslo_concurrency.processutils [None req-a06f275b-7a9b-49b4-bba7-de77e25c23d9 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.015s {{(pid=76171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:43:47 devstack cinder-volume[76171]: DEBUG oslo_concurrency.processutils [None req-a06f275b-7a9b-49b4-bba7-de77e25c23d9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:43:47 devstack sudo[76967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 04 10:43:47 devstack sudo[76967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:43:48 devstack sudo[76967]: pam_unix(sudo:session): session closed for user root Nov 04 10:43:48 devstack cinder-volume[76171]: DEBUG oslo_concurrency.processutils [None req-a06f275b-7a9b-49b4-bba7-de77e25c23d9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.266s {{(pid=76171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:43:48 devstack cinder-volume[76171]: INFO cinder.volume.drivers.lvm [None req-a06f275b-7a9b-49b4-bba7-de77e25c23d9 None None] Enabling LVM thin provisioning by default because a thin pool exists. Nov 04 10:43:48 devstack cinder-volume[76171]: DEBUG oslo_concurrency.processutils [None req-a06f275b-7a9b-49b4-bba7-de77e25c23d9 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:43:48 devstack cinder-volume[76171]: DEBUG oslo_concurrency.processutils [None req-a06f275b-7a9b-49b4-bba7-de77e25c23d9 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.016s {{(pid=76171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:43:48 devstack cinder-volume[76171]: DEBUG oslo_concurrency.processutils [None req-a06f275b-7a9b-49b4-bba7-de77e25c23d9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:43:48 devstack sudo[76971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 04 10:43:48 devstack sudo[76971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:43:48 devstack sudo[76971]: pam_unix(sudo:session): session closed for user root Nov 04 10:43:48 devstack cinder-volume[76171]: DEBUG oslo_concurrency.processutils [None req-a06f275b-7a9b-49b4-bba7-de77e25c23d9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.265s {{(pid=76171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:43:48 devstack cinder-volume[76171]: DEBUG cinder.volume.drivers.lvm [None req-a06f275b-7a9b-49b4-bba7-de77e25c23d9 None None] Updating volume stats {{(pid=76171) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Nov 04 10:43:48 devstack cinder-volume[76171]: DEBUG oslo_concurrency.processutils [None req-a06f275b-7a9b-49b4-bba7-de77e25c23d9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:43:48 devstack sudo[76974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 04 10:43:48 devstack sudo[76974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:43:48 devstack sudo[76974]: pam_unix(sudo:session): session closed for user root Nov 04 10:43:48 devstack cinder-volume[76171]: DEBUG oslo_concurrency.processutils [None req-a06f275b-7a9b-49b4-bba7-de77e25c23d9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.265s {{(pid=76171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:43:48 devstack cinder-volume[76171]: DEBUG oslo_concurrency.processutils [None req-a06f275b-7a9b-49b4-bba7-de77e25c23d9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:43:48 devstack sudo[76977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 04 10:43:48 devstack sudo[76977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:43:48 devstack sudo[76977]: pam_unix(sudo:session): session closed for user root Nov 04 10:43:48 devstack cinder-volume[76171]: DEBUG oslo_concurrency.processutils [None req-a06f275b-7a9b-49b4-bba7-de77e25c23d9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.248s {{(pid=76171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:43:48 devstack cinder-volume[76171]: DEBUG oslo_concurrency.processutils [None req-a06f275b-7a9b-49b4-bba7-de77e25c23d9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:43:48 devstack sudo[76986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 04 10:43:48 devstack sudo[76986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:43:49 devstack sudo[76986]: pam_unix(sudo:session): session closed for user root Nov 04 10:43:49 devstack cinder-volume[76171]: DEBUG oslo_concurrency.processutils [None req-a06f275b-7a9b-49b4-bba7-de77e25c23d9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.280s {{(pid=76171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:43:49 devstack cinder-volume[76171]: DEBUG oslo_concurrency.processutils [None req-a06f275b-7a9b-49b4-bba7-de77e25c23d9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:43:49 devstack sudo[76990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 04 10:43:49 devstack sudo[76990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:43:49 devstack sudo[76990]: pam_unix(sudo:session): session closed for user root Nov 04 10:43:49 devstack cinder-volume[76171]: DEBUG oslo_concurrency.processutils [None req-a06f275b-7a9b-49b4-bba7-de77e25c23d9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.288s {{(pid=76171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:43:49 devstack cinder-volume[76171]: INFO cinder.volume.driver [None req-a06f275b-7a9b-49b4-bba7-de77e25c23d9 None None] Driver hasn't implemented _init_vendor_properties() Nov 04 10:43:49 devstack cinder-volume[76171]: DEBUG cinder.volume.driver [None req-a06f275b-7a9b-49b4-bba7-de77e25c23d9 None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=76171) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Nov 04 10:43:49 devstack cinder-volume[76171]: DEBUG oslo_db.sqlalchemy.engines [None req-a06f275b-7a9b-49b4-bba7-de77e25c23d9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76171) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 04 10:43:49 devstack cinder-volume[76171]: DEBUG dbcounter [-] [76171] Writer thread running {{(pid=76171) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Nov 04 10:43:49 devstack cinder-volume[76171]: DEBUG cinder.db.api [None req-a06f275b-7a9b-49b4-bba7-de77e25c23d9 None None] Building query based on filter {{(pid=76171) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Nov 04 10:43:49 devstack cinder-volume[76171]: DEBUG cinder.image.image_utils [None req-a06f275b-7a9b-49b4-bba7-de77e25c23d9 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=76171) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Nov 04 10:43:49 devstack cinder-volume[76171]: INFO cinder.keymgr.migration [None req-933b830b-35ef-4174-9c08-eef08b9c2ec9 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Nov 04 10:43:49 devstack cinder-volume[76171]: DEBUG cinder.volume.drivers.lvm [None req-a06f275b-7a9b-49b4-bba7-de77e25c23d9 None None] Updating volume stats {{(pid=76171) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Nov 04 10:43:49 devstack cinder-volume[76171]: DEBUG oslo_concurrency.processutils [None req-a06f275b-7a9b-49b4-bba7-de77e25c23d9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:43:49 devstack sudo[76994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 04 10:43:49 devstack sudo[76994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:43:49 devstack sudo[76994]: pam_unix(sudo:session): session closed for user root Nov 04 10:43:49 devstack cinder-volume[76171]: DEBUG oslo_concurrency.processutils [None req-a06f275b-7a9b-49b4-bba7-de77e25c23d9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.257s {{(pid=76171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:43:49 devstack cinder-volume[76171]: DEBUG oslo_concurrency.processutils [None req-a06f275b-7a9b-49b4-bba7-de77e25c23d9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:43:49 devstack sudo[76998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 04 10:43:49 devstack sudo[76998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:43:50 devstack sudo[76998]: pam_unix(sudo:session): session closed for user root Nov 04 10:43:50 devstack cinder-volume[76171]: DEBUG oslo_concurrency.processutils [None req-a06f275b-7a9b-49b4-bba7-de77e25c23d9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.275s {{(pid=76171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:43:50 devstack cinder-volume[76171]: DEBUG oslo_concurrency.processutils [None req-a06f275b-7a9b-49b4-bba7-de77e25c23d9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:43:50 devstack sudo[77001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 04 10:43:50 devstack sudo[77001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:43:50 devstack sudo[77001]: pam_unix(sudo:session): session closed for user root Nov 04 10:43:50 devstack cinder-volume[76171]: DEBUG oslo_concurrency.processutils [None req-a06f275b-7a9b-49b4-bba7-de77e25c23d9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.272s {{(pid=76171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:43:50 devstack cinder-volume[76171]: DEBUG oslo_concurrency.processutils [None req-a06f275b-7a9b-49b4-bba7-de77e25c23d9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:43:50 devstack sudo[77004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 04 10:43:50 devstack sudo[77004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:43:50 devstack sudo[77004]: pam_unix(sudo:session): session closed for user root Nov 04 10:43:50 devstack cinder-volume[76171]: DEBUG oslo_concurrency.processutils [None req-a06f275b-7a9b-49b4-bba7-de77e25c23d9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.247s {{(pid=76171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:43:50 devstack cinder-volume[76171]: DEBUG cinder.manager [None req-a06f275b-7a9b-49b4-bba7-de77e25c23d9 None None] Notifying Schedulers of capabilities ... {{(pid=76171) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 10:43:50 devstack cinder-volume[76171]: INFO cinder.volume.manager [None req-a06f275b-7a9b-49b4-bba7-de77e25c23d9 None None] Driver initialization completed successfully. Nov 04 10:43:50 devstack cinder-volume[76171]: INFO cinder.manager [None req-a06f275b-7a9b-49b4-bba7-de77e25c23d9 None None] Initiating service 2 cleanup Nov 04 10:43:50 devstack cinder-volume[76171]: INFO cinder.manager [None req-a06f275b-7a9b-49b4-bba7-de77e25c23d9 None None] Service 2 cleanup completed. Nov 04 10:43:50 devstack cinder-volume[76171]: DEBUG cinder.service [None req-a06f275b-7a9b-49b4-bba7-de77e25c23d9 None None] Creating RPC server for service cinder-volume {{(pid=76171) start /opt/stack/cinder/cinder/service.py:231}} Nov 04 10:43:50 devstack cinder-volume[76171]: DEBUG cinder.service [None req-a06f275b-7a9b-49b4-bba7-de77e25c23d9 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=76171) start /opt/stack/cinder/cinder/service.py:237}} Nov 04 10:43:50 devstack cinder-volume[76171]: INFO cinder.volume.manager [None req-a06f275b-7a9b-49b4-bba7-de77e25c23d9 None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Nov 04 10:43:50 devstack cinder-volume[76171]: DEBUG cinder.volume.drivers.lvm [None req-a06f275b-7a9b-49b4-bba7-de77e25c23d9 None None] Updating volume stats {{(pid=76171) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Nov 04 10:43:50 devstack cinder-volume[76171]: DEBUG oslo_concurrency.processutils [None req-a06f275b-7a9b-49b4-bba7-de77e25c23d9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:43:50 devstack sudo[77007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 04 10:43:50 devstack sudo[77007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:43:51 devstack sudo[77007]: pam_unix(sudo:session): session closed for user root Nov 04 10:43:51 devstack cinder-volume[76171]: DEBUG oslo_concurrency.processutils [None req-a06f275b-7a9b-49b4-bba7-de77e25c23d9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.275s {{(pid=76171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:43:51 devstack cinder-volume[76171]: DEBUG oslo_concurrency.processutils [None req-a06f275b-7a9b-49b4-bba7-de77e25c23d9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:43:51 devstack sudo[77012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 04 10:43:51 devstack sudo[77012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:43:51 devstack sudo[77012]: pam_unix(sudo:session): session closed for user root Nov 04 10:43:51 devstack cinder-volume[76171]: DEBUG oslo_concurrency.processutils [None req-a06f275b-7a9b-49b4-bba7-de77e25c23d9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.253s {{(pid=76171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:43:51 devstack cinder-volume[76171]: DEBUG oslo_concurrency.processutils [None req-a06f275b-7a9b-49b4-bba7-de77e25c23d9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:43:51 devstack sudo[77015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 04 10:43:51 devstack sudo[77015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:43:51 devstack sudo[77015]: pam_unix(sudo:session): session closed for user root Nov 04 10:43:51 devstack cinder-volume[76171]: DEBUG oslo_concurrency.processutils [None req-a06f275b-7a9b-49b4-bba7-de77e25c23d9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.277s {{(pid=76171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:43:51 devstack cinder-volume[76171]: DEBUG oslo_concurrency.processutils [None req-a06f275b-7a9b-49b4-bba7-de77e25c23d9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:43:51 devstack sudo[77018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 04 10:43:51 devstack sudo[77018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:43:51 devstack sudo[77018]: pam_unix(sudo:session): session closed for user root Nov 04 10:43:51 devstack cinder-volume[76171]: DEBUG oslo_concurrency.processutils [None req-a06f275b-7a9b-49b4-bba7-de77e25c23d9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.283s {{(pid=76171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:43:51 devstack cinder-volume[76171]: INFO cinder.volume.manager [None req-a06f275b-7a9b-49b4-bba7-de77e25c23d9 None None] Driver post RPC initialization completed successfully. Nov 04 10:43:54 devstack cinder-volume[76036]: DEBUG dbcounter [-] [76036] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=76036) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 10:44:01 devstack cinder-volume[76171]: DEBUG dbcounter [-] [76171] Writing DB stats cinder:SELECT=11,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=76171) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 10:44:01 devstack cinder-volume[76171]: DEBUG dbcounter [-] [76171] Writing DB stats cinder:SELECT=3,cinder:UPDATE=1 {{(pid=76171) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 10:44:38 devstack cinder-volume[76171]: DEBUG oslo_service.periodic_task [None req-d105b172-7bd8-46a0-b313-ab5002eb2699 None None] Running periodic task VolumeManager._thread_info {{(pid=76171) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 04 10:44:38 devstack cinder-volume[76171]: DEBUG cinder.volume.manager [None req-d105b172-7bd8-46a0-b313-ab5002eb2699 None None] thread count: 6 {{(pid=76171) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 04 10:44:38 devstack cinder-volume[76171]: DEBUG cinder.volume.manager [None req-d105b172-7bd8-46a0-b313-ab5002eb2699 None None] thread info: [<_MainThread(MainThread, started 127008611262592)>, , , , , ] {{(pid=76171) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 04 10:45:38 devstack cinder-volume[76171]: DEBUG oslo_service.periodic_task [None req-d105b172-7bd8-46a0-b313-ab5002eb2699 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76171) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 04 10:45:38 devstack cinder-volume[76171]: DEBUG cinder.volume.drivers.lvm [None req-d105b172-7bd8-46a0-b313-ab5002eb2699 None None] Updating volume stats {{(pid=76171) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Nov 04 10:45:38 devstack cinder-volume[76171]: DEBUG oslo_concurrency.processutils [None req-d105b172-7bd8-46a0-b313-ab5002eb2699 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:45:38 devstack sudo[82140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 04 10:45:38 devstack sudo[82140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:45:39 devstack sudo[82140]: pam_unix(sudo:session): session closed for user root Nov 04 10:45:39 devstack cinder-volume[76171]: DEBUG oslo_concurrency.processutils [None req-d105b172-7bd8-46a0-b313-ab5002eb2699 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.269s {{(pid=76171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:45:39 devstack cinder-volume[76171]: DEBUG oslo_concurrency.processutils [None req-d105b172-7bd8-46a0-b313-ab5002eb2699 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:45:39 devstack sudo[82143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 04 10:45:39 devstack sudo[82143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:45:39 devstack sudo[82143]: pam_unix(sudo:session): session closed for user root Nov 04 10:45:39 devstack cinder-volume[76171]: DEBUG oslo_concurrency.processutils [None req-d105b172-7bd8-46a0-b313-ab5002eb2699 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.256s {{(pid=76171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:45:39 devstack cinder-volume[76171]: DEBUG oslo_concurrency.processutils [None req-d105b172-7bd8-46a0-b313-ab5002eb2699 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:45:39 devstack sudo[82146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 04 10:45:39 devstack sudo[82146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:45:39 devstack sudo[82146]: pam_unix(sudo:session): session closed for user root Nov 04 10:45:39 devstack cinder-volume[76171]: DEBUG oslo_concurrency.processutils [None req-d105b172-7bd8-46a0-b313-ab5002eb2699 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.291s {{(pid=76171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:45:39 devstack cinder-volume[76171]: DEBUG oslo_concurrency.processutils [None req-d105b172-7bd8-46a0-b313-ab5002eb2699 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:45:39 devstack sudo[82151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 04 10:45:39 devstack sudo[82151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:45:40 devstack sudo[82151]: pam_unix(sudo:session): session closed for user root Nov 04 10:45:40 devstack cinder-volume[76171]: DEBUG oslo_concurrency.processutils [None req-d105b172-7bd8-46a0-b313-ab5002eb2699 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.271s {{(pid=76171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:45:40 devstack cinder-volume[76171]: DEBUG cinder.manager [None req-d105b172-7bd8-46a0-b313-ab5002eb2699 None None] Notifying Schedulers of capabilities ... {{(pid=76171) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 10:45:40 devstack cinder-volume[76171]: DEBUG oslo_service.periodic_task [None req-d105b172-7bd8-46a0-b313-ab5002eb2699 None None] Running periodic task VolumeManager._thread_info {{(pid=76171) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 04 10:45:40 devstack cinder-volume[76171]: DEBUG cinder.volume.manager [None req-d105b172-7bd8-46a0-b313-ab5002eb2699 None None] thread count: 6 {{(pid=76171) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 04 10:45:40 devstack cinder-volume[76171]: DEBUG cinder.volume.manager [None req-d105b172-7bd8-46a0-b313-ab5002eb2699 None None] thread info: [<_MainThread(MainThread, started 127008611262592)>, , , , , ] {{(pid=76171) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 04 10:46:01 devstack cinder-volume[76171]: DEBUG dbcounter [-] [76171] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=76171) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 10:46:38 devstack cinder-volume[76171]: DEBUG oslo_service.periodic_task [None req-d105b172-7bd8-46a0-b313-ab5002eb2699 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76171) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 04 10:46:38 devstack cinder-volume[76171]: DEBUG cinder.volume.drivers.lvm [None req-d105b172-7bd8-46a0-b313-ab5002eb2699 None None] Updating volume stats {{(pid=76171) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Nov 04 10:46:38 devstack cinder-volume[76171]: DEBUG oslo_concurrency.processutils [None req-d105b172-7bd8-46a0-b313-ab5002eb2699 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:46:38 devstack sudo[84055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 04 10:46:38 devstack sudo[84055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:46:39 devstack sudo[84055]: pam_unix(sudo:session): session closed for user root Nov 04 10:46:39 devstack cinder-volume[76171]: DEBUG oslo_concurrency.processutils [None req-d105b172-7bd8-46a0-b313-ab5002eb2699 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.306s {{(pid=76171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:46:39 devstack cinder-volume[76171]: DEBUG oslo_concurrency.processutils [None req-d105b172-7bd8-46a0-b313-ab5002eb2699 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:46:39 devstack sudo[84074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 04 10:46:39 devstack sudo[84074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:46:39 devstack sudo[84074]: pam_unix(sudo:session): session closed for user root Nov 04 10:46:39 devstack cinder-volume[76171]: DEBUG oslo_concurrency.processutils [None req-d105b172-7bd8-46a0-b313-ab5002eb2699 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.269s {{(pid=76171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:46:39 devstack cinder-volume[76171]: DEBUG oslo_concurrency.processutils [None req-d105b172-7bd8-46a0-b313-ab5002eb2699 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:46:39 devstack sudo[84079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 04 10:46:39 devstack sudo[84079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:46:39 devstack sudo[84079]: pam_unix(sudo:session): session closed for user root Nov 04 10:46:39 devstack cinder-volume[76171]: DEBUG oslo_concurrency.processutils [None req-d105b172-7bd8-46a0-b313-ab5002eb2699 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.270s {{(pid=76171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:46:39 devstack cinder-volume[76171]: DEBUG oslo_concurrency.processutils [None req-d105b172-7bd8-46a0-b313-ab5002eb2699 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:46:39 devstack sudo[84082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 04 10:46:39 devstack sudo[84082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:46:40 devstack sudo[84082]: pam_unix(sudo:session): session closed for user root Nov 04 10:46:40 devstack cinder-volume[76171]: DEBUG oslo_concurrency.processutils [None req-d105b172-7bd8-46a0-b313-ab5002eb2699 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.270s {{(pid=76171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:46:40 devstack cinder-volume[76171]: DEBUG cinder.manager [None req-d105b172-7bd8-46a0-b313-ab5002eb2699 None None] Notifying Schedulers of capabilities ... {{(pid=76171) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 10:46:40 devstack cinder-volume[76171]: DEBUG oslo_service.periodic_task [None req-d105b172-7bd8-46a0-b313-ab5002eb2699 None None] Running periodic task VolumeManager._thread_info {{(pid=76171) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 04 10:46:40 devstack cinder-volume[76171]: DEBUG cinder.volume.manager [None req-d105b172-7bd8-46a0-b313-ab5002eb2699 None None] thread count: 6 {{(pid=76171) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 04 10:46:40 devstack cinder-volume[76171]: DEBUG cinder.volume.manager [None req-d105b172-7bd8-46a0-b313-ab5002eb2699 None None] thread info: [<_MainThread(MainThread, started 127008611262592)>, , , , , ] {{(pid=76171) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 04 10:47:38 devstack cinder-volume[76171]: DEBUG oslo_service.periodic_task [None req-d105b172-7bd8-46a0-b313-ab5002eb2699 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76171) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 04 10:47:38 devstack cinder-volume[76171]: DEBUG cinder.volume.drivers.lvm [None req-d105b172-7bd8-46a0-b313-ab5002eb2699 None None] Updating volume stats {{(pid=76171) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Nov 04 10:47:38 devstack cinder-volume[76171]: DEBUG oslo_concurrency.processutils [None req-d105b172-7bd8-46a0-b313-ab5002eb2699 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:47:38 devstack sudo[85427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 04 10:47:38 devstack sudo[85427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:47:39 devstack sudo[85427]: pam_unix(sudo:session): session closed for user root Nov 04 10:47:39 devstack cinder-volume[76171]: DEBUG oslo_concurrency.processutils [None req-d105b172-7bd8-46a0-b313-ab5002eb2699 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.280s {{(pid=76171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:47:39 devstack cinder-volume[76171]: DEBUG oslo_concurrency.processutils [None req-d105b172-7bd8-46a0-b313-ab5002eb2699 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:47:39 devstack sudo[85430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 04 10:47:39 devstack sudo[85430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:47:39 devstack sudo[85430]: pam_unix(sudo:session): session closed for user root Nov 04 10:47:39 devstack cinder-volume[76171]: DEBUG oslo_concurrency.processutils [None req-d105b172-7bd8-46a0-b313-ab5002eb2699 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.262s {{(pid=76171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:47:39 devstack cinder-volume[76171]: DEBUG oslo_concurrency.processutils [None req-d105b172-7bd8-46a0-b313-ab5002eb2699 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:47:39 devstack sudo[85436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 04 10:47:39 devstack sudo[85436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:47:39 devstack sudo[85436]: pam_unix(sudo:session): session closed for user root Nov 04 10:47:39 devstack cinder-volume[76171]: DEBUG oslo_concurrency.processutils [None req-d105b172-7bd8-46a0-b313-ab5002eb2699 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.294s {{(pid=76171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:47:39 devstack cinder-volume[76171]: DEBUG oslo_concurrency.processutils [None req-d105b172-7bd8-46a0-b313-ab5002eb2699 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:47:39 devstack sudo[85439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 04 10:47:39 devstack sudo[85439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:47:40 devstack sudo[85439]: pam_unix(sudo:session): session closed for user root Nov 04 10:47:40 devstack cinder-volume[76171]: DEBUG oslo_concurrency.processutils [None req-d105b172-7bd8-46a0-b313-ab5002eb2699 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.313s {{(pid=76171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:47:40 devstack cinder-volume[76171]: DEBUG cinder.manager [None req-d105b172-7bd8-46a0-b313-ab5002eb2699 None None] Notifying Schedulers of capabilities ... {{(pid=76171) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 10:47:40 devstack cinder-volume[76171]: DEBUG oslo_service.periodic_task [None req-d105b172-7bd8-46a0-b313-ab5002eb2699 None None] Running periodic task VolumeManager._thread_info {{(pid=76171) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 04 10:47:40 devstack cinder-volume[76171]: DEBUG cinder.volume.manager [None req-d105b172-7bd8-46a0-b313-ab5002eb2699 None None] thread count: 6 {{(pid=76171) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 04 10:47:40 devstack cinder-volume[76171]: DEBUG cinder.volume.manager [None req-d105b172-7bd8-46a0-b313-ab5002eb2699 None None] thread info: [<_MainThread(MainThread, started 127008611262592)>, , , , , ] {{(pid=76171) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 04 10:48:01 devstack cinder-volume[76171]: DEBUG dbcounter [-] [76171] Writing DB stats cinder:SELECT=1 {{(pid=76171) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 10:48:01 devstack cinder-volume[76171]: DEBUG dbcounter [-] [76171] Writing DB stats cinder:UPDATE=1 {{(pid=76171) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 10:48:16 devstack cinder-volume[76036]: INFO oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] Caught SIGTERM, stopping children Nov 04 10:48:16 devstack cinder-volume[76036]: DEBUG oslo_concurrency.lockutils [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] Acquiring lock "singleton_lock" {{(pid=76036) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Nov 04 10:48:16 devstack cinder-volume[76036]: DEBUG oslo_concurrency.lockutils [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] Acquired lock "singleton_lock" {{(pid=76036) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Nov 04 10:48:16 devstack cinder-volume[76036]: DEBUG oslo_concurrency.lockutils [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] Releasing lock "singleton_lock" {{(pid=76036) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Nov 04 10:48:16 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] Stop services. {{(pid=76036) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Nov 04 10:48:16 devstack cinder-volume[76036]: DEBUG oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] Killing children. {{(pid=76036) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Nov 04 10:48:16 devstack cinder-volume[76036]: INFO oslo_service.backend._eventlet.service [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] Waiting on 1 children to exit Nov 04 10:48:21 devstack cinder-volume[76171]: INFO oslo_service.backend._eventlet.service [-] Parent process has died unexpectedly, exiting Nov 04 10:48:22 devstack cinder-volume[86236]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Nov 04 10:48:22 devstack cinder-volume[86236]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Nov 04 10:48:22 devstack cinder-volume[86236]: we strongly recommend against using it for new projects. Nov 04 10:48:22 devstack cinder-volume[86236]: If you are already using Eventlet, we recommend migrating to a different Nov 04 10:48:22 devstack cinder-volume[86236]: framework. For more detail see Nov 04 10:48:22 devstack cinder-volume[86236]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Nov 04 10:48:22 devstack cinder-volume[86236]: import eventlet # noqa Nov 04 10:48:24 devstack cinder-volume[86236]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86236) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Nov 04 10:48:24 devstack cinder-volume[86236]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86236) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Nov 04 10:48:24 devstack cinder-volume[86236]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86236) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Nov 04 10:48:24 devstack cinder-volume[86236]: INFO dbcounter [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] Registered counter for database cinder Nov 04 10:48:25 devstack cinder-volume[86236]: DEBUG oslo_db.sqlalchemy.engines [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86236) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 04 10:48:25 devstack cinder-volume[86236]: DEBUG dbcounter [-] [86236] Writer thread running {{(pid=86236) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Nov 04 10:48:25 devstack cinder-volume[86236]: INFO cinder.rpc [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Nov 04 10:48:25 devstack cinder-volume[86236]: INFO cinder.rpc [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Nov 04 10:48:25 devstack cinder-volume[86236]: DEBUG oslo_db.sqlalchemy.engines [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86236) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 04 10:48:25 devstack cinder-volume[86236]: INFO cinder.volume.manager [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] Determined volume DB was empty at startup. Nov 04 10:48:25 devstack cinder-volume[86236]: DEBUG cinder.volume.manager [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86236) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Nov 04 10:48:25 devstack cinder-volume[86236]: INFO cinder.volume.manager [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] Service not found for updating active_backend_id, assuming default for driver init. Nov 04 10:48:25 devstack cinder-volume[86236]: WARNING stevedore.named [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 04 10:48:25 devstack cinder-volume[86236]: WARNING castellan.key_manager [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 04 10:48:25 devstack cinder-volume[86236]: WARNING cinder.keymgr.conf_key_mgr [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 04 10:48:25 devstack cinder-volume[86236]: INFO cinder.volume.manager [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] Image-volume cache disabled for host devstack@QuobyteHD. Nov 04 10:48:25 devstack cinder-volume[86236]: DEBUG oslo_db.sqlalchemy.engines [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86236) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 04 10:48:25 devstack cinder-volume[86236]: INFO oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] Starting 1 workers Nov 04 10:48:25 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] Started child 86461 {{(pid=86236) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Nov 04 10:48:25 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] Full set of CONF: {{(pid=86236) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Nov 04 10:48:25 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] ******************************************************************************** {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Nov 04 10:48:25 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] Configuration options gathered from: {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Nov 04 10:48:25 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Nov 04 10:48:25 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Nov 04 10:48:25 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] ================================================================================ {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Nov 04 10:48:25 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] allow_availability_zone_fallback = False {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:48:25 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] allow_compression_on_image_upload = False {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:48:25 devstack cinder-volume[86461]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Nov 04 10:48:25 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] allowed_direct_url_schemes = [] {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:48:25 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] api_rate_limit = True {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:48:25 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] auth_strategy = keystone {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:48:25 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] backend_availability_zone = None {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:48:25 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] backend_host = None {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:48:25 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] backend_name = None {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:48:25 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] backend_stats_polling_interval = 60 {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:48:25 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] backup_api_class = cinder.backup.api.API {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:48:25 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:48:25 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] backup_name_template = backup-%s {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:48:25 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] backup_use_same_host = False {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:48:25 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] backup_use_temp_snapshot = False {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:48:25 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] chap_password = **** {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:48:25 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] chap_username = {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:48:25 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:48:25 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] cinder_internal_tenant_project_id = f776413d743c4a4c88b8631e5cd324b8 {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:48:25 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] cinder_internal_tenant_user_id = 7dbf5add13f947c28a1b157ef53a4306 {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:48:25 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] cluster = None {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:48:25 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] compression_format = gzip {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:48:25 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] compute_api_class = cinder.compute.nova.API {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:48:25 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] config_dir = [] {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:48:25 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:48:25 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] config_source = [] {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:48:25 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:48:25 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] control_exchange = openstack {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:48:25 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] debug = True {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:48:25 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] default_availability_zone = None {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:48:25 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] default_group_type = None {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:48:25 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:48:25 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] default_volume_type = QuobyteHD {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:48:25 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] disk_geometry = None {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:48:25 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] driver_client_cert = None {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:48:25 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] driver_client_cert_key = None {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:48:25 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] driver_data_namespace = None {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:48:25 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] driver_ssl_cert_path = None {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:48:25 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] driver_ssl_cert_verify = False {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:48:25 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] driver_use_ssl = False {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:48:25 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] enable_new_services = True {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:48:25 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] enable_unsupported_driver = False {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:48:25 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] enabled_backends = ['QuobyteHD'] {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:48:25 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] enforce_multipath_for_image_xfer = False {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:48:25 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] filter_function = None {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:48:25 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] glance_api_insecure = False {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:48:25 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] glance_api_servers = ['http://192.168.122.89/image'] {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:48:25 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] glance_api_ssl_compression = False {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:48:25 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] glance_ca_certificates_file = None {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:48:25 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] glance_catalog_info = image:glance:publicURL {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:48:25 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] glance_certfile = None {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:48:25 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:48:25 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] glance_keyfile = None {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:48:25 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] glance_num_retries = 3 {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:48:25 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] glance_request_timeout = None {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:48:25 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] goodness_function = None {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:48:25 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] graceful_shutdown_timeout = 5 {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:48:25 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] group_api_class = cinder.group.api.API {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:48:25 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] host = devstack {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:48:25 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] image_compress_on_upload = True {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:48:25 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] image_conversion_address_space_limit = 1 {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:48:25 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] image_conversion_cpu_limit = 60 {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:48:25 devstack cinder-volume[76171]: DEBUG oslo_concurrency.lockutils [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] Acquiring lock "singleton_lock" {{(pid=76171) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Nov 04 10:48:25 devstack cinder-volume[76171]: DEBUG oslo_concurrency.lockutils [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] Acquired lock "singleton_lock" {{(pid=76171) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Nov 04 10:48:25 devstack cinder-volume[76171]: DEBUG oslo_concurrency.lockutils [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] Releasing lock "singleton_lock" {{(pid=76171) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Nov 04 10:48:25 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:48:25 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] image_conversion_disable = False {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:48:25 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] image_upload_use_cinder_backend = False {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:48:25 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] image_upload_use_internal_tenant = False {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:48:25 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] image_volume_cache_enabled = False {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:48:25 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] image_volume_cache_max_count = 0 {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:48:25 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] image_volume_cache_max_size_gb = 0 {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:48:25 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] init_host_max_objects_retrieval = 0 {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:48:25 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] instance_format = [instance: %(uuid)s] {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:48:25 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:48:25 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] iscsi_target_flags = {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:48:25 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] iscsi_write_cache = on {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:48:25 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] iser_helper = tgtadm {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:48:25 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] iser_ip_address = 192.168.122.89 {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:48:25 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] iser_port = 3260 {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:48:25 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:48:25 devstack cinder-volume[86461]: INFO cinder.volume.manager [None req-b009728e-94a5-46b0-8bf5-8cd0afc1c51f None None] Starting volume driver QuobyteDriver (1.2.1) Nov 04 10:48:25 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] log_color = False {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:48:25 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] log_config_append = None {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:48:25 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:48:25 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] log_dir = None {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:48:25 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] log_file = None {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:48:25 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] log_options = True {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:48:25 devstack cinder-volume[86461]: DEBUG cinder.volume.drivers.remotefs [None req-b009728e-94a5-46b0-8bf5-8cd0afc1c51f None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=86461) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Nov 04 10:48:25 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] log_rotate_interval = 1 {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:48:25 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] log_rotate_interval_type = days {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:48:25 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] log_rotation_type = none {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:48:25 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:48:25 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:48:25 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:48:25 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:48:25 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:48:25 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] max_age = 0 {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:48:25 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] max_logfile_count = 30 {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:48:25 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] max_logfile_size_mb = 200 {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:48:25 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] max_over_subscription_ratio = 20.0 {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:48:25 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] message_reap_interval = 86400 {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:48:25 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] message_ttl = 2592000 {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:48:25 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] migration_create_volume_timeout_secs = 300 {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:48:25 devstack cinder-volume[76171]: WARNING amqp [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] Received method (60, 30) during closing channel 1. This method will be ignored Nov 04 10:48:25 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] monkey_patch = False {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:48:25 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] monkey_patch_modules = [] {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:48:25 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] my_ip = 192.168.122.89 {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:48:25 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] no_snapshot_gb_quota = False {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:48:25 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] num_iser_scan_tries = 3 {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:48:25 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] num_shell_tries = 3 {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:48:25 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] num_volume_device_scan_tries = 3 {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:48:25 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] nvmeof_conn_info_version = 1 {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:48:25 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] nvmet_ns_id = 10 {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:48:25 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] nvmet_port_id = 1 {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:48:25 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] osapi_max_limit = 1000 {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:48:25 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] osapi_volume_ext_list = [] {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:48:25 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:48:25 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] osapi_volume_listen = 0.0.0.0 {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:48:25 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] osapi_volume_listen_port = 8776 {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:48:25 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] osapi_volume_use_ssl = False {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:48:25 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] osapi_volume_workers = None {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:48:25 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] per_volume_size_limit = -1 {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:48:25 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] periodic_fuzzy_delay = 60 {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:48:25 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] periodic_interval = 60 {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:48:25 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] project_id_regex = [0-9a-f\-]+ {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:48:25 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] public_endpoint = None {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:48:25 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] publish_errors = False {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:48:25 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] quota_backup_gigabytes = 1000 {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:48:25 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] quota_backups = 10 {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:48:25 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:48:25 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] quota_gigabytes = 1000 {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:48:25 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] quota_groups = 10 {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:48:25 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] quota_snapshots = 10 {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:48:25 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] quota_volumes = 10 {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:48:25 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] rate_limit_burst = 0 {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:48:25 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] rate_limit_except_level = CRITICAL {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:48:25 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] rate_limit_interval = 0 {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:48:25 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] reinit_driver_count = 3 {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:48:25 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] replication_device = **** {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:48:25 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] report_discard_supported = False {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:48:25 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] report_interval = 120 {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:48:25 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] reservation_clean_interval = 86400 {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:48:25 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] reservation_expire = 86400 {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:48:25 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] reserved_image_namespaces = [] {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:48:25 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] reserved_percentage = 0 {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:48:25 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:48:25 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:48:25 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] rpc_response_timeout = 120 {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:48:25 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] run_external_periodic_tasks = True {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:48:25 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:48:25 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] scst_target_driver = iscsi {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:48:25 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] scst_target_iqn_name = None {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:48:25 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] service_down_time = 720 {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:48:25 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] shell_completion = None {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:48:25 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] snapshot_name_template = snapshot-%s {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:48:25 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] split_loggers = False {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:48:25 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] state_path = /opt/stack/data/cinder {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:48:25 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] storage_availability_zone = nova {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:48:25 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] storage_protocol = iSCSI {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:48:25 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] syslog_log_facility = LOG_USER {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:48:25 devstack cinder-volume[76171]: WARNING amqp [None req-7b2d4911-e67e-4a29-a037-70973350ed6b None None] Received method (60, 30) during closing channel 1. This method will be ignored Nov 04 10:48:25 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] target_helper = lioadm {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:48:25 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] target_ip_address = 192.168.122.89 {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:48:25 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] target_port = 3260 {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:48:25 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:48:25 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] target_protocol = iscsi {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:48:25 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] target_secondary_ip_addresses = [] {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:48:25 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] trace_flags = None {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:48:25 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] transfer_api_class = cinder.transfer.api.API {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:48:25 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] transport_url = **** {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:48:25 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] until_refresh = 0 {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:48:25 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] use_chap_auth = False {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:48:25 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] use_default_quota_class = True {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:48:25 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] use_journal = False {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:48:25 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] use_json = False {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:48:25 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] use_multipath_for_image_xfer = False {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:48:25 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] use_stderr = False {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:48:25 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] use_syslog = False {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:48:25 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] verify_glance_signatures = enabled {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:48:25 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:48:25 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] volume_api_class = cinder.volume.api.API {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:48:25 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] volume_backend_name = None {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:48:25 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] volume_clear = zero {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:48:25 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] volume_clear_ionice = None {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:48:25 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] volume_clear_size = 0 {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:48:25 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:48:25 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] volume_copy_bps_limit = 0 {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:48:25 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] volume_dd_blocksize = 1M {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:48:25 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:48:25 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] volume_name_template = volume-%s {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:48:25 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] volume_service_inithost_offload = False {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:48:25 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] volume_usage_audit_period = month {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:48:25 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:48:25 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] zoning_mode = None {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:48:25 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] oslo_concurrency.disable_process_locking = False {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:25 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:25 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:25 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:25 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:25 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:25 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:25 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:25 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:25 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:25 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] keystone_authtoken.auth_section = None {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:25 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] keystone_authtoken.auth_type = password {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:25 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] keystone_authtoken.auth_version = None {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:25 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] keystone_authtoken.cache = None {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:25 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:25 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] keystone_authtoken.certfile = None {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:25 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] keystone_authtoken.delay_auth_decision = False {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:25 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:25 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] keystone_authtoken.http_connect_timeout = None {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:25 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:25 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] keystone_authtoken.include_service_catalog = True {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:25 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] keystone_authtoken.insecure = False {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:25 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] keystone_authtoken.interface = public {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:25 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] keystone_authtoken.keyfile = None {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:25 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] keystone_authtoken.memcache_password = **** {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:25 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:25 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:25 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:25 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:25 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:25 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:25 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:25 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:25 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:25 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:25 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:25 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:25 devstack cinder-volume[86461]: DEBUG cinder.volume.drivers.quobyte [None req-b009728e-94a5-46b0-8bf5-8cd0afc1c51f None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=86461) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}} Nov 04 10:48:25 devstack cinder-volume[86461]: WARNING cinder.volume.drivers.quobyte [None req-b009728e-94a5-46b0-8bf5-8cd0afc1c51f None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Nov 04 10:48:25 devstack cinder-volume[86461]: WARNING cinder.volume.drivers.quobyte [None req-b009728e-94a5-46b0-8bf5-8cd0afc1c51f None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Nov 04 10:48:25 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:25 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:25 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] keystone_authtoken.memcache_username = None {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:25 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:25 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] keystone_authtoken.region_name = None {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:25 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:25 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] keystone_authtoken.service_token_roles_required = True {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:25 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] keystone_authtoken.service_type = None {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:25 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] keystone_authtoken.token_cache_time = 300 {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:25 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.89/identity {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:25 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] cache.backend = dogpile.cache.null {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:25 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] cache.backend_argument = **** {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:25 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] cache.backend_expiration_time = None {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:25 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] cache.config_prefix = cache.oslo {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:25 devstack cinder-volume[86461]: DEBUG oslo_concurrency.processutils [None req-b009728e-94a5-46b0-8bf5-8cd0afc1c51f None None] Running cmd (subprocess): mount.quobyte {{(pid=86461) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:48:25 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] cache.debug_cache_backend = False {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:25 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] cache.enable_retry_client = False {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:25 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] cache.enable_socket_keepalive = False {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:25 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] cache.enabled = False {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:25 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] cache.expiration_time = 600 {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:25 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:25 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] cache.hashclient_retry_attempts = 2 {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:25 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:25 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] cache.memcache_dead_retry = 300 {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:25 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:25 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:25 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] cache.memcache_pool_maxsize = 10 {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:25 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:26 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] cache.memcache_sasl_enabled = False {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:26 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:26 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] cache.password = **** {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:26 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] cache.proxies = [] {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:26 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] cache.redis_db = 0 {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:26 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] cache.redis_sentinel_service_name = mymaster {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:26 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:26 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] cache.redis_server = localhost:6379 {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:26 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] cache.retry_attempts = 2 {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:26 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] cache.retry_delay = 0.0 {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:26 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] cache.socket_keepalive_count = 1 {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:26 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] cache.socket_keepalive_idle = 1 {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:26 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] cache.socket_keepalive_interval = 1 {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:26 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] cache.socket_timeout = 1.0 {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:26 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] cache.tls_allowed_ciphers = None {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:26 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] cache.tls_cafile = None {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:26 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] cache.tls_certfile = None {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:26 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] cache.tls_enabled = False {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:26 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] cache.tls_keyfile = None {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:26 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] cache.username = None {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:26 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] coordination.backend_url = **** {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:26 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] database.asyncio_connection = **** {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:26 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] database.asyncio_slave_connection = **** {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:26 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] database.backend = sqlalchemy {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:26 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] database.connection = **** {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:26 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] database.connection_debug = 0 {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:26 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] database.connection_parameters = {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:26 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] database.connection_recycle_time = 3600 {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:26 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] database.connection_trace = False {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:26 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] database.db_inc_retry_interval = True {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:26 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] database.db_max_retries = 20 {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:26 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] database.db_max_retry_interval = 10 {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:26 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] database.db_retry_interval = 1 {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:26 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] database.max_overflow = 50 {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:26 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] database.max_pool_size = 5 {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:26 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] database.max_retries = 10 {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:26 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:26 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] database.mysql_wsrep_sync_wait = None {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:26 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] database.pool_timeout = None {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:26 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] database.retry_interval = 10 {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:26 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] database.slave_connection = **** {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:26 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] database.sqlite_synchronous = True {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:26 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] database.synchronous_reader = True {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:26 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] database.use_db_reconnect = False {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:26 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:26 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:26 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:26 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:26 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:26 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] oslo_messaging_tracing.insecure = False {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:26 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:26 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:26 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:26 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:26 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] profiler.connection_string = messaging:// {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:26 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] profiler.enabled = False {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:26 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] profiler.es_doc_type = notification {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:26 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] profiler.es_scroll_size = 10000 {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:26 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] profiler.es_scroll_time = 2m {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:26 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] profiler.filter_error_trace = False {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:26 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] profiler.hmac_keys = **** {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:26 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] profiler.sentinel_service_name = mymaster {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:26 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] profiler.socket_timeout = 0.1 {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:26 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] profiler.trace_requests = False {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:26 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] profiler.trace_sqlalchemy = False {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:26 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] profiler_jaeger.process_tags = {} {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:26 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] profiler_jaeger.service_name_prefix = None {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:26 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] profiler_otlp.service_name_prefix = None {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:26 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] oslo_policy.enforce_new_defaults = True {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:26 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] oslo_policy.policy_default_rule = default {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:26 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:26 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] oslo_policy.policy_file = policy.yaml {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:26 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:26 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:26 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:26 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:26 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:26 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] oslo_policy.remote_timeout = 60.0 {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:26 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:26 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] privsep_osbrick.group = None {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:26 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] privsep_osbrick.helper_command = None {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:26 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:26 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:26 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:26 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] privsep_osbrick.user = None {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:26 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:26 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] cinder_sys_admin.group = None {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:26 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] cinder_sys_admin.helper_command = None {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:26 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:26 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:26 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:26 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] cinder_sys_admin.user = None {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:26 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] service_user.auth_section = None {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:26 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] service_user.auth_type = password {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:26 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] service_user.cafile = None {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:26 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] service_user.certfile = None {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:26 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] service_user.collect_timing = False {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:26 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] service_user.insecure = False {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:26 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] service_user.keyfile = None {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:26 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] service_user.send_service_user_token = True {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:26 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] service_user.split_loggers = False {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:26 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] service_user.timeout = None {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:26 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] service_user.tls_ciphers = None {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:26 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] service_user.tls_min_version = None {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:26 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] glance.auth_section = None {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:26 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] glance.auth_type = password {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:26 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:26 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] glance.certfile = None {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:26 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] glance.collect_timing = False {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:26 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] glance.insecure = False {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:26 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] glance.keyfile = None {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:26 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] glance.region_name = None {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:26 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] glance.split_loggers = False {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:26 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] glance.timeout = None {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:26 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] glance.tls_ciphers = None {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:26 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] glance.tls_min_version = None {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:26 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] backend_defaults.backend_availability_zone = None {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:26 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:26 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:26 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] backend_defaults.chap_password = **** {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:26 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] backend_defaults.chap_username = {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:26 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:26 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] backend_defaults.disk_geometry = None {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:26 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] backend_defaults.driver_client_cert = None {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:26 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] backend_defaults.driver_client_cert_key = None {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:26 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] backend_defaults.driver_data_namespace = None {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:26 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:26 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:26 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] backend_defaults.driver_use_ssl = False {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:26 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] backend_defaults.enable_unsupported_driver = False {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:26 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:26 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] backend_defaults.extra_capabilities = {} {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:26 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] backend_defaults.filter_function = None {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:26 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] backend_defaults.goodness_function = None {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:26 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:26 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:26 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:26 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:26 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:26 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] backend_defaults.iscsi_target_flags = {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:26 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] backend_defaults.iscsi_write_cache = on {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:26 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] backend_defaults.iser_helper = tgtadm {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:26 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] backend_defaults.iser_ip_address = 192.168.122.89 {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:26 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] backend_defaults.iser_port = 3260 {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:26 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:26 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:26 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] backend_defaults.nas_host = {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:26 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] backend_defaults.nas_login = admin {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:26 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] backend_defaults.nas_mount_options = None {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:26 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] backend_defaults.nas_password = **** {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:26 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] backend_defaults.nas_private_key = {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:26 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:26 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:26 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] backend_defaults.nas_share_path = {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:26 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] backend_defaults.nas_ssh_port = 22 {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:26 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:26 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:26 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] backend_defaults.num_shell_tries = 3 {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:26 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:26 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:26 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:26 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] backend_defaults.nvmet_port_id = 1 {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:26 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] backend_defaults.quobyte_client_cfg = None {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:26 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:26 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:26 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:26 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:26 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:26 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] backend_defaults.quobyte_volume_url = None {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:26 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] backend_defaults.replication_device = **** {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:26 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] backend_defaults.report_discard_supported = False {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:26 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] backend_defaults.reserved_percentage = 0 {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:26 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] backend_defaults.scst_target_driver = iscsi {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:26 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] backend_defaults.scst_target_iqn_name = None {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:26 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] backend_defaults.storage_protocol = iSCSI {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:26 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:26 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] backend_defaults.target_helper = tgtadm {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:26 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] backend_defaults.target_ip_address = 192.168.122.89 {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:26 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] backend_defaults.target_port = 3260 {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:26 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:26 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] backend_defaults.target_protocol = iscsi {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:26 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:26 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] backend_defaults.trace_flags = None {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:26 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] backend_defaults.unique_fqdn_network = True {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:26 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] backend_defaults.use_chap_auth = False {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:26 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:26 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] backend_defaults.volume_backend_name = None {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:26 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] backend_defaults.volume_clear = zero {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:26 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] backend_defaults.volume_clear_ionice = None {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:26 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] backend_defaults.volume_clear_size = 0 {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:26 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:26 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:26 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:26 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:26 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:26 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] oslo_reports.file_event_handler = None {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:26 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:26 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] oslo_reports.log_dir = None {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:26 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] QuobyteHD.backend_availability_zone = None {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:26 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] QuobyteHD.backend_host = None {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:26 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:26 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:26 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] QuobyteHD.chap_password = **** {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:26 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] QuobyteHD.chap_username = None {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:26 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] QuobyteHD.chiscsi_conf = None {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:26 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] QuobyteHD.disk_geometry = None {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:26 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] QuobyteHD.driver_client_cert = None {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:26 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] QuobyteHD.driver_client_cert_key = None {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:26 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] QuobyteHD.driver_data_namespace = None {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:26 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:26 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:26 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] QuobyteHD.driver_use_ssl = None {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:26 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] QuobyteHD.enable_unsupported_driver = None {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:26 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:26 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] QuobyteHD.extra_capabilities = None {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:26 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] QuobyteHD.filter_function = None {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:26 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] QuobyteHD.goodness_function = None {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:26 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:26 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:26 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:26 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:26 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:26 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] QuobyteHD.iscsi_target_flags = None {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:26 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] QuobyteHD.iscsi_write_cache = None {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:26 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] QuobyteHD.iser_helper = None {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:26 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] QuobyteHD.iser_ip_address = None {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:26 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] QuobyteHD.iser_port = None {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:26 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] QuobyteHD.iser_target_prefix = None {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:26 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:26 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] QuobyteHD.nas_host = None {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:26 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] QuobyteHD.nas_login = None {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:26 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] QuobyteHD.nas_mount_options = None {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:26 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] QuobyteHD.nas_password = **** {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:26 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] QuobyteHD.nas_private_key = None {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:26 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:26 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:26 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] QuobyteHD.nas_share_path = None {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:26 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] QuobyteHD.nas_ssh_port = None {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:26 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:26 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:26 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] QuobyteHD.num_shell_tries = None {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:26 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:26 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:26 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] QuobyteHD.nvmet_ns_id = None {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:26 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] QuobyteHD.nvmet_port_id = None {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:26 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:26 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:26 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:26 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:26 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:26 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:26 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898 {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:26 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] QuobyteHD.replication_device = **** {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:26 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] QuobyteHD.report_discard_supported = None {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:26 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] QuobyteHD.reserved_percentage = None {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:26 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] QuobyteHD.scst_target_driver = None {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:26 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:26 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] QuobyteHD.storage_protocol = None {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:26 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:26 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] QuobyteHD.target_helper = None {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:26 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] QuobyteHD.target_ip_address = None {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:26 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] QuobyteHD.target_port = None {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:26 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] QuobyteHD.target_prefix = None {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:26 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] QuobyteHD.target_protocol = None {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:26 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:26 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] QuobyteHD.trace_flags = None {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:26 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] QuobyteHD.unique_fqdn_network = None {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:26 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] QuobyteHD.use_chap_auth = None {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:26 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:26 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:26 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] QuobyteHD.volume_clear = None {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:26 devstack quobyte-client[86466]: Reading configuration file: /etc/quobyte/client.cfg Nov 04 10:48:26 devstack quobyte-client[86466]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Nov 04 10:48:26 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] QuobyteHD.volume_clear_ionice = None {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:26 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] QuobyteHD.volume_clear_size = None {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:26 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:26 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:26 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:26 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:26 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] QuobyteHD.volumes_dir = None {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:26 devstack cinder-volume[86461]: DEBUG oslo_concurrency.processutils [None req-b009728e-94a5-46b0-8bf5-8cd0afc1c51f None None] CMD "mount.quobyte" returned: 1 in 0.193s {{(pid=86461) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:48:26 devstack cinder-volume[86461]: DEBUG oslo_concurrency.lockutils [None req-b009728e-94a5-46b0-8bf5-8cd0afc1c51f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86461) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:48:26 devstack cinder-volume[86461]: DEBUG oslo_concurrency.lockutils [None req-b009728e-94a5-46b0-8bf5-8cd0afc1c51f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86461) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:48:26 devstack cinder-volume[86461]: DEBUG cinder.volume.drivers.quobyte [None req-b009728e-94a5-46b0-8bf5-8cd0afc1c51f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898': None} {{(pid=86461) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:48:26 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:26 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:26 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:26 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:26 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:26 devstack cinder-volume[86461]: INFO cinder.volume.drivers.quobyte [None req-b009728e-94a5-46b0-8bf5-8cd0afc1c51f None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898 ... Nov 04 10:48:26 devstack cinder-volume[86461]: DEBUG oslo_concurrency.processutils [None req-b009728e-94a5-46b0-8bf5-8cd0afc1c51f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1 -c /etc/quobyte/client-cinder.cfg {{(pid=86461) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:48:26 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:26 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:26 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:26 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:26 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:26 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:26 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:26 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:26 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:26 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:26 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:26 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:26 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:26 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:26 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:26 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:26 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:26 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:26 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:26 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:26 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:26 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:26 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:26 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:26 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] oslo_messaging_rabbit.ssl = False {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:26 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:26 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:26 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:26 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:26 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:26 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] oslo_messaging_rabbit.ssl_version = {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:26 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:26 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] oslo_messaging_notifications.driver = [] {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:26 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] oslo_messaging_notifications.retry = -1 {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:26 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:26 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] oslo_messaging_notifications.transport_url = **** {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:26 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:26 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] key_manager.fixed_key = **** {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:26 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:26 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] barbican.barbican_api_version = None {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:26 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] barbican.barbican_endpoint = None {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:26 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] barbican.barbican_endpoint_type = public {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:26 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] barbican.barbican_region_name = None {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:26 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] barbican.cafile = None {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:26 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] barbican.certfile = None {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:26 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] barbican.collect_timing = False {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:26 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] barbican.insecure = False {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:26 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] barbican.keyfile = None {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:26 devstack sudo[86471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1 -c /etc/quobyte/client-cinder.cfg Nov 04 10:48:26 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] barbican.number_of_retries = 60 {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:26 devstack sudo[86471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:48:26 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] barbican.retry_delay = 1 {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:26 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] barbican.send_service_user_token = False {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:26 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] barbican.split_loggers = False {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:26 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] barbican.timeout = None {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:26 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] barbican.tls_ciphers = None {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:26 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] barbican.tls_min_version = None {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:26 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] barbican.verify_ssl = True {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:26 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] barbican.verify_ssl_path = None {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:26 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] barbican_service_user.auth_section = None {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:26 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] barbican_service_user.auth_type = None {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:26 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] barbican_service_user.cafile = None {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:26 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] barbican_service_user.certfile = None {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:26 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] barbican_service_user.collect_timing = False {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:26 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] barbican_service_user.insecure = False {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:26 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] barbican_service_user.keyfile = None {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:26 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] barbican_service_user.split_loggers = False {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:26 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] barbican_service_user.timeout = None {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:26 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] barbican_service_user.tls_ciphers = None {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:26 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] barbican_service_user.tls_min_version = None {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:26 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] vault.approle_role_id = **** {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:26 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] vault.approle_secret_id = **** {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:26 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] vault.auth_method = approle {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:26 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] vault.auth_path = None {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:26 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] vault.kv_mountpoint = secret {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:26 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] vault.kv_path = None {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:26 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] vault.kv_version = 2 {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:26 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] vault.namespace = None {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:26 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] vault.root_token_id = **** {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:26 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] vault.ssl_ca_crt_file = None {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:26 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] vault.timeout = 60.0 {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:26 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] vault.token_file = None {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:26 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] vault.token_role = None {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:26 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] vault.use_ssl = False {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:26 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:26 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] ******************************************************************************** {{(pid=86236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Nov 04 10:48:26 devstack sudo[86471]: pam_unix(sudo:session): session closed for user root Nov 04 10:48:26 devstack cinder-volume[86461]: DEBUG oslo_concurrency.processutils [None req-b009728e-94a5-46b0-8bf5-8cd0afc1c51f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1 -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.428s {{(pid=86461) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:48:26 devstack cinder-volume[86461]: INFO cinder.volume.drivers.quobyte [None req-b009728e-94a5-46b0-8bf5-8cd0afc1c51f None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898 succeeded Nov 04 10:48:26 devstack cinder-volume[86461]: DEBUG cinder.volume.drivers.quobyte [None req-b009728e-94a5-46b0-8bf5-8cd0afc1c51f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'] {{(pid=86461) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:48:26 devstack cinder-volume[86461]: DEBUG oslo_concurrency.lockutils [None req-b009728e-94a5-46b0-8bf5-8cd0afc1c51f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.442s {{(pid=86461) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:48:26 devstack cinder-volume[86461]: DEBUG oslo_concurrency.processutils [None req-b009728e-94a5-46b0-8bf5-8cd0afc1c51f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1 {{(pid=86461) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:48:26 devstack sudo[86573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1 Nov 04 10:48:26 devstack sudo[86573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:48:26 devstack sudo[86573]: pam_unix(sudo:session): session closed for user root Nov 04 10:48:26 devstack cinder-volume[86461]: DEBUG oslo_concurrency.processutils [None req-b009728e-94a5-46b0-8bf5-8cd0afc1c51f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1" returned: 0 in 0.244s {{(pid=86461) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:48:26 devstack cinder-volume[86461]: INFO cinder.volume.driver [None req-b009728e-94a5-46b0-8bf5-8cd0afc1c51f None None] Driver hasn't implemented _init_vendor_properties() Nov 04 10:48:26 devstack cinder-volume[86461]: DEBUG cinder.volume.driver [None req-b009728e-94a5-46b0-8bf5-8cd0afc1c51f None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.6128959655762, 'free_capacity_gb': 1773.6128959655762, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86461) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Nov 04 10:48:26 devstack cinder-volume[86461]: DEBUG oslo_db.sqlalchemy.engines [None req-b009728e-94a5-46b0-8bf5-8cd0afc1c51f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86461) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 04 10:48:26 devstack cinder-volume[86461]: DEBUG dbcounter [-] [86461] Writer thread running {{(pid=86461) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Nov 04 10:48:26 devstack cinder-volume[86461]: DEBUG cinder.db.api [None req-b009728e-94a5-46b0-8bf5-8cd0afc1c51f None None] Building query based on filter {{(pid=86461) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Nov 04 10:48:26 devstack cinder-volume[86461]: DEBUG cinder.image.image_utils [None req-b009728e-94a5-46b0-8bf5-8cd0afc1c51f None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=86461) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Nov 04 10:48:26 devstack cinder-volume[86461]: INFO cinder.keymgr.migration [None req-de51d754-aa73-4f3f-ab2c-7d97970caeae None None] Not migrating encryption keys because the ConfKeyManager is still in use. Nov 04 10:48:26 devstack cinder-volume[86461]: DEBUG oslo_concurrency.lockutils [None req-b009728e-94a5-46b0-8bf5-8cd0afc1c51f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86461) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:48:26 devstack cinder-volume[86461]: DEBUG oslo_concurrency.lockutils [None req-b009728e-94a5-46b0-8bf5-8cd0afc1c51f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86461) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:48:26 devstack cinder-volume[86461]: DEBUG cinder.volume.drivers.quobyte [None req-b009728e-94a5-46b0-8bf5-8cd0afc1c51f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898': None} {{(pid=86461) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:48:26 devstack cinder-volume[86461]: DEBUG cinder.volume.drivers.quobyte [None req-b009728e-94a5-46b0-8bf5-8cd0afc1c51f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'] {{(pid=86461) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:48:26 devstack cinder-volume[86461]: DEBUG oslo_concurrency.lockutils [None req-b009728e-94a5-46b0-8bf5-8cd0afc1c51f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86461) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:48:26 devstack cinder-volume[86461]: DEBUG oslo_concurrency.processutils [None req-b009728e-94a5-46b0-8bf5-8cd0afc1c51f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1 {{(pid=86461) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:48:27 devstack sudo[86576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1 Nov 04 10:48:27 devstack sudo[86576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:48:27 devstack sudo[86576]: pam_unix(sudo:session): session closed for user root Nov 04 10:48:27 devstack cinder-volume[86461]: DEBUG oslo_concurrency.processutils [None req-b009728e-94a5-46b0-8bf5-8cd0afc1c51f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1" returned: 0 in 0.243s {{(pid=86461) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:48:27 devstack cinder-volume[86461]: DEBUG cinder.manager [None req-b009728e-94a5-46b0-8bf5-8cd0afc1c51f None None] Notifying Schedulers of capabilities ... {{(pid=86461) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 10:48:27 devstack cinder-volume[86461]: INFO cinder.volume.manager [None req-b009728e-94a5-46b0-8bf5-8cd0afc1c51f None None] Driver initialization completed successfully. Nov 04 10:48:27 devstack cinder-volume[86461]: INFO cinder.manager [None req-b009728e-94a5-46b0-8bf5-8cd0afc1c51f None None] Initiating service 3 cleanup Nov 04 10:48:27 devstack cinder-volume[86461]: INFO cinder.manager [None req-b009728e-94a5-46b0-8bf5-8cd0afc1c51f None None] Service 3 cleanup completed. Nov 04 10:48:27 devstack cinder-volume[86461]: DEBUG cinder.service [None req-b009728e-94a5-46b0-8bf5-8cd0afc1c51f None None] Creating RPC server for service cinder-volume {{(pid=86461) start /opt/stack/cinder/cinder/service.py:231}} Nov 04 10:48:27 devstack cinder-volume[86461]: DEBUG cinder.service [None req-b009728e-94a5-46b0-8bf5-8cd0afc1c51f None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=86461) start /opt/stack/cinder/cinder/service.py:237}} Nov 04 10:48:27 devstack cinder-volume[86461]: INFO cinder.volume.manager [None req-b009728e-94a5-46b0-8bf5-8cd0afc1c51f None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1) Nov 04 10:48:27 devstack cinder-volume[86461]: DEBUG oslo_concurrency.lockutils [None req-b009728e-94a5-46b0-8bf5-8cd0afc1c51f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86461) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:48:27 devstack cinder-volume[86461]: DEBUG oslo_concurrency.lockutils [None req-b009728e-94a5-46b0-8bf5-8cd0afc1c51f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86461) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:48:27 devstack cinder-volume[86461]: DEBUG cinder.volume.drivers.quobyte [None req-b009728e-94a5-46b0-8bf5-8cd0afc1c51f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898': None} {{(pid=86461) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:48:27 devstack cinder-volume[86461]: DEBUG cinder.volume.drivers.quobyte [None req-b009728e-94a5-46b0-8bf5-8cd0afc1c51f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'] {{(pid=86461) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:48:27 devstack cinder-volume[86461]: DEBUG oslo_concurrency.lockutils [None req-b009728e-94a5-46b0-8bf5-8cd0afc1c51f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86461) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:48:27 devstack cinder-volume[86461]: DEBUG oslo_concurrency.processutils [None req-b009728e-94a5-46b0-8bf5-8cd0afc1c51f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1 {{(pid=86461) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:48:27 devstack sudo[86580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1 Nov 04 10:48:27 devstack sudo[86580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:48:27 devstack sudo[86580]: pam_unix(sudo:session): session closed for user root Nov 04 10:48:27 devstack cinder-volume[86461]: DEBUG oslo_concurrency.processutils [None req-b009728e-94a5-46b0-8bf5-8cd0afc1c51f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1" returned: 0 in 0.259s {{(pid=86461) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:48:27 devstack cinder-volume[86461]: INFO cinder.volume.manager [None req-b009728e-94a5-46b0-8bf5-8cd0afc1c51f None None] Driver post RPC initialization completed successfully. Nov 04 10:48:32 devstack cinder-volume[86461]: DEBUG oslo_concurrency.lockutils [None req-edafa34f-b956-4ba2-8dc0-0ad4d1adae57 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86461) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:48:32 devstack cinder-volume[86461]: DEBUG oslo_concurrency.lockutils [None req-edafa34f-b956-4ba2-8dc0-0ad4d1adae57 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86461) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:48:32 devstack cinder-volume[86461]: DEBUG cinder.volume.drivers.quobyte [None req-edafa34f-b956-4ba2-8dc0-0ad4d1adae57 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898': None} {{(pid=86461) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:48:32 devstack cinder-volume[86461]: DEBUG cinder.volume.drivers.quobyte [None req-edafa34f-b956-4ba2-8dc0-0ad4d1adae57 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'] {{(pid=86461) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:48:32 devstack cinder-volume[86461]: DEBUG oslo_concurrency.lockutils [None req-edafa34f-b956-4ba2-8dc0-0ad4d1adae57 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86461) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:48:32 devstack cinder-volume[86461]: DEBUG oslo_concurrency.processutils [None req-edafa34f-b956-4ba2-8dc0-0ad4d1adae57 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1 {{(pid=86461) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:48:32 devstack sudo[86778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1 Nov 04 10:48:32 devstack sudo[86778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:48:32 devstack sudo[86778]: pam_unix(sudo:session): session closed for user root Nov 04 10:48:32 devstack cinder-volume[86461]: DEBUG oslo_concurrency.processutils [None req-edafa34f-b956-4ba2-8dc0-0ad4d1adae57 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1" returned: 0 in 0.245s {{(pid=86461) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:48:32 devstack cinder-volume[86461]: DEBUG cinder.manager [None req-edafa34f-b956-4ba2-8dc0-0ad4d1adae57 None None] Notifying Schedulers of capabilities ... {{(pid=86461) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 10:48:35 devstack cinder-volume[86236]: INFO oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] Caught SIGTERM, stopping children Nov 04 10:48:35 devstack cinder-volume[86236]: DEBUG oslo_concurrency.lockutils [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] Acquiring lock "singleton_lock" {{(pid=86236) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Nov 04 10:48:35 devstack cinder-volume[86236]: DEBUG oslo_concurrency.lockutils [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] Acquired lock "singleton_lock" {{(pid=86236) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Nov 04 10:48:35 devstack cinder-volume[86236]: DEBUG oslo_concurrency.lockutils [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] Releasing lock "singleton_lock" {{(pid=86236) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Nov 04 10:48:35 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] Stop services. {{(pid=86236) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Nov 04 10:48:35 devstack cinder-volume[86236]: DEBUG oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] Killing children. {{(pid=86236) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Nov 04 10:48:35 devstack cinder-volume[86236]: INFO oslo_service.backend._eventlet.service [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] Waiting on 1 children to exit Nov 04 10:48:37 devstack cinder-volume[86461]: DEBUG dbcounter [-] [86461] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=86461) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 10:48:37 devstack cinder-volume[86461]: DEBUG dbcounter [-] [86461] Writing DB stats cinder:SELECT=4,cinder:UPDATE=1 {{(pid=86461) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 10:48:37 devstack cinder-volume[86461]: DEBUG oslo_service.periodic_task [None req-7be94910-e397-4797-a6d2-456ac9cd67df None None] Running periodic task VolumeManager._thread_info {{(pid=86461) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 04 10:48:37 devstack cinder-volume[86461]: DEBUG cinder.volume.manager [None req-7be94910-e397-4797-a6d2-456ac9cd67df None None] thread count: 6 {{(pid=86461) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 04 10:48:37 devstack cinder-volume[86461]: DEBUG cinder.volume.manager [None req-7be94910-e397-4797-a6d2-456ac9cd67df None None] thread info: [<_MainThread(MainThread, started 138322407587968)>, , , , , ] {{(pid=86461) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 04 10:48:40 devstack cinder-volume[86461]: INFO oslo_service.backend._eventlet.service [-] Parent process has died unexpectedly, exiting Nov 04 10:48:40 devstack cinder-volume[86461]: DEBUG oslo_concurrency.lockutils [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] Acquiring lock "singleton_lock" {{(pid=86461) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Nov 04 10:48:40 devstack cinder-volume[86461]: DEBUG oslo_concurrency.lockutils [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] Acquired lock "singleton_lock" {{(pid=86461) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Nov 04 10:48:40 devstack cinder-volume[86461]: DEBUG oslo_concurrency.lockutils [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] Releasing lock "singleton_lock" {{(pid=86461) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Nov 04 10:48:40 devstack cinder-volume[86461]: WARNING amqp [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] Received method (60, 30) during closing channel 1. This method will be ignored Nov 04 10:48:40 devstack cinder-volume[86994]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Nov 04 10:48:40 devstack cinder-volume[86994]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Nov 04 10:48:40 devstack cinder-volume[86994]: we strongly recommend against using it for new projects. Nov 04 10:48:40 devstack cinder-volume[86994]: If you are already using Eventlet, we recommend migrating to a different Nov 04 10:48:40 devstack cinder-volume[86994]: framework. For more detail see Nov 04 10:48:40 devstack cinder-volume[86994]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Nov 04 10:48:40 devstack cinder-volume[86994]: import eventlet # noqa Nov 04 10:48:40 devstack cinder-volume[86461]: WARNING amqp [None req-7247ba1f-1458-4259-9fee-f3da67131637 None None] Received method (60, 30) during closing channel 1. This method will be ignored Nov 04 10:48:43 devstack cinder-volume[86994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86994) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Nov 04 10:48:43 devstack cinder-volume[86994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86994) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Nov 04 10:48:43 devstack cinder-volume[86994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86994) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Nov 04 10:48:44 devstack cinder-volume[86994]: INFO dbcounter [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] Registered counter for database cinder Nov 04 10:48:44 devstack cinder-volume[86994]: DEBUG oslo_db.sqlalchemy.engines [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86994) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 04 10:48:44 devstack cinder-volume[86994]: DEBUG dbcounter [-] [86994] Writer thread running {{(pid=86994) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Nov 04 10:48:44 devstack cinder-volume[86994]: INFO cinder.rpc [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Nov 04 10:48:44 devstack cinder-volume[86994]: INFO cinder.rpc [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Nov 04 10:48:44 devstack cinder-volume[86994]: DEBUG oslo_db.sqlalchemy.engines [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86994) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 04 10:48:44 devstack cinder-volume[86994]: INFO cinder.volume.manager [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] Determined volume DB was empty at startup. Nov 04 10:48:44 devstack cinder-volume[86994]: DEBUG cinder.volume.manager [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86994) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Nov 04 10:48:44 devstack cinder-volume[86994]: WARNING stevedore.named [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 04 10:48:44 devstack cinder-volume[86994]: WARNING castellan.key_manager [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 04 10:48:44 devstack cinder-volume[86994]: WARNING cinder.keymgr.conf_key_mgr [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 04 10:48:44 devstack cinder-volume[86994]: INFO cinder.volume.manager [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] Image-volume cache disabled for host devstack@QuobyteHD. Nov 04 10:48:44 devstack cinder-volume[86994]: DEBUG oslo_db.sqlalchemy.engines [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86994) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 04 10:48:44 devstack cinder-volume[86994]: INFO oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] Starting 1 workers Nov 04 10:48:44 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] Started child 87272 {{(pid=86994) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Nov 04 10:48:44 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] Full set of CONF: {{(pid=86994) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Nov 04 10:48:44 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] ******************************************************************************** {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Nov 04 10:48:44 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] Configuration options gathered from: {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Nov 04 10:48:44 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Nov 04 10:48:44 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Nov 04 10:48:44 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] ================================================================================ {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Nov 04 10:48:44 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] allow_availability_zone_fallback = False {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:48:44 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] allow_compression_on_image_upload = False {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:48:44 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] allowed_direct_url_schemes = [] {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:48:44 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] api_rate_limit = True {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:48:44 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] auth_strategy = keystone {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:48:44 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] backend_availability_zone = None {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:48:44 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] backend_host = None {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:48:44 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] backend_name = None {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:48:44 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] backend_stats_polling_interval = 60 {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:48:44 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] backup_api_class = cinder.backup.api.API {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:48:44 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:48:44 devstack cinder-volume[87272]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Nov 04 10:48:44 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] backup_name_template = backup-%s {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:48:44 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] backup_use_same_host = False {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:48:44 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] backup_use_temp_snapshot = False {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:48:44 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] chap_password = **** {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:48:44 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] chap_username = {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:48:44 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:48:44 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] cinder_internal_tenant_project_id = f776413d743c4a4c88b8631e5cd324b8 {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:48:44 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] cinder_internal_tenant_user_id = 7dbf5add13f947c28a1b157ef53a4306 {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:48:44 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] cluster = None {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:48:44 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] compression_format = gzip {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:48:44 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] compute_api_class = cinder.compute.nova.API {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:48:44 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] config_dir = [] {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:48:44 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:48:44 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] config_source = [] {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:48:44 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:48:44 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] control_exchange = openstack {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:48:44 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] debug = True {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:48:44 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] default_availability_zone = None {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:48:44 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] default_group_type = None {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:48:44 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:48:44 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] default_volume_type = QuobyteHD {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:48:44 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] disk_geometry = None {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:48:44 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] driver_client_cert = None {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:48:44 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] driver_client_cert_key = None {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:48:44 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] driver_data_namespace = None {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:48:44 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] driver_ssl_cert_path = None {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:48:44 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] driver_ssl_cert_verify = False {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:48:44 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] driver_use_ssl = False {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:48:44 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] enable_new_services = True {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:48:44 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] enable_unsupported_driver = False {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:48:44 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] enabled_backends = ['QuobyteHD'] {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:48:44 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] enforce_multipath_for_image_xfer = False {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:48:44 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] filter_function = None {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:48:44 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] glance_api_insecure = False {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:48:44 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] glance_api_servers = ['http://192.168.122.89/image'] {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:48:44 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] glance_api_ssl_compression = False {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:48:44 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] glance_ca_certificates_file = None {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:48:44 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] glance_catalog_info = image:glance:publicURL {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:48:44 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] glance_certfile = None {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:48:44 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:48:44 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] glance_keyfile = None {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:48:44 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] glance_num_retries = 3 {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:48:44 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] glance_request_timeout = None {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:48:44 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] goodness_function = None {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:48:44 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] graceful_shutdown_timeout = 5 {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:48:44 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] group_api_class = cinder.group.api.API {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:48:44 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] host = devstack {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:48:44 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] image_compress_on_upload = True {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:48:44 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] image_conversion_address_space_limit = 1 {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:48:44 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] image_conversion_cpu_limit = 60 {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:48:44 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:48:44 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] image_conversion_disable = False {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:48:44 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] image_upload_use_cinder_backend = False {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:48:44 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] image_upload_use_internal_tenant = False {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:48:44 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] image_volume_cache_enabled = False {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:48:44 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] image_volume_cache_max_count = 0 {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:48:44 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] image_volume_cache_max_size_gb = 0 {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:48:44 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] init_host_max_objects_retrieval = 0 {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:48:44 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] instance_format = [instance: %(uuid)s] {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:48:44 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:48:44 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] iscsi_target_flags = {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:48:44 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] iscsi_write_cache = on {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:48:44 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] iser_helper = tgtadm {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:48:44 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] iser_ip_address = 192.168.122.89 {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:48:44 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] iser_port = 3260 {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:48:44 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:48:44 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] log_color = False {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:48:44 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] log_config_append = None {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:48:44 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:48:44 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] log_dir = None {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:48:44 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] log_file = None {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:48:44 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] log_options = True {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:48:44 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] log_rotate_interval = 1 {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] log_rotate_interval_type = days {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] log_rotation_type = none {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] max_age = 0 {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] max_logfile_count = 30 {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] max_logfile_size_mb = 200 {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] max_over_subscription_ratio = 20.0 {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] message_reap_interval = 86400 {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] message_ttl = 2592000 {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] migration_create_volume_timeout_secs = 300 {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] monkey_patch = False {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] monkey_patch_modules = [] {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] my_ip = 192.168.122.89 {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] no_snapshot_gb_quota = False {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] num_iser_scan_tries = 3 {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] num_shell_tries = 3 {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] num_volume_device_scan_tries = 3 {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] nvmeof_conn_info_version = 1 {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] nvmet_ns_id = 10 {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] nvmet_port_id = 1 {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] osapi_max_limit = 1000 {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] osapi_volume_ext_list = [] {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] osapi_volume_listen = 0.0.0.0 {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] osapi_volume_listen_port = 8776 {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] osapi_volume_use_ssl = False {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] osapi_volume_workers = None {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] per_volume_size_limit = -1 {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] periodic_fuzzy_delay = 60 {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] periodic_interval = 60 {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] project_id_regex = [0-9a-f\-]+ {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] public_endpoint = None {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] publish_errors = False {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] quota_backup_gigabytes = 1000 {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] quota_backups = 10 {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:48:45 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-2b8efa46-8cba-40c2-a6df-21b2fd5e1556 None None] Starting volume driver QuobyteDriver (1.2.1) Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:48:45 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.remotefs [None req-2b8efa46-8cba-40c2-a6df-21b2fd5e1556 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=87272) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] quota_gigabytes = 1000 {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] quota_groups = 10 {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] quota_snapshots = 10 {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] quota_volumes = 10 {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] rate_limit_burst = 0 {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] rate_limit_except_level = CRITICAL {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] rate_limit_interval = 0 {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] reinit_driver_count = 3 {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] replication_device = **** {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] report_discard_supported = False {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] report_interval = 120 {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] reservation_clean_interval = 86400 {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] reservation_expire = 86400 {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] reserved_image_namespaces = [] {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] reserved_percentage = 0 {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] rpc_response_timeout = 120 {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] run_external_periodic_tasks = True {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] scst_target_driver = iscsi {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] scst_target_iqn_name = None {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] service_down_time = 720 {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] shell_completion = None {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] snapshot_name_template = snapshot-%s {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] split_loggers = False {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] state_path = /opt/stack/data/cinder {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] storage_availability_zone = nova {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] storage_protocol = iSCSI {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] syslog_log_facility = LOG_USER {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] target_helper = lioadm {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] target_ip_address = 192.168.122.89 {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] target_port = 3260 {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] target_protocol = iscsi {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] target_secondary_ip_addresses = [] {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] trace_flags = None {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] transfer_api_class = cinder.transfer.api.API {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] transport_url = **** {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] until_refresh = 0 {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] use_chap_auth = False {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] use_default_quota_class = True {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] use_journal = False {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] use_json = False {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] use_multipath_for_image_xfer = False {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] use_stderr = False {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] use_syslog = False {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] verify_glance_signatures = enabled {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] volume_api_class = cinder.volume.api.API {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] volume_backend_name = None {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] volume_clear = zero {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] volume_clear_ionice = None {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] volume_clear_size = 0 {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] volume_copy_bps_limit = 0 {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] volume_dd_blocksize = 1M {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] volume_name_template = volume-%s {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] volume_service_inithost_offload = False {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] volume_usage_audit_period = month {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] zoning_mode = None {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] oslo_concurrency.disable_process_locking = False {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] keystone_authtoken.auth_section = None {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] keystone_authtoken.auth_type = password {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] keystone_authtoken.auth_version = None {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] keystone_authtoken.cache = None {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] keystone_authtoken.certfile = None {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] keystone_authtoken.delay_auth_decision = False {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] keystone_authtoken.http_connect_timeout = None {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] keystone_authtoken.include_service_catalog = True {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] keystone_authtoken.insecure = False {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] keystone_authtoken.interface = public {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] keystone_authtoken.keyfile = None {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] keystone_authtoken.memcache_password = **** {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] keystone_authtoken.memcache_username = None {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] keystone_authtoken.region_name = None {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] keystone_authtoken.service_token_roles_required = True {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] keystone_authtoken.service_type = None {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] keystone_authtoken.token_cache_time = 300 {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.89/identity {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] cache.backend = dogpile.cache.null {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] cache.backend_argument = **** {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] cache.backend_expiration_time = None {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] cache.config_prefix = cache.oslo {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] cache.debug_cache_backend = False {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] cache.enable_retry_client = False {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] cache.enable_socket_keepalive = False {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] cache.enabled = False {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] cache.expiration_time = 600 {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] cache.hashclient_dead_timeout = 60.0 {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] cache.hashclient_retry_attempts = 2 {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] cache.memcache_dead_retry = 300 {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] cache.memcache_pool_maxsize = 10 {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:45 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-2b8efa46-8cba-40c2-a6df-21b2fd5e1556 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=87272) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] cache.memcache_sasl_enabled = False {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:45 devstack cinder-volume[87272]: WARNING cinder.volume.drivers.quobyte [None req-2b8efa46-8cba-40c2-a6df-21b2fd5e1556 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] cache.memcache_servers = ['localhost:11211'] {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:45 devstack cinder-volume[87272]: WARNING cinder.volume.drivers.quobyte [None req-2b8efa46-8cba-40c2-a6df-21b2fd5e1556 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] cache.password = **** {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] cache.proxies = [] {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] cache.redis_db = 0 {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] cache.redis_sentinel_service_name = mymaster {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:45 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-2b8efa46-8cba-40c2-a6df-21b2fd5e1556 None None] Running cmd (subprocess): mount.quobyte {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] cache.redis_server = localhost:6379 {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] cache.retry_attempts = 2 {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] cache.retry_delay = 0.0 {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] cache.socket_keepalive_count = 1 {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] cache.socket_keepalive_idle = 1 {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] cache.socket_keepalive_interval = 1 {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] cache.socket_timeout = 1.0 {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] cache.tls_allowed_ciphers = None {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] cache.tls_cafile = None {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] cache.tls_certfile = None {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] cache.tls_enabled = False {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] cache.tls_keyfile = None {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] cache.username = None {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] coordination.backend_url = **** {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] database.asyncio_connection = **** {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] database.asyncio_slave_connection = **** {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] database.backend = sqlalchemy {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] database.connection = **** {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] database.connection_debug = 0 {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] database.connection_parameters = {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] database.connection_recycle_time = 3600 {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] database.connection_trace = False {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] database.db_inc_retry_interval = True {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] database.db_max_retries = 20 {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] database.db_max_retry_interval = 10 {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] database.db_retry_interval = 1 {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] database.max_overflow = 50 {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] database.max_pool_size = 5 {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] database.max_retries = 10 {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] database.mysql_sql_mode = TRADITIONAL {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] database.mysql_wsrep_sync_wait = None {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] database.pool_timeout = None {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] database.retry_interval = 10 {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] database.slave_connection = **** {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] database.sqlite_synchronous = True {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] database.synchronous_reader = True {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] database.use_db_reconnect = False {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] oslo_messaging_metrics.metrics_process_name = {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] oslo_messaging_tracing.insecure = False {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] profiler.connection_string = messaging:// {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] profiler.enabled = False {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] profiler.es_doc_type = notification {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] profiler.es_scroll_size = 10000 {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] profiler.es_scroll_time = 2m {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] profiler.filter_error_trace = False {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] profiler.hmac_keys = **** {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] profiler.sentinel_service_name = mymaster {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] profiler.socket_timeout = 0.1 {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] profiler.trace_requests = False {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] profiler.trace_sqlalchemy = False {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] profiler_jaeger.process_tags = {} {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] profiler_jaeger.service_name_prefix = None {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] profiler_otlp.service_name_prefix = None {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] oslo_policy.enforce_new_defaults = True {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] oslo_policy.policy_default_rule = default {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] oslo_policy.policy_file = policy.yaml {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] oslo_policy.remote_timeout = 60.0 {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] privsep_osbrick.capabilities = [21, 2] {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] privsep_osbrick.group = None {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] privsep_osbrick.helper_command = None {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] privsep_osbrick.user = None {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] cinder_sys_admin.group = None {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] cinder_sys_admin.helper_command = None {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] cinder_sys_admin.user = None {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] service_user.auth_section = None {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] service_user.auth_type = password {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] service_user.cafile = None {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] service_user.certfile = None {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] service_user.collect_timing = False {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] service_user.insecure = False {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] service_user.keyfile = None {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] service_user.send_service_user_token = True {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] service_user.split_loggers = False {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] service_user.timeout = None {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] service_user.tls_ciphers = None {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] service_user.tls_min_version = None {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] glance.auth_section = None {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] glance.auth_type = password {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] glance.certfile = None {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] glance.collect_timing = False {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] glance.insecure = False {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] glance.keyfile = None {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] glance.region_name = None {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] glance.split_loggers = False {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] glance.timeout = None {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] glance.tls_ciphers = None {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] glance.tls_min_version = None {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] backend_defaults.backend_availability_zone = None {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] backend_defaults.chap_password = **** {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] backend_defaults.chap_username = {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] backend_defaults.disk_geometry = None {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] backend_defaults.driver_client_cert = None {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] backend_defaults.driver_client_cert_key = None {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] backend_defaults.driver_data_namespace = None {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] backend_defaults.driver_use_ssl = False {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] backend_defaults.enable_unsupported_driver = False {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] backend_defaults.extra_capabilities = {} {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] backend_defaults.filter_function = None {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] backend_defaults.goodness_function = None {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] backend_defaults.iscsi_target_flags = {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] backend_defaults.iscsi_write_cache = on {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] backend_defaults.iser_helper = tgtadm {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] backend_defaults.iser_ip_address = 192.168.122.89 {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] backend_defaults.iser_port = 3260 {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] backend_defaults.nas_host = {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] backend_defaults.nas_login = admin {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] backend_defaults.nas_mount_options = None {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] backend_defaults.nas_password = **** {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] backend_defaults.nas_private_key = {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] backend_defaults.nas_share_path = {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] backend_defaults.nas_ssh_port = 22 {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:45 devstack quobyte-client[87273]: Reading configuration file: /etc/quobyte/client.cfg Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] backend_defaults.num_shell_tries = 3 {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:45 devstack quobyte-client[87273]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] backend_defaults.nvmet_ns_id = 10 {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] backend_defaults.nvmet_port_id = 1 {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] backend_defaults.quobyte_client_cfg = None {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:45 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-2b8efa46-8cba-40c2-a6df-21b2fd5e1556 None None] CMD "mount.quobyte" returned: 1 in 0.056s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] backend_defaults.quobyte_volume_url = None {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:45 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-2b8efa46-8cba-40c2-a6df-21b2fd5e1556 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] backend_defaults.replication_device = **** {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:45 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-2b8efa46-8cba-40c2-a6df-21b2fd5e1556 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] backend_defaults.report_discard_supported = False {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] backend_defaults.reserved_percentage = 0 {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:45 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-2b8efa46-8cba-40c2-a6df-21b2fd5e1556 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898': None} {{(pid=87272) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] backend_defaults.scst_target_driver = iscsi {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] backend_defaults.scst_target_iqn_name = None {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] backend_defaults.storage_protocol = iSCSI {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] backend_defaults.target_helper = tgtadm {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] backend_defaults.target_ip_address = 192.168.122.89 {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] backend_defaults.target_port = 3260 {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] backend_defaults.target_protocol = iscsi {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] backend_defaults.trace_flags = None {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] backend_defaults.unique_fqdn_network = True {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] backend_defaults.use_chap_auth = False {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] backend_defaults.volume_backend_name = None {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] backend_defaults.volume_clear = zero {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] backend_defaults.volume_clear_ionice = None {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] backend_defaults.volume_clear_size = 0 {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] oslo_reports.file_event_handler = None {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:45 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-2b8efa46-8cba-40c2-a6df-21b2fd5e1556 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'] {{(pid=87272) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] oslo_reports.log_dir = None {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:45 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-2b8efa46-8cba-40c2-a6df-21b2fd5e1556 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] QuobyteHD.backend_availability_zone = None {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] QuobyteHD.backend_host = None {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:45 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-2b8efa46-8cba-40c2-a6df-21b2fd5e1556 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] QuobyteHD.chap_password = **** {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] QuobyteHD.chap_username = None {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] QuobyteHD.chiscsi_conf = None {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] QuobyteHD.disk_geometry = None {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] QuobyteHD.driver_client_cert = None {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] QuobyteHD.driver_client_cert_key = None {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] QuobyteHD.driver_data_namespace = None {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] QuobyteHD.driver_use_ssl = None {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] QuobyteHD.enable_unsupported_driver = None {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] QuobyteHD.extra_capabilities = None {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] QuobyteHD.filter_function = None {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] QuobyteHD.goodness_function = None {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] QuobyteHD.iscsi_target_flags = None {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] QuobyteHD.iscsi_write_cache = None {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] QuobyteHD.iser_helper = None {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] QuobyteHD.iser_ip_address = None {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] QuobyteHD.iser_port = None {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] QuobyteHD.iser_target_prefix = None {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] QuobyteHD.nas_host = None {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] QuobyteHD.nas_login = None {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] QuobyteHD.nas_mount_options = None {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] QuobyteHD.nas_password = **** {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] QuobyteHD.nas_private_key = None {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] QuobyteHD.nas_share_path = None {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] QuobyteHD.nas_ssh_port = None {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] QuobyteHD.num_iser_scan_tries = None {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] QuobyteHD.num_shell_tries = None {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] QuobyteHD.nvmet_ns_id = None {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] QuobyteHD.nvmet_port_id = None {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898 {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] QuobyteHD.replication_device = **** {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] QuobyteHD.report_discard_supported = None {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] QuobyteHD.reserved_percentage = None {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] QuobyteHD.scst_target_driver = None {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] QuobyteHD.storage_protocol = None {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] QuobyteHD.target_helper = None {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] QuobyteHD.target_ip_address = None {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] QuobyteHD.target_port = None {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] QuobyteHD.target_prefix = None {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] QuobyteHD.target_protocol = None {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] QuobyteHD.trace_flags = None {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] QuobyteHD.unique_fqdn_network = None {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] QuobyteHD.use_chap_auth = None {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] QuobyteHD.volume_clear = None {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] QuobyteHD.volume_clear_ionice = None {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] QuobyteHD.volume_clear_size = None {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:45 devstack sudo[87274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1 Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] QuobyteHD.volume_dd_blocksize = None {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] QuobyteHD.volumes_dir = None {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:45 devstack sudo[87274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] oslo_messaging_rabbit.ssl = False {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] oslo_messaging_rabbit.ssl_version = {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] oslo_messaging_notifications.driver = [] {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] oslo_messaging_notifications.retry = -1 {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] oslo_messaging_notifications.transport_url = **** {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] key_manager.fixed_key = **** {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] barbican.barbican_api_version = None {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] barbican.barbican_endpoint = None {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] barbican.barbican_endpoint_type = public {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] barbican.barbican_region_name = None {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] barbican.cafile = None {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] barbican.certfile = None {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] barbican.collect_timing = False {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] barbican.insecure = False {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] barbican.keyfile = None {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] barbican.number_of_retries = 60 {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] barbican.retry_delay = 1 {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] barbican.send_service_user_token = False {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] barbican.split_loggers = False {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] barbican.timeout = None {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] barbican.tls_ciphers = None {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] barbican.tls_min_version = None {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] barbican.verify_ssl = True {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] barbican.verify_ssl_path = None {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] barbican_service_user.auth_section = None {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] barbican_service_user.auth_type = None {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] barbican_service_user.cafile = None {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] barbican_service_user.certfile = None {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] barbican_service_user.collect_timing = False {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] barbican_service_user.insecure = False {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] barbican_service_user.keyfile = None {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] barbican_service_user.split_loggers = False {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] barbican_service_user.timeout = None {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] barbican_service_user.tls_ciphers = None {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] barbican_service_user.tls_min_version = None {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] vault.approle_role_id = **** {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] vault.approle_secret_id = **** {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] vault.auth_method = approle {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] vault.auth_path = None {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] vault.kv_mountpoint = secret {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] vault.kv_path = None {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] vault.kv_version = 2 {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] vault.namespace = None {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] vault.root_token_id = **** {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] vault.ssl_ca_crt_file = None {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] vault.timeout = 60.0 {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] vault.token_file = None {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] vault.token_role = None {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] vault.use_ssl = False {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 10:48:45 devstack cinder-volume[86994]: DEBUG oslo_service.backend._eventlet.service [None req-fae3bf4d-0b5d-4132-981d-05b7350c022c None None] ******************************************************************************** {{(pid=86994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Nov 04 10:48:45 devstack sudo[87274]: pam_unix(sudo:session): session closed for user root Nov 04 10:48:45 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-2b8efa46-8cba-40c2-a6df-21b2fd5e1556 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1" returned: 0 in 0.236s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:48:45 devstack cinder-volume[87272]: INFO cinder.volume.driver [None req-2b8efa46-8cba-40c2-a6df-21b2fd5e1556 None None] Driver hasn't implemented _init_vendor_properties() Nov 04 10:48:45 devstack cinder-volume[87272]: DEBUG cinder.volume.driver [None req-2b8efa46-8cba-40c2-a6df-21b2fd5e1556 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.6128959655762, 'free_capacity_gb': 1773.6128959655762, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87272) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Nov 04 10:48:45 devstack cinder-volume[87272]: DEBUG oslo_db.sqlalchemy.engines [None req-2b8efa46-8cba-40c2-a6df-21b2fd5e1556 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87272) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 04 10:48:45 devstack cinder-volume[87272]: DEBUG dbcounter [-] [87272] Writer thread running {{(pid=87272) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Nov 04 10:48:45 devstack cinder-volume[87272]: DEBUG cinder.db.api [None req-2b8efa46-8cba-40c2-a6df-21b2fd5e1556 None None] Building query based on filter {{(pid=87272) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Nov 04 10:48:45 devstack cinder-volume[87272]: DEBUG cinder.image.image_utils [None req-2b8efa46-8cba-40c2-a6df-21b2fd5e1556 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=87272) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Nov 04 10:48:45 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-2b8efa46-8cba-40c2-a6df-21b2fd5e1556 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:48:45 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-2b8efa46-8cba-40c2-a6df-21b2fd5e1556 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:48:45 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-2b8efa46-8cba-40c2-a6df-21b2fd5e1556 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898': None} {{(pid=87272) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:48:45 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-2b8efa46-8cba-40c2-a6df-21b2fd5e1556 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'] {{(pid=87272) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:48:45 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-2b8efa46-8cba-40c2-a6df-21b2fd5e1556 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:48:45 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-2b8efa46-8cba-40c2-a6df-21b2fd5e1556 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:48:45 devstack cinder-volume[87272]: INFO cinder.keymgr.migration [None req-e611141c-669d-45cf-9ad7-ab99aa4dae1c None None] Not migrating encryption keys because the ConfKeyManager is still in use. Nov 04 10:48:45 devstack sudo[87278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1 Nov 04 10:48:45 devstack sudo[87278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:48:45 devstack sudo[87278]: pam_unix(sudo:session): session closed for user root Nov 04 10:48:45 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-2b8efa46-8cba-40c2-a6df-21b2fd5e1556 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1" returned: 0 in 0.228s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:48:45 devstack cinder-volume[87272]: DEBUG cinder.manager [None req-2b8efa46-8cba-40c2-a6df-21b2fd5e1556 None None] Notifying Schedulers of capabilities ... {{(pid=87272) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 10:48:45 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-2b8efa46-8cba-40c2-a6df-21b2fd5e1556 None None] Driver initialization completed successfully. Nov 04 10:48:45 devstack cinder-volume[87272]: INFO cinder.manager [None req-2b8efa46-8cba-40c2-a6df-21b2fd5e1556 None None] Initiating service 3 cleanup Nov 04 10:48:45 devstack cinder-volume[87272]: INFO cinder.manager [None req-2b8efa46-8cba-40c2-a6df-21b2fd5e1556 None None] Service 3 cleanup completed. Nov 04 10:48:45 devstack cinder-volume[87272]: DEBUG cinder.service [None req-2b8efa46-8cba-40c2-a6df-21b2fd5e1556 None None] Creating RPC server for service cinder-volume {{(pid=87272) start /opt/stack/cinder/cinder/service.py:231}} Nov 04 10:48:45 devstack cinder-volume[87272]: DEBUG cinder.service [None req-2b8efa46-8cba-40c2-a6df-21b2fd5e1556 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=87272) start /opt/stack/cinder/cinder/service.py:237}} Nov 04 10:48:45 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-2b8efa46-8cba-40c2-a6df-21b2fd5e1556 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1) Nov 04 10:48:45 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-2b8efa46-8cba-40c2-a6df-21b2fd5e1556 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:48:45 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-2b8efa46-8cba-40c2-a6df-21b2fd5e1556 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:48:45 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-2b8efa46-8cba-40c2-a6df-21b2fd5e1556 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898': None} {{(pid=87272) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:48:45 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-2b8efa46-8cba-40c2-a6df-21b2fd5e1556 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'] {{(pid=87272) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:48:45 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-2b8efa46-8cba-40c2-a6df-21b2fd5e1556 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:48:45 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-2b8efa46-8cba-40c2-a6df-21b2fd5e1556 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:48:45 devstack sudo[87283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1 Nov 04 10:48:45 devstack sudo[87283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:48:46 devstack sudo[87283]: pam_unix(sudo:session): session closed for user root Nov 04 10:48:46 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-2b8efa46-8cba-40c2-a6df-21b2fd5e1556 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1" returned: 0 in 0.234s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:48:46 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-2b8efa46-8cba-40c2-a6df-21b2fd5e1556 None None] Driver post RPC initialization completed successfully. Nov 04 10:48:54 devstack cinder-volume[86994]: DEBUG dbcounter [-] [86994] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=86994) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 10:48:55 devstack cinder-volume[87272]: DEBUG dbcounter [-] [87272] Writing DB stats cinder:SELECT=7,cinder:UPDATE=1 {{(pid=87272) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 10:48:56 devstack cinder-volume[87272]: DEBUG dbcounter [-] [87272] Writing DB stats cinder:SELECT=3 {{(pid=87272) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 10:49:14 devstack cinder-volume[87272]: DEBUG oslo_service.periodic_task [None req-236af0be-7f9d-4c80-b3d7-d645a9cd0dd1 None None] Running periodic task VolumeManager._thread_info {{(pid=87272) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 04 10:49:14 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-236af0be-7f9d-4c80-b3d7-d645a9cd0dd1 None None] thread count: 6 {{(pid=87272) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 04 10:49:14 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-236af0be-7f9d-4c80-b3d7-d645a9cd0dd1 None None] thread info: [<_MainThread(MainThread, started 127085713244288)>, , , , , ] {{(pid=87272) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 04 10:49:44 devstack cinder-volume[87272]: DEBUG cinder.volume.flows.manager.create_volume [None req-eaad24de-851f-4152-aae5-93312616d6b0 tempest-TaggedAttachmentsTest-911145822 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87272) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 10:49:44 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-eaad24de-851f-4152-aae5-93312616d6b0 tempest-TaggedAttachmentsTest-911145822 None] Flow 'volume_create_manager' (194d90e0-0005-4ec7-a9d5-264362cea76d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:49:44 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-eaad24de-851f-4152-aae5-93312616d6b0 tempest-TaggedAttachmentsTest-911145822 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0fa5ba15-b5cd-4083-93b0-43b2e81d2596) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:49:45 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-eaad24de-851f-4152-aae5-93312616d6b0 tempest-TaggedAttachmentsTest-911145822 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0fa5ba15-b5cd-4083-93b0-43b2e81d2596) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T09:49:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-699912111',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b7c79776-1cbe-4a7f-8081-e4b479b6b035,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ca5ca55bfc542159153b9805a7d499a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T09:49:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T09:49:45Z,use_quota=True,user_id='c8dcd3c9a8f243dd9a4e6f8ab75835eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8989e4f-21e3-4f0a-9584-0d818784e883),volume_type_id=f8989e4f-21e3-4f0a-9584-0d818784e883)' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:49:45 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-eaad24de-851f-4152-aae5-93312616d6b0 tempest-TaggedAttachmentsTest-911145822 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eeb6e90b-707b-4b3e-97b2-43c4219fe371) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:49:45 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-eaad24de-851f-4152-aae5-93312616d6b0 tempest-TaggedAttachmentsTest-911145822 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eeb6e90b-707b-4b3e-97b2-43c4219fe371) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:49:45 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-eaad24de-851f-4152-aae5-93312616d6b0 tempest-TaggedAttachmentsTest-911145822 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (23e15ae4-be1e-40a5-8b22-a093a442dcd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:49:45 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-eaad24de-851f-4152-aae5-93312616d6b0 tempest-TaggedAttachmentsTest-911145822 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (23e15ae4-be1e-40a5-8b22-a093a442dcd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b7c79776-1cbe-4a7f-8081-e4b479b6b035', 'volume_name': 'volume-b7c79776-1cbe-4a7f-8081-e4b479b6b035', 'volume_size': 1}' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:49:45 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-eaad24de-851f-4152-aae5-93312616d6b0 tempest-TaggedAttachmentsTest-911145822 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (26df160e-4dd1-4058-8969-5cd45e2a3126) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:49:45 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-eaad24de-851f-4152-aae5-93312616d6b0 tempest-TaggedAttachmentsTest-911145822 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (26df160e-4dd1-4058-8969-5cd45e2a3126) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:49:45 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-eaad24de-851f-4152-aae5-93312616d6b0 tempest-TaggedAttachmentsTest-911145822 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d5beb96d-ef10-425d-a858-0b64e58cd15d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:49:45 devstack cinder-volume[87272]: INFO cinder.volume.flows.manager.create_volume [None req-eaad24de-851f-4152-aae5-93312616d6b0 tempest-TaggedAttachmentsTest-911145822 None] Volume b7c79776-1cbe-4a7f-8081-e4b479b6b035: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b7c79776-1cbe-4a7f-8081-e4b479b6b035', 'volume_size': 1} Nov 04 10:49:45 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-eaad24de-851f-4152-aae5-93312616d6b0 tempest-TaggedAttachmentsTest-911145822 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:49:45 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-eaad24de-851f-4152-aae5-93312616d6b0 tempest-TaggedAttachmentsTest-911145822 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:49:45 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-eaad24de-851f-4152-aae5-93312616d6b0 tempest-TaggedAttachmentsTest-911145822 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T09:49:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-699912111',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b7c79776-1cbe-4a7f-8081-e4b479b6b035,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ca5ca55bfc542159153b9805a7d499a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T09:49:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T09:49:45Z,use_quota=True,user_id='c8dcd3c9a8f243dd9a4e6f8ab75835eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8989e4f-21e3-4f0a-9584-0d818784e883),volume_type_id=f8989e4f-21e3-4f0a-9584-0d818784e883)}" {{(pid=87272) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 04 10:49:45 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.remotefs [None req-eaad24de-851f-4152-aae5-93312616d6b0 tempest-TaggedAttachmentsTest-911145822 None] Creating volume b7c79776-1cbe-4a7f-8081-e4b479b6b035 {{(pid=87272) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 10:49:45 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-eaad24de-851f-4152-aae5-93312616d6b0 tempest-TaggedAttachmentsTest-911145822 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:49:45 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-eaad24de-851f-4152-aae5-93312616d6b0 tempest-TaggedAttachmentsTest-911145822 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:49:45 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-eaad24de-851f-4152-aae5-93312616d6b0 tempest-TaggedAttachmentsTest-911145822 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898': None} {{(pid=87272) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:49:45 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-eaad24de-851f-4152-aae5-93312616d6b0 tempest-TaggedAttachmentsTest-911145822 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'] {{(pid=87272) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:49:45 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-eaad24de-851f-4152-aae5-93312616d6b0 tempest-TaggedAttachmentsTest-911145822 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:49:45 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-eaad24de-851f-4152-aae5-93312616d6b0 tempest-TaggedAttachmentsTest-911145822 None] Selected osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898 as target Quobyte volume. {{(pid=87272) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 10:49:45 devstack cinder-volume[87272]: INFO cinder.volume.drivers.remotefs [None req-eaad24de-851f-4152-aae5-93312616d6b0 tempest-TaggedAttachmentsTest-911145822 None] casted to osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898 Nov 04 10:49:45 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-eaad24de-851f-4152-aae5-93312616d6b0 tempest-TaggedAttachmentsTest-911145822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-b7c79776-1cbe-4a7f-8081-e4b479b6b035 1073741824 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:49:45 devstack sudo[87394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-b7c79776-1cbe-4a7f-8081-e4b479b6b035 1073741824 Nov 04 10:49:45 devstack sudo[87394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:49:45 devstack sudo[87394]: pam_unix(sudo:session): session closed for user root Nov 04 10:49:45 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-eaad24de-851f-4152-aae5-93312616d6b0 tempest-TaggedAttachmentsTest-911145822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-b7c79776-1cbe-4a7f-8081-e4b479b6b035 1073741824" returned: 0 in 0.633s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:49:45 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-eaad24de-851f-4152-aae5-93312616d6b0 tempest-TaggedAttachmentsTest-911145822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-b7c79776-1cbe-4a7f-8081-e4b479b6b035 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:49:45 devstack sudo[87715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-b7c79776-1cbe-4a7f-8081-e4b479b6b035 Nov 04 10:49:45 devstack sudo[87715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:49:46 devstack sudo[87715]: pam_unix(sudo:session): session closed for user root Nov 04 10:49:46 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-eaad24de-851f-4152-aae5-93312616d6b0 tempest-TaggedAttachmentsTest-911145822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-b7c79776-1cbe-4a7f-8081-e4b479b6b035" returned: 0 in 0.359s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:49:46 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-eaad24de-851f-4152-aae5-93312616d6b0 tempest-TaggedAttachmentsTest-911145822 None] <== create_volume: return (1057ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'} {{(pid=87272) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 04 10:49:46 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-eaad24de-851f-4152-aae5-93312616d6b0 tempest-TaggedAttachmentsTest-911145822 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.059s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:49:46 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-eaad24de-851f-4152-aae5-93312616d6b0 tempest-TaggedAttachmentsTest-911145822 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d5beb96d-ef10-425d-a858-0b64e58cd15d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b7c79776-1cbe-4a7f-8081-e4b479b6b035', 'volume_size': 1}' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:49:46 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-eaad24de-851f-4152-aae5-93312616d6b0 tempest-TaggedAttachmentsTest-911145822 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6828dcf-41ab-47c0-9865-f404b50d597b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:49:46 devstack cinder-volume[87272]: INFO cinder.volume.flows.manager.create_volume [None req-eaad24de-851f-4152-aae5-93312616d6b0 tempest-TaggedAttachmentsTest-911145822 None] Volume volume-b7c79776-1cbe-4a7f-8081-e4b479b6b035 (b7c79776-1cbe-4a7f-8081-e4b479b6b035): created successfully Nov 04 10:49:46 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-eaad24de-851f-4152-aae5-93312616d6b0 tempest-TaggedAttachmentsTest-911145822 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6828dcf-41ab-47c0-9865-f404b50d597b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:49:46 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-eaad24de-851f-4152-aae5-93312616d6b0 tempest-TaggedAttachmentsTest-911145822 None] Flow 'volume_create_manager' (194d90e0-0005-4ec7-a9d5-264362cea76d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87272) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:49:46 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-eaad24de-851f-4152-aae5-93312616d6b0 tempest-TaggedAttachmentsTest-911145822 None] Created volume successfully. Nov 04 10:49:56 devstack cinder-volume[87272]: DEBUG dbcounter [-] [87272] Writing DB stats cinder:SELECT=1,cinder:UPDATE=3,cinder:INSERT=1 {{(pid=87272) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 10:49:56 devstack cinder-volume[87272]: DEBUG dbcounter [-] [87272] Writing DB stats cinder:UPDATE=3,cinder:SELECT=3,cinder:DELETE=1 {{(pid=87272) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 10:50:14 devstack cinder-volume[87272]: DEBUG oslo_service.periodic_task [None req-236af0be-7f9d-4c80-b3d7-d645a9cd0dd1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87272) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 04 10:50:14 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-236af0be-7f9d-4c80-b3d7-d645a9cd0dd1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:50:14 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-236af0be-7f9d-4c80-b3d7-d645a9cd0dd1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:50:14 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-236af0be-7f9d-4c80-b3d7-d645a9cd0dd1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898': None} {{(pid=87272) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:50:14 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-236af0be-7f9d-4c80-b3d7-d645a9cd0dd1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'] {{(pid=87272) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:50:14 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-236af0be-7f9d-4c80-b3d7-d645a9cd0dd1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:50:14 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-236af0be-7f9d-4c80-b3d7-d645a9cd0dd1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:50:14 devstack sudo[88194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1 Nov 04 10:50:14 devstack sudo[88194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:50:14 devstack sudo[88194]: pam_unix(sudo:session): session closed for user root Nov 04 10:50:14 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-236af0be-7f9d-4c80-b3d7-d645a9cd0dd1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1" returned: 0 in 0.430s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:50:14 devstack cinder-volume[87272]: DEBUG cinder.manager [None req-236af0be-7f9d-4c80-b3d7-d645a9cd0dd1 None None] Notifying Schedulers of capabilities ... {{(pid=87272) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 10:50:14 devstack cinder-volume[87272]: DEBUG oslo_service.periodic_task [None req-236af0be-7f9d-4c80-b3d7-d645a9cd0dd1 None None] Running periodic task VolumeManager._thread_info {{(pid=87272) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 04 10:50:14 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-236af0be-7f9d-4c80-b3d7-d645a9cd0dd1 None None] thread count: 6 {{(pid=87272) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 04 10:50:14 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-236af0be-7f9d-4c80-b3d7-d645a9cd0dd1 None None] thread info: [<_MainThread(MainThread, started 127085713244288)>, , , , , ] {{(pid=87272) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 04 10:50:18 devstack cinder-volume[87272]: DEBUG cinder.volume.flows.manager.create_volume [None req-432be206-dc5e-48a1-8921-35d104fcc624 tempest-VolumesAdminNegativeTest-363334617 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87272) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 10:50:18 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-432be206-dc5e-48a1-8921-35d104fcc624 tempest-VolumesAdminNegativeTest-363334617 None] Flow 'volume_create_manager' (8a59aed6-7cce-4268-a543-309634ea4aff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:50:18 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-432be206-dc5e-48a1-8921-35d104fcc624 tempest-VolumesAdminNegativeTest-363334617 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6cade07d-3fa2-49a8-9aa4-a872d517b97c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:50:18 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-432be206-dc5e-48a1-8921-35d104fcc624 tempest-VolumesAdminNegativeTest-363334617 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6cade07d-3fa2-49a8-9aa4-a872d517b97c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T09:50:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-344449764',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ac0dd1b5-a6b1-468a-bb9b-e8858336b7e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d6f457f973d4035a89c8de0b2253fab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T09:50:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T09:50:18Z,use_quota=True,user_id='437a79fd03d94f6291e74581ff0c7e3b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8989e4f-21e3-4f0a-9584-0d818784e883),volume_type_id=f8989e4f-21e3-4f0a-9584-0d818784e883)' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:50:18 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-432be206-dc5e-48a1-8921-35d104fcc624 tempest-VolumesAdminNegativeTest-363334617 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5400cd2a-f6dc-4a51-a1a9-271d241a6974) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:50:18 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-432be206-dc5e-48a1-8921-35d104fcc624 tempest-VolumesAdminNegativeTest-363334617 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5400cd2a-f6dc-4a51-a1a9-271d241a6974) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:50:18 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-432be206-dc5e-48a1-8921-35d104fcc624 tempest-VolumesAdminNegativeTest-363334617 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ea48232-22dd-472e-acc0-f5ad181a8b01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:50:18 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-432be206-dc5e-48a1-8921-35d104fcc624 tempest-VolumesAdminNegativeTest-363334617 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ea48232-22dd-472e-acc0-f5ad181a8b01) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ac0dd1b5-a6b1-468a-bb9b-e8858336b7e0', 'volume_name': 'volume-ac0dd1b5-a6b1-468a-bb9b-e8858336b7e0', 'volume_size': 1}' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:50:18 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-432be206-dc5e-48a1-8921-35d104fcc624 tempest-VolumesAdminNegativeTest-363334617 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d41b2b9d-8b45-4e1f-836c-7a7ad87a2fc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:50:18 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-432be206-dc5e-48a1-8921-35d104fcc624 tempest-VolumesAdminNegativeTest-363334617 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d41b2b9d-8b45-4e1f-836c-7a7ad87a2fc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:50:18 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-432be206-dc5e-48a1-8921-35d104fcc624 tempest-VolumesAdminNegativeTest-363334617 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5fa9ec80-00d9-4f15-b144-52a4cd7a32b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:50:18 devstack cinder-volume[87272]: INFO cinder.volume.flows.manager.create_volume [None req-432be206-dc5e-48a1-8921-35d104fcc624 tempest-VolumesAdminNegativeTest-363334617 None] Volume ac0dd1b5-a6b1-468a-bb9b-e8858336b7e0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ac0dd1b5-a6b1-468a-bb9b-e8858336b7e0', 'volume_size': 1} Nov 04 10:50:18 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-432be206-dc5e-48a1-8921-35d104fcc624 tempest-VolumesAdminNegativeTest-363334617 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:50:18 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-432be206-dc5e-48a1-8921-35d104fcc624 tempest-VolumesAdminNegativeTest-363334617 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:50:18 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-432be206-dc5e-48a1-8921-35d104fcc624 tempest-VolumesAdminNegativeTest-363334617 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T09:50:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-344449764',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ac0dd1b5-a6b1-468a-bb9b-e8858336b7e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d6f457f973d4035a89c8de0b2253fab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T09:50:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T09:50:18Z,use_quota=True,user_id='437a79fd03d94f6291e74581ff0c7e3b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8989e4f-21e3-4f0a-9584-0d818784e883),volume_type_id=f8989e4f-21e3-4f0a-9584-0d818784e883)}" {{(pid=87272) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 04 10:50:18 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.remotefs [None req-432be206-dc5e-48a1-8921-35d104fcc624 tempest-VolumesAdminNegativeTest-363334617 None] Creating volume ac0dd1b5-a6b1-468a-bb9b-e8858336b7e0 {{(pid=87272) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 10:50:18 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-432be206-dc5e-48a1-8921-35d104fcc624 tempest-VolumesAdminNegativeTest-363334617 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:50:18 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-432be206-dc5e-48a1-8921-35d104fcc624 tempest-VolumesAdminNegativeTest-363334617 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:50:18 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-432be206-dc5e-48a1-8921-35d104fcc624 tempest-VolumesAdminNegativeTest-363334617 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898': None} {{(pid=87272) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:50:18 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-432be206-dc5e-48a1-8921-35d104fcc624 tempest-VolumesAdminNegativeTest-363334617 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'] {{(pid=87272) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:50:18 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-432be206-dc5e-48a1-8921-35d104fcc624 tempest-VolumesAdminNegativeTest-363334617 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:50:18 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-432be206-dc5e-48a1-8921-35d104fcc624 tempest-VolumesAdminNegativeTest-363334617 None] Selected osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898 as target Quobyte volume. {{(pid=87272) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 10:50:18 devstack cinder-volume[87272]: INFO cinder.volume.drivers.remotefs [None req-432be206-dc5e-48a1-8921-35d104fcc624 tempest-VolumesAdminNegativeTest-363334617 None] casted to osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898 Nov 04 10:50:18 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-432be206-dc5e-48a1-8921-35d104fcc624 tempest-VolumesAdminNegativeTest-363334617 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-ac0dd1b5-a6b1-468a-bb9b-e8858336b7e0 1073741824 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:50:18 devstack sudo[88243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-ac0dd1b5-a6b1-468a-bb9b-e8858336b7e0 1073741824 Nov 04 10:50:18 devstack sudo[88243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:50:19 devstack sudo[88243]: pam_unix(sudo:session): session closed for user root Nov 04 10:50:19 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-432be206-dc5e-48a1-8921-35d104fcc624 tempest-VolumesAdminNegativeTest-363334617 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-ac0dd1b5-a6b1-468a-bb9b-e8858336b7e0 1073741824" returned: 0 in 0.882s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:50:19 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-432be206-dc5e-48a1-8921-35d104fcc624 tempest-VolumesAdminNegativeTest-363334617 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-ac0dd1b5-a6b1-468a-bb9b-e8858336b7e0 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:50:19 devstack sudo[88256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-ac0dd1b5-a6b1-468a-bb9b-e8858336b7e0 Nov 04 10:50:19 devstack sudo[88256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:50:20 devstack sudo[88256]: pam_unix(sudo:session): session closed for user root Nov 04 10:50:20 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-432be206-dc5e-48a1-8921-35d104fcc624 tempest-VolumesAdminNegativeTest-363334617 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-ac0dd1b5-a6b1-468a-bb9b-e8858336b7e0" returned: 0 in 0.728s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:50:20 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-432be206-dc5e-48a1-8921-35d104fcc624 tempest-VolumesAdminNegativeTest-363334617 None] <== create_volume: return (1736ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'} {{(pid=87272) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 04 10:50:20 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-432be206-dc5e-48a1-8921-35d104fcc624 tempest-VolumesAdminNegativeTest-363334617 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.741s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:50:20 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-432be206-dc5e-48a1-8921-35d104fcc624 tempest-VolumesAdminNegativeTest-363334617 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5fa9ec80-00d9-4f15-b144-52a4cd7a32b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ac0dd1b5-a6b1-468a-bb9b-e8858336b7e0', 'volume_size': 1}' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:50:20 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-432be206-dc5e-48a1-8921-35d104fcc624 tempest-VolumesAdminNegativeTest-363334617 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b0e282a0-bedb-4a1d-82d9-0fd6a3b9f14c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:50:20 devstack cinder-volume[87272]: INFO cinder.volume.flows.manager.create_volume [None req-432be206-dc5e-48a1-8921-35d104fcc624 tempest-VolumesAdminNegativeTest-363334617 None] Volume volume-ac0dd1b5-a6b1-468a-bb9b-e8858336b7e0 (ac0dd1b5-a6b1-468a-bb9b-e8858336b7e0): created successfully Nov 04 10:50:20 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-432be206-dc5e-48a1-8921-35d104fcc624 tempest-VolumesAdminNegativeTest-363334617 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b0e282a0-bedb-4a1d-82d9-0fd6a3b9f14c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:50:20 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-432be206-dc5e-48a1-8921-35d104fcc624 tempest-VolumesAdminNegativeTest-363334617 None] Flow 'volume_create_manager' (8a59aed6-7cce-4268-a543-309634ea4aff) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87272) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:50:20 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-432be206-dc5e-48a1-8921-35d104fcc624 tempest-VolumesAdminNegativeTest-363334617 None] Created volume successfully. Nov 04 10:50:22 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-14ab7237-3cee-4a33-bd72-669e5eb9c5f6 tempest-VolumesAdminNegativeTest-363334617 None] Acquiring lock "cinder-ac0dd1b5-a6b1-468a-bb9b-e8858336b7e0-delete_volume" by "delete_volume" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:50:22 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-14ab7237-3cee-4a33-bd72-669e5eb9c5f6 tempest-VolumesAdminNegativeTest-363334617 None] Lock "cinder-ac0dd1b5-a6b1-468a-bb9b-e8858336b7e0-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:50:22 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-14ab7237-3cee-4a33-bd72-669e5eb9c5f6 tempest-VolumesAdminNegativeTest-363334617 None] Acquiring lock "cinder-quobyte-ac0dd1b5-a6b1-468a-bb9b-e8858336b7e0" by "delete_volume" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:50:23 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-14ab7237-3cee-4a33-bd72-669e5eb9c5f6 tempest-VolumesAdminNegativeTest-363334617 None] Lock "cinder-quobyte-ac0dd1b5-a6b1-468a-bb9b-e8858336b7e0" acquired by "delete_volume" :: waited 0.044s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:50:23 devstack cinder-volume[87272]: INFO oslo.privsep.daemon [None req-14ab7237-3cee-4a33-bd72-669e5eb9c5f6 tempest-VolumesAdminNegativeTest-363334617 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmplgd_w3o0/privsep.sock'] Nov 04 10:50:23 devstack sudo[88263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmplgd_w3o0/privsep.sock Nov 04 10:50:23 devstack sudo[88263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:50:24 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-c19b667b-0907-44c8-a784-dce01689b052 tempest-BackendsCapabilitiesAdminTestsJSON-21080716 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.6128959655762, 'free_capacity_gb': 1773.6128959655762, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87272) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Nov 04 10:50:24 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-4b51a229-01cb-41be-a131-2644accd9605 tempest-BackendsCapabilitiesAdminTestsJSON-21080716 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.6128959655762, 'free_capacity_gb': 1773.6128959655762, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87272) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Nov 04 10:50:24 devstack cinder-volume[87272]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:105: EventletDeprecationWarning: Nov 04 10:50:24 devstack cinder-volume[87272]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Nov 04 10:50:24 devstack cinder-volume[87272]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Nov 04 10:50:24 devstack cinder-volume[87272]: WARNING oslo.privsep.daemon [-] privsep log: Nov 04 10:50:24 devstack cinder-volume[87272]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Nov 04 10:50:24 devstack cinder-volume[87272]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Nov 04 10:50:24 devstack cinder-volume[87272]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Nov 04 10:50:24 devstack cinder-volume[87272]: WARNING oslo.privsep.daemon [-] privsep log: Nov 04 10:50:24 devstack cinder-volume[87272]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet Nov 04 10:50:25 devstack sudo[88263]: pam_unix(sudo:session): session closed for user root Nov 04 10:50:25 devstack cinder-volume[87272]: INFO oslo.privsep.daemon [None req-14ab7237-3cee-4a33-bd72-669e5eb9c5f6 tempest-VolumesAdminNegativeTest-363334617 None] Spawned new privsep daemon via rootwrap Nov 04 10:50:25 devstack cinder-volume[87272]: DEBUG oslo.privsep.daemon [None req-14ab7237-3cee-4a33-bd72-669e5eb9c5f6 tempest-VolumesAdminNegativeTest-363334617 None] Accepted privsep connection to /tmp/tmplgd_w3o0/privsep.sock {{(pid=87272) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}} Nov 04 10:50:25 devstack cinder-volume[87272]: INFO oslo.privsep.daemon [-] privsep daemon starting Nov 04 10:50:25 devstack cinder-volume[87272]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Nov 04 10:50:25 devstack cinder-volume[87272]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Nov 04 10:50:25 devstack cinder-volume[87272]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 88269 Nov 04 10:50:25 devstack cinder-volume[87272]: DEBUG oslo.privsep.daemon [-] privsep: reply[990d1e53-f419-44c5-8c38-2d3dbeb7124a]: (2,) {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:50:25 devstack cinder-volume[87272]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebbad541-565e-4e00-81e8-7709dc39cda9]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:50:25 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-14ab7237-3cee-4a33-bd72-669e5eb9c5f6 tempest-VolumesAdminNegativeTest-363334617 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-ac0dd1b5-a6b1-468a-bb9b-e8858336b7e0 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:50:25 devstack sudo[88273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-ac0dd1b5-a6b1-468a-bb9b-e8858336b7e0 Nov 04 10:50:25 devstack sudo[88273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:50:26 devstack sudo[88273]: pam_unix(sudo:session): session closed for user root Nov 04 10:50:26 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-14ab7237-3cee-4a33-bd72-669e5eb9c5f6 tempest-VolumesAdminNegativeTest-363334617 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-ac0dd1b5-a6b1-468a-bb9b-e8858336b7e0" returned: 0 in 0.727s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:50:26 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-14ab7237-3cee-4a33-bd72-669e5eb9c5f6 tempest-VolumesAdminNegativeTest-363334617 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-ac0dd1b5-a6b1-468a-bb9b-e8858336b7e0 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:50:26 devstack sudo[88282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-ac0dd1b5-a6b1-468a-bb9b-e8858336b7e0 Nov 04 10:50:26 devstack sudo[88282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:50:26 devstack sudo[88282]: pam_unix(sudo:session): session closed for user root Nov 04 10:50:26 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-14ab7237-3cee-4a33-bd72-669e5eb9c5f6 tempest-VolumesAdminNegativeTest-363334617 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-ac0dd1b5-a6b1-468a-bb9b-e8858336b7e0" returned: 0 in 0.471s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:50:26 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-14ab7237-3cee-4a33-bd72-669e5eb9c5f6 tempest-VolumesAdminNegativeTest-363334617 None] Lock "cinder-quobyte-ac0dd1b5-a6b1-468a-bb9b-e8858336b7e0" released by "delete_volume" :: held 3.512s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:50:26 devstack cinder-volume[87272]: WARNING cinder.quota [None req-14ab7237-3cee-4a33-bd72-669e5eb9c5f6 tempest-VolumesAdminNegativeTest-363334617 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Nov 04 10:50:26 devstack cinder-volume[87272]: WARNING cinder.quota [None req-14ab7237-3cee-4a33-bd72-669e5eb9c5f6 tempest-VolumesAdminNegativeTest-363334617 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Nov 04 10:50:26 devstack cinder-volume[87272]: DEBUG cinder.quota [None req-14ab7237-3cee-4a33-bd72-669e5eb9c5f6 tempest-VolumesAdminNegativeTest-363334617 None] Created reservations ['26f873a8-0adc-4aa7-9fd1-144c299cd74d', 'eca2012f-22e0-4e8c-a957-93feda8cd451', 'bd4f7aef-0018-4051-a75b-35bc891bd59c', 'b30fa7ca-d85a-4c0e-a86a-7389118a24cf'] {{(pid=87272) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 10:50:26 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-14ab7237-3cee-4a33-bd72-669e5eb9c5f6 tempest-VolumesAdminNegativeTest-363334617 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:50:26 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-14ab7237-3cee-4a33-bd72-669e5eb9c5f6 tempest-VolumesAdminNegativeTest-363334617 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:50:26 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-14ab7237-3cee-4a33-bd72-669e5eb9c5f6 tempest-VolumesAdminNegativeTest-363334617 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898': None} {{(pid=87272) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:50:26 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-14ab7237-3cee-4a33-bd72-669e5eb9c5f6 tempest-VolumesAdminNegativeTest-363334617 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'] {{(pid=87272) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:50:26 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-14ab7237-3cee-4a33-bd72-669e5eb9c5f6 tempest-VolumesAdminNegativeTest-363334617 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:50:26 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-14ab7237-3cee-4a33-bd72-669e5eb9c5f6 tempest-VolumesAdminNegativeTest-363334617 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:50:26 devstack sudo[88315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1 Nov 04 10:50:26 devstack sudo[88315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:50:27 devstack sudo[88315]: pam_unix(sudo:session): session closed for user root Nov 04 10:50:27 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-14ab7237-3cee-4a33-bd72-669e5eb9c5f6 tempest-VolumesAdminNegativeTest-363334617 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1" returned: 0 in 0.328s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:50:27 devstack cinder-volume[87272]: DEBUG cinder.manager [None req-14ab7237-3cee-4a33-bd72-669e5eb9c5f6 tempest-VolumesAdminNegativeTest-363334617 None] Notifying Schedulers of capabilities ... {{(pid=87272) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 10:50:27 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-14ab7237-3cee-4a33-bd72-669e5eb9c5f6 tempest-VolumesAdminNegativeTest-363334617 None] Deleted volume successfully. Nov 04 10:50:27 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-14ab7237-3cee-4a33-bd72-669e5eb9c5f6 tempest-VolumesAdminNegativeTest-363334617 None] Lock "cinder-ac0dd1b5-a6b1-468a-bb9b-e8858336b7e0-delete_volume" released by "delete_volume" :: held 4.313s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:50:36 devstack cinder-volume[87272]: DEBUG dbcounter [-] [87272] Writing DB stats cinder:UPDATE=12,cinder:INSERT=2,cinder:SELECT=5 {{(pid=87272) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 10:50:37 devstack cinder-volume[87272]: DEBUG dbcounter [-] [87272] Writing DB stats cinder:SELECT=9,cinder:UPDATE=10,cinder:DELETE=2,cinder:INSERT=3 {{(pid=87272) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 10:50:39 devstack cinder-volume[87272]: DEBUG cinder.volume.flows.manager.create_volume [None req-c83c4cf8-8eb0-4e62-bf45-e2634cbd3e7c tempest-AttachVolumeTestJSON-969779014 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87272) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 10:50:39 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-c83c4cf8-8eb0-4e62-bf45-e2634cbd3e7c tempest-AttachVolumeTestJSON-969779014 None] Flow 'volume_create_manager' (3a3cdf13-124b-49c0-9463-c8580c46cfcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:50:39 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-c83c4cf8-8eb0-4e62-bf45-e2634cbd3e7c tempest-AttachVolumeTestJSON-969779014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4cf7331c-b343-4ab4-a891-6f05b26f4bd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:50:39 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-c83c4cf8-8eb0-4e62-bf45-e2634cbd3e7c tempest-AttachVolumeTestJSON-969779014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4cf7331c-b343-4ab4-a891-6f05b26f4bd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T09:50:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1823819073',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=59b91a30-e454-41fc-a994-fcd060c22047,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9af529190a64458b1851782c52971fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T09:50:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T09:50:39Z,use_quota=True,user_id='7506d2d06b404f1083e8817e6a4ee71b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8989e4f-21e3-4f0a-9584-0d818784e883),volume_type_id=f8989e4f-21e3-4f0a-9584-0d818784e883)' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:50:39 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-c83c4cf8-8eb0-4e62-bf45-e2634cbd3e7c tempest-AttachVolumeTestJSON-969779014 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (292aab8a-9527-483e-be48-6192b5e778fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:50:39 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-c83c4cf8-8eb0-4e62-bf45-e2634cbd3e7c tempest-AttachVolumeTestJSON-969779014 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (292aab8a-9527-483e-be48-6192b5e778fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:50:39 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-c83c4cf8-8eb0-4e62-bf45-e2634cbd3e7c tempest-AttachVolumeTestJSON-969779014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09ee0b98-ad60-4b33-abae-567846fa6b8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:50:39 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-c83c4cf8-8eb0-4e62-bf45-e2634cbd3e7c tempest-AttachVolumeTestJSON-969779014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09ee0b98-ad60-4b33-abae-567846fa6b8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '59b91a30-e454-41fc-a994-fcd060c22047', 'volume_name': 'volume-59b91a30-e454-41fc-a994-fcd060c22047', 'volume_size': 1}' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:50:39 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-c83c4cf8-8eb0-4e62-bf45-e2634cbd3e7c tempest-AttachVolumeTestJSON-969779014 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (376886d6-b9c1-4eb6-b825-4cecf7efcfb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:50:39 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-c83c4cf8-8eb0-4e62-bf45-e2634cbd3e7c tempest-AttachVolumeTestJSON-969779014 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (376886d6-b9c1-4eb6-b825-4cecf7efcfb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:50:39 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-c83c4cf8-8eb0-4e62-bf45-e2634cbd3e7c tempest-AttachVolumeTestJSON-969779014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (639e8511-4c24-4a3f-aff9-630509afa397) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:50:39 devstack cinder-volume[87272]: INFO cinder.volume.flows.manager.create_volume [None req-c83c4cf8-8eb0-4e62-bf45-e2634cbd3e7c tempest-AttachVolumeTestJSON-969779014 None] Volume 59b91a30-e454-41fc-a994-fcd060c22047: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-59b91a30-e454-41fc-a994-fcd060c22047', 'volume_size': 1} Nov 04 10:50:39 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-c83c4cf8-8eb0-4e62-bf45-e2634cbd3e7c tempest-AttachVolumeTestJSON-969779014 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:50:39 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-c83c4cf8-8eb0-4e62-bf45-e2634cbd3e7c tempest-AttachVolumeTestJSON-969779014 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:50:39 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-c83c4cf8-8eb0-4e62-bf45-e2634cbd3e7c tempest-AttachVolumeTestJSON-969779014 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T09:50:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1823819073',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=59b91a30-e454-41fc-a994-fcd060c22047,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9af529190a64458b1851782c52971fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T09:50:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T09:50:39Z,use_quota=True,user_id='7506d2d06b404f1083e8817e6a4ee71b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8989e4f-21e3-4f0a-9584-0d818784e883),volume_type_id=f8989e4f-21e3-4f0a-9584-0d818784e883)}" {{(pid=87272) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 04 10:50:39 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.remotefs [None req-c83c4cf8-8eb0-4e62-bf45-e2634cbd3e7c tempest-AttachVolumeTestJSON-969779014 None] Creating volume 59b91a30-e454-41fc-a994-fcd060c22047 {{(pid=87272) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 10:50:39 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-c83c4cf8-8eb0-4e62-bf45-e2634cbd3e7c tempest-AttachVolumeTestJSON-969779014 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:50:39 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-c83c4cf8-8eb0-4e62-bf45-e2634cbd3e7c tempest-AttachVolumeTestJSON-969779014 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:50:39 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-c83c4cf8-8eb0-4e62-bf45-e2634cbd3e7c tempest-AttachVolumeTestJSON-969779014 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898': None} {{(pid=87272) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:50:39 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-c83c4cf8-8eb0-4e62-bf45-e2634cbd3e7c tempest-AttachVolumeTestJSON-969779014 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'] {{(pid=87272) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:50:39 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-c83c4cf8-8eb0-4e62-bf45-e2634cbd3e7c tempest-AttachVolumeTestJSON-969779014 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:50:39 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-c83c4cf8-8eb0-4e62-bf45-e2634cbd3e7c tempest-AttachVolumeTestJSON-969779014 None] Selected osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898 as target Quobyte volume. {{(pid=87272) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 10:50:39 devstack cinder-volume[87272]: INFO cinder.volume.drivers.remotefs [None req-c83c4cf8-8eb0-4e62-bf45-e2634cbd3e7c tempest-AttachVolumeTestJSON-969779014 None] casted to osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898 Nov 04 10:50:39 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-c83c4cf8-8eb0-4e62-bf45-e2634cbd3e7c tempest-AttachVolumeTestJSON-969779014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-59b91a30-e454-41fc-a994-fcd060c22047 1073741824 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:50:39 devstack sudo[88389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-59b91a30-e454-41fc-a994-fcd060c22047 1073741824 Nov 04 10:50:39 devstack sudo[88389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:50:40 devstack sudo[88389]: pam_unix(sudo:session): session closed for user root Nov 04 10:50:40 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-c83c4cf8-8eb0-4e62-bf45-e2634cbd3e7c tempest-AttachVolumeTestJSON-969779014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-59b91a30-e454-41fc-a994-fcd060c22047 1073741824" returned: 0 in 0.552s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:50:40 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-c83c4cf8-8eb0-4e62-bf45-e2634cbd3e7c tempest-AttachVolumeTestJSON-969779014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-59b91a30-e454-41fc-a994-fcd060c22047 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:50:40 devstack sudo[88395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-59b91a30-e454-41fc-a994-fcd060c22047 Nov 04 10:50:40 devstack sudo[88395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:50:40 devstack sudo[88395]: pam_unix(sudo:session): session closed for user root Nov 04 10:50:40 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-c83c4cf8-8eb0-4e62-bf45-e2634cbd3e7c tempest-AttachVolumeTestJSON-969779014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-59b91a30-e454-41fc-a994-fcd060c22047" returned: 0 in 0.322s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:50:40 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-c83c4cf8-8eb0-4e62-bf45-e2634cbd3e7c tempest-AttachVolumeTestJSON-969779014 None] <== create_volume: return (946ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'} {{(pid=87272) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 04 10:50:40 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-c83c4cf8-8eb0-4e62-bf45-e2634cbd3e7c tempest-AttachVolumeTestJSON-969779014 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.948s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:50:40 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-c83c4cf8-8eb0-4e62-bf45-e2634cbd3e7c tempest-AttachVolumeTestJSON-969779014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (639e8511-4c24-4a3f-aff9-630509afa397) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-59b91a30-e454-41fc-a994-fcd060c22047', 'volume_size': 1}' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:50:40 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-c83c4cf8-8eb0-4e62-bf45-e2634cbd3e7c tempest-AttachVolumeTestJSON-969779014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c2f6726-65b9-405b-a8a0-99c6ab004f13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:50:40 devstack cinder-volume[87272]: INFO cinder.volume.flows.manager.create_volume [None req-c83c4cf8-8eb0-4e62-bf45-e2634cbd3e7c tempest-AttachVolumeTestJSON-969779014 None] Volume volume-59b91a30-e454-41fc-a994-fcd060c22047 (59b91a30-e454-41fc-a994-fcd060c22047): created successfully Nov 04 10:50:40 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-c83c4cf8-8eb0-4e62-bf45-e2634cbd3e7c tempest-AttachVolumeTestJSON-969779014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c2f6726-65b9-405b-a8a0-99c6ab004f13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:50:40 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-c83c4cf8-8eb0-4e62-bf45-e2634cbd3e7c tempest-AttachVolumeTestJSON-969779014 None] Flow 'volume_create_manager' (3a3cdf13-124b-49c0-9463-c8580c46cfcf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87272) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:50:40 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-c83c4cf8-8eb0-4e62-bf45-e2634cbd3e7c tempest-AttachVolumeTestJSON-969779014 None] Created volume successfully. Nov 04 10:50:44 devstack cinder-volume[87272]: WARNING py.warnings [req-05f31227-12e2-414e-b43e-2166c7594b22 req-6942dba2-8210-4a62-8b2f-27b24e5b7f9c tempest-AttachVolumeTestJSON-969779014 None] /opt/stack/cinder/cinder/db/api.py:2468: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes" and FROM element "volumes_1". Apply join condition(s) between each element to resolve. Nov 04 10:50:44 devstack cinder-volume[87272]: .first() Nov 04 10:50:44 devstack cinder-volume[87272]: Nov 04 10:50:44 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [req-05f31227-12e2-414e-b43e-2166c7594b22 req-6942dba2-8210-4a62-8b2f-27b24e5b7f9c tempest-AttachVolumeTestJSON-969779014 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:50:44 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [req-05f31227-12e2-414e-b43e-2166c7594b22 req-6942dba2-8210-4a62-8b2f-27b24e5b7f9c tempest-AttachVolumeTestJSON-969779014 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:50:44 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [req-05f31227-12e2-414e-b43e-2166c7594b22 req-6942dba2-8210-4a62-8b2f-27b24e5b7f9c tempest-AttachVolumeTestJSON-969779014 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.013s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:50:44 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [req-05f31227-12e2-414e-b43e-2166c7594b22 req-6942dba2-8210-4a62-8b2f-27b24e5b7f9c tempest-AttachVolumeTestJSON-969779014 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898', 'name': 'volume-59b91a30-e454-41fc-a994-fcd060c22047', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '302bb848-6ab3-4a12-b84b-6e5af739bf89', 'enforce_multipath': True} {{(pid=87272) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 04 10:50:44 devstack cinder-volume[87272]: INFO cinder.volume.manager [req-05f31227-12e2-414e-b43e-2166c7594b22 req-6942dba2-8210-4a62-8b2f-27b24e5b7f9c tempest-AttachVolumeTestJSON-969779014 None] attachment_update completed successfully. Nov 04 10:50:48 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-7082ff99-1f0c-47bd-b3a5-fda84342254b tempest-GroupsV320Test-551663212 None] Group tempest-GroupsV320Test-Group-1487791446: creating Nov 04 10:50:48 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-7082ff99-1f0c-47bd-b3a5-fda84342254b tempest-GroupsV320Test-551663212 None] Group tempest-GroupsV320Test-Group-1487791446: created successfully Nov 04 10:50:48 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-7082ff99-1f0c-47bd-b3a5-fda84342254b tempest-GroupsV320Test-551663212 None] Create group completed successfully. Nov 04 10:50:50 devstack cinder-volume[87272]: DEBUG cinder.quota [None req-8ab41589-4910-4558-bbc2-57f3f9c29604 tempest-GroupsV320Test-551663212 None] Created reservations ['778660ac-a3c5-40b9-abd4-7efe9a4299d1'] {{(pid=87272) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 10:50:50 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-8ab41589-4910-4558-bbc2-57f3f9c29604 tempest-GroupsV320Test-551663212 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:50:50 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-8ab41589-4910-4558-bbc2-57f3f9c29604 tempest-GroupsV320Test-551663212 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:50:50 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-8ab41589-4910-4558-bbc2-57f3f9c29604 tempest-GroupsV320Test-551663212 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898': None} {{(pid=87272) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:50:50 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-8ab41589-4910-4558-bbc2-57f3f9c29604 tempest-GroupsV320Test-551663212 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'] {{(pid=87272) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:50:50 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-8ab41589-4910-4558-bbc2-57f3f9c29604 tempest-GroupsV320Test-551663212 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:50:50 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-8ab41589-4910-4558-bbc2-57f3f9c29604 tempest-GroupsV320Test-551663212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:50:50 devstack sudo[89016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1 Nov 04 10:50:50 devstack sudo[89016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:50:50 devstack sudo[89016]: pam_unix(sudo:session): session closed for user root Nov 04 10:50:50 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-8ab41589-4910-4558-bbc2-57f3f9c29604 tempest-GroupsV320Test-551663212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1" returned: 0 in 0.357s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:50:50 devstack cinder-volume[87272]: DEBUG cinder.manager [None req-8ab41589-4910-4558-bbc2-57f3f9c29604 tempest-GroupsV320Test-551663212 None] Notifying Schedulers of capabilities ... {{(pid=87272) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 10:50:50 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-8ab41589-4910-4558-bbc2-57f3f9c29604 tempest-GroupsV320Test-551663212 None] Delete group completed successfully. Nov 04 10:51:00 devstack cinder-volume[87272]: DEBUG dbcounter [-] [87272] Writing DB stats cinder:UPDATE=9,cinder:SELECT=18,cinder:DELETE=1,cinder:INSERT=1 {{(pid=87272) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 10:51:00 devstack cinder-volume[87272]: DEBUG dbcounter [-] [87272] Writing DB stats cinder:SELECT=13,cinder:INSERT=1,cinder:UPDATE=8 {{(pid=87272) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 10:51:08 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [req-0acca5e9-195f-4db9-9f3c-aecba2e2ef18 req-a25d023d-f4d9-48de-8169-564a92290906 tempest-TaggedAttachmentsTest-911145822 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:51:08 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [req-0acca5e9-195f-4db9-9f3c-aecba2e2ef18 req-a25d023d-f4d9-48de-8169-564a92290906 tempest-TaggedAttachmentsTest-911145822 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:51:08 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [req-0acca5e9-195f-4db9-9f3c-aecba2e2ef18 req-a25d023d-f4d9-48de-8169-564a92290906 tempest-TaggedAttachmentsTest-911145822 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.016s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:51:08 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [req-0acca5e9-195f-4db9-9f3c-aecba2e2ef18 req-a25d023d-f4d9-48de-8169-564a92290906 tempest-TaggedAttachmentsTest-911145822 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898', 'name': 'volume-b7c79776-1cbe-4a7f-8081-e4b479b6b035', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '70699f94-1aca-4cfb-b054-2be6cc2e164d', 'enforce_multipath': True} {{(pid=87272) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 04 10:51:08 devstack cinder-volume[87272]: INFO cinder.volume.manager [req-0acca5e9-195f-4db9-9f3c-aecba2e2ef18 req-a25d023d-f4d9-48de-8169-564a92290906 tempest-TaggedAttachmentsTest-911145822 None] attachment_update completed successfully. Nov 04 10:51:11 devstack cinder-volume[87272]: INFO cinder.volume.manager [req-1e2a649e-212d-408c-aff9-92e0af2837d8 req-42ad44c1-8014-4086-af06-f137df5fa908 tempest-TaggedAttachmentsTest-911145822 None] Terminate volume connection completed successfully. Nov 04 10:51:11 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [req-1e2a649e-212d-408c-aff9-92e0af2837d8 req-42ad44c1-8014-4086-af06-f137df5fa908 tempest-TaggedAttachmentsTest-911145822 None] Deleting attachment 70699f94-1aca-4cfb-b054-2be6cc2e164d. {{(pid=87272) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 04 10:51:14 devstack cinder-volume[87272]: DEBUG oslo_service.periodic_task [None req-236af0be-7f9d-4c80-b3d7-d645a9cd0dd1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87272) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 04 10:51:14 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-236af0be-7f9d-4c80-b3d7-d645a9cd0dd1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:51:14 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-236af0be-7f9d-4c80-b3d7-d645a9cd0dd1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:51:14 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-236af0be-7f9d-4c80-b3d7-d645a9cd0dd1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898': None} {{(pid=87272) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:51:14 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-236af0be-7f9d-4c80-b3d7-d645a9cd0dd1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'] {{(pid=87272) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:51:14 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-236af0be-7f9d-4c80-b3d7-d645a9cd0dd1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.044s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:51:14 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-236af0be-7f9d-4c80-b3d7-d645a9cd0dd1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:51:14 devstack sudo[89632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1 Nov 04 10:51:14 devstack sudo[89632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:51:14 devstack sudo[89632]: pam_unix(sudo:session): session closed for user root Nov 04 10:51:14 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-236af0be-7f9d-4c80-b3d7-d645a9cd0dd1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1" returned: 0 in 0.416s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:51:14 devstack cinder-volume[87272]: DEBUG cinder.manager [None req-236af0be-7f9d-4c80-b3d7-d645a9cd0dd1 None None] Notifying Schedulers of capabilities ... {{(pid=87272) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 10:51:14 devstack cinder-volume[87272]: DEBUG oslo_service.periodic_task [None req-236af0be-7f9d-4c80-b3d7-d645a9cd0dd1 None None] Running periodic task VolumeManager._thread_info {{(pid=87272) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 04 10:51:14 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-236af0be-7f9d-4c80-b3d7-d645a9cd0dd1 None None] thread count: 8 {{(pid=87272) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 04 10:51:14 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-236af0be-7f9d-4c80-b3d7-d645a9cd0dd1 None None] thread info: [<_MainThread(MainThread, started 127085713244288)>, , , , , , , ] {{(pid=87272) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 04 10:51:16 devstack cinder-volume[87272]: INFO cinder.volume.manager [req-211adbd3-6d74-418e-975a-dbb72beadedf req-c77c2782-9c8a-4376-95ed-d9fddc22aa60 tempest-AttachVolumeTestJSON-969779014 None] Terminate volume connection completed successfully. Nov 04 10:51:16 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [req-211adbd3-6d74-418e-975a-dbb72beadedf req-c77c2782-9c8a-4376-95ed-d9fddc22aa60 tempest-AttachVolumeTestJSON-969779014 None] Deleting attachment 302bb848-6ab3-4a12-b84b-6e5af739bf89. {{(pid=87272) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 04 10:51:18 devstack cinder-volume[87272]: DEBUG cinder.volume.flows.manager.create_volume [None req-650181c2-6dbe-4338-bd27-f5235c9555c0 tempest-DeleteServersTestJSON-1539023327 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87272) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 10:51:18 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-650181c2-6dbe-4338-bd27-f5235c9555c0 tempest-DeleteServersTestJSON-1539023327 None] Flow 'volume_create_manager' (4eb21a3b-f383-402f-a661-7f180acb5e3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:51:18 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-650181c2-6dbe-4338-bd27-f5235c9555c0 tempest-DeleteServersTestJSON-1539023327 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd89c66f-e657-44fa-8a1e-e795e763bcba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:51:18 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-650181c2-6dbe-4338-bd27-f5235c9555c0 tempest-DeleteServersTestJSON-1539023327 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd89c66f-e657-44fa-8a1e-e795e763bcba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T09:51:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1173331552',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d452c41-5e12-4d15-bcac-e6e0ef7b3079,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a7e8650dd78348d2a39479f92bd437c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T09:51:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T09:51:18Z,use_quota=True,user_id='26eb01189b144fc89ab296a2c8f7f66e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8989e4f-21e3-4f0a-9584-0d818784e883),volume_type_id=f8989e4f-21e3-4f0a-9584-0d818784e883)' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:51:18 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-650181c2-6dbe-4338-bd27-f5235c9555c0 tempest-DeleteServersTestJSON-1539023327 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c3125ad-2963-4400-b007-0bf9aede3e86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:51:18 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-650181c2-6dbe-4338-bd27-f5235c9555c0 tempest-DeleteServersTestJSON-1539023327 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c3125ad-2963-4400-b007-0bf9aede3e86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:51:18 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-650181c2-6dbe-4338-bd27-f5235c9555c0 tempest-DeleteServersTestJSON-1539023327 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (112158bf-d757-49c0-b6e5-18985b012bf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:51:18 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-650181c2-6dbe-4338-bd27-f5235c9555c0 tempest-DeleteServersTestJSON-1539023327 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (112158bf-d757-49c0-b6e5-18985b012bf5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2d452c41-5e12-4d15-bcac-e6e0ef7b3079', 'volume_name': 'volume-2d452c41-5e12-4d15-bcac-e6e0ef7b3079', 'volume_size': 1}' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:51:18 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-650181c2-6dbe-4338-bd27-f5235c9555c0 tempest-DeleteServersTestJSON-1539023327 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (590d8135-a94b-42df-8bcf-b3e7aeda359b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:51:18 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-650181c2-6dbe-4338-bd27-f5235c9555c0 tempest-DeleteServersTestJSON-1539023327 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (590d8135-a94b-42df-8bcf-b3e7aeda359b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:51:18 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-650181c2-6dbe-4338-bd27-f5235c9555c0 tempest-DeleteServersTestJSON-1539023327 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (08537d8a-3bb5-40fe-9724-6bda84f25dda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:51:18 devstack cinder-volume[87272]: INFO cinder.volume.flows.manager.create_volume [None req-650181c2-6dbe-4338-bd27-f5235c9555c0 tempest-DeleteServersTestJSON-1539023327 None] Volume 2d452c41-5e12-4d15-bcac-e6e0ef7b3079: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2d452c41-5e12-4d15-bcac-e6e0ef7b3079', 'volume_size': 1} Nov 04 10:51:18 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-650181c2-6dbe-4338-bd27-f5235c9555c0 tempest-DeleteServersTestJSON-1539023327 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:51:18 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-650181c2-6dbe-4338-bd27-f5235c9555c0 tempest-DeleteServersTestJSON-1539023327 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:51:18 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-650181c2-6dbe-4338-bd27-f5235c9555c0 tempest-DeleteServersTestJSON-1539023327 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T09:51:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1173331552',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d452c41-5e12-4d15-bcac-e6e0ef7b3079,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a7e8650dd78348d2a39479f92bd437c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T09:51:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T09:51:18Z,use_quota=True,user_id='26eb01189b144fc89ab296a2c8f7f66e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8989e4f-21e3-4f0a-9584-0d818784e883),volume_type_id=f8989e4f-21e3-4f0a-9584-0d818784e883)}" {{(pid=87272) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 04 10:51:18 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.remotefs [None req-650181c2-6dbe-4338-bd27-f5235c9555c0 tempest-DeleteServersTestJSON-1539023327 None] Creating volume 2d452c41-5e12-4d15-bcac-e6e0ef7b3079 {{(pid=87272) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 10:51:18 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-650181c2-6dbe-4338-bd27-f5235c9555c0 tempest-DeleteServersTestJSON-1539023327 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:51:18 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-650181c2-6dbe-4338-bd27-f5235c9555c0 tempest-DeleteServersTestJSON-1539023327 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:51:18 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-650181c2-6dbe-4338-bd27-f5235c9555c0 tempest-DeleteServersTestJSON-1539023327 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898': None} {{(pid=87272) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:51:18 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-650181c2-6dbe-4338-bd27-f5235c9555c0 tempest-DeleteServersTestJSON-1539023327 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'] {{(pid=87272) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:51:18 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-650181c2-6dbe-4338-bd27-f5235c9555c0 tempest-DeleteServersTestJSON-1539023327 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:51:18 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-650181c2-6dbe-4338-bd27-f5235c9555c0 tempest-DeleteServersTestJSON-1539023327 None] Selected osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898 as target Quobyte volume. {{(pid=87272) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 10:51:18 devstack cinder-volume[87272]: INFO cinder.volume.drivers.remotefs [None req-650181c2-6dbe-4338-bd27-f5235c9555c0 tempest-DeleteServersTestJSON-1539023327 None] casted to osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898 Nov 04 10:51:18 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-650181c2-6dbe-4338-bd27-f5235c9555c0 tempest-DeleteServersTestJSON-1539023327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-2d452c41-5e12-4d15-bcac-e6e0ef7b3079 1073741824 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:51:18 devstack sudo[89693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-2d452c41-5e12-4d15-bcac-e6e0ef7b3079 1073741824 Nov 04 10:51:18 devstack sudo[89693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:51:19 devstack sudo[89693]: pam_unix(sudo:session): session closed for user root Nov 04 10:51:19 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-650181c2-6dbe-4338-bd27-f5235c9555c0 tempest-DeleteServersTestJSON-1539023327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-2d452c41-5e12-4d15-bcac-e6e0ef7b3079 1073741824" returned: 0 in 0.958s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:51:19 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-650181c2-6dbe-4338-bd27-f5235c9555c0 tempest-DeleteServersTestJSON-1539023327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-2d452c41-5e12-4d15-bcac-e6e0ef7b3079 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:51:19 devstack sudo[89718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-2d452c41-5e12-4d15-bcac-e6e0ef7b3079 Nov 04 10:51:19 devstack sudo[89718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:51:20 devstack sudo[89718]: pam_unix(sudo:session): session closed for user root Nov 04 10:51:20 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-650181c2-6dbe-4338-bd27-f5235c9555c0 tempest-DeleteServersTestJSON-1539023327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-2d452c41-5e12-4d15-bcac-e6e0ef7b3079" returned: 0 in 0.601s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:51:20 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-650181c2-6dbe-4338-bd27-f5235c9555c0 tempest-DeleteServersTestJSON-1539023327 None] <== create_volume: return (1651ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'} {{(pid=87272) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 04 10:51:20 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-650181c2-6dbe-4338-bd27-f5235c9555c0 tempest-DeleteServersTestJSON-1539023327 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.654s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:51:20 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-650181c2-6dbe-4338-bd27-f5235c9555c0 tempest-DeleteServersTestJSON-1539023327 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (08537d8a-3bb5-40fe-9724-6bda84f25dda) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2d452c41-5e12-4d15-bcac-e6e0ef7b3079', 'volume_size': 1}' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:51:20 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-650181c2-6dbe-4338-bd27-f5235c9555c0 tempest-DeleteServersTestJSON-1539023327 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (330affe5-78c9-49cf-88cc-689a234a1365) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:51:20 devstack cinder-volume[87272]: INFO cinder.volume.flows.manager.create_volume [None req-650181c2-6dbe-4338-bd27-f5235c9555c0 tempest-DeleteServersTestJSON-1539023327 None] Volume volume-2d452c41-5e12-4d15-bcac-e6e0ef7b3079 (2d452c41-5e12-4d15-bcac-e6e0ef7b3079): created successfully Nov 04 10:51:20 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-650181c2-6dbe-4338-bd27-f5235c9555c0 tempest-DeleteServersTestJSON-1539023327 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (330affe5-78c9-49cf-88cc-689a234a1365) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:51:20 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-650181c2-6dbe-4338-bd27-f5235c9555c0 tempest-DeleteServersTestJSON-1539023327 None] Flow 'volume_create_manager' (4eb21a3b-f383-402f-a661-7f180acb5e3f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87272) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:51:20 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-650181c2-6dbe-4338-bd27-f5235c9555c0 tempest-DeleteServersTestJSON-1539023327 None] Created volume successfully. Nov 04 10:51:22 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [req-12595d28-1b9d-49ad-9806-fff8e5c9d261 req-d1b11483-faa3-4d60-af25-b4c508a30e18 tempest-DeleteServersTestJSON-1539023327 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:51:22 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [req-12595d28-1b9d-49ad-9806-fff8e5c9d261 req-d1b11483-faa3-4d60-af25-b4c508a30e18 tempest-DeleteServersTestJSON-1539023327 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.004s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:51:22 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [req-12595d28-1b9d-49ad-9806-fff8e5c9d261 req-d1b11483-faa3-4d60-af25-b4c508a30e18 tempest-DeleteServersTestJSON-1539023327 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.068s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:51:22 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [req-12595d28-1b9d-49ad-9806-fff8e5c9d261 req-d1b11483-faa3-4d60-af25-b4c508a30e18 tempest-DeleteServersTestJSON-1539023327 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898', 'name': 'volume-2d452c41-5e12-4d15-bcac-e6e0ef7b3079', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '58380743-b881-4753-bf86-8d637af59bad', 'enforce_multipath': True} {{(pid=87272) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 04 10:51:22 devstack cinder-volume[87272]: INFO cinder.volume.manager [req-12595d28-1b9d-49ad-9806-fff8e5c9d261 req-d1b11483-faa3-4d60-af25-b4c508a30e18 tempest-DeleteServersTestJSON-1539023327 None] attachment_update completed successfully. Nov 04 10:51:28 devstack cinder-volume[87272]: INFO cinder.volume.manager [req-a2404121-b591-4170-8852-111a0435df06 req-3723cb3c-9460-4266-8f91-5d25f22f3d9e tempest-DeleteServersTestJSON-1539023327 None] Terminate volume connection completed successfully. Nov 04 10:51:28 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [req-a2404121-b591-4170-8852-111a0435df06 req-3723cb3c-9460-4266-8f91-5d25f22f3d9e tempest-DeleteServersTestJSON-1539023327 None] Deleting attachment 58380743-b881-4753-bf86-8d637af59bad. {{(pid=87272) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 04 10:51:28 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-d10db620-4c75-4895-ab70-b2bdc3cf385a tempest-TaggedAttachmentsTest-911145822 None] Acquiring lock "cinder-b7c79776-1cbe-4a7f-8081-e4b479b6b035-delete_volume" by "delete_volume" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:51:28 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-d10db620-4c75-4895-ab70-b2bdc3cf385a tempest-TaggedAttachmentsTest-911145822 None] Lock "cinder-b7c79776-1cbe-4a7f-8081-e4b479b6b035-delete_volume" acquired by "delete_volume" :: waited 0.055s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:51:28 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-d10db620-4c75-4895-ab70-b2bdc3cf385a tempest-TaggedAttachmentsTest-911145822 None] Acquiring lock "cinder-quobyte-b7c79776-1cbe-4a7f-8081-e4b479b6b035" by "delete_volume" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:51:28 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-d10db620-4c75-4895-ab70-b2bdc3cf385a tempest-TaggedAttachmentsTest-911145822 None] Lock "cinder-quobyte-b7c79776-1cbe-4a7f-8081-e4b479b6b035" acquired by "delete_volume" :: waited 0.021s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:51:29 devstack cinder-volume[87272]: DEBUG oslo.privsep.daemon [-] privsep: reply[b50620c4-617e-4a91-bf28-e38825f683f3]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:51:29 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-d10db620-4c75-4895-ab70-b2bdc3cf385a tempest-TaggedAttachmentsTest-911145822 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-b7c79776-1cbe-4a7f-8081-e4b479b6b035 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:51:29 devstack sudo[90322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-b7c79776-1cbe-4a7f-8081-e4b479b6b035 Nov 04 10:51:29 devstack sudo[90322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:51:29 devstack sudo[90322]: pam_unix(sudo:session): session closed for user root Nov 04 10:51:29 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-d10db620-4c75-4895-ab70-b2bdc3cf385a tempest-TaggedAttachmentsTest-911145822 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-b7c79776-1cbe-4a7f-8081-e4b479b6b035" returned: 0 in 0.533s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:51:29 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-d10db620-4c75-4895-ab70-b2bdc3cf385a tempest-TaggedAttachmentsTest-911145822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-b7c79776-1cbe-4a7f-8081-e4b479b6b035 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:51:29 devstack sudo[90328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-b7c79776-1cbe-4a7f-8081-e4b479b6b035 Nov 04 10:51:29 devstack sudo[90328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:51:29 devstack sudo[90328]: pam_unix(sudo:session): session closed for user root Nov 04 10:51:29 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-d10db620-4c75-4895-ab70-b2bdc3cf385a tempest-TaggedAttachmentsTest-911145822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-b7c79776-1cbe-4a7f-8081-e4b479b6b035" returned: 0 in 0.288s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:51:29 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-d10db620-4c75-4895-ab70-b2bdc3cf385a tempest-TaggedAttachmentsTest-911145822 None] Lock "cinder-quobyte-b7c79776-1cbe-4a7f-8081-e4b479b6b035" released by "delete_volume" :: held 0.879s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:51:29 devstack cinder-volume[87272]: DEBUG cinder.quota [None req-d10db620-4c75-4895-ab70-b2bdc3cf385a tempest-TaggedAttachmentsTest-911145822 None] Created reservations ['1de1462e-98ed-4336-84fc-a5b3bc3cf4c9', '3d7b9a23-5549-402d-8f0d-41e38aafcad6', 'ebc805c9-b123-4705-a2fe-e02896aeac0d', '6ccf31a2-2631-4169-8a4c-80e1f44b3b72'] {{(pid=87272) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 10:51:29 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-7ebd30bf-2d87-4ffc-98f3-f8045d55de68 tempest-DeleteServersTestJSON-1539023327 None] Acquiring lock "cinder-2d452c41-5e12-4d15-bcac-e6e0ef7b3079-delete_volume" by "delete_volume" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:51:30 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-7ebd30bf-2d87-4ffc-98f3-f8045d55de68 tempest-DeleteServersTestJSON-1539023327 None] Lock "cinder-2d452c41-5e12-4d15-bcac-e6e0ef7b3079-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:51:30 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-7ebd30bf-2d87-4ffc-98f3-f8045d55de68 tempest-DeleteServersTestJSON-1539023327 None] Acquiring lock "cinder-quobyte-2d452c41-5e12-4d15-bcac-e6e0ef7b3079" by "delete_volume" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:51:30 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-d10db620-4c75-4895-ab70-b2bdc3cf385a tempest-TaggedAttachmentsTest-911145822 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:51:30 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-d10db620-4c75-4895-ab70-b2bdc3cf385a tempest-TaggedAttachmentsTest-911145822 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:51:30 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-d10db620-4c75-4895-ab70-b2bdc3cf385a tempest-TaggedAttachmentsTest-911145822 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898': None} {{(pid=87272) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:51:30 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-d10db620-4c75-4895-ab70-b2bdc3cf385a tempest-TaggedAttachmentsTest-911145822 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'] {{(pid=87272) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:51:30 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-d10db620-4c75-4895-ab70-b2bdc3cf385a tempest-TaggedAttachmentsTest-911145822 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:51:30 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-d10db620-4c75-4895-ab70-b2bdc3cf385a tempest-TaggedAttachmentsTest-911145822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:51:30 devstack sudo[90332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1 Nov 04 10:51:30 devstack sudo[90332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:51:30 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-7ebd30bf-2d87-4ffc-98f3-f8045d55de68 tempest-DeleteServersTestJSON-1539023327 None] Lock "cinder-quobyte-2d452c41-5e12-4d15-bcac-e6e0ef7b3079" acquired by "delete_volume" :: waited 0.053s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:51:30 devstack cinder-volume[87272]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a98127f-905c-40f3-93b6-b1daa4fed2fe]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:51:30 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-7ebd30bf-2d87-4ffc-98f3-f8045d55de68 tempest-DeleteServersTestJSON-1539023327 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-2d452c41-5e12-4d15-bcac-e6e0ef7b3079 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:51:30 devstack sudo[90334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-2d452c41-5e12-4d15-bcac-e6e0ef7b3079 Nov 04 10:51:30 devstack sudo[90334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:51:30 devstack sudo[90332]: pam_unix(sudo:session): session closed for user root Nov 04 10:51:30 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-d10db620-4c75-4895-ab70-b2bdc3cf385a tempest-TaggedAttachmentsTest-911145822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1" returned: 0 in 0.325s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:51:30 devstack cinder-volume[87272]: DEBUG cinder.manager [None req-d10db620-4c75-4895-ab70-b2bdc3cf385a tempest-TaggedAttachmentsTest-911145822 None] Notifying Schedulers of capabilities ... {{(pid=87272) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 10:51:30 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-d10db620-4c75-4895-ab70-b2bdc3cf385a tempest-TaggedAttachmentsTest-911145822 None] Deleted volume successfully. Nov 04 10:51:30 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-d10db620-4c75-4895-ab70-b2bdc3cf385a tempest-TaggedAttachmentsTest-911145822 None] Lock "cinder-b7c79776-1cbe-4a7f-8081-e4b479b6b035-delete_volume" released by "delete_volume" :: held 1.627s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:51:30 devstack sudo[90334]: pam_unix(sudo:session): session closed for user root Nov 04 10:51:30 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-7ebd30bf-2d87-4ffc-98f3-f8045d55de68 tempest-DeleteServersTestJSON-1539023327 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-2d452c41-5e12-4d15-bcac-e6e0ef7b3079" returned: 0 in 0.417s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:51:30 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-7ebd30bf-2d87-4ffc-98f3-f8045d55de68 tempest-DeleteServersTestJSON-1539023327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-2d452c41-5e12-4d15-bcac-e6e0ef7b3079 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:51:30 devstack sudo[90340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-2d452c41-5e12-4d15-bcac-e6e0ef7b3079 Nov 04 10:51:30 devstack sudo[90340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:51:30 devstack sudo[90340]: pam_unix(sudo:session): session closed for user root Nov 04 10:51:30 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-7ebd30bf-2d87-4ffc-98f3-f8045d55de68 tempest-DeleteServersTestJSON-1539023327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-2d452c41-5e12-4d15-bcac-e6e0ef7b3079" returned: 0 in 0.275s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:51:30 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-7ebd30bf-2d87-4ffc-98f3-f8045d55de68 tempest-DeleteServersTestJSON-1539023327 None] Lock "cinder-quobyte-2d452c41-5e12-4d15-bcac-e6e0ef7b3079" released by "delete_volume" :: held 0.748s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:51:31 devstack cinder-volume[87272]: DEBUG cinder.quota [None req-7ebd30bf-2d87-4ffc-98f3-f8045d55de68 tempest-DeleteServersTestJSON-1539023327 None] Created reservations ['3c3e2347-f9f8-45f1-82ef-0652bc95fc91', 'd6faf102-b290-42cb-a712-d74c586e7aa4', 'ab891ff2-1bc9-43af-97fb-e1f7a99d1e4e', 'aab092b9-653d-43e6-bf01-5fbdf396ef1d'] {{(pid=87272) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 10:51:31 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-7ebd30bf-2d87-4ffc-98f3-f8045d55de68 tempest-DeleteServersTestJSON-1539023327 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:51:31 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-7ebd30bf-2d87-4ffc-98f3-f8045d55de68 tempest-DeleteServersTestJSON-1539023327 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:51:31 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-7ebd30bf-2d87-4ffc-98f3-f8045d55de68 tempest-DeleteServersTestJSON-1539023327 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898': None} {{(pid=87272) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:51:31 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-7ebd30bf-2d87-4ffc-98f3-f8045d55de68 tempest-DeleteServersTestJSON-1539023327 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'] {{(pid=87272) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:51:31 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-7ebd30bf-2d87-4ffc-98f3-f8045d55de68 tempest-DeleteServersTestJSON-1539023327 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:51:31 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-7ebd30bf-2d87-4ffc-98f3-f8045d55de68 tempest-DeleteServersTestJSON-1539023327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:51:31 devstack sudo[90343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1 Nov 04 10:51:31 devstack sudo[90343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:51:31 devstack sudo[90343]: pam_unix(sudo:session): session closed for user root Nov 04 10:51:31 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-7ebd30bf-2d87-4ffc-98f3-f8045d55de68 tempest-DeleteServersTestJSON-1539023327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1" returned: 0 in 0.447s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:51:31 devstack cinder-volume[87272]: DEBUG cinder.manager [None req-7ebd30bf-2d87-4ffc-98f3-f8045d55de68 tempest-DeleteServersTestJSON-1539023327 None] Notifying Schedulers of capabilities ... {{(pid=87272) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 10:51:31 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-7ebd30bf-2d87-4ffc-98f3-f8045d55de68 tempest-DeleteServersTestJSON-1539023327 None] Deleted volume successfully. Nov 04 10:51:31 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-7ebd30bf-2d87-4ffc-98f3-f8045d55de68 tempest-DeleteServersTestJSON-1539023327 None] Lock "cinder-2d452c41-5e12-4d15-bcac-e6e0ef7b3079-delete_volume" released by "delete_volume" :: held 1.604s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:51:41 devstack cinder-volume[87272]: DEBUG dbcounter [-] [87272] Writing DB stats cinder:SELECT=27,cinder:UPDATE=20,cinder:INSERT=5,cinder:DELETE=1 {{(pid=87272) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 10:51:41 devstack cinder-volume[87272]: DEBUG dbcounter [-] [87272] Writing DB stats cinder:SELECT=29,cinder:UPDATE=24,cinder:INSERT=4,cinder:DELETE=2 {{(pid=87272) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 10:51:42 devstack cinder-volume[87272]: DEBUG cinder.volume.flows.manager.create_volume [None req-2476d417-70a0-41e7-9a33-fa3dafe8f92b tempest-VolumeSnapshotQuotasNegativeTestJSON-1096229834 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87272) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 10:51:42 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-2476d417-70a0-41e7-9a33-fa3dafe8f92b tempest-VolumeSnapshotQuotasNegativeTestJSON-1096229834 None] Flow 'volume_create_manager' (98dc30d5-91eb-49b3-8680-4a46fc71d762) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:51:42 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-2476d417-70a0-41e7-9a33-fa3dafe8f92b tempest-VolumeSnapshotQuotasNegativeTestJSON-1096229834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5cfdc71-913a-4454-9ce4-4145a6a0856d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:51:42 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-2476d417-70a0-41e7-9a33-fa3dafe8f92b tempest-VolumeSnapshotQuotasNegativeTestJSON-1096229834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5cfdc71-913a-4454-9ce4-4145a6a0856d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T09:51:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1848234734',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=42c4a801-4b7a-4eb1-b8e2-2b4c640b3fe6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f0bcb1f9002549ecaf79080fd4e3e80c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T09:51:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T09:51:42Z,use_quota=True,user_id='c91f7a1c172b4a469bd6267c9f5552d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8989e4f-21e3-4f0a-9584-0d818784e883),volume_type_id=f8989e4f-21e3-4f0a-9584-0d818784e883)' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:51:42 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-2476d417-70a0-41e7-9a33-fa3dafe8f92b tempest-VolumeSnapshotQuotasNegativeTestJSON-1096229834 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a6534968-b752-41b9-93c5-654993de8cb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:51:42 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-2476d417-70a0-41e7-9a33-fa3dafe8f92b tempest-VolumeSnapshotQuotasNegativeTestJSON-1096229834 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a6534968-b752-41b9-93c5-654993de8cb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:51:42 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-2476d417-70a0-41e7-9a33-fa3dafe8f92b tempest-VolumeSnapshotQuotasNegativeTestJSON-1096229834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11d0a6bd-1536-4eba-ad41-d8de91413a81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:51:42 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-2476d417-70a0-41e7-9a33-fa3dafe8f92b tempest-VolumeSnapshotQuotasNegativeTestJSON-1096229834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11d0a6bd-1536-4eba-ad41-d8de91413a81) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '42c4a801-4b7a-4eb1-b8e2-2b4c640b3fe6', 'volume_name': 'volume-42c4a801-4b7a-4eb1-b8e2-2b4c640b3fe6', 'volume_size': 1}' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:51:42 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-2476d417-70a0-41e7-9a33-fa3dafe8f92b tempest-VolumeSnapshotQuotasNegativeTestJSON-1096229834 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30b77666-24f7-4afe-9c5e-d8a4493b5d2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:51:42 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-2476d417-70a0-41e7-9a33-fa3dafe8f92b tempest-VolumeSnapshotQuotasNegativeTestJSON-1096229834 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30b77666-24f7-4afe-9c5e-d8a4493b5d2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:51:42 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-2476d417-70a0-41e7-9a33-fa3dafe8f92b tempest-VolumeSnapshotQuotasNegativeTestJSON-1096229834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a18a1ac8-290f-4598-999e-9e080b7dae29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:51:42 devstack cinder-volume[87272]: INFO cinder.volume.flows.manager.create_volume [None req-2476d417-70a0-41e7-9a33-fa3dafe8f92b tempest-VolumeSnapshotQuotasNegativeTestJSON-1096229834 None] Volume 42c4a801-4b7a-4eb1-b8e2-2b4c640b3fe6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-42c4a801-4b7a-4eb1-b8e2-2b4c640b3fe6', 'volume_size': 1} Nov 04 10:51:42 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-2476d417-70a0-41e7-9a33-fa3dafe8f92b tempest-VolumeSnapshotQuotasNegativeTestJSON-1096229834 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:51:42 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-2476d417-70a0-41e7-9a33-fa3dafe8f92b tempest-VolumeSnapshotQuotasNegativeTestJSON-1096229834 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:51:42 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-2476d417-70a0-41e7-9a33-fa3dafe8f92b tempest-VolumeSnapshotQuotasNegativeTestJSON-1096229834 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T09:51:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1848234734',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=42c4a801-4b7a-4eb1-b8e2-2b4c640b3fe6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f0bcb1f9002549ecaf79080fd4e3e80c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T09:51:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T09:51:42Z,use_quota=True,user_id='c91f7a1c172b4a469bd6267c9f5552d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8989e4f-21e3-4f0a-9584-0d818784e883),volume_type_id=f8989e4f-21e3-4f0a-9584-0d818784e883)}" {{(pid=87272) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 04 10:51:42 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.remotefs [None req-2476d417-70a0-41e7-9a33-fa3dafe8f92b tempest-VolumeSnapshotQuotasNegativeTestJSON-1096229834 None] Creating volume 42c4a801-4b7a-4eb1-b8e2-2b4c640b3fe6 {{(pid=87272) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 10:51:42 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-2476d417-70a0-41e7-9a33-fa3dafe8f92b tempest-VolumeSnapshotQuotasNegativeTestJSON-1096229834 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:51:42 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-2476d417-70a0-41e7-9a33-fa3dafe8f92b tempest-VolumeSnapshotQuotasNegativeTestJSON-1096229834 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:51:42 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-2476d417-70a0-41e7-9a33-fa3dafe8f92b tempest-VolumeSnapshotQuotasNegativeTestJSON-1096229834 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898': None} {{(pid=87272) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:51:42 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-2476d417-70a0-41e7-9a33-fa3dafe8f92b tempest-VolumeSnapshotQuotasNegativeTestJSON-1096229834 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'] {{(pid=87272) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:51:42 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-2476d417-70a0-41e7-9a33-fa3dafe8f92b tempest-VolumeSnapshotQuotasNegativeTestJSON-1096229834 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:51:42 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-2476d417-70a0-41e7-9a33-fa3dafe8f92b tempest-VolumeSnapshotQuotasNegativeTestJSON-1096229834 None] Selected osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898 as target Quobyte volume. {{(pid=87272) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 10:51:42 devstack cinder-volume[87272]: INFO cinder.volume.drivers.remotefs [None req-2476d417-70a0-41e7-9a33-fa3dafe8f92b tempest-VolumeSnapshotQuotasNegativeTestJSON-1096229834 None] casted to osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898 Nov 04 10:51:42 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-2476d417-70a0-41e7-9a33-fa3dafe8f92b tempest-VolumeSnapshotQuotasNegativeTestJSON-1096229834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-42c4a801-4b7a-4eb1-b8e2-2b4c640b3fe6 1073741824 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:51:42 devstack sudo[90369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-42c4a801-4b7a-4eb1-b8e2-2b4c640b3fe6 1073741824 Nov 04 10:51:42 devstack sudo[90369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:51:43 devstack sudo[90369]: pam_unix(sudo:session): session closed for user root Nov 04 10:51:43 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-2476d417-70a0-41e7-9a33-fa3dafe8f92b tempest-VolumeSnapshotQuotasNegativeTestJSON-1096229834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-42c4a801-4b7a-4eb1-b8e2-2b4c640b3fe6 1073741824" returned: 0 in 0.560s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:51:43 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-2476d417-70a0-41e7-9a33-fa3dafe8f92b tempest-VolumeSnapshotQuotasNegativeTestJSON-1096229834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-42c4a801-4b7a-4eb1-b8e2-2b4c640b3fe6 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:51:43 devstack sudo[90375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-42c4a801-4b7a-4eb1-b8e2-2b4c640b3fe6 Nov 04 10:51:43 devstack sudo[90375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:51:43 devstack sudo[90375]: pam_unix(sudo:session): session closed for user root Nov 04 10:51:43 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-2476d417-70a0-41e7-9a33-fa3dafe8f92b tempest-VolumeSnapshotQuotasNegativeTestJSON-1096229834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-42c4a801-4b7a-4eb1-b8e2-2b4c640b3fe6" returned: 0 in 0.255s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:51:43 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-2476d417-70a0-41e7-9a33-fa3dafe8f92b tempest-VolumeSnapshotQuotasNegativeTestJSON-1096229834 None] <== create_volume: return (863ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'} {{(pid=87272) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 04 10:51:43 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-2476d417-70a0-41e7-9a33-fa3dafe8f92b tempest-VolumeSnapshotQuotasNegativeTestJSON-1096229834 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.866s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:51:43 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-2476d417-70a0-41e7-9a33-fa3dafe8f92b tempest-VolumeSnapshotQuotasNegativeTestJSON-1096229834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a18a1ac8-290f-4598-999e-9e080b7dae29) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-42c4a801-4b7a-4eb1-b8e2-2b4c640b3fe6', 'volume_size': 1}' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:51:43 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-2476d417-70a0-41e7-9a33-fa3dafe8f92b tempest-VolumeSnapshotQuotasNegativeTestJSON-1096229834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b77bbd47-285e-4789-ade2-61de27af457e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:51:43 devstack cinder-volume[87272]: INFO cinder.volume.flows.manager.create_volume [None req-2476d417-70a0-41e7-9a33-fa3dafe8f92b tempest-VolumeSnapshotQuotasNegativeTestJSON-1096229834 None] Volume volume-42c4a801-4b7a-4eb1-b8e2-2b4c640b3fe6 (42c4a801-4b7a-4eb1-b8e2-2b4c640b3fe6): created successfully Nov 04 10:51:43 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-2476d417-70a0-41e7-9a33-fa3dafe8f92b tempest-VolumeSnapshotQuotasNegativeTestJSON-1096229834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b77bbd47-285e-4789-ade2-61de27af457e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:51:43 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-2476d417-70a0-41e7-9a33-fa3dafe8f92b tempest-VolumeSnapshotQuotasNegativeTestJSON-1096229834 None] Flow 'volume_create_manager' (98dc30d5-91eb-49b3-8680-4a46fc71d762) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87272) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:51:43 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-2476d417-70a0-41e7-9a33-fa3dafe8f92b tempest-VolumeSnapshotQuotasNegativeTestJSON-1096229834 None] Created volume successfully. Nov 04 10:51:44 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-2ae0cf6f-d8cc-49d5-8c95-247840d215c7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1096229834 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:51:44 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-2ae0cf6f-d8cc-49d5-8c95-247840d215c7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1096229834 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:51:44 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.remotefs [None req-2ae0cf6f-d8cc-49d5-8c95-247840d215c7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1096229834 None] Creating offline snapshot 90fa8834-614e-4116-9248-d1936124a933 of volume 42c4a801-4b7a-4eb1-b8e2-2b4c640b3fe6 {{(pid=87272) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 04 10:51:44 devstack cinder-volume[87272]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2524e40-6469-483f-a64f-aa9447b5b6ce]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:51:44 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-2ae0cf6f-d8cc-49d5-8c95-247840d215c7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1096229834 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-42c4a801-4b7a-4eb1-b8e2-2b4c640b3fe6 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:51:44 devstack sudo[90379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-42c4a801-4b7a-4eb1-b8e2-2b4c640b3fe6 Nov 04 10:51:44 devstack sudo[90379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:51:45 devstack sudo[90379]: pam_unix(sudo:session): session closed for user root Nov 04 10:51:45 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-2ae0cf6f-d8cc-49d5-8c95-247840d215c7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1096229834 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-42c4a801-4b7a-4eb1-b8e2-2b4c640b3fe6" returned: 0 in 0.453s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:51:45 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-2ae0cf6f-d8cc-49d5-8c95-247840d215c7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1096229834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-42c4a801-4b7a-4eb1-b8e2-2b4c640b3fe6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-42c4a801-4b7a-4eb1-b8e2-2b4c640b3fe6.90fa8834-614e-4116-9248-d1936124a933 1G {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:51:45 devstack sudo[90384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-42c4a801-4b7a-4eb1-b8e2-2b4c640b3fe6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-42c4a801-4b7a-4eb1-b8e2-2b4c640b3fe6.90fa8834-614e-4116-9248-d1936124a933 1G Nov 04 10:51:45 devstack sudo[90384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:51:45 devstack sudo[90384]: pam_unix(sudo:session): session closed for user root Nov 04 10:51:45 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-2ae0cf6f-d8cc-49d5-8c95-247840d215c7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1096229834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-42c4a801-4b7a-4eb1-b8e2-2b4c640b3fe6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-42c4a801-4b7a-4eb1-b8e2-2b4c640b3fe6.90fa8834-614e-4116-9248-d1936124a933 1G" returned: 0 in 0.572s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:51:45 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-2ae0cf6f-d8cc-49d5-8c95-247840d215c7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1096229834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-42c4a801-4b7a-4eb1-b8e2-2b4c640b3fe6 -F qcow2 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-42c4a801-4b7a-4eb1-b8e2-2b4c640b3fe6.90fa8834-614e-4116-9248-d1936124a933 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:51:45 devstack sudo[90391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-42c4a801-4b7a-4eb1-b8e2-2b4c640b3fe6 -F qcow2 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-42c4a801-4b7a-4eb1-b8e2-2b4c640b3fe6.90fa8834-614e-4116-9248-d1936124a933 Nov 04 10:51:45 devstack sudo[90391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:51:46 devstack sudo[90391]: pam_unix(sudo:session): session closed for user root Nov 04 10:51:46 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-2ae0cf6f-d8cc-49d5-8c95-247840d215c7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1096229834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-42c4a801-4b7a-4eb1-b8e2-2b4c640b3fe6 -F qcow2 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-42c4a801-4b7a-4eb1-b8e2-2b4c640b3fe6.90fa8834-614e-4116-9248-d1936124a933" returned: 0 in 0.493s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:51:46 devstack cinder-volume[87272]: WARNING cinder.volume.drivers.remotefs [None req-2ae0cf6f-d8cc-49d5-8c95-247840d215c7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1096229834 None] /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-42c4a801-4b7a-4eb1-b8e2-2b4c640b3fe6.90fa8834-614e-4116-9248-d1936124a933 is being set with open permissions: ugo+rw Nov 04 10:51:46 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-2ae0cf6f-d8cc-49d5-8c95-247840d215c7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1096229834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-42c4a801-4b7a-4eb1-b8e2-2b4c640b3fe6.90fa8834-614e-4116-9248-d1936124a933 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:51:46 devstack sudo[90397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-42c4a801-4b7a-4eb1-b8e2-2b4c640b3fe6.90fa8834-614e-4116-9248-d1936124a933 Nov 04 10:51:46 devstack sudo[90397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:51:46 devstack sudo[90397]: pam_unix(sudo:session): session closed for user root Nov 04 10:51:46 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-2ae0cf6f-d8cc-49d5-8c95-247840d215c7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1096229834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-42c4a801-4b7a-4eb1-b8e2-2b4c640b3fe6.90fa8834-614e-4116-9248-d1936124a933" returned: 0 in 0.422s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:51:46 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-2ae0cf6f-d8cc-49d5-8c95-247840d215c7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1096229834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-42c4a801-4b7a-4eb1-b8e2-2b4c640b3fe6.info {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:51:46 devstack sudo[90400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-42c4a801-4b7a-4eb1-b8e2-2b4c640b3fe6.info Nov 04 10:51:46 devstack sudo[90400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:51:47 devstack sudo[90400]: pam_unix(sudo:session): session closed for user root Nov 04 10:51:47 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-2ae0cf6f-d8cc-49d5-8c95-247840d215c7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1096229834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-42c4a801-4b7a-4eb1-b8e2-2b4c640b3fe6.info" returned: 0 in 0.287s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:51:47 devstack cinder-volume[87272]: WARNING cinder.volume.drivers.remotefs [None req-2ae0cf6f-d8cc-49d5-8c95-247840d215c7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1096229834 None] /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-42c4a801-4b7a-4eb1-b8e2-2b4c640b3fe6.info is being set with open permissions: ugo+rw Nov 04 10:51:47 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-2ae0cf6f-d8cc-49d5-8c95-247840d215c7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1096229834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-42c4a801-4b7a-4eb1-b8e2-2b4c640b3fe6.info {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:51:47 devstack sudo[90403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-42c4a801-4b7a-4eb1-b8e2-2b4c640b3fe6.info Nov 04 10:51:47 devstack sudo[90403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:51:47 devstack sudo[90403]: pam_unix(sudo:session): session closed for user root Nov 04 10:51:47 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-2ae0cf6f-d8cc-49d5-8c95-247840d215c7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1096229834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-42c4a801-4b7a-4eb1-b8e2-2b4c640b3fe6.info" returned: 0 in 0.268s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:51:47 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-2ae0cf6f-d8cc-49d5-8c95-247840d215c7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1096229834 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.619s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:51:47 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-2ae0cf6f-d8cc-49d5-8c95-247840d215c7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1096229834 None] Create snapshot completed successfully Nov 04 10:51:48 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-78bfa23c-29e6-4a8e-a844-7e7ec806f52c tempest-VolumeSnapshotQuotasNegativeTestJSON-1096229834 None] Acquiring lock "cinder-90fa8834-614e-4116-9248-d1936124a933-delete_snapshot" by "delete_snapshot" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:51:48 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-78bfa23c-29e6-4a8e-a844-7e7ec806f52c tempest-VolumeSnapshotQuotasNegativeTestJSON-1096229834 None] Lock "cinder-90fa8834-614e-4116-9248-d1936124a933-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:51:48 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-78bfa23c-29e6-4a8e-a844-7e7ec806f52c tempest-VolumeSnapshotQuotasNegativeTestJSON-1096229834 None] Acquiring lock "cinder-quobyte-42c4a801-4b7a-4eb1-b8e2-2b4c640b3fe6" by "delete_snapshot" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:51:48 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-78bfa23c-29e6-4a8e-a844-7e7ec806f52c tempest-VolumeSnapshotQuotasNegativeTestJSON-1096229834 None] Lock "cinder-quobyte-42c4a801-4b7a-4eb1-b8e2-2b4c640b3fe6" acquired by "delete_snapshot" :: waited 0.032s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:51:48 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-78bfa23c-29e6-4a8e-a844-7e7ec806f52c tempest-VolumeSnapshotQuotasNegativeTestJSON-1096229834 None] Acquiring lock "cinder-quobyte-90fa8834-614e-4116-9248-d1936124a933" by "_delete_snapshot" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:51:48 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-78bfa23c-29e6-4a8e-a844-7e7ec806f52c tempest-VolumeSnapshotQuotasNegativeTestJSON-1096229834 None] Lock "cinder-quobyte-90fa8834-614e-4116-9248-d1936124a933" acquired by "_delete_snapshot" :: waited 0.042s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:51:48 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.remotefs [None req-78bfa23c-29e6-4a8e-a844-7e7ec806f52c tempest-VolumeSnapshotQuotasNegativeTestJSON-1096229834 None] Deleting offline snapshot 90fa8834-614e-4116-9248-d1936124a933 of volume 42c4a801-4b7a-4eb1-b8e2-2b4c640b3fe6 {{(pid=87272) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 04 10:51:48 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.remotefs [None req-78bfa23c-29e6-4a8e-a844-7e7ec806f52c tempest-VolumeSnapshotQuotasNegativeTestJSON-1096229834 None] snapshot_file for this snap is: volume-42c4a801-4b7a-4eb1-b8e2-2b4c640b3fe6.90fa8834-614e-4116-9248-d1936124a933 {{(pid=87272) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 04 10:51:48 devstack cinder-volume[87272]: DEBUG oslo.privsep.daemon [-] privsep: reply[adfafab0-0084-48a3-ac9a-be3ca6697382]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:51:48 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-78bfa23c-29e6-4a8e-a844-7e7ec806f52c tempest-VolumeSnapshotQuotasNegativeTestJSON-1096229834 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-42c4a801-4b7a-4eb1-b8e2-2b4c640b3fe6.90fa8834-614e-4116-9248-d1936124a933 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:51:48 devstack sudo[90408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-42c4a801-4b7a-4eb1-b8e2-2b4c640b3fe6.90fa8834-614e-4116-9248-d1936124a933 Nov 04 10:51:48 devstack sudo[90408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:51:49 devstack sudo[90408]: pam_unix(sudo:session): session closed for user root Nov 04 10:51:49 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-78bfa23c-29e6-4a8e-a844-7e7ec806f52c tempest-VolumeSnapshotQuotasNegativeTestJSON-1096229834 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-42c4a801-4b7a-4eb1-b8e2-2b4c640b3fe6.90fa8834-614e-4116-9248-d1936124a933" returned: 0 in 0.519s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:51:49 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.remotefs [None req-78bfa23c-29e6-4a8e-a844-7e7ec806f52c tempest-VolumeSnapshotQuotasNegativeTestJSON-1096229834 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-42c4a801-4b7a-4eb1-b8e2-2b4c640b3fe6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87272) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 10:51:49 devstack cinder-volume[87272]: DEBUG oslo.privsep.daemon [-] privsep: reply[5896459d-f091-4bd0-84a1-283fa7aaa9bb]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:51:49 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-78bfa23c-29e6-4a8e-a844-7e7ec806f52c tempest-VolumeSnapshotQuotasNegativeTestJSON-1096229834 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-42c4a801-4b7a-4eb1-b8e2-2b4c640b3fe6 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:51:49 devstack sudo[90415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-42c4a801-4b7a-4eb1-b8e2-2b4c640b3fe6 Nov 04 10:51:49 devstack sudo[90415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:51:49 devstack sudo[90415]: pam_unix(sudo:session): session closed for user root Nov 04 10:51:49 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-78bfa23c-29e6-4a8e-a844-7e7ec806f52c tempest-VolumeSnapshotQuotasNegativeTestJSON-1096229834 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-42c4a801-4b7a-4eb1-b8e2-2b4c640b3fe6" returned: 0 in 0.621s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:51:49 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-78bfa23c-29e6-4a8e-a844-7e7ec806f52c tempest-VolumeSnapshotQuotasNegativeTestJSON-1096229834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-42c4a801-4b7a-4eb1-b8e2-2b4c640b3fe6.90fa8834-614e-4116-9248-d1936124a933 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:51:49 devstack sudo[90440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-42c4a801-4b7a-4eb1-b8e2-2b4c640b3fe6.90fa8834-614e-4116-9248-d1936124a933 Nov 04 10:51:49 devstack sudo[90440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:51:50 devstack sudo[90440]: pam_unix(sudo:session): session closed for user root Nov 04 10:51:50 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-78bfa23c-29e6-4a8e-a844-7e7ec806f52c tempest-VolumeSnapshotQuotasNegativeTestJSON-1096229834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-42c4a801-4b7a-4eb1-b8e2-2b4c640b3fe6.90fa8834-614e-4116-9248-d1936124a933" returned: 0 in 0.410s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:51:50 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-78bfa23c-29e6-4a8e-a844-7e7ec806f52c tempest-VolumeSnapshotQuotasNegativeTestJSON-1096229834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-42c4a801-4b7a-4eb1-b8e2-2b4c640b3fe6.90fa8834-614e-4116-9248-d1936124a933 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:51:50 devstack sudo[90445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-42c4a801-4b7a-4eb1-b8e2-2b4c640b3fe6.90fa8834-614e-4116-9248-d1936124a933 Nov 04 10:51:50 devstack sudo[90445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:51:50 devstack sudo[90445]: pam_unix(sudo:session): session closed for user root Nov 04 10:51:50 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-78bfa23c-29e6-4a8e-a844-7e7ec806f52c tempest-VolumeSnapshotQuotasNegativeTestJSON-1096229834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-42c4a801-4b7a-4eb1-b8e2-2b4c640b3fe6.90fa8834-614e-4116-9248-d1936124a933" returned: 0 in 0.356s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:51:50 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-78bfa23c-29e6-4a8e-a844-7e7ec806f52c tempest-VolumeSnapshotQuotasNegativeTestJSON-1096229834 None] Lock "cinder-quobyte-90fa8834-614e-4116-9248-d1936124a933" released by "_delete_snapshot" :: held 2.129s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:51:50 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-78bfa23c-29e6-4a8e-a844-7e7ec806f52c tempest-VolumeSnapshotQuotasNegativeTestJSON-1096229834 None] Lock "cinder-quobyte-42c4a801-4b7a-4eb1-b8e2-2b4c640b3fe6" released by "delete_snapshot" :: held 2.184s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:51:50 devstack cinder-volume[87272]: WARNING cinder.quota [None req-78bfa23c-29e6-4a8e-a844-7e7ec806f52c tempest-VolumeSnapshotQuotasNegativeTestJSON-1096229834 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Nov 04 10:51:50 devstack cinder-volume[87272]: DEBUG cinder.quota [None req-78bfa23c-29e6-4a8e-a844-7e7ec806f52c tempest-VolumeSnapshotQuotasNegativeTestJSON-1096229834 None] Created reservations ['92170451-fda8-4ea3-bae9-a60958330590', '87b649fc-254e-4191-9854-afbe15918224', '7d0b943b-194f-4d1c-8297-ca22657eeecf', '9868af6d-8929-4b06-aebe-ec559911f353'] {{(pid=87272) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 10:51:50 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-78bfa23c-29e6-4a8e-a844-7e7ec806f52c tempest-VolumeSnapshotQuotasNegativeTestJSON-1096229834 None] Delete snapshot completed successfully. Nov 04 10:51:50 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-78bfa23c-29e6-4a8e-a844-7e7ec806f52c tempest-VolumeSnapshotQuotasNegativeTestJSON-1096229834 None] Lock "cinder-90fa8834-614e-4116-9248-d1936124a933-delete_snapshot" released by "delete_snapshot" :: held 2.381s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:51:51 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-5b03524b-25c9-4a4b-acc0-50cc5676386a tempest-VolumeSnapshotQuotasNegativeTestJSON-1096229834 None] Acquiring lock "cinder-42c4a801-4b7a-4eb1-b8e2-2b4c640b3fe6-delete_volume" by "delete_volume" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:51:51 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-5b03524b-25c9-4a4b-acc0-50cc5676386a tempest-VolumeSnapshotQuotasNegativeTestJSON-1096229834 None] Lock "cinder-42c4a801-4b7a-4eb1-b8e2-2b4c640b3fe6-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:51:51 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-5b03524b-25c9-4a4b-acc0-50cc5676386a tempest-VolumeSnapshotQuotasNegativeTestJSON-1096229834 None] Acquiring lock "cinder-quobyte-42c4a801-4b7a-4eb1-b8e2-2b4c640b3fe6" by "delete_volume" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:51:52 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-5b03524b-25c9-4a4b-acc0-50cc5676386a tempest-VolumeSnapshotQuotasNegativeTestJSON-1096229834 None] Lock "cinder-quobyte-42c4a801-4b7a-4eb1-b8e2-2b4c640b3fe6" acquired by "delete_volume" :: waited 0.024s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:51:52 devstack cinder-volume[87272]: DEBUG oslo.privsep.daemon [-] privsep: reply[b056cf46-75a8-4ab4-abd1-7c8887c086b3]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:51:52 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-5b03524b-25c9-4a4b-acc0-50cc5676386a tempest-VolumeSnapshotQuotasNegativeTestJSON-1096229834 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-42c4a801-4b7a-4eb1-b8e2-2b4c640b3fe6 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:51:52 devstack sudo[90451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-42c4a801-4b7a-4eb1-b8e2-2b4c640b3fe6 Nov 04 10:51:52 devstack sudo[90451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:51:52 devstack sudo[90451]: pam_unix(sudo:session): session closed for user root Nov 04 10:51:52 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-5b03524b-25c9-4a4b-acc0-50cc5676386a tempest-VolumeSnapshotQuotasNegativeTestJSON-1096229834 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-42c4a801-4b7a-4eb1-b8e2-2b4c640b3fe6" returned: 0 in 0.414s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:51:52 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-5b03524b-25c9-4a4b-acc0-50cc5676386a tempest-VolumeSnapshotQuotasNegativeTestJSON-1096229834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-42c4a801-4b7a-4eb1-b8e2-2b4c640b3fe6 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:51:52 devstack sudo[90457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-42c4a801-4b7a-4eb1-b8e2-2b4c640b3fe6 Nov 04 10:51:52 devstack sudo[90457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:51:52 devstack sudo[90457]: pam_unix(sudo:session): session closed for user root Nov 04 10:51:52 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-5b03524b-25c9-4a4b-acc0-50cc5676386a tempest-VolumeSnapshotQuotasNegativeTestJSON-1096229834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-42c4a801-4b7a-4eb1-b8e2-2b4c640b3fe6" returned: 0 in 0.280s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:51:52 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-5b03524b-25c9-4a4b-acc0-50cc5676386a tempest-VolumeSnapshotQuotasNegativeTestJSON-1096229834 None] Lock "cinder-quobyte-42c4a801-4b7a-4eb1-b8e2-2b4c640b3fe6" released by "delete_volume" :: held 0.788s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:51:52 devstack cinder-volume[87272]: DEBUG cinder.quota [None req-5b03524b-25c9-4a4b-acc0-50cc5676386a tempest-VolumeSnapshotQuotasNegativeTestJSON-1096229834 None] Created reservations ['c1bcd239-b4d4-4bc7-a404-bb53a054919c', 'a0bdb81e-d66a-48ba-861c-b3aa7f895229', '514414c2-d75f-49ec-91c5-01e0da25f7a0', 'b818916a-f2a9-47b3-bf09-c84e41522982'] {{(pid=87272) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 10:51:52 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-5b03524b-25c9-4a4b-acc0-50cc5676386a tempest-VolumeSnapshotQuotasNegativeTestJSON-1096229834 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:51:52 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-5b03524b-25c9-4a4b-acc0-50cc5676386a tempest-VolumeSnapshotQuotasNegativeTestJSON-1096229834 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:51:52 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-5b03524b-25c9-4a4b-acc0-50cc5676386a tempest-VolumeSnapshotQuotasNegativeTestJSON-1096229834 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898': None} {{(pid=87272) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:51:52 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-5b03524b-25c9-4a4b-acc0-50cc5676386a tempest-VolumeSnapshotQuotasNegativeTestJSON-1096229834 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'] {{(pid=87272) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:51:52 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-5b03524b-25c9-4a4b-acc0-50cc5676386a tempest-VolumeSnapshotQuotasNegativeTestJSON-1096229834 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:51:52 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-5b03524b-25c9-4a4b-acc0-50cc5676386a tempest-VolumeSnapshotQuotasNegativeTestJSON-1096229834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:51:53 devstack sudo[90461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1 Nov 04 10:51:53 devstack sudo[90461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:51:53 devstack sudo[90461]: pam_unix(sudo:session): session closed for user root Nov 04 10:51:53 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-5b03524b-25c9-4a4b-acc0-50cc5676386a tempest-VolumeSnapshotQuotasNegativeTestJSON-1096229834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1" returned: 0 in 0.442s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:51:53 devstack cinder-volume[87272]: DEBUG cinder.manager [None req-5b03524b-25c9-4a4b-acc0-50cc5676386a tempest-VolumeSnapshotQuotasNegativeTestJSON-1096229834 None] Notifying Schedulers of capabilities ... {{(pid=87272) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 10:51:53 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-5b03524b-25c9-4a4b-acc0-50cc5676386a tempest-VolumeSnapshotQuotasNegativeTestJSON-1096229834 None] Deleted volume successfully. Nov 04 10:51:53 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-5b03524b-25c9-4a4b-acc0-50cc5676386a tempest-VolumeSnapshotQuotasNegativeTestJSON-1096229834 None] Lock "cinder-42c4a801-4b7a-4eb1-b8e2-2b4c640b3fe6-delete_volume" released by "delete_volume" :: held 1.517s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:52:02 devstack cinder-volume[87272]: DEBUG dbcounter [-] [87272] Writing DB stats cinder:SELECT=16,cinder:UPDATE=20,cinder:INSERT=5,cinder:DELETE=1 {{(pid=87272) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 10:52:03 devstack cinder-volume[87272]: DEBUG dbcounter [-] [87272] Writing DB stats cinder:UPDATE=16,cinder:SELECT=16,cinder:DELETE=2,cinder:INSERT=5 {{(pid=87272) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 10:52:14 devstack cinder-volume[87272]: DEBUG oslo_service.periodic_task [None req-236af0be-7f9d-4c80-b3d7-d645a9cd0dd1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87272) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 04 10:52:14 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-236af0be-7f9d-4c80-b3d7-d645a9cd0dd1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:52:14 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-236af0be-7f9d-4c80-b3d7-d645a9cd0dd1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:52:14 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-236af0be-7f9d-4c80-b3d7-d645a9cd0dd1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898': None} {{(pid=87272) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:52:14 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-236af0be-7f9d-4c80-b3d7-d645a9cd0dd1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'] {{(pid=87272) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:52:14 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-236af0be-7f9d-4c80-b3d7-d645a9cd0dd1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:52:14 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-236af0be-7f9d-4c80-b3d7-d645a9cd0dd1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:52:14 devstack sudo[90539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1 Nov 04 10:52:14 devstack sudo[90539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:52:14 devstack sudo[90539]: pam_unix(sudo:session): session closed for user root Nov 04 10:52:14 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-236af0be-7f9d-4c80-b3d7-d645a9cd0dd1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1" returned: 0 in 0.332s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:52:14 devstack cinder-volume[87272]: DEBUG cinder.manager [None req-236af0be-7f9d-4c80-b3d7-d645a9cd0dd1 None None] Notifying Schedulers of capabilities ... {{(pid=87272) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 10:52:14 devstack cinder-volume[87272]: DEBUG oslo_service.periodic_task [None req-236af0be-7f9d-4c80-b3d7-d645a9cd0dd1 None None] Running periodic task VolumeManager._thread_info {{(pid=87272) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 04 10:52:14 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-236af0be-7f9d-4c80-b3d7-d645a9cd0dd1 None None] thread count: 8 {{(pid=87272) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 04 10:52:14 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-236af0be-7f9d-4c80-b3d7-d645a9cd0dd1 None None] thread info: [<_MainThread(MainThread, started 127085713244288)>, , , , , , , ] {{(pid=87272) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 04 10:52:46 devstack cinder-volume[87272]: DEBUG cinder.volume.flows.manager.create_volume [None req-8c149f3b-41ee-4504-b4af-ec07ba6e9ab2 tempest-VolumesActionsTest-1874813921 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87272) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 10:52:46 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-8c149f3b-41ee-4504-b4af-ec07ba6e9ab2 tempest-VolumesActionsTest-1874813921 None] Flow 'volume_create_manager' (765ba12e-2a56-4dab-9d90-30a8676a25b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:52:46 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-8c149f3b-41ee-4504-b4af-ec07ba6e9ab2 tempest-VolumesActionsTest-1874813921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87604b3e-341a-44a6-b771-3d9f593ab055) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:52:46 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-8c149f3b-41ee-4504-b4af-ec07ba6e9ab2 tempest-VolumesActionsTest-1874813921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87604b3e-341a-44a6-b771-3d9f593ab055) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T09:52:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1851616368',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=171be892-1afe-47c7-b8fd-915686e6d751,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ebc5facbf73344079918d4c6828b6985',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T09:52:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T09:52:46Z,use_quota=True,user_id='bb73b98c6b6748899fe24acefca7dde5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8989e4f-21e3-4f0a-9584-0d818784e883),volume_type_id=f8989e4f-21e3-4f0a-9584-0d818784e883)' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:52:46 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-8c149f3b-41ee-4504-b4af-ec07ba6e9ab2 tempest-VolumesActionsTest-1874813921 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (31a90c86-1e50-4aae-ae9b-9a4906546a22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:52:46 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-8c149f3b-41ee-4504-b4af-ec07ba6e9ab2 tempest-VolumesActionsTest-1874813921 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (31a90c86-1e50-4aae-ae9b-9a4906546a22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:52:46 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-8c149f3b-41ee-4504-b4af-ec07ba6e9ab2 tempest-VolumesActionsTest-1874813921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b0d2120-ef7c-43ad-bb4e-079b94d9e328) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:52:46 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-8c149f3b-41ee-4504-b4af-ec07ba6e9ab2 tempest-VolumesActionsTest-1874813921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b0d2120-ef7c-43ad-bb4e-079b94d9e328) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '171be892-1afe-47c7-b8fd-915686e6d751', 'volume_name': 'volume-171be892-1afe-47c7-b8fd-915686e6d751', 'volume_size': 1}' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:52:46 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-8c149f3b-41ee-4504-b4af-ec07ba6e9ab2 tempest-VolumesActionsTest-1874813921 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63bbbc2c-fca7-42b4-a909-51c0fcf1ee02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:52:46 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-8c149f3b-41ee-4504-b4af-ec07ba6e9ab2 tempest-VolumesActionsTest-1874813921 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63bbbc2c-fca7-42b4-a909-51c0fcf1ee02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:52:46 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-8c149f3b-41ee-4504-b4af-ec07ba6e9ab2 tempest-VolumesActionsTest-1874813921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (51f8e8ae-6707-424c-ab1a-05dc2e792567) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:52:46 devstack cinder-volume[87272]: INFO cinder.volume.flows.manager.create_volume [None req-8c149f3b-41ee-4504-b4af-ec07ba6e9ab2 tempest-VolumesActionsTest-1874813921 None] Volume 171be892-1afe-47c7-b8fd-915686e6d751: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-171be892-1afe-47c7-b8fd-915686e6d751', 'volume_size': 1} Nov 04 10:52:46 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-8c149f3b-41ee-4504-b4af-ec07ba6e9ab2 tempest-VolumesActionsTest-1874813921 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:52:46 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-8c149f3b-41ee-4504-b4af-ec07ba6e9ab2 tempest-VolumesActionsTest-1874813921 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:52:46 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-8c149f3b-41ee-4504-b4af-ec07ba6e9ab2 tempest-VolumesActionsTest-1874813921 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T09:52:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1851616368',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=171be892-1afe-47c7-b8fd-915686e6d751,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ebc5facbf73344079918d4c6828b6985',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T09:52:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T09:52:46Z,use_quota=True,user_id='bb73b98c6b6748899fe24acefca7dde5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8989e4f-21e3-4f0a-9584-0d818784e883),volume_type_id=f8989e4f-21e3-4f0a-9584-0d818784e883)}" {{(pid=87272) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 04 10:52:46 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.remotefs [None req-8c149f3b-41ee-4504-b4af-ec07ba6e9ab2 tempest-VolumesActionsTest-1874813921 None] Creating volume 171be892-1afe-47c7-b8fd-915686e6d751 {{(pid=87272) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 10:52:46 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-8c149f3b-41ee-4504-b4af-ec07ba6e9ab2 tempest-VolumesActionsTest-1874813921 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:52:46 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-8c149f3b-41ee-4504-b4af-ec07ba6e9ab2 tempest-VolumesActionsTest-1874813921 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:52:46 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-8c149f3b-41ee-4504-b4af-ec07ba6e9ab2 tempest-VolumesActionsTest-1874813921 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898': None} {{(pid=87272) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:52:46 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-8c149f3b-41ee-4504-b4af-ec07ba6e9ab2 tempest-VolumesActionsTest-1874813921 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'] {{(pid=87272) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:52:46 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-8c149f3b-41ee-4504-b4af-ec07ba6e9ab2 tempest-VolumesActionsTest-1874813921 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:52:46 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-8c149f3b-41ee-4504-b4af-ec07ba6e9ab2 tempest-VolumesActionsTest-1874813921 None] Selected osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898 as target Quobyte volume. {{(pid=87272) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 10:52:46 devstack cinder-volume[87272]: INFO cinder.volume.drivers.remotefs [None req-8c149f3b-41ee-4504-b4af-ec07ba6e9ab2 tempest-VolumesActionsTest-1874813921 None] casted to osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898 Nov 04 10:52:46 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-8c149f3b-41ee-4504-b4af-ec07ba6e9ab2 tempest-VolumesActionsTest-1874813921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-171be892-1afe-47c7-b8fd-915686e6d751 1073741824 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:52:46 devstack sudo[91043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-171be892-1afe-47c7-b8fd-915686e6d751 1073741824 Nov 04 10:52:46 devstack sudo[91043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:52:46 devstack cinder-volume[87272]: DEBUG cinder.volume.flows.manager.create_volume [None req-970ef51e-2d88-4b0f-b41c-36153e85d0a1 tempest-AttachVolumeShelveTestJSON-1521270859 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87272) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 10:52:46 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-970ef51e-2d88-4b0f-b41c-36153e85d0a1 tempest-AttachVolumeShelveTestJSON-1521270859 None] Flow 'volume_create_manager' (50833b30-0514-4e9c-a7f5-765accdc8961) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:52:46 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-970ef51e-2d88-4b0f-b41c-36153e85d0a1 tempest-AttachVolumeShelveTestJSON-1521270859 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c568dd01-9f74-4df2-9277-45e385c6a7b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:52:46 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-970ef51e-2d88-4b0f-b41c-36153e85d0a1 tempest-AttachVolumeShelveTestJSON-1521270859 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c568dd01-9f74-4df2-9277-45e385c6a7b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T09:52:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1510325271',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b7746f4-19db-407d-ac88-9f929bfb64b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d338c2dbba94e8db40927b0423baafe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T09:52:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T09:52:47Z,use_quota=True,user_id='b1aa71e7e7fa4e66826f6a3b4f89b766',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8989e4f-21e3-4f0a-9584-0d818784e883),volume_type_id=f8989e4f-21e3-4f0a-9584-0d818784e883)' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:52:46 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-970ef51e-2d88-4b0f-b41c-36153e85d0a1 tempest-AttachVolumeShelveTestJSON-1521270859 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (91df69f9-3057-4ebc-b9e7-f17d6f58e5cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:52:46 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-970ef51e-2d88-4b0f-b41c-36153e85d0a1 tempest-AttachVolumeShelveTestJSON-1521270859 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (91df69f9-3057-4ebc-b9e7-f17d6f58e5cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:52:46 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-970ef51e-2d88-4b0f-b41c-36153e85d0a1 tempest-AttachVolumeShelveTestJSON-1521270859 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9837616b-c6b9-40d7-974e-758c9bb86dd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:52:46 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-970ef51e-2d88-4b0f-b41c-36153e85d0a1 tempest-AttachVolumeShelveTestJSON-1521270859 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9837616b-c6b9-40d7-974e-758c9bb86dd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9b7746f4-19db-407d-ac88-9f929bfb64b7', 'volume_name': 'volume-9b7746f4-19db-407d-ac88-9f929bfb64b7', 'volume_size': 1}' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:52:46 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-970ef51e-2d88-4b0f-b41c-36153e85d0a1 tempest-AttachVolumeShelveTestJSON-1521270859 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6671c222-70dc-4723-8882-cb2096263cca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:52:46 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-970ef51e-2d88-4b0f-b41c-36153e85d0a1 tempest-AttachVolumeShelveTestJSON-1521270859 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6671c222-70dc-4723-8882-cb2096263cca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:52:46 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-970ef51e-2d88-4b0f-b41c-36153e85d0a1 tempest-AttachVolumeShelveTestJSON-1521270859 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c1acc29-1929-4a2e-bc07-61a076239c74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:52:46 devstack cinder-volume[87272]: INFO cinder.volume.flows.manager.create_volume [None req-970ef51e-2d88-4b0f-b41c-36153e85d0a1 tempest-AttachVolumeShelveTestJSON-1521270859 None] Volume 9b7746f4-19db-407d-ac88-9f929bfb64b7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9b7746f4-19db-407d-ac88-9f929bfb64b7', 'volume_size': 1} Nov 04 10:52:46 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-970ef51e-2d88-4b0f-b41c-36153e85d0a1 tempest-AttachVolumeShelveTestJSON-1521270859 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:52:47 devstack sudo[91043]: pam_unix(sudo:session): session closed for user root Nov 04 10:52:47 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-8c149f3b-41ee-4504-b4af-ec07ba6e9ab2 tempest-VolumesActionsTest-1874813921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-171be892-1afe-47c7-b8fd-915686e6d751 1073741824" returned: 0 in 0.600s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:52:47 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-8c149f3b-41ee-4504-b4af-ec07ba6e9ab2 tempest-VolumesActionsTest-1874813921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-171be892-1afe-47c7-b8fd-915686e6d751 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:52:47 devstack sudo[91049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-171be892-1afe-47c7-b8fd-915686e6d751 Nov 04 10:52:47 devstack sudo[91049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:52:47 devstack sudo[91049]: pam_unix(sudo:session): session closed for user root Nov 04 10:52:47 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-8c149f3b-41ee-4504-b4af-ec07ba6e9ab2 tempest-VolumesActionsTest-1874813921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-171be892-1afe-47c7-b8fd-915686e6d751" returned: 0 in 0.274s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:52:47 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-8c149f3b-41ee-4504-b4af-ec07ba6e9ab2 tempest-VolumesActionsTest-1874813921 None] <== create_volume: return (970ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'} {{(pid=87272) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 04 10:52:47 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-8c149f3b-41ee-4504-b4af-ec07ba6e9ab2 tempest-VolumesActionsTest-1874813921 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.973s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:52:47 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-970ef51e-2d88-4b0f-b41c-36153e85d0a1 tempest-AttachVolumeShelveTestJSON-1521270859 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.792s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:52:47 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-970ef51e-2d88-4b0f-b41c-36153e85d0a1 tempest-AttachVolumeShelveTestJSON-1521270859 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T09:52:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1510325271',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b7746f4-19db-407d-ac88-9f929bfb64b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d338c2dbba94e8db40927b0423baafe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T09:52:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T09:52:47Z,use_quota=True,user_id='b1aa71e7e7fa4e66826f6a3b4f89b766',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8989e4f-21e3-4f0a-9584-0d818784e883),volume_type_id=f8989e4f-21e3-4f0a-9584-0d818784e883)}" {{(pid=87272) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 04 10:52:47 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.remotefs [None req-970ef51e-2d88-4b0f-b41c-36153e85d0a1 tempest-AttachVolumeShelveTestJSON-1521270859 None] Creating volume 9b7746f4-19db-407d-ac88-9f929bfb64b7 {{(pid=87272) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 10:52:47 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-970ef51e-2d88-4b0f-b41c-36153e85d0a1 tempest-AttachVolumeShelveTestJSON-1521270859 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:52:47 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-970ef51e-2d88-4b0f-b41c-36153e85d0a1 tempest-AttachVolumeShelveTestJSON-1521270859 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:52:47 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-970ef51e-2d88-4b0f-b41c-36153e85d0a1 tempest-AttachVolumeShelveTestJSON-1521270859 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898': None} {{(pid=87272) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:52:47 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-970ef51e-2d88-4b0f-b41c-36153e85d0a1 tempest-AttachVolumeShelveTestJSON-1521270859 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'] {{(pid=87272) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:52:47 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-970ef51e-2d88-4b0f-b41c-36153e85d0a1 tempest-AttachVolumeShelveTestJSON-1521270859 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:52:47 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-970ef51e-2d88-4b0f-b41c-36153e85d0a1 tempest-AttachVolumeShelveTestJSON-1521270859 None] Selected osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898 as target Quobyte volume. {{(pid=87272) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 10:52:47 devstack cinder-volume[87272]: INFO cinder.volume.drivers.remotefs [None req-970ef51e-2d88-4b0f-b41c-36153e85d0a1 tempest-AttachVolumeShelveTestJSON-1521270859 None] casted to osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898 Nov 04 10:52:47 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-970ef51e-2d88-4b0f-b41c-36153e85d0a1 tempest-AttachVolumeShelveTestJSON-1521270859 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-9b7746f4-19db-407d-ac88-9f929bfb64b7 1073741824 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:52:47 devstack sudo[91052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-9b7746f4-19db-407d-ac88-9f929bfb64b7 1073741824 Nov 04 10:52:47 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-8c149f3b-41ee-4504-b4af-ec07ba6e9ab2 tempest-VolumesActionsTest-1874813921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (51f8e8ae-6707-424c-ab1a-05dc2e792567) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-171be892-1afe-47c7-b8fd-915686e6d751', 'volume_size': 1}' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:52:47 devstack sudo[91052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:52:47 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-8c149f3b-41ee-4504-b4af-ec07ba6e9ab2 tempest-VolumesActionsTest-1874813921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (39f51c0c-8029-4dbe-97c3-5c61f0c4eb73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:52:47 devstack cinder-volume[87272]: INFO cinder.volume.flows.manager.create_volume [None req-8c149f3b-41ee-4504-b4af-ec07ba6e9ab2 tempest-VolumesActionsTest-1874813921 None] Volume volume-171be892-1afe-47c7-b8fd-915686e6d751 (171be892-1afe-47c7-b8fd-915686e6d751): created successfully Nov 04 10:52:47 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-8c149f3b-41ee-4504-b4af-ec07ba6e9ab2 tempest-VolumesActionsTest-1874813921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (39f51c0c-8029-4dbe-97c3-5c61f0c4eb73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:52:47 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-8c149f3b-41ee-4504-b4af-ec07ba6e9ab2 tempest-VolumesActionsTest-1874813921 None] Flow 'volume_create_manager' (765ba12e-2a56-4dab-9d90-30a8676a25b7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87272) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:52:47 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-8c149f3b-41ee-4504-b4af-ec07ba6e9ab2 tempest-VolumesActionsTest-1874813921 None] Created volume successfully. Nov 04 10:52:48 devstack sudo[91052]: pam_unix(sudo:session): session closed for user root Nov 04 10:52:48 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-970ef51e-2d88-4b0f-b41c-36153e85d0a1 tempest-AttachVolumeShelveTestJSON-1521270859 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-9b7746f4-19db-407d-ac88-9f929bfb64b7 1073741824" returned: 0 in 0.459s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:52:48 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-970ef51e-2d88-4b0f-b41c-36153e85d0a1 tempest-AttachVolumeShelveTestJSON-1521270859 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-9b7746f4-19db-407d-ac88-9f929bfb64b7 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:52:48 devstack sudo[91057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-9b7746f4-19db-407d-ac88-9f929bfb64b7 Nov 04 10:52:48 devstack sudo[91057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:52:48 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-87016a7a-2f4b-41ed-b059-fb8a3d96e17b tempest-VolumesActionsTest-1874813921 None] Acquiring lock "cinder-171be892-1afe-47c7-b8fd-915686e6d751" by "attach_volume" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:52:48 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-87016a7a-2f4b-41ed-b059-fb8a3d96e17b tempest-VolumesActionsTest-1874813921 None] Lock "cinder-171be892-1afe-47c7-b8fd-915686e6d751" acquired by "attach_volume" :: waited 0.035s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:52:48 devstack sudo[91057]: pam_unix(sudo:session): session closed for user root Nov 04 10:52:48 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-970ef51e-2d88-4b0f-b41c-36153e85d0a1 tempest-AttachVolumeShelveTestJSON-1521270859 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-9b7746f4-19db-407d-ac88-9f929bfb64b7" returned: 0 in 0.346s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:52:48 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-970ef51e-2d88-4b0f-b41c-36153e85d0a1 tempest-AttachVolumeShelveTestJSON-1521270859 None] <== create_volume: return (848ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'} {{(pid=87272) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 04 10:52:48 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-970ef51e-2d88-4b0f-b41c-36153e85d0a1 tempest-AttachVolumeShelveTestJSON-1521270859 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.853s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:52:48 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-87016a7a-2f4b-41ed-b059-fb8a3d96e17b tempest-VolumesActionsTest-1874813921 None] Attaching volume 171be892-1afe-47c7-b8fd-915686e6d751 to instance d4818cd2-925c-465c-ad0b-e84bc070527e at mountpoint /dev/vdb on host None. Nov 04 10:52:48 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-970ef51e-2d88-4b0f-b41c-36153e85d0a1 tempest-AttachVolumeShelveTestJSON-1521270859 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c1acc29-1929-4a2e-bc07-61a076239c74) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9b7746f4-19db-407d-ac88-9f929bfb64b7', 'volume_size': 1}' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:52:48 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-970ef51e-2d88-4b0f-b41c-36153e85d0a1 tempest-AttachVolumeShelveTestJSON-1521270859 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9560e515-0978-4614-b600-63624f7a3bf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:52:48 devstack cinder-volume[87272]: INFO cinder.volume.flows.manager.create_volume [None req-970ef51e-2d88-4b0f-b41c-36153e85d0a1 tempest-AttachVolumeShelveTestJSON-1521270859 None] Volume volume-9b7746f4-19db-407d-ac88-9f929bfb64b7 (9b7746f4-19db-407d-ac88-9f929bfb64b7): created successfully Nov 04 10:52:48 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-970ef51e-2d88-4b0f-b41c-36153e85d0a1 tempest-AttachVolumeShelveTestJSON-1521270859 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9560e515-0978-4614-b600-63624f7a3bf1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:52:48 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-970ef51e-2d88-4b0f-b41c-36153e85d0a1 tempest-AttachVolumeShelveTestJSON-1521270859 None] Flow 'volume_create_manager' (50833b30-0514-4e9c-a7f5-765accdc8961) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87272) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:52:48 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-970ef51e-2d88-4b0f-b41c-36153e85d0a1 tempest-AttachVolumeShelveTestJSON-1521270859 None] Created volume successfully. Nov 04 10:52:48 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-87016a7a-2f4b-41ed-b059-fb8a3d96e17b tempest-VolumesActionsTest-1874813921 None] Attach volume completed successfully. Nov 04 10:52:48 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-87016a7a-2f4b-41ed-b059-fb8a3d96e17b tempest-VolumesActionsTest-1874813921 None] Lock "cinder-171be892-1afe-47c7-b8fd-915686e6d751" released by "attach_volume" :: held 0.262s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:52:49 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-864b4814-28c7-49ca-af03-dc40ea36d85b tempest-VolumesActionsTest-930627907 None] Terminate volume connection completed successfully. Nov 04 10:52:49 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-864b4814-28c7-49ca-af03-dc40ea36d85b tempest-VolumesActionsTest-930627907 None] Acquiring lock "cinder-171be892-1afe-47c7-b8fd-915686e6d751-detach_volume" by "detach_volume" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:52:49 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-864b4814-28c7-49ca-af03-dc40ea36d85b tempest-VolumesActionsTest-930627907 None] Lock "cinder-171be892-1afe-47c7-b8fd-915686e6d751-detach_volume" acquired by "detach_volume" :: waited 0.015s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:52:49 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-864b4814-28c7-49ca-af03-dc40ea36d85b tempest-VolumesActionsTest-930627907 None] Detaching volume 171be892-1afe-47c7-b8fd-915686e6d751 from instance d4818cd2-925c-465c-ad0b-e84bc070527e. Nov 04 10:52:49 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-864b4814-28c7-49ca-af03-dc40ea36d85b tempest-VolumesActionsTest-930627907 None] Detach volume completed successfully. Nov 04 10:52:49 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-864b4814-28c7-49ca-af03-dc40ea36d85b tempest-VolumesActionsTest-930627907 None] Lock "cinder-171be892-1afe-47c7-b8fd-915686e6d751-detach_volume" released by "detach_volume" :: held 0.073s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:52:49 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-25025784-232a-4b26-8a3d-c15a5e991de9 tempest-VolumesActionsTest-1874813921 None] Acquiring lock "cinder-171be892-1afe-47c7-b8fd-915686e6d751-detach_volume" by "detach_volume" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:52:49 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-25025784-232a-4b26-8a3d-c15a5e991de9 tempest-VolumesActionsTest-1874813921 None] Lock "cinder-171be892-1afe-47c7-b8fd-915686e6d751-detach_volume" acquired by "detach_volume" :: waited 0.025s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:52:49 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-25025784-232a-4b26-8a3d-c15a5e991de9 tempest-VolumesActionsTest-1874813921 None] Volume detach called, but volume not attached. Nov 04 10:52:49 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-25025784-232a-4b26-8a3d-c15a5e991de9 tempest-VolumesActionsTest-1874813921 None] Lock "cinder-171be892-1afe-47c7-b8fd-915686e6d751-detach_volume" released by "detach_volume" :: held 0.030s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:52:50 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-5fd28899-ad0c-4d8a-bc0a-077307b9a0ae tempest-VolumesActionsTest-1874813921 None] Acquiring lock "cinder-171be892-1afe-47c7-b8fd-915686e6d751-delete_volume" by "delete_volume" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:52:50 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-5fd28899-ad0c-4d8a-bc0a-077307b9a0ae tempest-VolumesActionsTest-1874813921 None] Lock "cinder-171be892-1afe-47c7-b8fd-915686e6d751-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:52:50 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-5fd28899-ad0c-4d8a-bc0a-077307b9a0ae tempest-VolumesActionsTest-1874813921 None] Acquiring lock "cinder-quobyte-171be892-1afe-47c7-b8fd-915686e6d751" by "delete_volume" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:52:50 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-5fd28899-ad0c-4d8a-bc0a-077307b9a0ae tempest-VolumesActionsTest-1874813921 None] Lock "cinder-quobyte-171be892-1afe-47c7-b8fd-915686e6d751" acquired by "delete_volume" :: waited 0.035s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:52:50 devstack cinder-volume[87272]: DEBUG oslo.privsep.daemon [-] privsep: reply[d94331e5-98c3-4259-b757-b15945370344]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:52:50 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-5fd28899-ad0c-4d8a-bc0a-077307b9a0ae tempest-VolumesActionsTest-1874813921 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-171be892-1afe-47c7-b8fd-915686e6d751 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:52:50 devstack cinder-volume[87272]: DEBUG cinder.volume.flows.manager.create_volume [None req-ed7f1e3d-cb37-417f-b7b3-d5bda624a42e tempest-AttachVolumeTestJSON-969779014 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87272) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 10:52:50 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-ed7f1e3d-cb37-417f-b7b3-d5bda624a42e tempest-AttachVolumeTestJSON-969779014 None] Flow 'volume_create_manager' (eb887d5f-0287-46ac-9df2-9412ff3a4274) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:52:50 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-ed7f1e3d-cb37-417f-b7b3-d5bda624a42e tempest-AttachVolumeTestJSON-969779014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96a0fac3-fddd-46cd-819d-8d4e8dab37a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:52:50 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-ed7f1e3d-cb37-417f-b7b3-d5bda624a42e tempest-AttachVolumeTestJSON-969779014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96a0fac3-fddd-46cd-819d-8d4e8dab37a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T09:52:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-955172755',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d32c452-7fc9-4858-a5c5-861b2992b96d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9af529190a64458b1851782c52971fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T09:52:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T09:52:50Z,use_quota=True,user_id='7506d2d06b404f1083e8817e6a4ee71b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8989e4f-21e3-4f0a-9584-0d818784e883),volume_type_id=f8989e4f-21e3-4f0a-9584-0d818784e883)' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:52:50 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-ed7f1e3d-cb37-417f-b7b3-d5bda624a42e tempest-AttachVolumeTestJSON-969779014 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1c10766-e8ca-4c3f-8186-44f059b514fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:52:50 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-ed7f1e3d-cb37-417f-b7b3-d5bda624a42e tempest-AttachVolumeTestJSON-969779014 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1c10766-e8ca-4c3f-8186-44f059b514fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:52:50 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-ed7f1e3d-cb37-417f-b7b3-d5bda624a42e tempest-AttachVolumeTestJSON-969779014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (898b2112-3589-48b8-b25d-addcb92cc616) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:52:50 devstack sudo[91066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-171be892-1afe-47c7-b8fd-915686e6d751 Nov 04 10:52:50 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-ed7f1e3d-cb37-417f-b7b3-d5bda624a42e tempest-AttachVolumeTestJSON-969779014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (898b2112-3589-48b8-b25d-addcb92cc616) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0d32c452-7fc9-4858-a5c5-861b2992b96d', 'volume_name': 'volume-0d32c452-7fc9-4858-a5c5-861b2992b96d', 'volume_size': 1}' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:52:50 devstack sudo[91066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:52:50 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-ed7f1e3d-cb37-417f-b7b3-d5bda624a42e tempest-AttachVolumeTestJSON-969779014 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (604664e8-4dd0-4b1c-af38-a2f1beed4592) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:52:50 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-ed7f1e3d-cb37-417f-b7b3-d5bda624a42e tempest-AttachVolumeTestJSON-969779014 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (604664e8-4dd0-4b1c-af38-a2f1beed4592) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:52:50 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-ed7f1e3d-cb37-417f-b7b3-d5bda624a42e tempest-AttachVolumeTestJSON-969779014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ecd95775-5a2b-4541-8918-e98f3847232b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:52:50 devstack cinder-volume[87272]: INFO cinder.volume.flows.manager.create_volume [None req-ed7f1e3d-cb37-417f-b7b3-d5bda624a42e tempest-AttachVolumeTestJSON-969779014 None] Volume 0d32c452-7fc9-4858-a5c5-861b2992b96d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0d32c452-7fc9-4858-a5c5-861b2992b96d', 'volume_size': 1} Nov 04 10:52:50 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-ed7f1e3d-cb37-417f-b7b3-d5bda624a42e tempest-AttachVolumeTestJSON-969779014 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:52:50 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-ed7f1e3d-cb37-417f-b7b3-d5bda624a42e tempest-AttachVolumeTestJSON-969779014 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:52:50 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-ed7f1e3d-cb37-417f-b7b3-d5bda624a42e tempest-AttachVolumeTestJSON-969779014 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T09:52:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-955172755',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d32c452-7fc9-4858-a5c5-861b2992b96d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9af529190a64458b1851782c52971fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T09:52:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T09:52:50Z,use_quota=True,user_id='7506d2d06b404f1083e8817e6a4ee71b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8989e4f-21e3-4f0a-9584-0d818784e883),volume_type_id=f8989e4f-21e3-4f0a-9584-0d818784e883)}" {{(pid=87272) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 04 10:52:50 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.remotefs [None req-ed7f1e3d-cb37-417f-b7b3-d5bda624a42e tempest-AttachVolumeTestJSON-969779014 None] Creating volume 0d32c452-7fc9-4858-a5c5-861b2992b96d {{(pid=87272) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 10:52:50 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-ed7f1e3d-cb37-417f-b7b3-d5bda624a42e tempest-AttachVolumeTestJSON-969779014 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:52:50 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-ed7f1e3d-cb37-417f-b7b3-d5bda624a42e tempest-AttachVolumeTestJSON-969779014 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:52:50 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-ed7f1e3d-cb37-417f-b7b3-d5bda624a42e tempest-AttachVolumeTestJSON-969779014 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898': None} {{(pid=87272) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:52:50 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-ed7f1e3d-cb37-417f-b7b3-d5bda624a42e tempest-AttachVolumeTestJSON-969779014 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'] {{(pid=87272) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:52:50 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-ed7f1e3d-cb37-417f-b7b3-d5bda624a42e tempest-AttachVolumeTestJSON-969779014 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:52:50 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-ed7f1e3d-cb37-417f-b7b3-d5bda624a42e tempest-AttachVolumeTestJSON-969779014 None] Selected osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898 as target Quobyte volume. {{(pid=87272) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 10:52:50 devstack cinder-volume[87272]: INFO cinder.volume.drivers.remotefs [None req-ed7f1e3d-cb37-417f-b7b3-d5bda624a42e tempest-AttachVolumeTestJSON-969779014 None] casted to osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898 Nov 04 10:52:50 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-ed7f1e3d-cb37-417f-b7b3-d5bda624a42e tempest-AttachVolumeTestJSON-969779014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-0d32c452-7fc9-4858-a5c5-861b2992b96d 1073741824 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:52:50 devstack sudo[91068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-0d32c452-7fc9-4858-a5c5-861b2992b96d 1073741824 Nov 04 10:52:50 devstack sudo[91068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:52:50 devstack sudo[91066]: pam_unix(sudo:session): session closed for user root Nov 04 10:52:50 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-5fd28899-ad0c-4d8a-bc0a-077307b9a0ae tempest-VolumesActionsTest-1874813921 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-171be892-1afe-47c7-b8fd-915686e6d751" returned: 0 in 0.494s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:52:50 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-5fd28899-ad0c-4d8a-bc0a-077307b9a0ae tempest-VolumesActionsTest-1874813921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-171be892-1afe-47c7-b8fd-915686e6d751 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:52:50 devstack sudo[91073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-171be892-1afe-47c7-b8fd-915686e6d751 Nov 04 10:52:50 devstack sudo[91073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:52:51 devstack sudo[91068]: pam_unix(sudo:session): session closed for user root Nov 04 10:52:51 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-ed7f1e3d-cb37-417f-b7b3-d5bda624a42e tempest-AttachVolumeTestJSON-969779014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-0d32c452-7fc9-4858-a5c5-861b2992b96d 1073741824" returned: 0 in 0.583s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:52:51 devstack sudo[91073]: pam_unix(sudo:session): session closed for user root Nov 04 10:52:51 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-5fd28899-ad0c-4d8a-bc0a-077307b9a0ae tempest-VolumesActionsTest-1874813921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-171be892-1afe-47c7-b8fd-915686e6d751" returned: 0 in 0.345s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:52:51 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-ed7f1e3d-cb37-417f-b7b3-d5bda624a42e tempest-AttachVolumeTestJSON-969779014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-0d32c452-7fc9-4858-a5c5-861b2992b96d {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:52:51 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-5fd28899-ad0c-4d8a-bc0a-077307b9a0ae tempest-VolumesActionsTest-1874813921 None] Lock "cinder-quobyte-171be892-1afe-47c7-b8fd-915686e6d751" released by "delete_volume" :: held 0.903s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:52:51 devstack sudo[91082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-0d32c452-7fc9-4858-a5c5-861b2992b96d Nov 04 10:52:51 devstack sudo[91082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:52:51 devstack cinder-volume[87272]: DEBUG cinder.quota [None req-5fd28899-ad0c-4d8a-bc0a-077307b9a0ae tempest-VolumesActionsTest-1874813921 None] Created reservations ['63a2958a-4fda-4fe1-b897-b4c1305a0549', '104e31e9-1024-4898-a0e8-7940560857ec', 'b290f8ab-4e56-4e1a-9a42-0aad25804f2b', '6ee98b85-7288-41ff-95eb-a00e8ad59aa6'] {{(pid=87272) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 10:52:51 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-5fd28899-ad0c-4d8a-bc0a-077307b9a0ae tempest-VolumesActionsTest-1874813921 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:52:51 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-5fd28899-ad0c-4d8a-bc0a-077307b9a0ae tempest-VolumesActionsTest-1874813921 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:52:51 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-5fd28899-ad0c-4d8a-bc0a-077307b9a0ae tempest-VolumesActionsTest-1874813921 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898': None} {{(pid=87272) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:52:51 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-5fd28899-ad0c-4d8a-bc0a-077307b9a0ae tempest-VolumesActionsTest-1874813921 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'] {{(pid=87272) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:52:51 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-5fd28899-ad0c-4d8a-bc0a-077307b9a0ae tempest-VolumesActionsTest-1874813921 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:52:51 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-5fd28899-ad0c-4d8a-bc0a-077307b9a0ae tempest-VolumesActionsTest-1874813921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:52:51 devstack sudo[91084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1 Nov 04 10:52:51 devstack sudo[91084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:52:51 devstack sudo[91084]: pam_unix(sudo:session): session closed for user root Nov 04 10:52:51 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-5fd28899-ad0c-4d8a-bc0a-077307b9a0ae tempest-VolumesActionsTest-1874813921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1" returned: 0 in 0.382s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:52:51 devstack cinder-volume[87272]: DEBUG cinder.manager [None req-5fd28899-ad0c-4d8a-bc0a-077307b9a0ae tempest-VolumesActionsTest-1874813921 None] Notifying Schedulers of capabilities ... {{(pid=87272) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 10:52:51 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-5fd28899-ad0c-4d8a-bc0a-077307b9a0ae tempest-VolumesActionsTest-1874813921 None] Deleted volume successfully. Nov 04 10:52:51 devstack sudo[91082]: pam_unix(sudo:session): session closed for user root Nov 04 10:52:51 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-ed7f1e3d-cb37-417f-b7b3-d5bda624a42e tempest-AttachVolumeTestJSON-969779014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-0d32c452-7fc9-4858-a5c5-861b2992b96d" returned: 0 in 0.684s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:52:51 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-ed7f1e3d-cb37-417f-b7b3-d5bda624a42e tempest-AttachVolumeTestJSON-969779014 None] <== create_volume: return (1337ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'} {{(pid=87272) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 04 10:52:51 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-ed7f1e3d-cb37-417f-b7b3-d5bda624a42e tempest-AttachVolumeTestJSON-969779014 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.340s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:52:51 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-5fd28899-ad0c-4d8a-bc0a-077307b9a0ae tempest-VolumesActionsTest-1874813921 None] Lock "cinder-171be892-1afe-47c7-b8fd-915686e6d751-delete_volume" released by "delete_volume" :: held 1.726s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:52:51 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-ed7f1e3d-cb37-417f-b7b3-d5bda624a42e tempest-AttachVolumeTestJSON-969779014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ecd95775-5a2b-4541-8918-e98f3847232b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0d32c452-7fc9-4858-a5c5-861b2992b96d', 'volume_size': 1}' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:52:51 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-ed7f1e3d-cb37-417f-b7b3-d5bda624a42e tempest-AttachVolumeTestJSON-969779014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (40569877-28a2-4e0a-aeea-2865b3726e00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:52:51 devstack cinder-volume[87272]: INFO cinder.volume.flows.manager.create_volume [None req-ed7f1e3d-cb37-417f-b7b3-d5bda624a42e tempest-AttachVolumeTestJSON-969779014 None] Volume volume-0d32c452-7fc9-4858-a5c5-861b2992b96d (0d32c452-7fc9-4858-a5c5-861b2992b96d): created successfully Nov 04 10:52:51 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-ed7f1e3d-cb37-417f-b7b3-d5bda624a42e tempest-AttachVolumeTestJSON-969779014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (40569877-28a2-4e0a-aeea-2865b3726e00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:52:51 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-ed7f1e3d-cb37-417f-b7b3-d5bda624a42e tempest-AttachVolumeTestJSON-969779014 None] Flow 'volume_create_manager' (eb887d5f-0287-46ac-9df2-9412ff3a4274) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87272) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:52:51 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-ed7f1e3d-cb37-417f-b7b3-d5bda624a42e tempest-AttachVolumeTestJSON-969779014 None] Created volume successfully. Nov 04 10:52:52 devstack cinder-volume[87272]: DEBUG cinder.volume.flows.manager.create_volume [None req-838ec3f5-b636-4226-bda0-1357ae49a2b9 tempest-ServerActionsTestOtherA-1078392334 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87272) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 10:52:52 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-838ec3f5-b636-4226-bda0-1357ae49a2b9 tempest-ServerActionsTestOtherA-1078392334 None] Flow 'volume_create_manager' (d62188ad-c967-4bbd-97d7-508675e2b9fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:52:53 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-838ec3f5-b636-4226-bda0-1357ae49a2b9 tempest-ServerActionsTestOtherA-1078392334 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3af5eeb-3139-4dcb-93e6-ad9c8a14e5e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:52:53 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-838ec3f5-b636-4226-bda0-1357ae49a2b9 tempest-ServerActionsTestOtherA-1078392334 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3af5eeb-3139-4dcb-93e6-ad9c8a14e5e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T09:52:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-633516740',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c1a96b74-c5b4-4d72-bda6-bf6b762cf5ab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec81cb8bfc924c069e647d173aa0088b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T09:52:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T09:52:53Z,use_quota=True,user_id='ae2d733d411a403fb44b0a87d1459f7e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8989e4f-21e3-4f0a-9584-0d818784e883),volume_type_id=f8989e4f-21e3-4f0a-9584-0d818784e883)' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:52:53 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-838ec3f5-b636-4226-bda0-1357ae49a2b9 tempest-ServerActionsTestOtherA-1078392334 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8209f29-f0ba-4c1d-b457-69d652f66749) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:52:53 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-838ec3f5-b636-4226-bda0-1357ae49a2b9 tempest-ServerActionsTestOtherA-1078392334 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8209f29-f0ba-4c1d-b457-69d652f66749) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:52:53 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-838ec3f5-b636-4226-bda0-1357ae49a2b9 tempest-ServerActionsTestOtherA-1078392334 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ede25fe-fa16-407c-9781-13e40d52f863) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:52:53 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-838ec3f5-b636-4226-bda0-1357ae49a2b9 tempest-ServerActionsTestOtherA-1078392334 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ede25fe-fa16-407c-9781-13e40d52f863) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c1a96b74-c5b4-4d72-bda6-bf6b762cf5ab', 'volume_name': 'volume-c1a96b74-c5b4-4d72-bda6-bf6b762cf5ab', 'volume_size': 1}' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:52:53 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-838ec3f5-b636-4226-bda0-1357ae49a2b9 tempest-ServerActionsTestOtherA-1078392334 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1da48d39-47c3-41b1-8144-d1987d149184) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:52:53 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-838ec3f5-b636-4226-bda0-1357ae49a2b9 tempest-ServerActionsTestOtherA-1078392334 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1da48d39-47c3-41b1-8144-d1987d149184) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:52:53 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-838ec3f5-b636-4226-bda0-1357ae49a2b9 tempest-ServerActionsTestOtherA-1078392334 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67a57ed0-4e31-4a3a-855c-d13bcd1e8b47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:52:53 devstack cinder-volume[87272]: INFO cinder.volume.flows.manager.create_volume [None req-838ec3f5-b636-4226-bda0-1357ae49a2b9 tempest-ServerActionsTestOtherA-1078392334 None] Volume c1a96b74-c5b4-4d72-bda6-bf6b762cf5ab: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c1a96b74-c5b4-4d72-bda6-bf6b762cf5ab', 'volume_size': 1} Nov 04 10:52:53 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-838ec3f5-b636-4226-bda0-1357ae49a2b9 tempest-ServerActionsTestOtherA-1078392334 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:52:53 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-838ec3f5-b636-4226-bda0-1357ae49a2b9 tempest-ServerActionsTestOtherA-1078392334 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:52:53 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-838ec3f5-b636-4226-bda0-1357ae49a2b9 tempest-ServerActionsTestOtherA-1078392334 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T09:52:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-633516740',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c1a96b74-c5b4-4d72-bda6-bf6b762cf5ab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec81cb8bfc924c069e647d173aa0088b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T09:52:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T09:52:53Z,use_quota=True,user_id='ae2d733d411a403fb44b0a87d1459f7e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8989e4f-21e3-4f0a-9584-0d818784e883),volume_type_id=f8989e4f-21e3-4f0a-9584-0d818784e883)}" {{(pid=87272) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 04 10:52:53 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.remotefs [None req-838ec3f5-b636-4226-bda0-1357ae49a2b9 tempest-ServerActionsTestOtherA-1078392334 None] Creating volume c1a96b74-c5b4-4d72-bda6-bf6b762cf5ab {{(pid=87272) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 10:52:53 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-838ec3f5-b636-4226-bda0-1357ae49a2b9 tempest-ServerActionsTestOtherA-1078392334 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:52:53 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-838ec3f5-b636-4226-bda0-1357ae49a2b9 tempest-ServerActionsTestOtherA-1078392334 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:52:53 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-838ec3f5-b636-4226-bda0-1357ae49a2b9 tempest-ServerActionsTestOtherA-1078392334 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898': None} {{(pid=87272) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:52:53 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-838ec3f5-b636-4226-bda0-1357ae49a2b9 tempest-ServerActionsTestOtherA-1078392334 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'] {{(pid=87272) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:52:53 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-838ec3f5-b636-4226-bda0-1357ae49a2b9 tempest-ServerActionsTestOtherA-1078392334 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:52:53 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-838ec3f5-b636-4226-bda0-1357ae49a2b9 tempest-ServerActionsTestOtherA-1078392334 None] Selected osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898 as target Quobyte volume. {{(pid=87272) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 10:52:53 devstack cinder-volume[87272]: INFO cinder.volume.drivers.remotefs [None req-838ec3f5-b636-4226-bda0-1357ae49a2b9 tempest-ServerActionsTestOtherA-1078392334 None] casted to osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898 Nov 04 10:52:53 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-838ec3f5-b636-4226-bda0-1357ae49a2b9 tempest-ServerActionsTestOtherA-1078392334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-c1a96b74-c5b4-4d72-bda6-bf6b762cf5ab 1073741824 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:52:53 devstack sudo[91131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-c1a96b74-c5b4-4d72-bda6-bf6b762cf5ab 1073741824 Nov 04 10:52:53 devstack sudo[91131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:52:53 devstack sudo[91131]: pam_unix(sudo:session): session closed for user root Nov 04 10:52:53 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-838ec3f5-b636-4226-bda0-1357ae49a2b9 tempest-ServerActionsTestOtherA-1078392334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-c1a96b74-c5b4-4d72-bda6-bf6b762cf5ab 1073741824" returned: 0 in 0.891s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:52:54 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-838ec3f5-b636-4226-bda0-1357ae49a2b9 tempest-ServerActionsTestOtherA-1078392334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-c1a96b74-c5b4-4d72-bda6-bf6b762cf5ab {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:52:54 devstack sudo[91147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-c1a96b74-c5b4-4d72-bda6-bf6b762cf5ab Nov 04 10:52:54 devstack sudo[91147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:52:54 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [req-0e3a1a71-a929-47c8-9aac-69f33d0b6ae6 req-ba02e0cc-f253-4c64-ac3f-55bea6c7ff4c tempest-AttachVolumeTestJSON-969779014 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:52:54 devstack sudo[91147]: pam_unix(sudo:session): session closed for user root Nov 04 10:52:54 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-838ec3f5-b636-4226-bda0-1357ae49a2b9 tempest-ServerActionsTestOtherA-1078392334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-c1a96b74-c5b4-4d72-bda6-bf6b762cf5ab" returned: 0 in 0.297s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:52:54 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-838ec3f5-b636-4226-bda0-1357ae49a2b9 tempest-ServerActionsTestOtherA-1078392334 None] <== create_volume: return (1298ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'} {{(pid=87272) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 04 10:52:54 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-838ec3f5-b636-4226-bda0-1357ae49a2b9 tempest-ServerActionsTestOtherA-1078392334 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.301s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:52:54 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [req-0e3a1a71-a929-47c8-9aac-69f33d0b6ae6 req-ba02e0cc-f253-4c64-ac3f-55bea6c7ff4c tempest-AttachVolumeTestJSON-969779014 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.039s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:52:54 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-838ec3f5-b636-4226-bda0-1357ae49a2b9 tempest-ServerActionsTestOtherA-1078392334 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67a57ed0-4e31-4a3a-855c-d13bcd1e8b47) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c1a96b74-c5b4-4d72-bda6-bf6b762cf5ab', 'volume_size': 1}' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:52:54 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-838ec3f5-b636-4226-bda0-1357ae49a2b9 tempest-ServerActionsTestOtherA-1078392334 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8907cf02-49a6-4f46-951f-f8e3b7610156) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:52:54 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [req-0e3a1a71-a929-47c8-9aac-69f33d0b6ae6 req-ba02e0cc-f253-4c64-ac3f-55bea6c7ff4c tempest-AttachVolumeTestJSON-969779014 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.038s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:52:54 devstack cinder-volume[87272]: INFO cinder.volume.flows.manager.create_volume [None req-838ec3f5-b636-4226-bda0-1357ae49a2b9 tempest-ServerActionsTestOtherA-1078392334 None] Volume volume-c1a96b74-c5b4-4d72-bda6-bf6b762cf5ab (c1a96b74-c5b4-4d72-bda6-bf6b762cf5ab): created successfully Nov 04 10:52:54 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-838ec3f5-b636-4226-bda0-1357ae49a2b9 tempest-ServerActionsTestOtherA-1078392334 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8907cf02-49a6-4f46-951f-f8e3b7610156) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:52:54 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-838ec3f5-b636-4226-bda0-1357ae49a2b9 tempest-ServerActionsTestOtherA-1078392334 None] Flow 'volume_create_manager' (d62188ad-c967-4bbd-97d7-508675e2b9fc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87272) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:52:54 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-838ec3f5-b636-4226-bda0-1357ae49a2b9 tempest-ServerActionsTestOtherA-1078392334 None] Created volume successfully. Nov 04 10:52:54 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [req-0e3a1a71-a929-47c8-9aac-69f33d0b6ae6 req-ba02e0cc-f253-4c64-ac3f-55bea6c7ff4c tempest-AttachVolumeTestJSON-969779014 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898', 'name': 'volume-0d32c452-7fc9-4858-a5c5-861b2992b96d', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '8b4fe6a9-1f8c-4d95-b06e-b612a81b582f', 'enforce_multipath': True} {{(pid=87272) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 04 10:52:54 devstack cinder-volume[87272]: INFO cinder.volume.manager [req-0e3a1a71-a929-47c8-9aac-69f33d0b6ae6 req-ba02e0cc-f253-4c64-ac3f-55bea6c7ff4c tempest-AttachVolumeTestJSON-969779014 None] attachment_update completed successfully. Nov 04 10:52:55 devstack cinder-volume[87272]: DEBUG cinder.volume.flows.manager.create_volume [None req-4039e064-229b-466f-84fc-a699b42dfaa6 tempest-VolumesActionsTest-1874813921 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87272) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 10:52:55 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-4039e064-229b-466f-84fc-a699b42dfaa6 tempest-VolumesActionsTest-1874813921 None] Flow 'volume_create_manager' (901ebd52-6f06-4b9c-8fc4-4b7b366a6b09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:52:55 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-4039e064-229b-466f-84fc-a699b42dfaa6 tempest-VolumesActionsTest-1874813921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (49d596ec-709d-4d04-b0ee-9abd8a7d0fd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:52:55 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-4039e064-229b-466f-84fc-a699b42dfaa6 tempest-VolumesActionsTest-1874813921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (49d596ec-709d-4d04-b0ee-9abd8a7d0fd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T09:52:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-549139959',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dafaaf8a-69b4-4b10-a33d-7851a4e40080,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ebc5facbf73344079918d4c6828b6985',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T09:52:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T09:52:56Z,use_quota=True,user_id='bb73b98c6b6748899fe24acefca7dde5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8989e4f-21e3-4f0a-9584-0d818784e883),volume_type_id=f8989e4f-21e3-4f0a-9584-0d818784e883)' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:52:55 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-4039e064-229b-466f-84fc-a699b42dfaa6 tempest-VolumesActionsTest-1874813921 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b5ea406-c5e1-4790-afc3-d6dcb30f750f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:52:55 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-4039e064-229b-466f-84fc-a699b42dfaa6 tempest-VolumesActionsTest-1874813921 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b5ea406-c5e1-4790-afc3-d6dcb30f750f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:52:55 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-4039e064-229b-466f-84fc-a699b42dfaa6 tempest-VolumesActionsTest-1874813921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (545bef2e-fff3-4909-8071-265c945ba523) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:52:55 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-4039e064-229b-466f-84fc-a699b42dfaa6 tempest-VolumesActionsTest-1874813921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (545bef2e-fff3-4909-8071-265c945ba523) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dafaaf8a-69b4-4b10-a33d-7851a4e40080', 'volume_name': 'volume-dafaaf8a-69b4-4b10-a33d-7851a4e40080', 'volume_size': 1}' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:52:55 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-4039e064-229b-466f-84fc-a699b42dfaa6 tempest-VolumesActionsTest-1874813921 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (398f5455-e6ad-4448-ae9c-8eb2a8758b91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:52:55 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-4039e064-229b-466f-84fc-a699b42dfaa6 tempest-VolumesActionsTest-1874813921 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (398f5455-e6ad-4448-ae9c-8eb2a8758b91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:52:55 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-4039e064-229b-466f-84fc-a699b42dfaa6 tempest-VolumesActionsTest-1874813921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74006f6f-775b-45b0-9cf8-4f9239999e4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:52:55 devstack cinder-volume[87272]: INFO cinder.volume.flows.manager.create_volume [None req-4039e064-229b-466f-84fc-a699b42dfaa6 tempest-VolumesActionsTest-1874813921 None] Volume dafaaf8a-69b4-4b10-a33d-7851a4e40080: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dafaaf8a-69b4-4b10-a33d-7851a4e40080', 'volume_size': 1} Nov 04 10:52:55 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-4039e064-229b-466f-84fc-a699b42dfaa6 tempest-VolumesActionsTest-1874813921 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:52:55 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-4039e064-229b-466f-84fc-a699b42dfaa6 tempest-VolumesActionsTest-1874813921 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:52:55 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-4039e064-229b-466f-84fc-a699b42dfaa6 tempest-VolumesActionsTest-1874813921 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T09:52:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-549139959',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dafaaf8a-69b4-4b10-a33d-7851a4e40080,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ebc5facbf73344079918d4c6828b6985',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T09:52:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T09:52:56Z,use_quota=True,user_id='bb73b98c6b6748899fe24acefca7dde5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8989e4f-21e3-4f0a-9584-0d818784e883),volume_type_id=f8989e4f-21e3-4f0a-9584-0d818784e883)}" {{(pid=87272) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 04 10:52:55 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.remotefs [None req-4039e064-229b-466f-84fc-a699b42dfaa6 tempest-VolumesActionsTest-1874813921 None] Creating volume dafaaf8a-69b4-4b10-a33d-7851a4e40080 {{(pid=87272) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 10:52:56 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-4039e064-229b-466f-84fc-a699b42dfaa6 tempest-VolumesActionsTest-1874813921 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:52:56 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-4039e064-229b-466f-84fc-a699b42dfaa6 tempest-VolumesActionsTest-1874813921 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:52:56 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-4039e064-229b-466f-84fc-a699b42dfaa6 tempest-VolumesActionsTest-1874813921 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898': None} {{(pid=87272) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:52:56 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-4039e064-229b-466f-84fc-a699b42dfaa6 tempest-VolumesActionsTest-1874813921 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'] {{(pid=87272) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:52:56 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-4039e064-229b-466f-84fc-a699b42dfaa6 tempest-VolumesActionsTest-1874813921 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:52:56 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-4039e064-229b-466f-84fc-a699b42dfaa6 tempest-VolumesActionsTest-1874813921 None] Selected osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898 as target Quobyte volume. {{(pid=87272) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 10:52:56 devstack cinder-volume[87272]: INFO cinder.volume.drivers.remotefs [None req-4039e064-229b-466f-84fc-a699b42dfaa6 tempest-VolumesActionsTest-1874813921 None] casted to osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898 Nov 04 10:52:56 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-4039e064-229b-466f-84fc-a699b42dfaa6 tempest-VolumesActionsTest-1874813921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-dafaaf8a-69b4-4b10-a33d-7851a4e40080 1073741824 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:52:56 devstack sudo[91569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-dafaaf8a-69b4-4b10-a33d-7851a4e40080 1073741824 Nov 04 10:52:56 devstack sudo[91569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:52:56 devstack sudo[91569]: pam_unix(sudo:session): session closed for user root Nov 04 10:52:56 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-4039e064-229b-466f-84fc-a699b42dfaa6 tempest-VolumesActionsTest-1874813921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-dafaaf8a-69b4-4b10-a33d-7851a4e40080 1073741824" returned: 0 in 0.600s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:52:56 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-4039e064-229b-466f-84fc-a699b42dfaa6 tempest-VolumesActionsTest-1874813921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-dafaaf8a-69b4-4b10-a33d-7851a4e40080 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:52:56 devstack sudo[91575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-dafaaf8a-69b4-4b10-a33d-7851a4e40080 Nov 04 10:52:56 devstack sudo[91575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:52:57 devstack sudo[91575]: pam_unix(sudo:session): session closed for user root Nov 04 10:52:57 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-4039e064-229b-466f-84fc-a699b42dfaa6 tempest-VolumesActionsTest-1874813921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-dafaaf8a-69b4-4b10-a33d-7851a4e40080" returned: 0 in 0.431s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:52:57 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-4039e064-229b-466f-84fc-a699b42dfaa6 tempest-VolumesActionsTest-1874813921 None] <== create_volume: return (1114ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'} {{(pid=87272) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 04 10:52:57 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-4039e064-229b-466f-84fc-a699b42dfaa6 tempest-VolumesActionsTest-1874813921 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.117s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:52:57 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-4039e064-229b-466f-84fc-a699b42dfaa6 tempest-VolumesActionsTest-1874813921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74006f6f-775b-45b0-9cf8-4f9239999e4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dafaaf8a-69b4-4b10-a33d-7851a4e40080', 'volume_size': 1}' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:52:57 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-4039e064-229b-466f-84fc-a699b42dfaa6 tempest-VolumesActionsTest-1874813921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a5d7684-e394-47e7-abc3-f785c322392e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:52:57 devstack cinder-volume[87272]: INFO cinder.volume.flows.manager.create_volume [None req-4039e064-229b-466f-84fc-a699b42dfaa6 tempest-VolumesActionsTest-1874813921 None] Volume volume-dafaaf8a-69b4-4b10-a33d-7851a4e40080 (dafaaf8a-69b4-4b10-a33d-7851a4e40080): created successfully Nov 04 10:52:57 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-4039e064-229b-466f-84fc-a699b42dfaa6 tempest-VolumesActionsTest-1874813921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a5d7684-e394-47e7-abc3-f785c322392e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:52:57 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-4039e064-229b-466f-84fc-a699b42dfaa6 tempest-VolumesActionsTest-1874813921 None] Flow 'volume_create_manager' (901ebd52-6f06-4b9c-8fc4-4b7b366a6b09) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87272) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:52:57 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-4039e064-229b-466f-84fc-a699b42dfaa6 tempest-VolumesActionsTest-1874813921 None] Created volume successfully. Nov 04 10:52:57 devstack cinder-volume[87272]: DEBUG cinder.volume.flows.manager.create_volume [None req-827c729d-adfc-477a-99b1-2999db63f241 tempest-AttachVolumeTestJSON-969779014 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87272) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 10:52:57 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-827c729d-adfc-477a-99b1-2999db63f241 tempest-AttachVolumeTestJSON-969779014 None] Flow 'volume_create_manager' (321fefd5-4327-4b31-a6ad-3380427c7300) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:52:57 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-827c729d-adfc-477a-99b1-2999db63f241 tempest-AttachVolumeTestJSON-969779014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0d0d0e8-6236-4022-957a-bb6bc1d0f53a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:52:57 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-827c729d-adfc-477a-99b1-2999db63f241 tempest-AttachVolumeTestJSON-969779014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0d0d0e8-6236-4022-957a-bb6bc1d0f53a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T09:52:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-998418514',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ebcb6fbe-5804-4bad-8c3c-f786d70e86e1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9af529190a64458b1851782c52971fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T09:52:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T09:52:57Z,use_quota=True,user_id='7506d2d06b404f1083e8817e6a4ee71b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8989e4f-21e3-4f0a-9584-0d818784e883),volume_type_id=f8989e4f-21e3-4f0a-9584-0d818784e883)' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:52:57 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-827c729d-adfc-477a-99b1-2999db63f241 tempest-AttachVolumeTestJSON-969779014 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (35347ee8-a9be-4d8a-bbc1-c40d4ecd78c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:52:57 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-827c729d-adfc-477a-99b1-2999db63f241 tempest-AttachVolumeTestJSON-969779014 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (35347ee8-a9be-4d8a-bbc1-c40d4ecd78c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:52:57 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-827c729d-adfc-477a-99b1-2999db63f241 tempest-AttachVolumeTestJSON-969779014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (059635cc-994e-4810-9bb1-59cb9fd5e04a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:52:57 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-827c729d-adfc-477a-99b1-2999db63f241 tempest-AttachVolumeTestJSON-969779014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (059635cc-994e-4810-9bb1-59cb9fd5e04a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ebcb6fbe-5804-4bad-8c3c-f786d70e86e1', 'volume_name': 'volume-ebcb6fbe-5804-4bad-8c3c-f786d70e86e1', 'volume_size': 1}' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:52:57 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-827c729d-adfc-477a-99b1-2999db63f241 tempest-AttachVolumeTestJSON-969779014 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2200871c-a20d-47a0-beec-0c37cc4a6f17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:52:57 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-827c729d-adfc-477a-99b1-2999db63f241 tempest-AttachVolumeTestJSON-969779014 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2200871c-a20d-47a0-beec-0c37cc4a6f17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:52:57 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-827c729d-adfc-477a-99b1-2999db63f241 tempest-AttachVolumeTestJSON-969779014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f94e596-3352-4e3f-8907-6d788ae4f48b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:52:57 devstack cinder-volume[87272]: INFO cinder.volume.flows.manager.create_volume [None req-827c729d-adfc-477a-99b1-2999db63f241 tempest-AttachVolumeTestJSON-969779014 None] Volume ebcb6fbe-5804-4bad-8c3c-f786d70e86e1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ebcb6fbe-5804-4bad-8c3c-f786d70e86e1', 'volume_size': 1} Nov 04 10:52:57 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-827c729d-adfc-477a-99b1-2999db63f241 tempest-AttachVolumeTestJSON-969779014 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:52:57 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-827c729d-adfc-477a-99b1-2999db63f241 tempest-AttachVolumeTestJSON-969779014 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:52:57 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-827c729d-adfc-477a-99b1-2999db63f241 tempest-AttachVolumeTestJSON-969779014 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T09:52:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-998418514',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ebcb6fbe-5804-4bad-8c3c-f786d70e86e1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9af529190a64458b1851782c52971fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T09:52:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T09:52:57Z,use_quota=True,user_id='7506d2d06b404f1083e8817e6a4ee71b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8989e4f-21e3-4f0a-9584-0d818784e883),volume_type_id=f8989e4f-21e3-4f0a-9584-0d818784e883)}" {{(pid=87272) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 04 10:52:57 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.remotefs [None req-827c729d-adfc-477a-99b1-2999db63f241 tempest-AttachVolumeTestJSON-969779014 None] Creating volume ebcb6fbe-5804-4bad-8c3c-f786d70e86e1 {{(pid=87272) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 10:52:57 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-827c729d-adfc-477a-99b1-2999db63f241 tempest-AttachVolumeTestJSON-969779014 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:52:57 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-827c729d-adfc-477a-99b1-2999db63f241 tempest-AttachVolumeTestJSON-969779014 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:52:57 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-827c729d-adfc-477a-99b1-2999db63f241 tempest-AttachVolumeTestJSON-969779014 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898': None} {{(pid=87272) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:52:57 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-827c729d-adfc-477a-99b1-2999db63f241 tempest-AttachVolumeTestJSON-969779014 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'] {{(pid=87272) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:52:57 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-827c729d-adfc-477a-99b1-2999db63f241 tempest-AttachVolumeTestJSON-969779014 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:52:57 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-827c729d-adfc-477a-99b1-2999db63f241 tempest-AttachVolumeTestJSON-969779014 None] Selected osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898 as target Quobyte volume. {{(pid=87272) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 10:52:57 devstack cinder-volume[87272]: INFO cinder.volume.drivers.remotefs [None req-827c729d-adfc-477a-99b1-2999db63f241 tempest-AttachVolumeTestJSON-969779014 None] casted to osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898 Nov 04 10:52:57 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-827c729d-adfc-477a-99b1-2999db63f241 tempest-AttachVolumeTestJSON-969779014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-ebcb6fbe-5804-4bad-8c3c-f786d70e86e1 1073741824 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:52:57 devstack sudo[91578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-ebcb6fbe-5804-4bad-8c3c-f786d70e86e1 1073741824 Nov 04 10:52:57 devstack sudo[91578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:52:57 devstack sudo[91578]: pam_unix(sudo:session): session closed for user root Nov 04 10:52:57 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-827c729d-adfc-477a-99b1-2999db63f241 tempest-AttachVolumeTestJSON-969779014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-ebcb6fbe-5804-4bad-8c3c-f786d70e86e1 1073741824" returned: 0 in 0.608s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:52:58 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-827c729d-adfc-477a-99b1-2999db63f241 tempest-AttachVolumeTestJSON-969779014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-ebcb6fbe-5804-4bad-8c3c-f786d70e86e1 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:52:58 devstack sudo[91588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-ebcb6fbe-5804-4bad-8c3c-f786d70e86e1 Nov 04 10:52:58 devstack sudo[91588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:52:58 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-ccd5ac2c-f538-4033-bf0f-48c6e50cd8c3 tempest-VolumesActionsTest-930627907 None] Acquiring lock "cinder-dafaaf8a-69b4-4b10-a33d-7851a4e40080-delete_volume" by "delete_volume" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:52:58 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-ccd5ac2c-f538-4033-bf0f-48c6e50cd8c3 tempest-VolumesActionsTest-930627907 None] Lock "cinder-dafaaf8a-69b4-4b10-a33d-7851a4e40080-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:52:58 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-ccd5ac2c-f538-4033-bf0f-48c6e50cd8c3 tempest-VolumesActionsTest-930627907 None] Acquiring lock "cinder-quobyte-dafaaf8a-69b4-4b10-a33d-7851a4e40080" by "delete_volume" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:52:58 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-ccd5ac2c-f538-4033-bf0f-48c6e50cd8c3 tempest-VolumesActionsTest-930627907 None] Lock "cinder-quobyte-dafaaf8a-69b4-4b10-a33d-7851a4e40080" acquired by "delete_volume" :: waited 0.021s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:52:58 devstack cinder-volume[87272]: DEBUG oslo.privsep.daemon [-] privsep: reply[33ed97f2-d371-40b5-965e-35a765195230]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:52:58 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-ccd5ac2c-f538-4033-bf0f-48c6e50cd8c3 tempest-VolumesActionsTest-930627907 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-dafaaf8a-69b4-4b10-a33d-7851a4e40080 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:52:58 devstack sudo[91588]: pam_unix(sudo:session): session closed for user root Nov 04 10:52:58 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-827c729d-adfc-477a-99b1-2999db63f241 tempest-AttachVolumeTestJSON-969779014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-ebcb6fbe-5804-4bad-8c3c-f786d70e86e1" returned: 0 in 0.425s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:52:58 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-827c729d-adfc-477a-99b1-2999db63f241 tempest-AttachVolumeTestJSON-969779014 None] <== create_volume: return (1093ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'} {{(pid=87272) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 04 10:52:58 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-827c729d-adfc-477a-99b1-2999db63f241 tempest-AttachVolumeTestJSON-969779014 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.096s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:52:58 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-827c729d-adfc-477a-99b1-2999db63f241 tempest-AttachVolumeTestJSON-969779014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f94e596-3352-4e3f-8907-6d788ae4f48b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ebcb6fbe-5804-4bad-8c3c-f786d70e86e1', 'volume_size': 1}' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:52:58 devstack sudo[91591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-dafaaf8a-69b4-4b10-a33d-7851a4e40080 Nov 04 10:52:58 devstack sudo[91591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:52:58 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-827c729d-adfc-477a-99b1-2999db63f241 tempest-AttachVolumeTestJSON-969779014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (727b673f-f23c-455d-bc2c-a39a16a79325) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:52:58 devstack cinder-volume[87272]: INFO cinder.volume.flows.manager.create_volume [None req-827c729d-adfc-477a-99b1-2999db63f241 tempest-AttachVolumeTestJSON-969779014 None] Volume volume-ebcb6fbe-5804-4bad-8c3c-f786d70e86e1 (ebcb6fbe-5804-4bad-8c3c-f786d70e86e1): created successfully Nov 04 10:52:58 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-827c729d-adfc-477a-99b1-2999db63f241 tempest-AttachVolumeTestJSON-969779014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (727b673f-f23c-455d-bc2c-a39a16a79325) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:52:58 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-827c729d-adfc-477a-99b1-2999db63f241 tempest-AttachVolumeTestJSON-969779014 None] Flow 'volume_create_manager' (321fefd5-4327-4b31-a6ad-3380427c7300) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87272) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:52:58 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-827c729d-adfc-477a-99b1-2999db63f241 tempest-AttachVolumeTestJSON-969779014 None] Created volume successfully. Nov 04 10:52:58 devstack sudo[91591]: pam_unix(sudo:session): session closed for user root Nov 04 10:52:58 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-ccd5ac2c-f538-4033-bf0f-48c6e50cd8c3 tempest-VolumesActionsTest-930627907 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-dafaaf8a-69b4-4b10-a33d-7851a4e40080" returned: 0 in 0.454s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:52:58 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-ccd5ac2c-f538-4033-bf0f-48c6e50cd8c3 tempest-VolumesActionsTest-930627907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-dafaaf8a-69b4-4b10-a33d-7851a4e40080 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:52:58 devstack sudo[91598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-dafaaf8a-69b4-4b10-a33d-7851a4e40080 Nov 04 10:52:58 devstack sudo[91598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:52:59 devstack sudo[91598]: pam_unix(sudo:session): session closed for user root Nov 04 10:52:59 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-ccd5ac2c-f538-4033-bf0f-48c6e50cd8c3 tempest-VolumesActionsTest-930627907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-dafaaf8a-69b4-4b10-a33d-7851a4e40080" returned: 0 in 0.279s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:52:59 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-ccd5ac2c-f538-4033-bf0f-48c6e50cd8c3 tempest-VolumesActionsTest-930627907 None] Lock "cinder-quobyte-dafaaf8a-69b4-4b10-a33d-7851a4e40080" released by "delete_volume" :: held 0.804s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:52:59 devstack cinder-volume[87272]: DEBUG cinder.quota [None req-ccd5ac2c-f538-4033-bf0f-48c6e50cd8c3 tempest-VolumesActionsTest-930627907 None] Created reservations ['df5a67f8-bbaf-4fb6-ba0a-06f65ab29e23', '8a1dce5e-43d0-4faa-abff-a79998c3bacd', 'f281fd8c-b456-4d6c-a6c7-178424735f0c', 'd4582a23-e3ec-4478-9769-074eb54a75b4'] {{(pid=87272) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 10:52:59 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-ccd5ac2c-f538-4033-bf0f-48c6e50cd8c3 tempest-VolumesActionsTest-930627907 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:52:59 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-ccd5ac2c-f538-4033-bf0f-48c6e50cd8c3 tempest-VolumesActionsTest-930627907 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:52:59 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-ccd5ac2c-f538-4033-bf0f-48c6e50cd8c3 tempest-VolumesActionsTest-930627907 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898': None} {{(pid=87272) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:52:59 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-ccd5ac2c-f538-4033-bf0f-48c6e50cd8c3 tempest-VolumesActionsTest-930627907 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'] {{(pid=87272) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:52:59 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-ccd5ac2c-f538-4033-bf0f-48c6e50cd8c3 tempest-VolumesActionsTest-930627907 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:52:59 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-ccd5ac2c-f538-4033-bf0f-48c6e50cd8c3 tempest-VolumesActionsTest-930627907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:52:59 devstack sudo[91601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1 Nov 04 10:52:59 devstack sudo[91601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:52:59 devstack sudo[91601]: pam_unix(sudo:session): session closed for user root Nov 04 10:52:59 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-ccd5ac2c-f538-4033-bf0f-48c6e50cd8c3 tempest-VolumesActionsTest-930627907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1" returned: 0 in 0.662s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:53:00 devstack cinder-volume[87272]: DEBUG cinder.manager [None req-ccd5ac2c-f538-4033-bf0f-48c6e50cd8c3 tempest-VolumesActionsTest-930627907 None] Notifying Schedulers of capabilities ... {{(pid=87272) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 10:53:00 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-ccd5ac2c-f538-4033-bf0f-48c6e50cd8c3 tempest-VolumesActionsTest-930627907 None] Deleted volume successfully. Nov 04 10:53:00 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-ccd5ac2c-f538-4033-bf0f-48c6e50cd8c3 tempest-VolumesActionsTest-930627907 None] Lock "cinder-dafaaf8a-69b4-4b10-a33d-7851a4e40080-delete_volume" released by "delete_volume" :: held 1.862s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:53:00 devstack cinder-volume[87272]: DEBUG cinder.volume.flows.manager.create_volume [None req-0e550ea7-5236-43f6-906d-d0864d81dbc3 tempest-VolumesActionsTest-1874813921 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87272) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 10:53:00 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-0e550ea7-5236-43f6-906d-d0864d81dbc3 tempest-VolumesActionsTest-1874813921 None] Flow 'volume_create_manager' (4b4fd905-a12e-4cb9-8bdd-53446038f8ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:53:00 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-0e550ea7-5236-43f6-906d-d0864d81dbc3 tempest-VolumesActionsTest-1874813921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c1d3f6f-7fe2-45f3-91a5-cd1d048a10a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:53:00 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-0e550ea7-5236-43f6-906d-d0864d81dbc3 tempest-VolumesActionsTest-1874813921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c1d3f6f-7fe2-45f3-91a5-cd1d048a10a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T09:53:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-198534690',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=53616f33-b585-490b-b201-d254acfd6f79,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ebc5facbf73344079918d4c6828b6985',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T09:53:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T09:53:01Z,use_quota=True,user_id='bb73b98c6b6748899fe24acefca7dde5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8989e4f-21e3-4f0a-9584-0d818784e883),volume_type_id=f8989e4f-21e3-4f0a-9584-0d818784e883)' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:53:00 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-0e550ea7-5236-43f6-906d-d0864d81dbc3 tempest-VolumesActionsTest-1874813921 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (54245709-ac71-4fa4-959c-2615a4653b3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:53:00 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-0e550ea7-5236-43f6-906d-d0864d81dbc3 tempest-VolumesActionsTest-1874813921 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (54245709-ac71-4fa4-959c-2615a4653b3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:53:00 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-0e550ea7-5236-43f6-906d-d0864d81dbc3 tempest-VolumesActionsTest-1874813921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c0f309d-c921-43d7-a602-aa12c81fb1ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:53:00 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-0e550ea7-5236-43f6-906d-d0864d81dbc3 tempest-VolumesActionsTest-1874813921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c0f309d-c921-43d7-a602-aa12c81fb1ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '53616f33-b585-490b-b201-d254acfd6f79', 'volume_name': 'volume-53616f33-b585-490b-b201-d254acfd6f79', 'volume_size': 1}' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:53:00 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-0e550ea7-5236-43f6-906d-d0864d81dbc3 tempest-VolumesActionsTest-1874813921 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21048dfe-9485-4ff6-bce4-2d1cbfcd19b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:53:00 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-0e550ea7-5236-43f6-906d-d0864d81dbc3 tempest-VolumesActionsTest-1874813921 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21048dfe-9485-4ff6-bce4-2d1cbfcd19b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:53:00 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-0e550ea7-5236-43f6-906d-d0864d81dbc3 tempest-VolumesActionsTest-1874813921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01ed3511-1121-499d-9d1a-332df36b2b9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:53:00 devstack cinder-volume[87272]: INFO cinder.volume.flows.manager.create_volume [None req-0e550ea7-5236-43f6-906d-d0864d81dbc3 tempest-VolumesActionsTest-1874813921 None] Volume 53616f33-b585-490b-b201-d254acfd6f79: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-53616f33-b585-490b-b201-d254acfd6f79', 'volume_size': 1} Nov 04 10:53:00 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-0e550ea7-5236-43f6-906d-d0864d81dbc3 tempest-VolumesActionsTest-1874813921 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:53:00 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-0e550ea7-5236-43f6-906d-d0864d81dbc3 tempest-VolumesActionsTest-1874813921 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:53:00 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-0e550ea7-5236-43f6-906d-d0864d81dbc3 tempest-VolumesActionsTest-1874813921 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T09:53:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-198534690',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=53616f33-b585-490b-b201-d254acfd6f79,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ebc5facbf73344079918d4c6828b6985',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T09:53:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T09:53:01Z,use_quota=True,user_id='bb73b98c6b6748899fe24acefca7dde5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8989e4f-21e3-4f0a-9584-0d818784e883),volume_type_id=f8989e4f-21e3-4f0a-9584-0d818784e883)}" {{(pid=87272) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 04 10:53:00 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.remotefs [None req-0e550ea7-5236-43f6-906d-d0864d81dbc3 tempest-VolumesActionsTest-1874813921 None] Creating volume 53616f33-b585-490b-b201-d254acfd6f79 {{(pid=87272) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 10:53:00 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-0e550ea7-5236-43f6-906d-d0864d81dbc3 tempest-VolumesActionsTest-1874813921 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:53:00 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-0e550ea7-5236-43f6-906d-d0864d81dbc3 tempest-VolumesActionsTest-1874813921 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:53:00 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-0e550ea7-5236-43f6-906d-d0864d81dbc3 tempest-VolumesActionsTest-1874813921 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898': None} {{(pid=87272) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:53:00 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-0e550ea7-5236-43f6-906d-d0864d81dbc3 tempest-VolumesActionsTest-1874813921 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'] {{(pid=87272) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:53:00 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-0e550ea7-5236-43f6-906d-d0864d81dbc3 tempest-VolumesActionsTest-1874813921 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:53:00 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-0e550ea7-5236-43f6-906d-d0864d81dbc3 tempest-VolumesActionsTest-1874813921 None] Selected osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898 as target Quobyte volume. {{(pid=87272) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 10:53:00 devstack cinder-volume[87272]: INFO cinder.volume.drivers.remotefs [None req-0e550ea7-5236-43f6-906d-d0864d81dbc3 tempest-VolumesActionsTest-1874813921 None] casted to osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898 Nov 04 10:53:00 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-0e550ea7-5236-43f6-906d-d0864d81dbc3 tempest-VolumesActionsTest-1874813921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-53616f33-b585-490b-b201-d254acfd6f79 1073741824 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:53:00 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [req-1967b78b-4c95-4981-9cde-6e28915db6ea req-51e59798-6139-4923-bb24-4249cb6fda34 tempest-AttachVolumeTestJSON-969779014 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:53:00 devstack sudo[91652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-53616f33-b585-490b-b201-d254acfd6f79 1073741824 Nov 04 10:53:00 devstack sudo[91652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:53:01 devstack sudo[91652]: pam_unix(sudo:session): session closed for user root Nov 04 10:53:01 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-0e550ea7-5236-43f6-906d-d0864d81dbc3 tempest-VolumesActionsTest-1874813921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-53616f33-b585-490b-b201-d254acfd6f79 1073741824" returned: 0 in 0.595s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:53:01 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-0e550ea7-5236-43f6-906d-d0864d81dbc3 tempest-VolumesActionsTest-1874813921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-53616f33-b585-490b-b201-d254acfd6f79 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:53:01 devstack sudo[91661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-53616f33-b585-490b-b201-d254acfd6f79 Nov 04 10:53:01 devstack sudo[91661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:53:01 devstack sudo[91661]: pam_unix(sudo:session): session closed for user root Nov 04 10:53:01 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-0e550ea7-5236-43f6-906d-d0864d81dbc3 tempest-VolumesActionsTest-1874813921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-53616f33-b585-490b-b201-d254acfd6f79" returned: 0 in 0.281s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:53:01 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-0e550ea7-5236-43f6-906d-d0864d81dbc3 tempest-VolumesActionsTest-1874813921 None] <== create_volume: return (933ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'} {{(pid=87272) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 04 10:53:01 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-0e550ea7-5236-43f6-906d-d0864d81dbc3 tempest-VolumesActionsTest-1874813921 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.935s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:53:01 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [req-1967b78b-4c95-4981-9cde-6e28915db6ea req-51e59798-6139-4923-bb24-4249cb6fda34 tempest-AttachVolumeTestJSON-969779014 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.908s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:53:01 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-0e550ea7-5236-43f6-906d-d0864d81dbc3 tempest-VolumesActionsTest-1874813921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01ed3511-1121-499d-9d1a-332df36b2b9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-53616f33-b585-490b-b201-d254acfd6f79', 'volume_size': 1}' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:53:01 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-0e550ea7-5236-43f6-906d-d0864d81dbc3 tempest-VolumesActionsTest-1874813921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54421e6f-1b6e-41a9-aa54-fe54cab2b63f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:53:01 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [req-1967b78b-4c95-4981-9cde-6e28915db6ea req-51e59798-6139-4923-bb24-4249cb6fda34 tempest-AttachVolumeTestJSON-969779014 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.028s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:53:01 devstack cinder-volume[87272]: INFO cinder.volume.flows.manager.create_volume [None req-0e550ea7-5236-43f6-906d-d0864d81dbc3 tempest-VolumesActionsTest-1874813921 None] Volume volume-53616f33-b585-490b-b201-d254acfd6f79 (53616f33-b585-490b-b201-d254acfd6f79): created successfully Nov 04 10:53:01 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-0e550ea7-5236-43f6-906d-d0864d81dbc3 tempest-VolumesActionsTest-1874813921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54421e6f-1b6e-41a9-aa54-fe54cab2b63f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:53:01 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-0e550ea7-5236-43f6-906d-d0864d81dbc3 tempest-VolumesActionsTest-1874813921 None] Flow 'volume_create_manager' (4b4fd905-a12e-4cb9-8bdd-53446038f8ba) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87272) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:53:01 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-0e550ea7-5236-43f6-906d-d0864d81dbc3 tempest-VolumesActionsTest-1874813921 None] Created volume successfully. Nov 04 10:53:01 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [req-1967b78b-4c95-4981-9cde-6e28915db6ea req-51e59798-6139-4923-bb24-4249cb6fda34 tempest-AttachVolumeTestJSON-969779014 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898', 'name': 'volume-ebcb6fbe-5804-4bad-8c3c-f786d70e86e1', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '3b3e82b4-9384-4526-8e68-7a4b48b25698', 'enforce_multipath': True} {{(pid=87272) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 04 10:53:02 devstack cinder-volume[87272]: INFO cinder.volume.manager [req-1967b78b-4c95-4981-9cde-6e28915db6ea req-51e59798-6139-4923-bb24-4249cb6fda34 tempest-AttachVolumeTestJSON-969779014 None] attachment_update completed successfully. Nov 04 10:53:02 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [req-1d68d133-9523-4b55-ac0d-72acf03452da req-a7cfad7d-212a-4ca0-bad6-9ff66c31da9c tempest-AttachVolumeShelveTestJSON-1521270859 None] No connector for attachment 93e11eea-630f-48a1-bed0-bbaee7f6ac40; skipping storage backend terminate_connection call. {{(pid=87272) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5010}} Nov 04 10:53:02 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [req-1d68d133-9523-4b55-ac0d-72acf03452da req-a7cfad7d-212a-4ca0-bad6-9ff66c31da9c tempest-AttachVolumeShelveTestJSON-1521270859 None] Deleting attachment 93e11eea-630f-48a1-bed0-bbaee7f6ac40. {{(pid=87272) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 04 10:53:03 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-abdab56c-3332-43b7-91f2-3eb73132fe3f tempest-VolumesActionsTest-930627907 None] Acquiring lock "cinder-53616f33-b585-490b-b201-d254acfd6f79-delete_volume" by "delete_volume" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:53:03 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-abdab56c-3332-43b7-91f2-3eb73132fe3f tempest-VolumesActionsTest-930627907 None] Lock "cinder-53616f33-b585-490b-b201-d254acfd6f79-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:53:03 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-abdab56c-3332-43b7-91f2-3eb73132fe3f tempest-VolumesActionsTest-930627907 None] Acquiring lock "cinder-quobyte-53616f33-b585-490b-b201-d254acfd6f79" by "delete_volume" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:53:03 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-abdab56c-3332-43b7-91f2-3eb73132fe3f tempest-VolumesActionsTest-930627907 None] Lock "cinder-quobyte-53616f33-b585-490b-b201-d254acfd6f79" acquired by "delete_volume" :: waited 0.023s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:53:03 devstack cinder-volume[87272]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf12d297-42f9-4dec-b1d7-dcbf14fba9ed]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:53:03 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-abdab56c-3332-43b7-91f2-3eb73132fe3f tempest-VolumesActionsTest-930627907 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-53616f33-b585-490b-b201-d254acfd6f79 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:53:03 devstack sudo[91671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-53616f33-b585-490b-b201-d254acfd6f79 Nov 04 10:53:03 devstack sudo[91671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:53:04 devstack sudo[91671]: pam_unix(sudo:session): session closed for user root Nov 04 10:53:04 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-abdab56c-3332-43b7-91f2-3eb73132fe3f tempest-VolumesActionsTest-930627907 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-53616f33-b585-490b-b201-d254acfd6f79" returned: 0 in 0.717s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:53:04 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-abdab56c-3332-43b7-91f2-3eb73132fe3f tempest-VolumesActionsTest-930627907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-53616f33-b585-490b-b201-d254acfd6f79 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:53:04 devstack sudo[91708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-53616f33-b585-490b-b201-d254acfd6f79 Nov 04 10:53:04 devstack sudo[91708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:53:04 devstack sudo[91708]: pam_unix(sudo:session): session closed for user root Nov 04 10:53:04 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-abdab56c-3332-43b7-91f2-3eb73132fe3f tempest-VolumesActionsTest-930627907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-53616f33-b585-490b-b201-d254acfd6f79" returned: 0 in 0.545s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:53:04 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-abdab56c-3332-43b7-91f2-3eb73132fe3f tempest-VolumesActionsTest-930627907 None] Lock "cinder-quobyte-53616f33-b585-490b-b201-d254acfd6f79" released by "delete_volume" :: held 1.372s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:53:04 devstack cinder-volume[87272]: INFO cinder.volume.manager [req-0c05e2fe-6fb8-4c18-97b1-6b9df4fe8b59 req-eafe0a6a-1c86-48c8-8d7d-67616fbba7cd tempest-AttachVolumeTestJSON-969779014 None] Terminate volume connection completed successfully. Nov 04 10:53:04 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [req-0c05e2fe-6fb8-4c18-97b1-6b9df4fe8b59 req-eafe0a6a-1c86-48c8-8d7d-67616fbba7cd tempest-AttachVolumeTestJSON-969779014 None] Deleting attachment 8b4fe6a9-1f8c-4d95-b06e-b612a81b582f. {{(pid=87272) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 04 10:53:04 devstack cinder-volume[87272]: DEBUG cinder.quota [None req-abdab56c-3332-43b7-91f2-3eb73132fe3f tempest-VolumesActionsTest-930627907 None] Created reservations ['c4de0535-778b-4aa7-8908-4af57b2e4186', '5b59b076-14c4-40b5-af6e-b3b19a2f52fd', '7253e594-2b33-4306-b541-717b45138ebb', '25d4caa2-6e3c-4860-a6e6-a331614813ff'] {{(pid=87272) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 10:53:04 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-abdab56c-3332-43b7-91f2-3eb73132fe3f tempest-VolumesActionsTest-930627907 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:53:04 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-abdab56c-3332-43b7-91f2-3eb73132fe3f tempest-VolumesActionsTest-930627907 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:53:04 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-abdab56c-3332-43b7-91f2-3eb73132fe3f tempest-VolumesActionsTest-930627907 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898': None} {{(pid=87272) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:53:04 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-abdab56c-3332-43b7-91f2-3eb73132fe3f tempest-VolumesActionsTest-930627907 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'] {{(pid=87272) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:53:04 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-abdab56c-3332-43b7-91f2-3eb73132fe3f tempest-VolumesActionsTest-930627907 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:53:04 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-abdab56c-3332-43b7-91f2-3eb73132fe3f tempest-VolumesActionsTest-930627907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:53:04 devstack sudo[91726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1 Nov 04 10:53:04 devstack sudo[91726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:53:05 devstack sudo[91726]: pam_unix(sudo:session): session closed for user root Nov 04 10:53:05 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-abdab56c-3332-43b7-91f2-3eb73132fe3f tempest-VolumesActionsTest-930627907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1" returned: 0 in 0.450s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:53:05 devstack cinder-volume[87272]: DEBUG cinder.manager [None req-abdab56c-3332-43b7-91f2-3eb73132fe3f tempest-VolumesActionsTest-930627907 None] Notifying Schedulers of capabilities ... {{(pid=87272) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 10:53:05 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-abdab56c-3332-43b7-91f2-3eb73132fe3f tempest-VolumesActionsTest-930627907 None] Deleted volume successfully. Nov 04 10:53:05 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-abdab56c-3332-43b7-91f2-3eb73132fe3f tempest-VolumesActionsTest-930627907 None] Lock "cinder-53616f33-b585-490b-b201-d254acfd6f79-delete_volume" released by "delete_volume" :: held 2.266s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:53:06 devstack cinder-volume[87272]: DEBUG cinder.volume.flows.manager.create_volume [None req-ecb34a6c-5fdd-4766-b606-7060f726771f tempest-VolumesActionsTest-1874813921 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87272) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 10:53:06 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-ecb34a6c-5fdd-4766-b606-7060f726771f tempest-VolumesActionsTest-1874813921 None] Flow 'volume_create_manager' (36497ffb-bdaa-4b59-a460-3b5963097d92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:53:06 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-ecb34a6c-5fdd-4766-b606-7060f726771f tempest-VolumesActionsTest-1874813921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (334a6da1-6cdb-40cd-9481-4f99d6b19c35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:53:06 devstack cinder-volume[87272]: INFO cinder.volume.manager [req-320c2452-734d-4d4f-86a3-64e7775a1194 req-824d3a70-fc5c-4b93-93fc-266fdab25188 tempest-AttachVolumeTestJSON-969779014 None] Terminate volume connection completed successfully. Nov 04 10:53:06 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [req-320c2452-734d-4d4f-86a3-64e7775a1194 req-824d3a70-fc5c-4b93-93fc-266fdab25188 tempest-AttachVolumeTestJSON-969779014 None] Deleting attachment 3b3e82b4-9384-4526-8e68-7a4b48b25698. {{(pid=87272) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 04 10:53:06 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-ecb34a6c-5fdd-4766-b606-7060f726771f tempest-VolumesActionsTest-1874813921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (334a6da1-6cdb-40cd-9481-4f99d6b19c35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T09:53:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1545203510',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a9587cf-9a56-4cc7-a2de-e911c5f3274c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ebc5facbf73344079918d4c6828b6985',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T09:53:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T09:53:06Z,use_quota=True,user_id='bb73b98c6b6748899fe24acefca7dde5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8989e4f-21e3-4f0a-9584-0d818784e883),volume_type_id=f8989e4f-21e3-4f0a-9584-0d818784e883)' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:53:06 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-ecb34a6c-5fdd-4766-b606-7060f726771f tempest-VolumesActionsTest-1874813921 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (733ac888-f6c6-4b9d-9c6d-fe8dc5758f4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:53:06 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-ecb34a6c-5fdd-4766-b606-7060f726771f tempest-VolumesActionsTest-1874813921 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (733ac888-f6c6-4b9d-9c6d-fe8dc5758f4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:53:06 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-ecb34a6c-5fdd-4766-b606-7060f726771f tempest-VolumesActionsTest-1874813921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4cbe0fe9-39db-4548-9b2f-9e45ed938c04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:53:06 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-ecb34a6c-5fdd-4766-b606-7060f726771f tempest-VolumesActionsTest-1874813921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4cbe0fe9-39db-4548-9b2f-9e45ed938c04) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2a9587cf-9a56-4cc7-a2de-e911c5f3274c', 'volume_name': 'volume-2a9587cf-9a56-4cc7-a2de-e911c5f3274c', 'volume_size': 1}' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:53:06 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-ecb34a6c-5fdd-4766-b606-7060f726771f tempest-VolumesActionsTest-1874813921 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f92a171f-3943-48a7-9d4a-55fa55b5984e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:53:06 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-ecb34a6c-5fdd-4766-b606-7060f726771f tempest-VolumesActionsTest-1874813921 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f92a171f-3943-48a7-9d4a-55fa55b5984e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:53:06 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-ecb34a6c-5fdd-4766-b606-7060f726771f tempest-VolumesActionsTest-1874813921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c1997af0-11ce-49a7-87a6-38cdb84a4e66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:53:06 devstack cinder-volume[87272]: INFO cinder.volume.flows.manager.create_volume [None req-ecb34a6c-5fdd-4766-b606-7060f726771f tempest-VolumesActionsTest-1874813921 None] Volume 2a9587cf-9a56-4cc7-a2de-e911c5f3274c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2a9587cf-9a56-4cc7-a2de-e911c5f3274c', 'volume_size': 1} Nov 04 10:53:06 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-ecb34a6c-5fdd-4766-b606-7060f726771f tempest-VolumesActionsTest-1874813921 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:53:06 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-ecb34a6c-5fdd-4766-b606-7060f726771f tempest-VolumesActionsTest-1874813921 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.006s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:53:06 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-ecb34a6c-5fdd-4766-b606-7060f726771f tempest-VolumesActionsTest-1874813921 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T09:53:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1545203510',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a9587cf-9a56-4cc7-a2de-e911c5f3274c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ebc5facbf73344079918d4c6828b6985',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T09:53:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T09:53:06Z,use_quota=True,user_id='bb73b98c6b6748899fe24acefca7dde5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8989e4f-21e3-4f0a-9584-0d818784e883),volume_type_id=f8989e4f-21e3-4f0a-9584-0d818784e883)}" {{(pid=87272) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 04 10:53:06 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.remotefs [None req-ecb34a6c-5fdd-4766-b606-7060f726771f tempest-VolumesActionsTest-1874813921 None] Creating volume 2a9587cf-9a56-4cc7-a2de-e911c5f3274c {{(pid=87272) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 10:53:06 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-ecb34a6c-5fdd-4766-b606-7060f726771f tempest-VolumesActionsTest-1874813921 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:53:06 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-ecb34a6c-5fdd-4766-b606-7060f726771f tempest-VolumesActionsTest-1874813921 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:53:06 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-ecb34a6c-5fdd-4766-b606-7060f726771f tempest-VolumesActionsTest-1874813921 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898': None} {{(pid=87272) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:53:06 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-ecb34a6c-5fdd-4766-b606-7060f726771f tempest-VolumesActionsTest-1874813921 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'] {{(pid=87272) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:53:06 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-ecb34a6c-5fdd-4766-b606-7060f726771f tempest-VolumesActionsTest-1874813921 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:53:06 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-ecb34a6c-5fdd-4766-b606-7060f726771f tempest-VolumesActionsTest-1874813921 None] Selected osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898 as target Quobyte volume. {{(pid=87272) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 10:53:06 devstack cinder-volume[87272]: INFO cinder.volume.drivers.remotefs [None req-ecb34a6c-5fdd-4766-b606-7060f726771f tempest-VolumesActionsTest-1874813921 None] casted to osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898 Nov 04 10:53:06 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-ecb34a6c-5fdd-4766-b606-7060f726771f tempest-VolumesActionsTest-1874813921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-2a9587cf-9a56-4cc7-a2de-e911c5f3274c 1073741824 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:53:06 devstack sudo[91763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-2a9587cf-9a56-4cc7-a2de-e911c5f3274c 1073741824 Nov 04 10:53:06 devstack sudo[91763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:53:07 devstack sudo[91763]: pam_unix(sudo:session): session closed for user root Nov 04 10:53:07 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-ecb34a6c-5fdd-4766-b606-7060f726771f tempest-VolumesActionsTest-1874813921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-2a9587cf-9a56-4cc7-a2de-e911c5f3274c 1073741824" returned: 0 in 0.822s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:53:07 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-ecb34a6c-5fdd-4766-b606-7060f726771f tempest-VolumesActionsTest-1874813921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-2a9587cf-9a56-4cc7-a2de-e911c5f3274c {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:53:07 devstack sudo[91768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-2a9587cf-9a56-4cc7-a2de-e911c5f3274c Nov 04 10:53:07 devstack sudo[91768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:53:08 devstack sudo[91768]: pam_unix(sudo:session): session closed for user root Nov 04 10:53:08 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-ecb34a6c-5fdd-4766-b606-7060f726771f tempest-VolumesActionsTest-1874813921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-2a9587cf-9a56-4cc7-a2de-e911c5f3274c" returned: 0 in 0.551s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:53:08 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-ecb34a6c-5fdd-4766-b606-7060f726771f tempest-VolumesActionsTest-1874813921 None] <== create_volume: return (1471ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'} {{(pid=87272) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 04 10:53:08 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-ecb34a6c-5fdd-4766-b606-7060f726771f tempest-VolumesActionsTest-1874813921 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.480s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:53:08 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-ecb34a6c-5fdd-4766-b606-7060f726771f tempest-VolumesActionsTest-1874813921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c1997af0-11ce-49a7-87a6-38cdb84a4e66) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2a9587cf-9a56-4cc7-a2de-e911c5f3274c', 'volume_size': 1}' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:53:08 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-ecb34a6c-5fdd-4766-b606-7060f726771f tempest-VolumesActionsTest-1874813921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53f63950-cfe9-40bc-a45d-f8ddf25c61ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:53:08 devstack cinder-volume[87272]: INFO cinder.volume.flows.manager.create_volume [None req-ecb34a6c-5fdd-4766-b606-7060f726771f tempest-VolumesActionsTest-1874813921 None] Volume volume-2a9587cf-9a56-4cc7-a2de-e911c5f3274c (2a9587cf-9a56-4cc7-a2de-e911c5f3274c): created successfully Nov 04 10:53:08 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-ecb34a6c-5fdd-4766-b606-7060f726771f tempest-VolumesActionsTest-1874813921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53f63950-cfe9-40bc-a45d-f8ddf25c61ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:53:08 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-ecb34a6c-5fdd-4766-b606-7060f726771f tempest-VolumesActionsTest-1874813921 None] Flow 'volume_create_manager' (36497ffb-bdaa-4b59-a460-3b5963097d92) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87272) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:53:08 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-ecb34a6c-5fdd-4766-b606-7060f726771f tempest-VolumesActionsTest-1874813921 None] Created volume successfully. Nov 04 10:53:08 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-36597bf1-2da3-4e09-abf7-00e540062df3 tempest-VolumesActionsTest-930627907 None] Acquiring lock "cinder-2a9587cf-9a56-4cc7-a2de-e911c5f3274c-delete_volume" by "delete_volume" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:53:08 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-36597bf1-2da3-4e09-abf7-00e540062df3 tempest-VolumesActionsTest-930627907 None] Lock "cinder-2a9587cf-9a56-4cc7-a2de-e911c5f3274c-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:53:09 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-36597bf1-2da3-4e09-abf7-00e540062df3 tempest-VolumesActionsTest-930627907 None] Acquiring lock "cinder-quobyte-2a9587cf-9a56-4cc7-a2de-e911c5f3274c" by "delete_volume" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:53:09 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-36597bf1-2da3-4e09-abf7-00e540062df3 tempest-VolumesActionsTest-930627907 None] Lock "cinder-quobyte-2a9587cf-9a56-4cc7-a2de-e911c5f3274c" acquired by "delete_volume" :: waited 0.029s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:53:09 devstack cinder-volume[87272]: DEBUG oslo.privsep.daemon [-] privsep: reply[1322977f-7bb6-4196-897c-7140ecd8bd59]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:53:09 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-36597bf1-2da3-4e09-abf7-00e540062df3 tempest-VolumesActionsTest-930627907 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-2a9587cf-9a56-4cc7-a2de-e911c5f3274c {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:53:09 devstack sudo[91791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-2a9587cf-9a56-4cc7-a2de-e911c5f3274c Nov 04 10:53:09 devstack sudo[91791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:53:09 devstack sudo[91791]: pam_unix(sudo:session): session closed for user root Nov 04 10:53:09 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-36597bf1-2da3-4e09-abf7-00e540062df3 tempest-VolumesActionsTest-930627907 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-2a9587cf-9a56-4cc7-a2de-e911c5f3274c" returned: 0 in 0.517s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:53:09 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-36597bf1-2da3-4e09-abf7-00e540062df3 tempest-VolumesActionsTest-930627907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-2a9587cf-9a56-4cc7-a2de-e911c5f3274c {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:53:09 devstack sudo[91797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-2a9587cf-9a56-4cc7-a2de-e911c5f3274c Nov 04 10:53:09 devstack sudo[91797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:53:09 devstack sudo[91797]: pam_unix(sudo:session): session closed for user root Nov 04 10:53:09 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-36597bf1-2da3-4e09-abf7-00e540062df3 tempest-VolumesActionsTest-930627907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-2a9587cf-9a56-4cc7-a2de-e911c5f3274c" returned: 0 in 0.352s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:53:10 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-36597bf1-2da3-4e09-abf7-00e540062df3 tempest-VolumesActionsTest-930627907 None] Lock "cinder-quobyte-2a9587cf-9a56-4cc7-a2de-e911c5f3274c" released by "delete_volume" :: held 0.943s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:53:10 devstack cinder-volume[87272]: DEBUG cinder.quota [None req-36597bf1-2da3-4e09-abf7-00e540062df3 tempest-VolumesActionsTest-930627907 None] Created reservations ['0a44fa3e-a8fb-4e64-b19c-a498e0e0567b', 'e547d13b-5015-407d-ac85-8be4f4587880', '930d8712-4a75-490f-9b8b-2ce9771c09d6', '0680165a-9320-45d2-9404-c43b3e83ae0c'] {{(pid=87272) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 10:53:10 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-36597bf1-2da3-4e09-abf7-00e540062df3 tempest-VolumesActionsTest-930627907 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:53:10 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-36597bf1-2da3-4e09-abf7-00e540062df3 tempest-VolumesActionsTest-930627907 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:53:10 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-36597bf1-2da3-4e09-abf7-00e540062df3 tempest-VolumesActionsTest-930627907 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898': None} {{(pid=87272) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:53:10 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-36597bf1-2da3-4e09-abf7-00e540062df3 tempest-VolumesActionsTest-930627907 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'] {{(pid=87272) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:53:10 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-36597bf1-2da3-4e09-abf7-00e540062df3 tempest-VolumesActionsTest-930627907 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:53:10 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-36597bf1-2da3-4e09-abf7-00e540062df3 tempest-VolumesActionsTest-930627907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:53:10 devstack sudo[91804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1 Nov 04 10:53:10 devstack sudo[91804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:53:10 devstack sudo[91804]: pam_unix(sudo:session): session closed for user root Nov 04 10:53:10 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-36597bf1-2da3-4e09-abf7-00e540062df3 tempest-VolumesActionsTest-930627907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1" returned: 0 in 0.378s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:53:10 devstack cinder-volume[87272]: DEBUG cinder.manager [None req-36597bf1-2da3-4e09-abf7-00e540062df3 tempest-VolumesActionsTest-930627907 None] Notifying Schedulers of capabilities ... {{(pid=87272) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 10:53:10 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-36597bf1-2da3-4e09-abf7-00e540062df3 tempest-VolumesActionsTest-930627907 None] Deleted volume successfully. Nov 04 10:53:10 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-36597bf1-2da3-4e09-abf7-00e540062df3 tempest-VolumesActionsTest-930627907 None] Lock "cinder-2a9587cf-9a56-4cc7-a2de-e911c5f3274c-delete_volume" released by "delete_volume" :: held 1.707s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:53:12 devstack cinder-volume[87272]: DEBUG cinder.volume.flows.manager.create_volume [None req-d07a6749-93f1-4d0c-851d-660761ebfacf tempest-VolumesActionsTest-1874813921 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87272) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 10:53:12 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-d07a6749-93f1-4d0c-851d-660761ebfacf tempest-VolumesActionsTest-1874813921 None] Flow 'volume_create_manager' (5e28f4dc-0514-4f08-9ac5-95e9b5d3260b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:53:12 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-d07a6749-93f1-4d0c-851d-660761ebfacf tempest-VolumesActionsTest-1874813921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (292f9c13-df18-4033-8af2-4ddd0baba61e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:53:12 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-d07a6749-93f1-4d0c-851d-660761ebfacf tempest-VolumesActionsTest-1874813921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (292f9c13-df18-4033-8af2-4ddd0baba61e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T09:53:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-685215453',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e6729f4a-ed2a-4e69-a737-f7f96045b96b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ebc5facbf73344079918d4c6828b6985',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T09:53:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T09:53:12Z,use_quota=True,user_id='bb73b98c6b6748899fe24acefca7dde5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8989e4f-21e3-4f0a-9584-0d818784e883),volume_type_id=f8989e4f-21e3-4f0a-9584-0d818784e883)' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:53:12 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-d07a6749-93f1-4d0c-851d-660761ebfacf tempest-VolumesActionsTest-1874813921 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a6a5f338-7235-4e1d-8fd1-81f5cb2b75d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:53:12 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-d07a6749-93f1-4d0c-851d-660761ebfacf tempest-VolumesActionsTest-1874813921 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a6a5f338-7235-4e1d-8fd1-81f5cb2b75d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:53:12 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-d07a6749-93f1-4d0c-851d-660761ebfacf tempest-VolumesActionsTest-1874813921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0dd2a03-c09c-47bd-9c21-6870e031d586) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:53:12 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-d07a6749-93f1-4d0c-851d-660761ebfacf tempest-VolumesActionsTest-1874813921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0dd2a03-c09c-47bd-9c21-6870e031d586) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e6729f4a-ed2a-4e69-a737-f7f96045b96b', 'volume_name': 'volume-e6729f4a-ed2a-4e69-a737-f7f96045b96b', 'volume_size': 1}' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:53:12 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-d07a6749-93f1-4d0c-851d-660761ebfacf tempest-VolumesActionsTest-1874813921 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c545ea2a-e845-4143-b2c5-da1d6940ffd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:53:12 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-d07a6749-93f1-4d0c-851d-660761ebfacf tempest-VolumesActionsTest-1874813921 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c545ea2a-e845-4143-b2c5-da1d6940ffd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:53:12 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-d07a6749-93f1-4d0c-851d-660761ebfacf tempest-VolumesActionsTest-1874813921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (80786302-a761-45dc-9fae-11e1be92cefb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:53:12 devstack cinder-volume[87272]: INFO cinder.volume.flows.manager.create_volume [None req-d07a6749-93f1-4d0c-851d-660761ebfacf tempest-VolumesActionsTest-1874813921 None] Volume e6729f4a-ed2a-4e69-a737-f7f96045b96b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e6729f4a-ed2a-4e69-a737-f7f96045b96b', 'volume_size': 1} Nov 04 10:53:12 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-d07a6749-93f1-4d0c-851d-660761ebfacf tempest-VolumesActionsTest-1874813921 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:53:12 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-d07a6749-93f1-4d0c-851d-660761ebfacf tempest-VolumesActionsTest-1874813921 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:53:12 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-d07a6749-93f1-4d0c-851d-660761ebfacf tempest-VolumesActionsTest-1874813921 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T09:53:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-685215453',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e6729f4a-ed2a-4e69-a737-f7f96045b96b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ebc5facbf73344079918d4c6828b6985',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T09:53:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T09:53:12Z,use_quota=True,user_id='bb73b98c6b6748899fe24acefca7dde5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8989e4f-21e3-4f0a-9584-0d818784e883),volume_type_id=f8989e4f-21e3-4f0a-9584-0d818784e883)}" {{(pid=87272) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 04 10:53:12 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.remotefs [None req-d07a6749-93f1-4d0c-851d-660761ebfacf tempest-VolumesActionsTest-1874813921 None] Creating volume e6729f4a-ed2a-4e69-a737-f7f96045b96b {{(pid=87272) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 10:53:12 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-d07a6749-93f1-4d0c-851d-660761ebfacf tempest-VolumesActionsTest-1874813921 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:53:12 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-d07a6749-93f1-4d0c-851d-660761ebfacf tempest-VolumesActionsTest-1874813921 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:53:12 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-d07a6749-93f1-4d0c-851d-660761ebfacf tempest-VolumesActionsTest-1874813921 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898': None} {{(pid=87272) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:53:12 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-d07a6749-93f1-4d0c-851d-660761ebfacf tempest-VolumesActionsTest-1874813921 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'] {{(pid=87272) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:53:12 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-d07a6749-93f1-4d0c-851d-660761ebfacf tempest-VolumesActionsTest-1874813921 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:53:12 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-d07a6749-93f1-4d0c-851d-660761ebfacf tempest-VolumesActionsTest-1874813921 None] Selected osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898 as target Quobyte volume. {{(pid=87272) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 10:53:12 devstack cinder-volume[87272]: INFO cinder.volume.drivers.remotefs [None req-d07a6749-93f1-4d0c-851d-660761ebfacf tempest-VolumesActionsTest-1874813921 None] casted to osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898 Nov 04 10:53:12 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-d07a6749-93f1-4d0c-851d-660761ebfacf tempest-VolumesActionsTest-1874813921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-e6729f4a-ed2a-4e69-a737-f7f96045b96b 1073741824 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:53:12 devstack sudo[91812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-e6729f4a-ed2a-4e69-a737-f7f96045b96b 1073741824 Nov 04 10:53:12 devstack sudo[91812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:53:13 devstack sudo[91812]: pam_unix(sudo:session): session closed for user root Nov 04 10:53:13 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-d07a6749-93f1-4d0c-851d-660761ebfacf tempest-VolumesActionsTest-1874813921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-e6729f4a-ed2a-4e69-a737-f7f96045b96b 1073741824" returned: 0 in 0.874s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:53:13 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-d07a6749-93f1-4d0c-851d-660761ebfacf tempest-VolumesActionsTest-1874813921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-e6729f4a-ed2a-4e69-a737-f7f96045b96b {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:53:13 devstack sudo[91817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-e6729f4a-ed2a-4e69-a737-f7f96045b96b Nov 04 10:53:13 devstack sudo[91817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:53:13 devstack sudo[91817]: pam_unix(sudo:session): session closed for user root Nov 04 10:53:13 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-d07a6749-93f1-4d0c-851d-660761ebfacf tempest-VolumesActionsTest-1874813921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-e6729f4a-ed2a-4e69-a737-f7f96045b96b" returned: 0 in 0.515s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:53:13 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-d07a6749-93f1-4d0c-851d-660761ebfacf tempest-VolumesActionsTest-1874813921 None] <== create_volume: return (1487ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'} {{(pid=87272) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 04 10:53:13 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-d07a6749-93f1-4d0c-851d-660761ebfacf tempest-VolumesActionsTest-1874813921 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.490s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:53:13 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-d07a6749-93f1-4d0c-851d-660761ebfacf tempest-VolumesActionsTest-1874813921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (80786302-a761-45dc-9fae-11e1be92cefb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e6729f4a-ed2a-4e69-a737-f7f96045b96b', 'volume_size': 1}' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:53:13 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-d07a6749-93f1-4d0c-851d-660761ebfacf tempest-VolumesActionsTest-1874813921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa8761e7-8052-4912-bfb3-6012e21acff4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:53:13 devstack cinder-volume[87272]: INFO cinder.volume.flows.manager.create_volume [None req-d07a6749-93f1-4d0c-851d-660761ebfacf tempest-VolumesActionsTest-1874813921 None] Volume volume-e6729f4a-ed2a-4e69-a737-f7f96045b96b (e6729f4a-ed2a-4e69-a737-f7f96045b96b): created successfully Nov 04 10:53:13 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-d07a6749-93f1-4d0c-851d-660761ebfacf tempest-VolumesActionsTest-1874813921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa8761e7-8052-4912-bfb3-6012e21acff4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:53:13 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-d07a6749-93f1-4d0c-851d-660761ebfacf tempest-VolumesActionsTest-1874813921 None] Flow 'volume_create_manager' (5e28f4dc-0514-4f08-9ac5-95e9b5d3260b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87272) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:53:14 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-d07a6749-93f1-4d0c-851d-660761ebfacf tempest-VolumesActionsTest-1874813921 None] Created volume successfully. Nov 04 10:53:14 devstack cinder-volume[87272]: DEBUG oslo_service.periodic_task [None req-236af0be-7f9d-4c80-b3d7-d645a9cd0dd1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87272) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 04 10:53:14 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-236af0be-7f9d-4c80-b3d7-d645a9cd0dd1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:53:14 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-236af0be-7f9d-4c80-b3d7-d645a9cd0dd1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:53:14 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-236af0be-7f9d-4c80-b3d7-d645a9cd0dd1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898': None} {{(pid=87272) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:53:14 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-236af0be-7f9d-4c80-b3d7-d645a9cd0dd1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'] {{(pid=87272) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:53:14 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-236af0be-7f9d-4c80-b3d7-d645a9cd0dd1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:53:14 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-236af0be-7f9d-4c80-b3d7-d645a9cd0dd1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:53:14 devstack sudo[91820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1 Nov 04 10:53:14 devstack sudo[91820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:53:14 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-e6ccf4bc-548b-4412-95b0-2b4f3c291b59 tempest-AttachVolumeTestJSON-969779014 None] Acquiring lock "cinder-ebcb6fbe-5804-4bad-8c3c-f786d70e86e1-delete_volume" by "delete_volume" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:53:14 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-e6ccf4bc-548b-4412-95b0-2b4f3c291b59 tempest-AttachVolumeTestJSON-969779014 None] Lock "cinder-ebcb6fbe-5804-4bad-8c3c-f786d70e86e1-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:53:14 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-e6ccf4bc-548b-4412-95b0-2b4f3c291b59 tempest-AttachVolumeTestJSON-969779014 None] Acquiring lock "cinder-quobyte-ebcb6fbe-5804-4bad-8c3c-f786d70e86e1" by "delete_volume" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:53:14 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-e6ccf4bc-548b-4412-95b0-2b4f3c291b59 tempest-AttachVolumeTestJSON-969779014 None] Lock "cinder-quobyte-ebcb6fbe-5804-4bad-8c3c-f786d70e86e1" acquired by "delete_volume" :: waited 0.021s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:53:14 devstack sudo[91820]: pam_unix(sudo:session): session closed for user root Nov 04 10:53:14 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-236af0be-7f9d-4c80-b3d7-d645a9cd0dd1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1" returned: 0 in 0.420s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:53:14 devstack cinder-volume[87272]: DEBUG cinder.manager [None req-236af0be-7f9d-4c80-b3d7-d645a9cd0dd1 None None] Notifying Schedulers of capabilities ... {{(pid=87272) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 10:53:14 devstack cinder-volume[87272]: DEBUG oslo.privsep.daemon [-] privsep: reply[01e2031f-2bff-4431-8d83-7e1bfc76c812]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:53:14 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-e6ccf4bc-548b-4412-95b0-2b4f3c291b59 tempest-AttachVolumeTestJSON-969779014 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-ebcb6fbe-5804-4bad-8c3c-f786d70e86e1 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:53:14 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-31a79179-b0c2-45ae-a2d5-51350ac231c8 tempest-VolumesActionsTest-930627907 None] Acquiring lock "cinder-e6729f4a-ed2a-4e69-a737-f7f96045b96b-delete_volume" by "delete_volume" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:53:14 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-31a79179-b0c2-45ae-a2d5-51350ac231c8 tempest-VolumesActionsTest-930627907 None] Lock "cinder-e6729f4a-ed2a-4e69-a737-f7f96045b96b-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:53:14 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-31a79179-b0c2-45ae-a2d5-51350ac231c8 tempest-VolumesActionsTest-930627907 None] Acquiring lock "cinder-quobyte-e6729f4a-ed2a-4e69-a737-f7f96045b96b" by "delete_volume" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:53:14 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-31a79179-b0c2-45ae-a2d5-51350ac231c8 tempest-VolumesActionsTest-930627907 None] Lock "cinder-quobyte-e6729f4a-ed2a-4e69-a737-f7f96045b96b" acquired by "delete_volume" :: waited 0.037s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:53:14 devstack sudo[91833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-ebcb6fbe-5804-4bad-8c3c-f786d70e86e1 Nov 04 10:53:14 devstack sudo[91833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:53:14 devstack cinder-volume[87272]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c11e5d3-997b-476f-bcb0-b89ff80f5fe0]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:53:14 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-31a79179-b0c2-45ae-a2d5-51350ac231c8 tempest-VolumesActionsTest-930627907 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-e6729f4a-ed2a-4e69-a737-f7f96045b96b {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:53:14 devstack sudo[91836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-e6729f4a-ed2a-4e69-a737-f7f96045b96b Nov 04 10:53:14 devstack sudo[91836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:53:15 devstack sudo[91833]: pam_unix(sudo:session): session closed for user root Nov 04 10:53:15 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-e6ccf4bc-548b-4412-95b0-2b4f3c291b59 tempest-AttachVolumeTestJSON-969779014 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-ebcb6fbe-5804-4bad-8c3c-f786d70e86e1" returned: 0 in 0.580s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:53:15 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-e6ccf4bc-548b-4412-95b0-2b4f3c291b59 tempest-AttachVolumeTestJSON-969779014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-ebcb6fbe-5804-4bad-8c3c-f786d70e86e1 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:53:15 devstack sudo[91844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-ebcb6fbe-5804-4bad-8c3c-f786d70e86e1 Nov 04 10:53:15 devstack sudo[91844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:53:15 devstack sudo[91836]: pam_unix(sudo:session): session closed for user root Nov 04 10:53:15 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-31a79179-b0c2-45ae-a2d5-51350ac231c8 tempest-VolumesActionsTest-930627907 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-e6729f4a-ed2a-4e69-a737-f7f96045b96b" returned: 0 in 0.486s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:53:15 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-31a79179-b0c2-45ae-a2d5-51350ac231c8 tempest-VolumesActionsTest-930627907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-e6729f4a-ed2a-4e69-a737-f7f96045b96b {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:53:15 devstack sudo[91852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-e6729f4a-ed2a-4e69-a737-f7f96045b96b Nov 04 10:53:15 devstack sudo[91852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:53:15 devstack sudo[91844]: pam_unix(sudo:session): session closed for user root Nov 04 10:53:15 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-e6ccf4bc-548b-4412-95b0-2b4f3c291b59 tempest-AttachVolumeTestJSON-969779014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-ebcb6fbe-5804-4bad-8c3c-f786d70e86e1" returned: 0 in 0.409s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:53:15 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-e6ccf4bc-548b-4412-95b0-2b4f3c291b59 tempest-AttachVolumeTestJSON-969779014 None] Lock "cinder-quobyte-ebcb6fbe-5804-4bad-8c3c-f786d70e86e1" released by "delete_volume" :: held 1.065s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:53:15 devstack sudo[91852]: pam_unix(sudo:session): session closed for user root Nov 04 10:53:15 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-31a79179-b0c2-45ae-a2d5-51350ac231c8 tempest-VolumesActionsTest-930627907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-e6729f4a-ed2a-4e69-a737-f7f96045b96b" returned: 0 in 0.358s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:53:15 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-31a79179-b0c2-45ae-a2d5-51350ac231c8 tempest-VolumesActionsTest-930627907 None] Lock "cinder-quobyte-e6729f4a-ed2a-4e69-a737-f7f96045b96b" released by "delete_volume" :: held 0.914s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:53:15 devstack cinder-volume[87272]: DEBUG cinder.quota [None req-e6ccf4bc-548b-4412-95b0-2b4f3c291b59 tempest-AttachVolumeTestJSON-969779014 None] Created reservations ['6c247a88-a4a0-4280-b921-95a61fd58de7', 'e0cf5112-a1b3-43f9-95e1-6e7b91f8f48b', '92bb8d4b-8a83-41e3-b032-62e8b28cb7d0', '2b7b3ba0-488c-458b-96f6-d4c530d40033'] {{(pid=87272) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 10:53:15 devstack cinder-volume[87272]: DEBUG cinder.quota [None req-31a79179-b0c2-45ae-a2d5-51350ac231c8 tempest-VolumesActionsTest-930627907 None] Created reservations ['198638de-8b26-4ca1-beb2-2e9896474ac5', 'b728051d-91b3-4d88-9de6-8a3e3d5902dd', 'e99b4113-ac97-487d-a8cb-7b091276c504', 'f9d41754-bea7-4209-acdf-bddcba3346e9'] {{(pid=87272) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 10:53:15 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-e6ccf4bc-548b-4412-95b0-2b4f3c291b59 tempest-AttachVolumeTestJSON-969779014 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:53:15 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-e6ccf4bc-548b-4412-95b0-2b4f3c291b59 tempest-AttachVolumeTestJSON-969779014 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:53:15 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-e6ccf4bc-548b-4412-95b0-2b4f3c291b59 tempest-AttachVolumeTestJSON-969779014 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898': None} {{(pid=87272) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:53:15 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-e6ccf4bc-548b-4412-95b0-2b4f3c291b59 tempest-AttachVolumeTestJSON-969779014 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'] {{(pid=87272) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:53:15 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-e6ccf4bc-548b-4412-95b0-2b4f3c291b59 tempest-AttachVolumeTestJSON-969779014 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:53:15 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-e6ccf4bc-548b-4412-95b0-2b4f3c291b59 tempest-AttachVolumeTestJSON-969779014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:53:15 devstack sudo[91873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1 Nov 04 10:53:15 devstack sudo[91873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:53:15 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-31a79179-b0c2-45ae-a2d5-51350ac231c8 tempest-VolumesActionsTest-930627907 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:53:15 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-31a79179-b0c2-45ae-a2d5-51350ac231c8 tempest-VolumesActionsTest-930627907 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:53:15 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-31a79179-b0c2-45ae-a2d5-51350ac231c8 tempest-VolumesActionsTest-930627907 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898': None} {{(pid=87272) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:53:15 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-31a79179-b0c2-45ae-a2d5-51350ac231c8 tempest-VolumesActionsTest-930627907 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'] {{(pid=87272) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:53:15 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-31a79179-b0c2-45ae-a2d5-51350ac231c8 tempest-VolumesActionsTest-930627907 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:53:15 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-31a79179-b0c2-45ae-a2d5-51350ac231c8 tempest-VolumesActionsTest-930627907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:53:15 devstack sudo[91877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1 Nov 04 10:53:15 devstack sudo[91877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:53:16 devstack sudo[91873]: pam_unix(sudo:session): session closed for user root Nov 04 10:53:16 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-e6ccf4bc-548b-4412-95b0-2b4f3c291b59 tempest-AttachVolumeTestJSON-969779014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1" returned: 0 in 0.304s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:53:16 devstack cinder-volume[87272]: DEBUG cinder.manager [None req-e6ccf4bc-548b-4412-95b0-2b4f3c291b59 tempest-AttachVolumeTestJSON-969779014 None] Notifying Schedulers of capabilities ... {{(pid=87272) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 10:53:16 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-e6ccf4bc-548b-4412-95b0-2b4f3c291b59 tempest-AttachVolumeTestJSON-969779014 None] Deleted volume successfully. Nov 04 10:53:16 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-e6ccf4bc-548b-4412-95b0-2b4f3c291b59 tempest-AttachVolumeTestJSON-969779014 None] Lock "cinder-ebcb6fbe-5804-4bad-8c3c-f786d70e86e1-delete_volume" released by "delete_volume" :: held 1.764s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:53:16 devstack sudo[91877]: pam_unix(sudo:session): session closed for user root Nov 04 10:53:16 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-31a79179-b0c2-45ae-a2d5-51350ac231c8 tempest-VolumesActionsTest-930627907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1" returned: 0 in 0.325s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:53:16 devstack cinder-volume[87272]: DEBUG cinder.manager [None req-31a79179-b0c2-45ae-a2d5-51350ac231c8 tempest-VolumesActionsTest-930627907 None] Notifying Schedulers of capabilities ... {{(pid=87272) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 10:53:16 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-31a79179-b0c2-45ae-a2d5-51350ac231c8 tempest-VolumesActionsTest-930627907 None] Deleted volume successfully. Nov 04 10:53:16 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-31a79179-b0c2-45ae-a2d5-51350ac231c8 tempest-VolumesActionsTest-930627907 None] Lock "cinder-e6729f4a-ed2a-4e69-a737-f7f96045b96b-delete_volume" released by "delete_volume" :: held 1.614s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:53:16 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-4478263a-1b1b-4a96-a828-35a622f5223e tempest-AttachVolumeTestJSON-969779014 None] Acquiring lock "cinder-0d32c452-7fc9-4858-a5c5-861b2992b96d-delete_volume" by "delete_volume" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:53:16 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-4478263a-1b1b-4a96-a828-35a622f5223e tempest-AttachVolumeTestJSON-969779014 None] Lock "cinder-0d32c452-7fc9-4858-a5c5-861b2992b96d-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:53:16 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-4478263a-1b1b-4a96-a828-35a622f5223e tempest-AttachVolumeTestJSON-969779014 None] Acquiring lock "cinder-quobyte-0d32c452-7fc9-4858-a5c5-861b2992b96d" by "delete_volume" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:53:16 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-4478263a-1b1b-4a96-a828-35a622f5223e tempest-AttachVolumeTestJSON-969779014 None] Lock "cinder-quobyte-0d32c452-7fc9-4858-a5c5-861b2992b96d" acquired by "delete_volume" :: waited 0.017s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:53:16 devstack cinder-volume[87272]: DEBUG oslo.privsep.daemon [-] privsep: reply[89f3970b-7600-4f02-9cb8-274da6e40446]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:53:16 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-4478263a-1b1b-4a96-a828-35a622f5223e tempest-AttachVolumeTestJSON-969779014 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-0d32c452-7fc9-4858-a5c5-861b2992b96d {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:53:17 devstack sudo[91881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-0d32c452-7fc9-4858-a5c5-861b2992b96d Nov 04 10:53:17 devstack sudo[91881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:53:17 devstack sudo[91881]: pam_unix(sudo:session): session closed for user root Nov 04 10:53:17 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-4478263a-1b1b-4a96-a828-35a622f5223e tempest-AttachVolumeTestJSON-969779014 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-0d32c452-7fc9-4858-a5c5-861b2992b96d" returned: 0 in 0.454s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:53:17 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-4478263a-1b1b-4a96-a828-35a622f5223e tempest-AttachVolumeTestJSON-969779014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-0d32c452-7fc9-4858-a5c5-861b2992b96d {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:53:17 devstack sudo[91887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-0d32c452-7fc9-4858-a5c5-861b2992b96d Nov 04 10:53:17 devstack sudo[91887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:53:17 devstack cinder-volume[87272]: DEBUG cinder.volume.flows.manager.create_volume [None req-9f4acabf-0d88-4f00-af7e-0427769d210b tempest-VolumesActionsTest-1874813921 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87272) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 10:53:17 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-9f4acabf-0d88-4f00-af7e-0427769d210b tempest-VolumesActionsTest-1874813921 None] Flow 'volume_create_manager' (9f803fa8-ae51-462b-8075-019901ca48c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:53:17 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-9f4acabf-0d88-4f00-af7e-0427769d210b tempest-VolumesActionsTest-1874813921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f70eb94-05e6-4b9b-bf31-d7d40cfbde6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:53:17 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-9f4acabf-0d88-4f00-af7e-0427769d210b tempest-VolumesActionsTest-1874813921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f70eb94-05e6-4b9b-bf31-d7d40cfbde6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T09:53:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1485827240',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=47a4076b-31a2-4945-bd70-5751c4508959,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ebc5facbf73344079918d4c6828b6985',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T09:53:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T09:53:18Z,use_quota=True,user_id='bb73b98c6b6748899fe24acefca7dde5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8989e4f-21e3-4f0a-9584-0d818784e883),volume_type_id=f8989e4f-21e3-4f0a-9584-0d818784e883)' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:53:17 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-9f4acabf-0d88-4f00-af7e-0427769d210b tempest-VolumesActionsTest-1874813921 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (369d528a-8533-4ae2-b4f1-35c840364485) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:53:17 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-9f4acabf-0d88-4f00-af7e-0427769d210b tempest-VolumesActionsTest-1874813921 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (369d528a-8533-4ae2-b4f1-35c840364485) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:53:17 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-9f4acabf-0d88-4f00-af7e-0427769d210b tempest-VolumesActionsTest-1874813921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (939d9803-82ff-4e8f-b308-04d2deb058c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:53:18 devstack sudo[91887]: pam_unix(sudo:session): session closed for user root Nov 04 10:53:18 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-9f4acabf-0d88-4f00-af7e-0427769d210b tempest-VolumesActionsTest-1874813921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (939d9803-82ff-4e8f-b308-04d2deb058c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '47a4076b-31a2-4945-bd70-5751c4508959', 'volume_name': 'volume-47a4076b-31a2-4945-bd70-5751c4508959', 'volume_size': 1}' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:53:18 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-9f4acabf-0d88-4f00-af7e-0427769d210b tempest-VolumesActionsTest-1874813921 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb8a29d6-b035-4c7d-bc8a-8278fee0ffcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:53:18 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-9f4acabf-0d88-4f00-af7e-0427769d210b tempest-VolumesActionsTest-1874813921 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb8a29d6-b035-4c7d-bc8a-8278fee0ffcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:53:18 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-9f4acabf-0d88-4f00-af7e-0427769d210b tempest-VolumesActionsTest-1874813921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d620a243-6b1f-4143-a38a-85fa900524c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:53:18 devstack cinder-volume[87272]: INFO cinder.volume.flows.manager.create_volume [None req-9f4acabf-0d88-4f00-af7e-0427769d210b tempest-VolumesActionsTest-1874813921 None] Volume 47a4076b-31a2-4945-bd70-5751c4508959: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-47a4076b-31a2-4945-bd70-5751c4508959', 'volume_size': 1} Nov 04 10:53:18 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-9f4acabf-0d88-4f00-af7e-0427769d210b tempest-VolumesActionsTest-1874813921 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:53:18 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-9f4acabf-0d88-4f00-af7e-0427769d210b tempest-VolumesActionsTest-1874813921 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:53:18 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-9f4acabf-0d88-4f00-af7e-0427769d210b tempest-VolumesActionsTest-1874813921 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T09:53:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1485827240',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=47a4076b-31a2-4945-bd70-5751c4508959,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ebc5facbf73344079918d4c6828b6985',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T09:53:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T09:53:18Z,use_quota=True,user_id='bb73b98c6b6748899fe24acefca7dde5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8989e4f-21e3-4f0a-9584-0d818784e883),volume_type_id=f8989e4f-21e3-4f0a-9584-0d818784e883)}" {{(pid=87272) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 04 10:53:18 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.remotefs [None req-9f4acabf-0d88-4f00-af7e-0427769d210b tempest-VolumesActionsTest-1874813921 None] Creating volume 47a4076b-31a2-4945-bd70-5751c4508959 {{(pid=87272) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 10:53:18 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-9f4acabf-0d88-4f00-af7e-0427769d210b tempest-VolumesActionsTest-1874813921 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:53:18 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-9f4acabf-0d88-4f00-af7e-0427769d210b tempest-VolumesActionsTest-1874813921 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:53:18 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-9f4acabf-0d88-4f00-af7e-0427769d210b tempest-VolumesActionsTest-1874813921 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898': None} {{(pid=87272) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:53:18 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-9f4acabf-0d88-4f00-af7e-0427769d210b tempest-VolumesActionsTest-1874813921 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'] {{(pid=87272) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:53:18 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-9f4acabf-0d88-4f00-af7e-0427769d210b tempest-VolumesActionsTest-1874813921 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:53:18 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-9f4acabf-0d88-4f00-af7e-0427769d210b tempest-VolumesActionsTest-1874813921 None] Selected osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898 as target Quobyte volume. {{(pid=87272) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 10:53:18 devstack cinder-volume[87272]: INFO cinder.volume.drivers.remotefs [None req-9f4acabf-0d88-4f00-af7e-0427769d210b tempest-VolumesActionsTest-1874813921 None] casted to osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898 Nov 04 10:53:18 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-9f4acabf-0d88-4f00-af7e-0427769d210b tempest-VolumesActionsTest-1874813921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-47a4076b-31a2-4945-bd70-5751c4508959 1073741824 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:53:18 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-4478263a-1b1b-4a96-a828-35a622f5223e tempest-AttachVolumeTestJSON-969779014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-0d32c452-7fc9-4858-a5c5-861b2992b96d" returned: 0 in 0.747s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:53:18 devstack sudo[91903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-47a4076b-31a2-4945-bd70-5751c4508959 1073741824 Nov 04 10:53:18 devstack sudo[91903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:53:18 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-4478263a-1b1b-4a96-a828-35a622f5223e tempest-AttachVolumeTestJSON-969779014 None] Lock "cinder-quobyte-0d32c452-7fc9-4858-a5c5-861b2992b96d" released by "delete_volume" :: held 1.270s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:53:18 devstack cinder-volume[87272]: DEBUG cinder.quota [None req-4478263a-1b1b-4a96-a828-35a622f5223e tempest-AttachVolumeTestJSON-969779014 None] Created reservations ['5f451a4c-f79d-4f65-a5d7-1f50d37bda99', 'c58b2090-8ac2-48e9-83a7-5572bfbbd455', '37ab0c80-c2ce-4f65-a5cd-da661b9e149c', '77d49a43-a38d-4d2b-afbc-fe8c6bb4adac'] {{(pid=87272) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 10:53:18 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-4478263a-1b1b-4a96-a828-35a622f5223e tempest-AttachVolumeTestJSON-969779014 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:53:18 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-4478263a-1b1b-4a96-a828-35a622f5223e tempest-AttachVolumeTestJSON-969779014 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:53:18 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-4478263a-1b1b-4a96-a828-35a622f5223e tempest-AttachVolumeTestJSON-969779014 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898': None} {{(pid=87272) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:53:18 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-4478263a-1b1b-4a96-a828-35a622f5223e tempest-AttachVolumeTestJSON-969779014 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'] {{(pid=87272) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:53:18 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-4478263a-1b1b-4a96-a828-35a622f5223e tempest-AttachVolumeTestJSON-969779014 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.034s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:53:18 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-4478263a-1b1b-4a96-a828-35a622f5223e tempest-AttachVolumeTestJSON-969779014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:53:18 devstack sudo[91946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1 Nov 04 10:53:18 devstack sudo[91946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:53:19 devstack sudo[91946]: pam_unix(sudo:session): session closed for user root Nov 04 10:53:19 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-4478263a-1b1b-4a96-a828-35a622f5223e tempest-AttachVolumeTestJSON-969779014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1" returned: 0 in 0.701s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:53:19 devstack cinder-volume[87272]: DEBUG cinder.manager [None req-4478263a-1b1b-4a96-a828-35a622f5223e tempest-AttachVolumeTestJSON-969779014 None] Notifying Schedulers of capabilities ... {{(pid=87272) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 10:53:19 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-4478263a-1b1b-4a96-a828-35a622f5223e tempest-AttachVolumeTestJSON-969779014 None] Deleted volume successfully. Nov 04 10:53:19 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-4478263a-1b1b-4a96-a828-35a622f5223e tempest-AttachVolumeTestJSON-969779014 None] Lock "cinder-0d32c452-7fc9-4858-a5c5-861b2992b96d-delete_volume" released by "delete_volume" :: held 2.450s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:53:19 devstack sudo[91903]: pam_unix(sudo:session): session closed for user root Nov 04 10:53:19 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-9f4acabf-0d88-4f00-af7e-0427769d210b tempest-VolumesActionsTest-1874813921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-47a4076b-31a2-4945-bd70-5751c4508959 1073741824" returned: 0 in 1.181s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:53:19 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-9f4acabf-0d88-4f00-af7e-0427769d210b tempest-VolumesActionsTest-1874813921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-47a4076b-31a2-4945-bd70-5751c4508959 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:53:19 devstack sudo[91990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-47a4076b-31a2-4945-bd70-5751c4508959 Nov 04 10:53:19 devstack sudo[91990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:53:19 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-42541c5c-d4af-4655-9f5d-db6174911d70 tempest-AttachVolumeTestJSON-969779014 None] Acquiring lock "cinder-59b91a30-e454-41fc-a994-fcd060c22047-delete_volume" by "delete_volume" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:53:19 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-42541c5c-d4af-4655-9f5d-db6174911d70 tempest-AttachVolumeTestJSON-969779014 None] Lock "cinder-59b91a30-e454-41fc-a994-fcd060c22047-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:53:19 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-42541c5c-d4af-4655-9f5d-db6174911d70 tempest-AttachVolumeTestJSON-969779014 None] Acquiring lock "cinder-quobyte-59b91a30-e454-41fc-a994-fcd060c22047" by "delete_volume" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:53:19 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-42541c5c-d4af-4655-9f5d-db6174911d70 tempest-AttachVolumeTestJSON-969779014 None] Lock "cinder-quobyte-59b91a30-e454-41fc-a994-fcd060c22047" acquired by "delete_volume" :: waited 0.017s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:53:19 devstack cinder-volume[87272]: DEBUG oslo.privsep.daemon [-] privsep: reply[11914b2f-7755-4775-b258-bb33b19c871e]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:53:19 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-42541c5c-d4af-4655-9f5d-db6174911d70 tempest-AttachVolumeTestJSON-969779014 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-59b91a30-e454-41fc-a994-fcd060c22047 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:53:19 devstack sudo[91990]: pam_unix(sudo:session): session closed for user root Nov 04 10:53:19 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-9f4acabf-0d88-4f00-af7e-0427769d210b tempest-VolumesActionsTest-1874813921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-47a4076b-31a2-4945-bd70-5751c4508959" returned: 0 in 0.405s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:53:19 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-9f4acabf-0d88-4f00-af7e-0427769d210b tempest-VolumesActionsTest-1874813921 None] <== create_volume: return (1662ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'} {{(pid=87272) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 04 10:53:19 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-9f4acabf-0d88-4f00-af7e-0427769d210b tempest-VolumesActionsTest-1874813921 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.671s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:53:19 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-9f4acabf-0d88-4f00-af7e-0427769d210b tempest-VolumesActionsTest-1874813921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d620a243-6b1f-4143-a38a-85fa900524c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-47a4076b-31a2-4945-bd70-5751c4508959', 'volume_size': 1}' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:53:19 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-9f4acabf-0d88-4f00-af7e-0427769d210b tempest-VolumesActionsTest-1874813921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b2be7a8-1250-43e4-a84c-5f767a5dea0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:53:19 devstack sudo[92027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-59b91a30-e454-41fc-a994-fcd060c22047 Nov 04 10:53:19 devstack sudo[92027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:53:19 devstack cinder-volume[87272]: INFO cinder.volume.flows.manager.create_volume [None req-9f4acabf-0d88-4f00-af7e-0427769d210b tempest-VolumesActionsTest-1874813921 None] Volume volume-47a4076b-31a2-4945-bd70-5751c4508959 (47a4076b-31a2-4945-bd70-5751c4508959): created successfully Nov 04 10:53:19 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-9f4acabf-0d88-4f00-af7e-0427769d210b tempest-VolumesActionsTest-1874813921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b2be7a8-1250-43e4-a84c-5f767a5dea0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:53:19 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-9f4acabf-0d88-4f00-af7e-0427769d210b tempest-VolumesActionsTest-1874813921 None] Flow 'volume_create_manager' (9f803fa8-ae51-462b-8075-019901ca48c9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87272) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:53:19 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-9f4acabf-0d88-4f00-af7e-0427769d210b tempest-VolumesActionsTest-1874813921 None] Created volume successfully. Nov 04 10:53:20 devstack sudo[92027]: pam_unix(sudo:session): session closed for user root Nov 04 10:53:20 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-42541c5c-d4af-4655-9f5d-db6174911d70 tempest-AttachVolumeTestJSON-969779014 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-59b91a30-e454-41fc-a994-fcd060c22047" returned: 0 in 0.603s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:53:20 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-42541c5c-d4af-4655-9f5d-db6174911d70 tempest-AttachVolumeTestJSON-969779014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-59b91a30-e454-41fc-a994-fcd060c22047 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:53:20 devstack sudo[92041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-59b91a30-e454-41fc-a994-fcd060c22047 Nov 04 10:53:20 devstack sudo[92041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:53:20 devstack sudo[92041]: pam_unix(sudo:session): session closed for user root Nov 04 10:53:20 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-42541c5c-d4af-4655-9f5d-db6174911d70 tempest-AttachVolumeTestJSON-969779014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-59b91a30-e454-41fc-a994-fcd060c22047" returned: 0 in 0.500s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:53:20 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-42541c5c-d4af-4655-9f5d-db6174911d70 tempest-AttachVolumeTestJSON-969779014 None] Lock "cinder-quobyte-59b91a30-e454-41fc-a994-fcd060c22047" released by "delete_volume" :: held 1.205s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:53:20 devstack cinder-volume[87272]: DEBUG cinder.quota [None req-42541c5c-d4af-4655-9f5d-db6174911d70 tempest-AttachVolumeTestJSON-969779014 None] Created reservations ['4724dae3-0c96-403f-a75d-357cf7f89476', 'ddf1275c-4813-428b-90cb-284ad585657e', '06c982fd-defb-4aab-a04f-f5ac371af323', 'c558e765-074b-402e-9a5a-a95c160656db'] {{(pid=87272) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 10:53:21 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-42541c5c-d4af-4655-9f5d-db6174911d70 tempest-AttachVolumeTestJSON-969779014 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:53:21 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-42541c5c-d4af-4655-9f5d-db6174911d70 tempest-AttachVolumeTestJSON-969779014 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:53:21 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-42541c5c-d4af-4655-9f5d-db6174911d70 tempest-AttachVolumeTestJSON-969779014 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898': None} {{(pid=87272) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:53:21 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-42541c5c-d4af-4655-9f5d-db6174911d70 tempest-AttachVolumeTestJSON-969779014 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'] {{(pid=87272) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:53:21 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-42541c5c-d4af-4655-9f5d-db6174911d70 tempest-AttachVolumeTestJSON-969779014 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:53:21 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-42541c5c-d4af-4655-9f5d-db6174911d70 tempest-AttachVolumeTestJSON-969779014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:53:21 devstack sudo[92048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1 Nov 04 10:53:21 devstack sudo[92048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:53:21 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-c590d0da-e3fa-4add-b076-fec539738ff8 tempest-VolumesActionsTest-1874813921 None] Acquiring lock "cinder-47a4076b-31a2-4945-bd70-5751c4508959-delete_volume" by "delete_volume" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:53:21 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-c590d0da-e3fa-4add-b076-fec539738ff8 tempest-VolumesActionsTest-1874813921 None] Lock "cinder-47a4076b-31a2-4945-bd70-5751c4508959-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:53:21 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-c590d0da-e3fa-4add-b076-fec539738ff8 tempest-VolumesActionsTest-1874813921 None] Acquiring lock "cinder-quobyte-47a4076b-31a2-4945-bd70-5751c4508959" by "delete_volume" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:53:21 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-c590d0da-e3fa-4add-b076-fec539738ff8 tempest-VolumesActionsTest-1874813921 None] Lock "cinder-quobyte-47a4076b-31a2-4945-bd70-5751c4508959" acquired by "delete_volume" :: waited 0.034s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:53:21 devstack sudo[92048]: pam_unix(sudo:session): session closed for user root Nov 04 10:53:21 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-42541c5c-d4af-4655-9f5d-db6174911d70 tempest-AttachVolumeTestJSON-969779014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1" returned: 0 in 0.340s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:53:21 devstack cinder-volume[87272]: DEBUG cinder.manager [None req-42541c5c-d4af-4655-9f5d-db6174911d70 tempest-AttachVolumeTestJSON-969779014 None] Notifying Schedulers of capabilities ... {{(pid=87272) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 10:53:21 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-42541c5c-d4af-4655-9f5d-db6174911d70 tempest-AttachVolumeTestJSON-969779014 None] Deleted volume successfully. Nov 04 10:53:21 devstack cinder-volume[87272]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cec4e10-c023-41f6-8d57-01bcac483cac]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:53:21 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-c590d0da-e3fa-4add-b076-fec539738ff8 tempest-VolumesActionsTest-1874813921 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-47a4076b-31a2-4945-bd70-5751c4508959 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:53:21 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-42541c5c-d4af-4655-9f5d-db6174911d70 tempest-AttachVolumeTestJSON-969779014 None] Lock "cinder-59b91a30-e454-41fc-a994-fcd060c22047-delete_volume" released by "delete_volume" :: held 1.902s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:53:21 devstack sudo[92051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-47a4076b-31a2-4945-bd70-5751c4508959 Nov 04 10:53:21 devstack sudo[92051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:53:21 devstack sudo[92051]: pam_unix(sudo:session): session closed for user root Nov 04 10:53:21 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-c590d0da-e3fa-4add-b076-fec539738ff8 tempest-VolumesActionsTest-1874813921 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-47a4076b-31a2-4945-bd70-5751c4508959" returned: 0 in 0.422s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:53:21 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-c590d0da-e3fa-4add-b076-fec539738ff8 tempest-VolumesActionsTest-1874813921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-47a4076b-31a2-4945-bd70-5751c4508959 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:53:21 devstack sudo[92057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-47a4076b-31a2-4945-bd70-5751c4508959 Nov 04 10:53:21 devstack sudo[92057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:53:22 devstack sudo[92057]: pam_unix(sudo:session): session closed for user root Nov 04 10:53:22 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-c590d0da-e3fa-4add-b076-fec539738ff8 tempest-VolumesActionsTest-1874813921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-47a4076b-31a2-4945-bd70-5751c4508959" returned: 0 in 0.270s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:53:22 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-c590d0da-e3fa-4add-b076-fec539738ff8 tempest-VolumesActionsTest-1874813921 None] Lock "cinder-quobyte-47a4076b-31a2-4945-bd70-5751c4508959" released by "delete_volume" :: held 0.755s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:53:22 devstack cinder-volume[87272]: DEBUG cinder.quota [None req-c590d0da-e3fa-4add-b076-fec539738ff8 tempest-VolumesActionsTest-1874813921 None] Created reservations ['156b3d6c-360e-45c9-aca0-1c8df171d5a2', '9f9b130f-ec92-44a4-8310-64c5043d6123', '1f85b961-93d1-4d23-a124-894a186fefbd', '2cdaeb05-22a1-43af-8616-ae734a73cf7e'] {{(pid=87272) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 10:53:22 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-c590d0da-e3fa-4add-b076-fec539738ff8 tempest-VolumesActionsTest-1874813921 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:53:22 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-c590d0da-e3fa-4add-b076-fec539738ff8 tempest-VolumesActionsTest-1874813921 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:53:22 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-c590d0da-e3fa-4add-b076-fec539738ff8 tempest-VolumesActionsTest-1874813921 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898': None} {{(pid=87272) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:53:22 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-c590d0da-e3fa-4add-b076-fec539738ff8 tempest-VolumesActionsTest-1874813921 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'] {{(pid=87272) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:53:22 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-c590d0da-e3fa-4add-b076-fec539738ff8 tempest-VolumesActionsTest-1874813921 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:53:22 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-c590d0da-e3fa-4add-b076-fec539738ff8 tempest-VolumesActionsTest-1874813921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:53:22 devstack sudo[92060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1 Nov 04 10:53:22 devstack sudo[92060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:53:22 devstack sudo[92060]: pam_unix(sudo:session): session closed for user root Nov 04 10:53:22 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-c590d0da-e3fa-4add-b076-fec539738ff8 tempest-VolumesActionsTest-1874813921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1" returned: 0 in 0.304s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:53:22 devstack cinder-volume[87272]: DEBUG cinder.manager [None req-c590d0da-e3fa-4add-b076-fec539738ff8 tempest-VolumesActionsTest-1874813921 None] Notifying Schedulers of capabilities ... {{(pid=87272) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 10:53:22 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-c590d0da-e3fa-4add-b076-fec539738ff8 tempest-VolumesActionsTest-1874813921 None] Deleted volume successfully. Nov 04 10:53:22 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-c590d0da-e3fa-4add-b076-fec539738ff8 tempest-VolumesActionsTest-1874813921 None] Lock "cinder-47a4076b-31a2-4945-bd70-5751c4508959-delete_volume" released by "delete_volume" :: held 1.482s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:53:32 devstack cinder-volume[87272]: DEBUG dbcounter [-] [87272] Writing DB stats cinder:SELECT=82,cinder:UPDATE=113,cinder:INSERT=21,cinder:DELETE=8 {{(pid=87272) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 10:53:32 devstack cinder-volume[87272]: DEBUG dbcounter [-] [87272] Writing DB stats cinder:UPDATE=105,cinder:SELECT=96,cinder:DELETE=11,cinder:INSERT=27 {{(pid=87272) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 10:53:34 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [req-229bb71a-c769-489f-9271-3c77bc706e69 req-d051d6c0-6d92-4dff-94ad-b8d0bea91784 tempest-ServerActionsTestOtherA-1078392334 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:53:34 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [req-229bb71a-c769-489f-9271-3c77bc706e69 req-d051d6c0-6d92-4dff-94ad-b8d0bea91784 tempest-ServerActionsTestOtherA-1078392334 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:53:34 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [req-229bb71a-c769-489f-9271-3c77bc706e69 req-d051d6c0-6d92-4dff-94ad-b8d0bea91784 tempest-ServerActionsTestOtherA-1078392334 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.030s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:53:34 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [req-229bb71a-c769-489f-9271-3c77bc706e69 req-d051d6c0-6d92-4dff-94ad-b8d0bea91784 tempest-ServerActionsTestOtherA-1078392334 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898', 'name': 'volume-c1a96b74-c5b4-4d72-bda6-bf6b762cf5ab', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '9f57246f-903a-4f39-b22a-a2095348014d', 'enforce_multipath': True} {{(pid=87272) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 04 10:53:34 devstack cinder-volume[87272]: INFO cinder.volume.manager [req-229bb71a-c769-489f-9271-3c77bc706e69 req-d051d6c0-6d92-4dff-94ad-b8d0bea91784 tempest-ServerActionsTestOtherA-1078392334 None] attachment_update completed successfully. Nov 04 10:53:38 devstack cinder-volume[87272]: INFO cinder.volume.manager [req-acc81996-7d4f-4443-be1d-a580fee83729 req-5e1d62e1-c604-432f-9e44-ab7fd2bcfc3e tempest-ServerActionsTestOtherA-1078392334 None] Terminate volume connection completed successfully. Nov 04 10:53:38 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [req-acc81996-7d4f-4443-be1d-a580fee83729 req-5e1d62e1-c604-432f-9e44-ab7fd2bcfc3e tempest-ServerActionsTestOtherA-1078392334 None] Deleting attachment 9f57246f-903a-4f39-b22a-a2095348014d. {{(pid=87272) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 04 10:53:40 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [req-acc81996-7d4f-4443-be1d-a580fee83729 req-86e8015b-cfe0-4743-8a70-20ad74677b5b tempest-ServerActionsTestOtherA-1078392334 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:53:40 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [req-acc81996-7d4f-4443-be1d-a580fee83729 req-86e8015b-cfe0-4743-8a70-20ad74677b5b tempest-ServerActionsTestOtherA-1078392334 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:53:40 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [req-acc81996-7d4f-4443-be1d-a580fee83729 req-86e8015b-cfe0-4743-8a70-20ad74677b5b tempest-ServerActionsTestOtherA-1078392334 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.035s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:53:40 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [req-acc81996-7d4f-4443-be1d-a580fee83729 req-86e8015b-cfe0-4743-8a70-20ad74677b5b tempest-ServerActionsTestOtherA-1078392334 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898', 'name': 'volume-c1a96b74-c5b4-4d72-bda6-bf6b762cf5ab', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '9010e3d6-8a02-4d28-b2dc-53619135d35b', 'enforce_multipath': True} {{(pid=87272) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 04 10:53:40 devstack cinder-volume[87272]: INFO cinder.volume.manager [req-acc81996-7d4f-4443-be1d-a580fee83729 req-86e8015b-cfe0-4743-8a70-20ad74677b5b tempest-ServerActionsTestOtherA-1078392334 None] attachment_update completed successfully. Nov 04 10:53:40 devstack cinder-volume[87272]: DEBUG cinder.volume.flows.manager.create_volume [None req-35fecc68-e074-46db-bdac-0259a53b43a2 tempest-AbsoluteLimitsTests-1620238171 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87272) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 10:53:40 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-35fecc68-e074-46db-bdac-0259a53b43a2 tempest-AbsoluteLimitsTests-1620238171 None] Flow 'volume_create_manager' (6c96ab08-75ce-496b-9ba1-af453c820b16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:53:40 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-35fecc68-e074-46db-bdac-0259a53b43a2 tempest-AbsoluteLimitsTests-1620238171 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (157e8f7d-096c-4515-bf89-e53638fb917f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:53:40 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-35fecc68-e074-46db-bdac-0259a53b43a2 tempest-AbsoluteLimitsTests-1620238171 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (157e8f7d-096c-4515-bf89-e53638fb917f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T09:53:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1531916868',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d7d5af3-5b95-4769-81d6-74ce6d9fcc37,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='284cbc15ea90416c94fb9f5fd32484d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T09:53:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T09:53:40Z,use_quota=True,user_id='68f3c275497042fab4becdd698f0101f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8989e4f-21e3-4f0a-9584-0d818784e883),volume_type_id=f8989e4f-21e3-4f0a-9584-0d818784e883)' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:53:40 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-35fecc68-e074-46db-bdac-0259a53b43a2 tempest-AbsoluteLimitsTests-1620238171 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58e36a04-a7ce-4720-8b72-7549931a297a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:53:40 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-35fecc68-e074-46db-bdac-0259a53b43a2 tempest-AbsoluteLimitsTests-1620238171 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58e36a04-a7ce-4720-8b72-7549931a297a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:53:40 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-35fecc68-e074-46db-bdac-0259a53b43a2 tempest-AbsoluteLimitsTests-1620238171 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6320eec9-f939-484a-81d7-e82b57597ddd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:53:40 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-35fecc68-e074-46db-bdac-0259a53b43a2 tempest-AbsoluteLimitsTests-1620238171 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6320eec9-f939-484a-81d7-e82b57597ddd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0d7d5af3-5b95-4769-81d6-74ce6d9fcc37', 'volume_name': 'volume-0d7d5af3-5b95-4769-81d6-74ce6d9fcc37', 'volume_size': 1}' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:53:40 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-35fecc68-e074-46db-bdac-0259a53b43a2 tempest-AbsoluteLimitsTests-1620238171 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f8573e82-75e6-46c9-a5ac-fd3f4b70962a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:53:40 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-35fecc68-e074-46db-bdac-0259a53b43a2 tempest-AbsoluteLimitsTests-1620238171 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f8573e82-75e6-46c9-a5ac-fd3f4b70962a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:53:40 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-35fecc68-e074-46db-bdac-0259a53b43a2 tempest-AbsoluteLimitsTests-1620238171 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (605ade7d-4d65-44fd-8d9d-a75d59f0f1b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:53:40 devstack cinder-volume[87272]: INFO cinder.volume.flows.manager.create_volume [None req-35fecc68-e074-46db-bdac-0259a53b43a2 tempest-AbsoluteLimitsTests-1620238171 None] Volume 0d7d5af3-5b95-4769-81d6-74ce6d9fcc37: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0d7d5af3-5b95-4769-81d6-74ce6d9fcc37', 'volume_size': 1} Nov 04 10:53:40 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-35fecc68-e074-46db-bdac-0259a53b43a2 tempest-AbsoluteLimitsTests-1620238171 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:53:40 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-35fecc68-e074-46db-bdac-0259a53b43a2 tempest-AbsoluteLimitsTests-1620238171 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:53:40 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-35fecc68-e074-46db-bdac-0259a53b43a2 tempest-AbsoluteLimitsTests-1620238171 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T09:53:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1531916868',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d7d5af3-5b95-4769-81d6-74ce6d9fcc37,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='284cbc15ea90416c94fb9f5fd32484d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T09:53:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T09:53:40Z,use_quota=True,user_id='68f3c275497042fab4becdd698f0101f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8989e4f-21e3-4f0a-9584-0d818784e883),volume_type_id=f8989e4f-21e3-4f0a-9584-0d818784e883)}" {{(pid=87272) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 04 10:53:40 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.remotefs [None req-35fecc68-e074-46db-bdac-0259a53b43a2 tempest-AbsoluteLimitsTests-1620238171 None] Creating volume 0d7d5af3-5b95-4769-81d6-74ce6d9fcc37 {{(pid=87272) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 10:53:40 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-35fecc68-e074-46db-bdac-0259a53b43a2 tempest-AbsoluteLimitsTests-1620238171 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:53:40 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-35fecc68-e074-46db-bdac-0259a53b43a2 tempest-AbsoluteLimitsTests-1620238171 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:53:40 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-35fecc68-e074-46db-bdac-0259a53b43a2 tempest-AbsoluteLimitsTests-1620238171 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898': None} {{(pid=87272) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:53:40 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-35fecc68-e074-46db-bdac-0259a53b43a2 tempest-AbsoluteLimitsTests-1620238171 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'] {{(pid=87272) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:53:40 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-35fecc68-e074-46db-bdac-0259a53b43a2 tempest-AbsoluteLimitsTests-1620238171 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:53:40 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-35fecc68-e074-46db-bdac-0259a53b43a2 tempest-AbsoluteLimitsTests-1620238171 None] Selected osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898 as target Quobyte volume. {{(pid=87272) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 10:53:40 devstack cinder-volume[87272]: INFO cinder.volume.drivers.remotefs [None req-35fecc68-e074-46db-bdac-0259a53b43a2 tempest-AbsoluteLimitsTests-1620238171 None] casted to osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898 Nov 04 10:53:40 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-35fecc68-e074-46db-bdac-0259a53b43a2 tempest-AbsoluteLimitsTests-1620238171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-0d7d5af3-5b95-4769-81d6-74ce6d9fcc37 1073741824 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:53:40 devstack sudo[92574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-0d7d5af3-5b95-4769-81d6-74ce6d9fcc37 1073741824 Nov 04 10:53:40 devstack sudo[92574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:53:41 devstack sudo[92574]: pam_unix(sudo:session): session closed for user root Nov 04 10:53:41 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-35fecc68-e074-46db-bdac-0259a53b43a2 tempest-AbsoluteLimitsTests-1620238171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-0d7d5af3-5b95-4769-81d6-74ce6d9fcc37 1073741824" returned: 0 in 0.781s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:53:41 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-35fecc68-e074-46db-bdac-0259a53b43a2 tempest-AbsoluteLimitsTests-1620238171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-0d7d5af3-5b95-4769-81d6-74ce6d9fcc37 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:53:41 devstack sudo[92593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-0d7d5af3-5b95-4769-81d6-74ce6d9fcc37 Nov 04 10:53:41 devstack sudo[92593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:53:41 devstack sudo[92593]: pam_unix(sudo:session): session closed for user root Nov 04 10:53:41 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-35fecc68-e074-46db-bdac-0259a53b43a2 tempest-AbsoluteLimitsTests-1620238171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-0d7d5af3-5b95-4769-81d6-74ce6d9fcc37" returned: 0 in 0.415s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:53:41 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-35fecc68-e074-46db-bdac-0259a53b43a2 tempest-AbsoluteLimitsTests-1620238171 None] <== create_volume: return (1264ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'} {{(pid=87272) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 04 10:53:41 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-35fecc68-e074-46db-bdac-0259a53b43a2 tempest-AbsoluteLimitsTests-1620238171 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.270s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:53:41 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-35fecc68-e074-46db-bdac-0259a53b43a2 tempest-AbsoluteLimitsTests-1620238171 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (605ade7d-4d65-44fd-8d9d-a75d59f0f1b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0d7d5af3-5b95-4769-81d6-74ce6d9fcc37', 'volume_size': 1}' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:53:41 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-35fecc68-e074-46db-bdac-0259a53b43a2 tempest-AbsoluteLimitsTests-1620238171 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37cc856d-e14b-43c4-ad4a-b3882a5e5250) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:53:41 devstack cinder-volume[87272]: INFO cinder.volume.flows.manager.create_volume [None req-35fecc68-e074-46db-bdac-0259a53b43a2 tempest-AbsoluteLimitsTests-1620238171 None] Volume volume-0d7d5af3-5b95-4769-81d6-74ce6d9fcc37 (0d7d5af3-5b95-4769-81d6-74ce6d9fcc37): created successfully Nov 04 10:53:41 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-35fecc68-e074-46db-bdac-0259a53b43a2 tempest-AbsoluteLimitsTests-1620238171 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37cc856d-e14b-43c4-ad4a-b3882a5e5250) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:53:42 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-35fecc68-e074-46db-bdac-0259a53b43a2 tempest-AbsoluteLimitsTests-1620238171 None] Flow 'volume_create_manager' (6c96ab08-75ce-496b-9ba1-af453c820b16) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87272) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:53:42 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-35fecc68-e074-46db-bdac-0259a53b43a2 tempest-AbsoluteLimitsTests-1620238171 None] Created volume successfully. Nov 04 10:53:43 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-d861ac21-222f-4715-b1f6-f280060dcbce tempest-AbsoluteLimitsTests-1620238171 None] Acquiring lock "cinder-0d7d5af3-5b95-4769-81d6-74ce6d9fcc37-delete_volume" by "delete_volume" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:53:43 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-d861ac21-222f-4715-b1f6-f280060dcbce tempest-AbsoluteLimitsTests-1620238171 None] Lock "cinder-0d7d5af3-5b95-4769-81d6-74ce6d9fcc37-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:53:43 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-d861ac21-222f-4715-b1f6-f280060dcbce tempest-AbsoluteLimitsTests-1620238171 None] Acquiring lock "cinder-quobyte-0d7d5af3-5b95-4769-81d6-74ce6d9fcc37" by "delete_volume" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:53:43 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-d861ac21-222f-4715-b1f6-f280060dcbce tempest-AbsoluteLimitsTests-1620238171 None] Lock "cinder-quobyte-0d7d5af3-5b95-4769-81d6-74ce6d9fcc37" acquired by "delete_volume" :: waited 0.022s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:53:43 devstack cinder-volume[87272]: DEBUG oslo.privsep.daemon [-] privsep: reply[a612a06d-4d11-43e0-98b2-90f7cc8337e5]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:53:43 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-d861ac21-222f-4715-b1f6-f280060dcbce tempest-AbsoluteLimitsTests-1620238171 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-0d7d5af3-5b95-4769-81d6-74ce6d9fcc37 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:53:43 devstack sudo[93063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-0d7d5af3-5b95-4769-81d6-74ce6d9fcc37 Nov 04 10:53:43 devstack sudo[93063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:53:43 devstack sudo[93063]: pam_unix(sudo:session): session closed for user root Nov 04 10:53:43 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-d861ac21-222f-4715-b1f6-f280060dcbce tempest-AbsoluteLimitsTests-1620238171 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-0d7d5af3-5b95-4769-81d6-74ce6d9fcc37" returned: 0 in 0.590s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:53:43 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-d861ac21-222f-4715-b1f6-f280060dcbce tempest-AbsoluteLimitsTests-1620238171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-0d7d5af3-5b95-4769-81d6-74ce6d9fcc37 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:53:43 devstack sudo[93083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-0d7d5af3-5b95-4769-81d6-74ce6d9fcc37 Nov 04 10:53:43 devstack sudo[93083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:53:44 devstack sudo[93083]: pam_unix(sudo:session): session closed for user root Nov 04 10:53:44 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-d861ac21-222f-4715-b1f6-f280060dcbce tempest-AbsoluteLimitsTests-1620238171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-0d7d5af3-5b95-4769-81d6-74ce6d9fcc37" returned: 0 in 0.398s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:53:44 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-d861ac21-222f-4715-b1f6-f280060dcbce tempest-AbsoluteLimitsTests-1620238171 None] Lock "cinder-quobyte-0d7d5af3-5b95-4769-81d6-74ce6d9fcc37" released by "delete_volume" :: held 1.062s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:53:44 devstack cinder-volume[87272]: DEBUG cinder.quota [None req-d861ac21-222f-4715-b1f6-f280060dcbce tempest-AbsoluteLimitsTests-1620238171 None] Created reservations ['394f04cc-642d-4d53-83fc-3d152e709140', '04363211-ad7f-43fb-a78a-f1a3e0775ac2', 'ead7bf42-6f0d-4304-ac2c-95447f0cc0e9', '0f2ba7e3-3e26-4614-9e8a-723cb64a8682'] {{(pid=87272) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 10:53:44 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-d861ac21-222f-4715-b1f6-f280060dcbce tempest-AbsoluteLimitsTests-1620238171 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:53:44 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-d861ac21-222f-4715-b1f6-f280060dcbce tempest-AbsoluteLimitsTests-1620238171 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:53:44 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-d861ac21-222f-4715-b1f6-f280060dcbce tempest-AbsoluteLimitsTests-1620238171 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898': None} {{(pid=87272) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:53:44 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-d861ac21-222f-4715-b1f6-f280060dcbce tempest-AbsoluteLimitsTests-1620238171 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'] {{(pid=87272) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:53:44 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-d861ac21-222f-4715-b1f6-f280060dcbce tempest-AbsoluteLimitsTests-1620238171 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:53:44 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-d861ac21-222f-4715-b1f6-f280060dcbce tempest-AbsoluteLimitsTests-1620238171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:53:44 devstack sudo[93094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1 Nov 04 10:53:44 devstack sudo[93094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:53:45 devstack sudo[93094]: pam_unix(sudo:session): session closed for user root Nov 04 10:53:45 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-d861ac21-222f-4715-b1f6-f280060dcbce tempest-AbsoluteLimitsTests-1620238171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1" returned: 0 in 0.641s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:53:45 devstack cinder-volume[87272]: DEBUG cinder.manager [None req-d861ac21-222f-4715-b1f6-f280060dcbce tempest-AbsoluteLimitsTests-1620238171 None] Notifying Schedulers of capabilities ... {{(pid=87272) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 10:53:45 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-d861ac21-222f-4715-b1f6-f280060dcbce tempest-AbsoluteLimitsTests-1620238171 None] Deleted volume successfully. Nov 04 10:53:45 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-d861ac21-222f-4715-b1f6-f280060dcbce tempest-AbsoluteLimitsTests-1620238171 None] Lock "cinder-0d7d5af3-5b95-4769-81d6-74ce6d9fcc37-delete_volume" released by "delete_volume" :: held 2.205s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:53:49 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-194d4a9a-f1ab-4d7d-9e0c-deced162e593 tempest-AttachVolumeShelveTestJSON-1521270859 None] Acquiring lock "cinder-9b7746f4-19db-407d-ac88-9f929bfb64b7-delete_volume" by "delete_volume" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:53:49 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-194d4a9a-f1ab-4d7d-9e0c-deced162e593 tempest-AttachVolumeShelveTestJSON-1521270859 None] Lock "cinder-9b7746f4-19db-407d-ac88-9f929bfb64b7-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:53:49 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-194d4a9a-f1ab-4d7d-9e0c-deced162e593 tempest-AttachVolumeShelveTestJSON-1521270859 None] Acquiring lock "cinder-quobyte-9b7746f4-19db-407d-ac88-9f929bfb64b7" by "delete_volume" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:53:49 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-194d4a9a-f1ab-4d7d-9e0c-deced162e593 tempest-AttachVolumeShelveTestJSON-1521270859 None] Lock "cinder-quobyte-9b7746f4-19db-407d-ac88-9f929bfb64b7" acquired by "delete_volume" :: waited 0.027s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:53:49 devstack cinder-volume[87272]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f9abd34-119e-4470-bc79-a1b45edae377]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:53:49 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-194d4a9a-f1ab-4d7d-9e0c-deced162e593 tempest-AttachVolumeShelveTestJSON-1521270859 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-9b7746f4-19db-407d-ac88-9f929bfb64b7 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:53:49 devstack sudo[93104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-9b7746f4-19db-407d-ac88-9f929bfb64b7 Nov 04 10:53:49 devstack sudo[93104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:53:49 devstack sudo[93104]: pam_unix(sudo:session): session closed for user root Nov 04 10:53:49 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-194d4a9a-f1ab-4d7d-9e0c-deced162e593 tempest-AttachVolumeShelveTestJSON-1521270859 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-9b7746f4-19db-407d-ac88-9f929bfb64b7" returned: 0 in 0.467s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:53:49 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-194d4a9a-f1ab-4d7d-9e0c-deced162e593 tempest-AttachVolumeShelveTestJSON-1521270859 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-9b7746f4-19db-407d-ac88-9f929bfb64b7 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:53:49 devstack sudo[93109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-9b7746f4-19db-407d-ac88-9f929bfb64b7 Nov 04 10:53:49 devstack sudo[93109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:53:50 devstack sudo[93109]: pam_unix(sudo:session): session closed for user root Nov 04 10:53:50 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-194d4a9a-f1ab-4d7d-9e0c-deced162e593 tempest-AttachVolumeShelveTestJSON-1521270859 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-9b7746f4-19db-407d-ac88-9f929bfb64b7" returned: 0 in 0.383s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:53:50 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-194d4a9a-f1ab-4d7d-9e0c-deced162e593 tempest-AttachVolumeShelveTestJSON-1521270859 None] Lock "cinder-quobyte-9b7746f4-19db-407d-ac88-9f929bfb64b7" released by "delete_volume" :: held 0.917s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:53:50 devstack cinder-volume[87272]: DEBUG cinder.quota [None req-194d4a9a-f1ab-4d7d-9e0c-deced162e593 tempest-AttachVolumeShelveTestJSON-1521270859 None] Created reservations ['84cb882f-3119-4d73-b7d1-9818cd875ab4', '27dfb2ed-aa45-4250-9c4b-56d901b43f4b', 'bb390a15-fdb8-4cec-a428-1beb2115379e', '996ba4e8-42b2-40d7-a93d-ca9596aa8452'] {{(pid=87272) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 10:53:50 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-194d4a9a-f1ab-4d7d-9e0c-deced162e593 tempest-AttachVolumeShelveTestJSON-1521270859 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:53:50 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-194d4a9a-f1ab-4d7d-9e0c-deced162e593 tempest-AttachVolumeShelveTestJSON-1521270859 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:53:50 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-194d4a9a-f1ab-4d7d-9e0c-deced162e593 tempest-AttachVolumeShelveTestJSON-1521270859 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898': None} {{(pid=87272) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:53:50 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-194d4a9a-f1ab-4d7d-9e0c-deced162e593 tempest-AttachVolumeShelveTestJSON-1521270859 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'] {{(pid=87272) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:53:50 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-194d4a9a-f1ab-4d7d-9e0c-deced162e593 tempest-AttachVolumeShelveTestJSON-1521270859 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:53:50 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-194d4a9a-f1ab-4d7d-9e0c-deced162e593 tempest-AttachVolumeShelveTestJSON-1521270859 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:53:50 devstack sudo[93112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1 Nov 04 10:53:50 devstack sudo[93112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:53:50 devstack sudo[93112]: pam_unix(sudo:session): session closed for user root Nov 04 10:53:50 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-194d4a9a-f1ab-4d7d-9e0c-deced162e593 tempest-AttachVolumeShelveTestJSON-1521270859 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1" returned: 0 in 0.489s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:53:51 devstack cinder-volume[87272]: DEBUG cinder.manager [None req-194d4a9a-f1ab-4d7d-9e0c-deced162e593 tempest-AttachVolumeShelveTestJSON-1521270859 None] Notifying Schedulers of capabilities ... {{(pid=87272) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 10:53:51 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-194d4a9a-f1ab-4d7d-9e0c-deced162e593 tempest-AttachVolumeShelveTestJSON-1521270859 None] Deleted volume successfully. Nov 04 10:53:51 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-194d4a9a-f1ab-4d7d-9e0c-deced162e593 tempest-AttachVolumeShelveTestJSON-1521270859 None] Lock "cinder-9b7746f4-19db-407d-ac88-9f929bfb64b7-delete_volume" released by "delete_volume" :: held 1.743s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:53:56 devstack cinder-volume[87272]: DEBUG cinder.volume.flows.manager.create_volume [None req-8d70f865-189a-4a64-8e9b-2cb5236b27e2 tempest-VolumesTransfersTest-114247105 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87272) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 10:53:56 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-8d70f865-189a-4a64-8e9b-2cb5236b27e2 tempest-VolumesTransfersTest-114247105 None] Flow 'volume_create_manager' (3caebff1-8996-4d00-bd41-85ea77dd9b97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:53:56 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-8d70f865-189a-4a64-8e9b-2cb5236b27e2 tempest-VolumesTransfersTest-114247105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6697bea9-1f97-4e85-9de7-d2a95c94e68b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:53:56 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-8d70f865-189a-4a64-8e9b-2cb5236b27e2 tempest-VolumesTransfersTest-114247105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6697bea9-1f97-4e85-9de7-d2a95c94e68b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T09:53:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-768004282',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=18e48c22-7452-42d9-993d-7122ae5eade3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fe4180f9f2a84c808247bd4ee60663a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T09:53:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T09:53:56Z,use_quota=True,user_id='575b6d0e5a6c4d6d9296cfcf4455d081',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8989e4f-21e3-4f0a-9584-0d818784e883),volume_type_id=f8989e4f-21e3-4f0a-9584-0d818784e883)' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:53:56 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-8d70f865-189a-4a64-8e9b-2cb5236b27e2 tempest-VolumesTransfersTest-114247105 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e6fb702-4517-4da8-a164-e020d52ccf87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:53:56 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-8d70f865-189a-4a64-8e9b-2cb5236b27e2 tempest-VolumesTransfersTest-114247105 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e6fb702-4517-4da8-a164-e020d52ccf87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:53:56 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-8d70f865-189a-4a64-8e9b-2cb5236b27e2 tempest-VolumesTransfersTest-114247105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dbcc730e-7d5f-43fa-adee-d5361ba2f62f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:53:56 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-8d70f865-189a-4a64-8e9b-2cb5236b27e2 tempest-VolumesTransfersTest-114247105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dbcc730e-7d5f-43fa-adee-d5361ba2f62f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '18e48c22-7452-42d9-993d-7122ae5eade3', 'volume_name': 'volume-18e48c22-7452-42d9-993d-7122ae5eade3', 'volume_size': 1}' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:53:56 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-8d70f865-189a-4a64-8e9b-2cb5236b27e2 tempest-VolumesTransfersTest-114247105 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3d21bfc-40bb-45b5-9115-51ff58c2c5ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:53:56 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-8d70f865-189a-4a64-8e9b-2cb5236b27e2 tempest-VolumesTransfersTest-114247105 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3d21bfc-40bb-45b5-9115-51ff58c2c5ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:53:56 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-8d70f865-189a-4a64-8e9b-2cb5236b27e2 tempest-VolumesTransfersTest-114247105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (69911954-11a8-4ff1-836e-81ec87c1e646) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:53:56 devstack cinder-volume[87272]: INFO cinder.volume.flows.manager.create_volume [None req-8d70f865-189a-4a64-8e9b-2cb5236b27e2 tempest-VolumesTransfersTest-114247105 None] Volume 18e48c22-7452-42d9-993d-7122ae5eade3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-18e48c22-7452-42d9-993d-7122ae5eade3', 'volume_size': 1} Nov 04 10:53:56 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-8d70f865-189a-4a64-8e9b-2cb5236b27e2 tempest-VolumesTransfersTest-114247105 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:53:56 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-8d70f865-189a-4a64-8e9b-2cb5236b27e2 tempest-VolumesTransfersTest-114247105 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:53:56 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-8d70f865-189a-4a64-8e9b-2cb5236b27e2 tempest-VolumesTransfersTest-114247105 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T09:53:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-768004282',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=18e48c22-7452-42d9-993d-7122ae5eade3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fe4180f9f2a84c808247bd4ee60663a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T09:53:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T09:53:56Z,use_quota=True,user_id='575b6d0e5a6c4d6d9296cfcf4455d081',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8989e4f-21e3-4f0a-9584-0d818784e883),volume_type_id=f8989e4f-21e3-4f0a-9584-0d818784e883)}" {{(pid=87272) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 04 10:53:56 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.remotefs [None req-8d70f865-189a-4a64-8e9b-2cb5236b27e2 tempest-VolumesTransfersTest-114247105 None] Creating volume 18e48c22-7452-42d9-993d-7122ae5eade3 {{(pid=87272) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 10:53:56 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-8d70f865-189a-4a64-8e9b-2cb5236b27e2 tempest-VolumesTransfersTest-114247105 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:53:56 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-8d70f865-189a-4a64-8e9b-2cb5236b27e2 tempest-VolumesTransfersTest-114247105 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:53:56 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-8d70f865-189a-4a64-8e9b-2cb5236b27e2 tempest-VolumesTransfersTest-114247105 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898': None} {{(pid=87272) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:53:56 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-8d70f865-189a-4a64-8e9b-2cb5236b27e2 tempest-VolumesTransfersTest-114247105 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'] {{(pid=87272) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:53:56 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-8d70f865-189a-4a64-8e9b-2cb5236b27e2 tempest-VolumesTransfersTest-114247105 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:53:56 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-8d70f865-189a-4a64-8e9b-2cb5236b27e2 tempest-VolumesTransfersTest-114247105 None] Selected osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898 as target Quobyte volume. {{(pid=87272) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 10:53:56 devstack cinder-volume[87272]: INFO cinder.volume.drivers.remotefs [None req-8d70f865-189a-4a64-8e9b-2cb5236b27e2 tempest-VolumesTransfersTest-114247105 None] casted to osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898 Nov 04 10:53:56 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-8d70f865-189a-4a64-8e9b-2cb5236b27e2 tempest-VolumesTransfersTest-114247105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-18e48c22-7452-42d9-993d-7122ae5eade3 1073741824 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:53:56 devstack sudo[93138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-18e48c22-7452-42d9-993d-7122ae5eade3 1073741824 Nov 04 10:53:56 devstack sudo[93138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:53:56 devstack sudo[93138]: pam_unix(sudo:session): session closed for user root Nov 04 10:53:56 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-8d70f865-189a-4a64-8e9b-2cb5236b27e2 tempest-VolumesTransfersTest-114247105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-18e48c22-7452-42d9-993d-7122ae5eade3 1073741824" returned: 0 in 0.598s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:53:57 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-8d70f865-189a-4a64-8e9b-2cb5236b27e2 tempest-VolumesTransfersTest-114247105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-18e48c22-7452-42d9-993d-7122ae5eade3 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:53:57 devstack sudo[93146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-18e48c22-7452-42d9-993d-7122ae5eade3 Nov 04 10:53:57 devstack sudo[93146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:53:57 devstack sudo[93146]: pam_unix(sudo:session): session closed for user root Nov 04 10:53:57 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-8d70f865-189a-4a64-8e9b-2cb5236b27e2 tempest-VolumesTransfersTest-114247105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-18e48c22-7452-42d9-993d-7122ae5eade3" returned: 0 in 0.349s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:53:57 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-8d70f865-189a-4a64-8e9b-2cb5236b27e2 tempest-VolumesTransfersTest-114247105 None] <== create_volume: return (1019ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'} {{(pid=87272) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 04 10:53:57 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-8d70f865-189a-4a64-8e9b-2cb5236b27e2 tempest-VolumesTransfersTest-114247105 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.023s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:53:57 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-8d70f865-189a-4a64-8e9b-2cb5236b27e2 tempest-VolumesTransfersTest-114247105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (69911954-11a8-4ff1-836e-81ec87c1e646) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-18e48c22-7452-42d9-993d-7122ae5eade3', 'volume_size': 1}' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:53:57 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-8d70f865-189a-4a64-8e9b-2cb5236b27e2 tempest-VolumesTransfersTest-114247105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (35c27878-b741-441b-9370-55f5a2dced36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:53:57 devstack cinder-volume[87272]: INFO cinder.volume.flows.manager.create_volume [None req-8d70f865-189a-4a64-8e9b-2cb5236b27e2 tempest-VolumesTransfersTest-114247105 None] Volume volume-18e48c22-7452-42d9-993d-7122ae5eade3 (18e48c22-7452-42d9-993d-7122ae5eade3): created successfully Nov 04 10:53:57 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-8d70f865-189a-4a64-8e9b-2cb5236b27e2 tempest-VolumesTransfersTest-114247105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (35c27878-b741-441b-9370-55f5a2dced36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:53:57 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-8d70f865-189a-4a64-8e9b-2cb5236b27e2 tempest-VolumesTransfersTest-114247105 None] Flow 'volume_create_manager' (3caebff1-8996-4d00-bd41-85ea77dd9b97) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87272) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:53:57 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-8d70f865-189a-4a64-8e9b-2cb5236b27e2 tempest-VolumesTransfersTest-114247105 None] Created volume successfully. Nov 04 10:54:00 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-e7958063-1066-4095-9845-b2f4bc16d6a7 tempest-VolumesTransfersTest-1648393077 None] Transfer volume completed successfully. Nov 04 10:54:01 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-c685d10b-7fbf-4e43-8b55-1d897bfb4c7a tempest-VolumesTransfersTest-1533698646 None] Acquiring lock "cinder-18e48c22-7452-42d9-993d-7122ae5eade3-delete_volume" by "delete_volume" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:54:01 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-c685d10b-7fbf-4e43-8b55-1d897bfb4c7a tempest-VolumesTransfersTest-1533698646 None] Lock "cinder-18e48c22-7452-42d9-993d-7122ae5eade3-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:54:01 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-c685d10b-7fbf-4e43-8b55-1d897bfb4c7a tempest-VolumesTransfersTest-1533698646 None] Acquiring lock "cinder-quobyte-18e48c22-7452-42d9-993d-7122ae5eade3" by "delete_volume" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:54:01 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-c685d10b-7fbf-4e43-8b55-1d897bfb4c7a tempest-VolumesTransfersTest-1533698646 None] Lock "cinder-quobyte-18e48c22-7452-42d9-993d-7122ae5eade3" acquired by "delete_volume" :: waited 0.023s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:54:01 devstack cinder-volume[87272]: DEBUG oslo.privsep.daemon [-] privsep: reply[51aca213-394a-419d-8761-150adf798c9a]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:54:01 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-c685d10b-7fbf-4e43-8b55-1d897bfb4c7a tempest-VolumesTransfersTest-1533698646 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-18e48c22-7452-42d9-993d-7122ae5eade3 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:54:01 devstack sudo[93239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-18e48c22-7452-42d9-993d-7122ae5eade3 Nov 04 10:54:01 devstack sudo[93239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:54:01 devstack sudo[93239]: pam_unix(sudo:session): session closed for user root Nov 04 10:54:01 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-c685d10b-7fbf-4e43-8b55-1d897bfb4c7a tempest-VolumesTransfersTest-1533698646 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-18e48c22-7452-42d9-993d-7122ae5eade3" returned: 0 in 0.459s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:54:01 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-c685d10b-7fbf-4e43-8b55-1d897bfb4c7a tempest-VolumesTransfersTest-1533698646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-18e48c22-7452-42d9-993d-7122ae5eade3 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:54:01 devstack sudo[93244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-18e48c22-7452-42d9-993d-7122ae5eade3 Nov 04 10:54:01 devstack sudo[93244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:54:02 devstack sudo[93244]: pam_unix(sudo:session): session closed for user root Nov 04 10:54:02 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-c685d10b-7fbf-4e43-8b55-1d897bfb4c7a tempest-VolumesTransfersTest-1533698646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-18e48c22-7452-42d9-993d-7122ae5eade3" returned: 0 in 0.331s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:54:02 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-c685d10b-7fbf-4e43-8b55-1d897bfb4c7a tempest-VolumesTransfersTest-1533698646 None] Lock "cinder-quobyte-18e48c22-7452-42d9-993d-7122ae5eade3" released by "delete_volume" :: held 0.852s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:54:02 devstack cinder-volume[87272]: DEBUG cinder.quota [None req-c685d10b-7fbf-4e43-8b55-1d897bfb4c7a tempest-VolumesTransfersTest-1533698646 None] Created reservations ['38b80694-2d89-44a0-9025-aef2a62c6158', 'd0a60d71-b067-4803-a848-aca80c310053', '61aeab44-ed9d-4b16-9fe3-d6c4c93142a9', 'c6fd0dd7-2d3e-4a59-9444-c871f6e1fb62'] {{(pid=87272) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 10:54:02 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-c685d10b-7fbf-4e43-8b55-1d897bfb4c7a tempest-VolumesTransfersTest-1533698646 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:54:02 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-c685d10b-7fbf-4e43-8b55-1d897bfb4c7a tempest-VolumesTransfersTest-1533698646 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:54:02 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-c685d10b-7fbf-4e43-8b55-1d897bfb4c7a tempest-VolumesTransfersTest-1533698646 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898': None} {{(pid=87272) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:54:02 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-c685d10b-7fbf-4e43-8b55-1d897bfb4c7a tempest-VolumesTransfersTest-1533698646 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'] {{(pid=87272) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:54:02 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-c685d10b-7fbf-4e43-8b55-1d897bfb4c7a tempest-VolumesTransfersTest-1533698646 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:54:02 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-c685d10b-7fbf-4e43-8b55-1d897bfb4c7a tempest-VolumesTransfersTest-1533698646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:54:02 devstack sudo[93271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1 Nov 04 10:54:02 devstack sudo[93271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:54:02 devstack sudo[93271]: pam_unix(sudo:session): session closed for user root Nov 04 10:54:02 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-c685d10b-7fbf-4e43-8b55-1d897bfb4c7a tempest-VolumesTransfersTest-1533698646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1" returned: 0 in 0.380s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:54:02 devstack cinder-volume[87272]: DEBUG cinder.manager [None req-c685d10b-7fbf-4e43-8b55-1d897bfb4c7a tempest-VolumesTransfersTest-1533698646 None] Notifying Schedulers of capabilities ... {{(pid=87272) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 10:54:02 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-c685d10b-7fbf-4e43-8b55-1d897bfb4c7a tempest-VolumesTransfersTest-1533698646 None] Deleted volume successfully. Nov 04 10:54:02 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-c685d10b-7fbf-4e43-8b55-1d897bfb4c7a tempest-VolumesTransfersTest-1533698646 None] Lock "cinder-18e48c22-7452-42d9-993d-7122ae5eade3-delete_volume" released by "delete_volume" :: held 1.607s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:54:03 devstack cinder-volume[87272]: DEBUG cinder.volume.flows.manager.create_volume [None req-ab7b354b-8c44-4ae1-8d89-e027d05bdb5b tempest-VolumesTransfersTest-114247105 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87272) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 10:54:03 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-ab7b354b-8c44-4ae1-8d89-e027d05bdb5b tempest-VolumesTransfersTest-114247105 None] Flow 'volume_create_manager' (90b4f8ab-119f-452c-8fd8-0aced1f540ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:54:03 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-ab7b354b-8c44-4ae1-8d89-e027d05bdb5b tempest-VolumesTransfersTest-114247105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c98ea5e7-a51e-4021-87b8-fa63051498ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:54:03 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-ab7b354b-8c44-4ae1-8d89-e027d05bdb5b tempest-VolumesTransfersTest-114247105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c98ea5e7-a51e-4021-87b8-fa63051498ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T09:54:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1563530227',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=172335a3-5098-42a5-8d2c-05de74978a35,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fe4180f9f2a84c808247bd4ee60663a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T09:54:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T09:54:03Z,use_quota=True,user_id='575b6d0e5a6c4d6d9296cfcf4455d081',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8989e4f-21e3-4f0a-9584-0d818784e883),volume_type_id=f8989e4f-21e3-4f0a-9584-0d818784e883)' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:54:03 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-ab7b354b-8c44-4ae1-8d89-e027d05bdb5b tempest-VolumesTransfersTest-114247105 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22c89021-0971-401f-82af-b14a6e1ff794) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:54:03 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-ab7b354b-8c44-4ae1-8d89-e027d05bdb5b tempest-VolumesTransfersTest-114247105 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22c89021-0971-401f-82af-b14a6e1ff794) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:54:03 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-ab7b354b-8c44-4ae1-8d89-e027d05bdb5b tempest-VolumesTransfersTest-114247105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (362ce5f5-3379-4889-bfeb-ae792e209a79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:54:03 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-ab7b354b-8c44-4ae1-8d89-e027d05bdb5b tempest-VolumesTransfersTest-114247105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (362ce5f5-3379-4889-bfeb-ae792e209a79) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '172335a3-5098-42a5-8d2c-05de74978a35', 'volume_name': 'volume-172335a3-5098-42a5-8d2c-05de74978a35', 'volume_size': 1}' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:54:03 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-ab7b354b-8c44-4ae1-8d89-e027d05bdb5b tempest-VolumesTransfersTest-114247105 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ecbd1bb7-2094-4b88-9c99-22e1ff9b50d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:54:03 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-ab7b354b-8c44-4ae1-8d89-e027d05bdb5b tempest-VolumesTransfersTest-114247105 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ecbd1bb7-2094-4b88-9c99-22e1ff9b50d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:54:03 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-ab7b354b-8c44-4ae1-8d89-e027d05bdb5b tempest-VolumesTransfersTest-114247105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ffafe68d-3532-495a-8660-e5896f30c761) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:54:03 devstack cinder-volume[87272]: INFO cinder.volume.flows.manager.create_volume [None req-ab7b354b-8c44-4ae1-8d89-e027d05bdb5b tempest-VolumesTransfersTest-114247105 None] Volume 172335a3-5098-42a5-8d2c-05de74978a35: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-172335a3-5098-42a5-8d2c-05de74978a35', 'volume_size': 1} Nov 04 10:54:03 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-ab7b354b-8c44-4ae1-8d89-e027d05bdb5b tempest-VolumesTransfersTest-114247105 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:54:03 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-ab7b354b-8c44-4ae1-8d89-e027d05bdb5b tempest-VolumesTransfersTest-114247105 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:54:03 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-ab7b354b-8c44-4ae1-8d89-e027d05bdb5b tempest-VolumesTransfersTest-114247105 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T09:54:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1563530227',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=172335a3-5098-42a5-8d2c-05de74978a35,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fe4180f9f2a84c808247bd4ee60663a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T09:54:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T09:54:03Z,use_quota=True,user_id='575b6d0e5a6c4d6d9296cfcf4455d081',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8989e4f-21e3-4f0a-9584-0d818784e883),volume_type_id=f8989e4f-21e3-4f0a-9584-0d818784e883)}" {{(pid=87272) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 04 10:54:03 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.remotefs [None req-ab7b354b-8c44-4ae1-8d89-e027d05bdb5b tempest-VolumesTransfersTest-114247105 None] Creating volume 172335a3-5098-42a5-8d2c-05de74978a35 {{(pid=87272) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 10:54:03 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-ab7b354b-8c44-4ae1-8d89-e027d05bdb5b tempest-VolumesTransfersTest-114247105 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:54:03 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-ab7b354b-8c44-4ae1-8d89-e027d05bdb5b tempest-VolumesTransfersTest-114247105 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:54:03 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-ab7b354b-8c44-4ae1-8d89-e027d05bdb5b tempest-VolumesTransfersTest-114247105 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898': None} {{(pid=87272) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:54:03 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-ab7b354b-8c44-4ae1-8d89-e027d05bdb5b tempest-VolumesTransfersTest-114247105 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'] {{(pid=87272) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:54:03 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-ab7b354b-8c44-4ae1-8d89-e027d05bdb5b tempest-VolumesTransfersTest-114247105 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:54:03 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-ab7b354b-8c44-4ae1-8d89-e027d05bdb5b tempest-VolumesTransfersTest-114247105 None] Selected osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898 as target Quobyte volume. {{(pid=87272) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 10:54:03 devstack cinder-volume[87272]: INFO cinder.volume.drivers.remotefs [None req-ab7b354b-8c44-4ae1-8d89-e027d05bdb5b tempest-VolumesTransfersTest-114247105 None] casted to osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898 Nov 04 10:54:03 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-ab7b354b-8c44-4ae1-8d89-e027d05bdb5b tempest-VolumesTransfersTest-114247105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-172335a3-5098-42a5-8d2c-05de74978a35 1073741824 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:54:03 devstack sudo[93275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-172335a3-5098-42a5-8d2c-05de74978a35 1073741824 Nov 04 10:54:03 devstack sudo[93275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:54:04 devstack sudo[93275]: pam_unix(sudo:session): session closed for user root Nov 04 10:54:04 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-ab7b354b-8c44-4ae1-8d89-e027d05bdb5b tempest-VolumesTransfersTest-114247105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-172335a3-5098-42a5-8d2c-05de74978a35 1073741824" returned: 0 in 0.617s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:54:04 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-ab7b354b-8c44-4ae1-8d89-e027d05bdb5b tempest-VolumesTransfersTest-114247105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-172335a3-5098-42a5-8d2c-05de74978a35 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:54:04 devstack sudo[93282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-172335a3-5098-42a5-8d2c-05de74978a35 Nov 04 10:54:04 devstack sudo[93282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:54:04 devstack sudo[93282]: pam_unix(sudo:session): session closed for user root Nov 04 10:54:04 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-ab7b354b-8c44-4ae1-8d89-e027d05bdb5b tempest-VolumesTransfersTest-114247105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-172335a3-5098-42a5-8d2c-05de74978a35" returned: 0 in 0.348s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:54:04 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-ab7b354b-8c44-4ae1-8d89-e027d05bdb5b tempest-VolumesTransfersTest-114247105 None] <== create_volume: return (1033ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'} {{(pid=87272) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 04 10:54:04 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-ab7b354b-8c44-4ae1-8d89-e027d05bdb5b tempest-VolumesTransfersTest-114247105 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.035s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:54:04 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-ab7b354b-8c44-4ae1-8d89-e027d05bdb5b tempest-VolumesTransfersTest-114247105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ffafe68d-3532-495a-8660-e5896f30c761) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-172335a3-5098-42a5-8d2c-05de74978a35', 'volume_size': 1}' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:54:04 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-ab7b354b-8c44-4ae1-8d89-e027d05bdb5b tempest-VolumesTransfersTest-114247105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f3b0d8a-1ef2-401e-b207-d730a13f5c51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:54:04 devstack cinder-volume[87272]: INFO cinder.volume.flows.manager.create_volume [None req-ab7b354b-8c44-4ae1-8d89-e027d05bdb5b tempest-VolumesTransfersTest-114247105 None] Volume volume-172335a3-5098-42a5-8d2c-05de74978a35 (172335a3-5098-42a5-8d2c-05de74978a35): created successfully Nov 04 10:54:04 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-ab7b354b-8c44-4ae1-8d89-e027d05bdb5b tempest-VolumesTransfersTest-114247105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f3b0d8a-1ef2-401e-b207-d730a13f5c51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:54:04 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-ab7b354b-8c44-4ae1-8d89-e027d05bdb5b tempest-VolumesTransfersTest-114247105 None] Flow 'volume_create_manager' (90b4f8ab-119f-452c-8fd8-0aced1f540ea) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87272) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:54:04 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-ab7b354b-8c44-4ae1-8d89-e027d05bdb5b tempest-VolumesTransfersTest-114247105 None] Created volume successfully. Nov 04 10:54:05 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-9d9dbe00-5c39-4e2b-bdd0-7ef7cb43edb3 tempest-VolumesTransfersTest-1533698646 None] Acquiring lock "cinder-172335a3-5098-42a5-8d2c-05de74978a35-delete_volume" by "delete_volume" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:54:05 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-9d9dbe00-5c39-4e2b-bdd0-7ef7cb43edb3 tempest-VolumesTransfersTest-1533698646 None] Lock "cinder-172335a3-5098-42a5-8d2c-05de74978a35-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:54:05 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-9d9dbe00-5c39-4e2b-bdd0-7ef7cb43edb3 tempest-VolumesTransfersTest-1533698646 None] Acquiring lock "cinder-quobyte-172335a3-5098-42a5-8d2c-05de74978a35" by "delete_volume" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:54:06 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-9d9dbe00-5c39-4e2b-bdd0-7ef7cb43edb3 tempest-VolumesTransfersTest-1533698646 None] Lock "cinder-quobyte-172335a3-5098-42a5-8d2c-05de74978a35" acquired by "delete_volume" :: waited 0.023s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:54:06 devstack cinder-volume[87272]: DEBUG oslo.privsep.daemon [-] privsep: reply[db16273c-a785-48d2-af01-002c81a25b59]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:54:06 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-9d9dbe00-5c39-4e2b-bdd0-7ef7cb43edb3 tempest-VolumesTransfersTest-1533698646 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-172335a3-5098-42a5-8d2c-05de74978a35 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:54:06 devstack sudo[93286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-172335a3-5098-42a5-8d2c-05de74978a35 Nov 04 10:54:06 devstack sudo[93286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:54:06 devstack sudo[93286]: pam_unix(sudo:session): session closed for user root Nov 04 10:54:06 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-9d9dbe00-5c39-4e2b-bdd0-7ef7cb43edb3 tempest-VolumesTransfersTest-1533698646 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-172335a3-5098-42a5-8d2c-05de74978a35" returned: 0 in 0.519s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:54:06 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-9d9dbe00-5c39-4e2b-bdd0-7ef7cb43edb3 tempest-VolumesTransfersTest-1533698646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-172335a3-5098-42a5-8d2c-05de74978a35 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:54:06 devstack sudo[93291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-172335a3-5098-42a5-8d2c-05de74978a35 Nov 04 10:54:06 devstack sudo[93291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:54:06 devstack sudo[93291]: pam_unix(sudo:session): session closed for user root Nov 04 10:54:06 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-9d9dbe00-5c39-4e2b-bdd0-7ef7cb43edb3 tempest-VolumesTransfersTest-1533698646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-172335a3-5098-42a5-8d2c-05de74978a35" returned: 0 in 0.290s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:54:06 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-9d9dbe00-5c39-4e2b-bdd0-7ef7cb43edb3 tempest-VolumesTransfersTest-1533698646 None] Lock "cinder-quobyte-172335a3-5098-42a5-8d2c-05de74978a35" released by "delete_volume" :: held 0.878s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:54:06 devstack cinder-volume[87272]: DEBUG cinder.quota [None req-9d9dbe00-5c39-4e2b-bdd0-7ef7cb43edb3 tempest-VolumesTransfersTest-1533698646 None] Created reservations ['aad00833-f403-4459-bc8b-83f3c4a6355b', 'a00568f7-9318-4300-be85-44fb4b05481f', '48cb113c-6b9e-47cc-866f-14c4c6ba27aa', 'ae24b546-12d7-4919-9585-b1372f3761cc'] {{(pid=87272) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 10:54:07 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-9d9dbe00-5c39-4e2b-bdd0-7ef7cb43edb3 tempest-VolumesTransfersTest-1533698646 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:54:07 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-9d9dbe00-5c39-4e2b-bdd0-7ef7cb43edb3 tempest-VolumesTransfersTest-1533698646 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:54:07 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-9d9dbe00-5c39-4e2b-bdd0-7ef7cb43edb3 tempest-VolumesTransfersTest-1533698646 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898': None} {{(pid=87272) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:54:07 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-9d9dbe00-5c39-4e2b-bdd0-7ef7cb43edb3 tempest-VolumesTransfersTest-1533698646 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'] {{(pid=87272) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:54:07 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-9d9dbe00-5c39-4e2b-bdd0-7ef7cb43edb3 tempest-VolumesTransfersTest-1533698646 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:54:07 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-9d9dbe00-5c39-4e2b-bdd0-7ef7cb43edb3 tempest-VolumesTransfersTest-1533698646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:54:07 devstack sudo[93294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1 Nov 04 10:54:07 devstack sudo[93294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:54:07 devstack sudo[93294]: pam_unix(sudo:session): session closed for user root Nov 04 10:54:07 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-9d9dbe00-5c39-4e2b-bdd0-7ef7cb43edb3 tempest-VolumesTransfersTest-1533698646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1" returned: 0 in 0.272s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:54:07 devstack cinder-volume[87272]: DEBUG cinder.manager [None req-9d9dbe00-5c39-4e2b-bdd0-7ef7cb43edb3 tempest-VolumesTransfersTest-1533698646 None] Notifying Schedulers of capabilities ... {{(pid=87272) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 10:54:07 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-9d9dbe00-5c39-4e2b-bdd0-7ef7cb43edb3 tempest-VolumesTransfersTest-1533698646 None] Deleted volume successfully. Nov 04 10:54:07 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-9d9dbe00-5c39-4e2b-bdd0-7ef7cb43edb3 tempest-VolumesTransfersTest-1533698646 None] Lock "cinder-172335a3-5098-42a5-8d2c-05de74978a35-delete_volume" released by "delete_volume" :: held 1.495s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:54:08 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-e4447606-0333-46f4-ba63-ca3c9ab96473 tempest-GroupSnapshotsV319Test-1618305287 None] Group tempest-GroupSnapshotsV319Test-Group-1557789377: creating Nov 04 10:54:08 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-e4447606-0333-46f4-ba63-ca3c9ab96473 tempest-GroupSnapshotsV319Test-1618305287 None] Group tempest-GroupSnapshotsV319Test-Group-1557789377: created successfully Nov 04 10:54:08 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-e4447606-0333-46f4-ba63-ca3c9ab96473 tempest-GroupSnapshotsV319Test-1618305287 None] Create group completed successfully. Nov 04 10:54:09 devstack cinder-volume[87272]: INFO cinder.volume.manager [req-acacebcc-cbb9-481f-a8ac-66b890a405f9 req-af91b553-c8ef-49c3-acf7-ddee10bc087c tempest-ServerActionsTestOtherA-1078392334 None] Terminate volume connection completed successfully. Nov 04 10:54:09 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [req-acacebcc-cbb9-481f-a8ac-66b890a405f9 req-af91b553-c8ef-49c3-acf7-ddee10bc087c tempest-ServerActionsTestOtherA-1078392334 None] Deleting attachment 9010e3d6-8a02-4d28-b2dc-53619135d35b. {{(pid=87272) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 04 10:54:10 devstack cinder-volume[87272]: DEBUG cinder.volume.flows.manager.create_volume [None req-7875056f-feb6-4d62-8c28-25a221d7b4c5 tempest-GroupSnapshotsV319Test-1618305287 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87272) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 10:54:10 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-7875056f-feb6-4d62-8c28-25a221d7b4c5 tempest-GroupSnapshotsV319Test-1618305287 None] Flow 'volume_create_manager' (04a06410-fca5-4f8b-ab0f-08b8ca0af602) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:54:10 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-7875056f-feb6-4d62-8c28-25a221d7b4c5 tempest-GroupSnapshotsV319Test-1618305287 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f97308e-ec68-44ed-b0b5-9d8867878aa4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:54:10 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-7875056f-feb6-4d62-8c28-25a221d7b4c5 tempest-GroupSnapshotsV319Test-1618305287 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f97308e-ec68-44ed-b0b5-9d8867878aa4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T09:54:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1115752372',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=1e495c24-1631-402e-9aed-c53e6063ea25,host='devstack@QuobyteHD#QuobyteHD',id=d2b12b20-9c16-41bc-bc9f-afab2aa39e8a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ecdf95da3574584b88db396d3c9f06d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T09:54:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T09:54:10Z,use_quota=True,user_id='5c26aeb57bcc4fc386f179164064196a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2550ff60-eacf-4610-b90c-7b652eb703be),volume_type_id=2550ff60-eacf-4610-b90c-7b652eb703be)' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:54:10 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-7875056f-feb6-4d62-8c28-25a221d7b4c5 tempest-GroupSnapshotsV319Test-1618305287 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e5d8840a-bc97-4828-be07-fd1e32165f3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:54:10 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-7875056f-feb6-4d62-8c28-25a221d7b4c5 tempest-GroupSnapshotsV319Test-1618305287 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e5d8840a-bc97-4828-be07-fd1e32165f3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:54:10 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-7875056f-feb6-4d62-8c28-25a221d7b4c5 tempest-GroupSnapshotsV319Test-1618305287 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bbdb4cfe-97ce-42f3-9f0b-9dc6e04d3b57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:54:10 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-7875056f-feb6-4d62-8c28-25a221d7b4c5 tempest-GroupSnapshotsV319Test-1618305287 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bbdb4cfe-97ce-42f3-9f0b-9dc6e04d3b57) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd2b12b20-9c16-41bc-bc9f-afab2aa39e8a', 'volume_name': 'volume-d2b12b20-9c16-41bc-bc9f-afab2aa39e8a', 'volume_size': 1}' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:54:10 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-7875056f-feb6-4d62-8c28-25a221d7b4c5 tempest-GroupSnapshotsV319Test-1618305287 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9ffdc85-9959-428a-a310-514b77c3371b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:54:10 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-7875056f-feb6-4d62-8c28-25a221d7b4c5 tempest-GroupSnapshotsV319Test-1618305287 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9ffdc85-9959-428a-a310-514b77c3371b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:54:10 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-7875056f-feb6-4d62-8c28-25a221d7b4c5 tempest-GroupSnapshotsV319Test-1618305287 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (137c8ffc-5481-4af6-bf18-c63c1bcf43a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:54:10 devstack cinder-volume[87272]: INFO cinder.volume.flows.manager.create_volume [None req-7875056f-feb6-4d62-8c28-25a221d7b4c5 tempest-GroupSnapshotsV319Test-1618305287 None] Volume d2b12b20-9c16-41bc-bc9f-afab2aa39e8a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d2b12b20-9c16-41bc-bc9f-afab2aa39e8a', 'volume_size': 1} Nov 04 10:54:10 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-7875056f-feb6-4d62-8c28-25a221d7b4c5 tempest-GroupSnapshotsV319Test-1618305287 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:54:10 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-7875056f-feb6-4d62-8c28-25a221d7b4c5 tempest-GroupSnapshotsV319Test-1618305287 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:54:10 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-7875056f-feb6-4d62-8c28-25a221d7b4c5 tempest-GroupSnapshotsV319Test-1618305287 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=1e495c24-1631-402e-9aed-c53e6063ea25,created_at=2026-11-04T09:54:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1115752372',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=1e495c24-1631-402e-9aed-c53e6063ea25,host='devstack@QuobyteHD#QuobyteHD',id=d2b12b20-9c16-41bc-bc9f-afab2aa39e8a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ecdf95da3574584b88db396d3c9f06d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T09:54:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T09:54:10Z,use_quota=True,user_id='5c26aeb57bcc4fc386f179164064196a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2550ff60-eacf-4610-b90c-7b652eb703be),volume_type_id=2550ff60-eacf-4610-b90c-7b652eb703be)}" {{(pid=87272) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 04 10:54:10 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.remotefs [None req-7875056f-feb6-4d62-8c28-25a221d7b4c5 tempest-GroupSnapshotsV319Test-1618305287 None] Creating volume d2b12b20-9c16-41bc-bc9f-afab2aa39e8a {{(pid=87272) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 10:54:10 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-7875056f-feb6-4d62-8c28-25a221d7b4c5 tempest-GroupSnapshotsV319Test-1618305287 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:54:10 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-7875056f-feb6-4d62-8c28-25a221d7b4c5 tempest-GroupSnapshotsV319Test-1618305287 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:54:10 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-7875056f-feb6-4d62-8c28-25a221d7b4c5 tempest-GroupSnapshotsV319Test-1618305287 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898': None} {{(pid=87272) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:54:10 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-7875056f-feb6-4d62-8c28-25a221d7b4c5 tempest-GroupSnapshotsV319Test-1618305287 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'] {{(pid=87272) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:54:10 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-7875056f-feb6-4d62-8c28-25a221d7b4c5 tempest-GroupSnapshotsV319Test-1618305287 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:54:10 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-7875056f-feb6-4d62-8c28-25a221d7b4c5 tempest-GroupSnapshotsV319Test-1618305287 None] Selected osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898 as target Quobyte volume. {{(pid=87272) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 10:54:10 devstack cinder-volume[87272]: INFO cinder.volume.drivers.remotefs [None req-7875056f-feb6-4d62-8c28-25a221d7b4c5 tempest-GroupSnapshotsV319Test-1618305287 None] casted to osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898 Nov 04 10:54:10 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-7875056f-feb6-4d62-8c28-25a221d7b4c5 tempest-GroupSnapshotsV319Test-1618305287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-d2b12b20-9c16-41bc-bc9f-afab2aa39e8a 1073741824 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:54:10 devstack sudo[93304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-d2b12b20-9c16-41bc-bc9f-afab2aa39e8a 1073741824 Nov 04 10:54:10 devstack sudo[93304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:54:11 devstack sudo[93304]: pam_unix(sudo:session): session closed for user root Nov 04 10:54:11 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-7875056f-feb6-4d62-8c28-25a221d7b4c5 tempest-GroupSnapshotsV319Test-1618305287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-d2b12b20-9c16-41bc-bc9f-afab2aa39e8a 1073741824" returned: 0 in 0.819s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:54:11 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-7875056f-feb6-4d62-8c28-25a221d7b4c5 tempest-GroupSnapshotsV319Test-1618305287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-d2b12b20-9c16-41bc-bc9f-afab2aa39e8a {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:54:11 devstack sudo[93333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-d2b12b20-9c16-41bc-bc9f-afab2aa39e8a Nov 04 10:54:11 devstack sudo[93333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:54:11 devstack sudo[93333]: pam_unix(sudo:session): session closed for user root Nov 04 10:54:11 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-7875056f-feb6-4d62-8c28-25a221d7b4c5 tempest-GroupSnapshotsV319Test-1618305287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-d2b12b20-9c16-41bc-bc9f-afab2aa39e8a" returned: 0 in 0.462s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:54:11 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-7875056f-feb6-4d62-8c28-25a221d7b4c5 tempest-GroupSnapshotsV319Test-1618305287 None] <== create_volume: return (1372ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'} {{(pid=87272) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 04 10:54:11 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-7875056f-feb6-4d62-8c28-25a221d7b4c5 tempest-GroupSnapshotsV319Test-1618305287 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.376s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:54:11 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-7875056f-feb6-4d62-8c28-25a221d7b4c5 tempest-GroupSnapshotsV319Test-1618305287 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (137c8ffc-5481-4af6-bf18-c63c1bcf43a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d2b12b20-9c16-41bc-bc9f-afab2aa39e8a', 'volume_size': 1}' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:54:11 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-7875056f-feb6-4d62-8c28-25a221d7b4c5 tempest-GroupSnapshotsV319Test-1618305287 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d52319c-36ac-4773-affe-4929e11e1740) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:54:11 devstack cinder-volume[87272]: INFO cinder.volume.flows.manager.create_volume [None req-7875056f-feb6-4d62-8c28-25a221d7b4c5 tempest-GroupSnapshotsV319Test-1618305287 None] Volume volume-d2b12b20-9c16-41bc-bc9f-afab2aa39e8a (d2b12b20-9c16-41bc-bc9f-afab2aa39e8a): created successfully Nov 04 10:54:11 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-7875056f-feb6-4d62-8c28-25a221d7b4c5 tempest-GroupSnapshotsV319Test-1618305287 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d52319c-36ac-4773-affe-4929e11e1740) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:54:11 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-7875056f-feb6-4d62-8c28-25a221d7b4c5 tempest-GroupSnapshotsV319Test-1618305287 None] Flow 'volume_create_manager' (04a06410-fca5-4f8b-ab0f-08b8ca0af602) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87272) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:54:11 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-7875056f-feb6-4d62-8c28-25a221d7b4c5 tempest-GroupSnapshotsV319Test-1618305287 None] Created volume successfully. Nov 04 10:54:13 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-344f720f-0a42-400e-a97d-3b205129df16 tempest-GroupSnapshotsV319Test-1618305287 None] GroupSnapshot 6d8234b0-245e-46c5-a75b-51df09e37182: creating. Nov 04 10:54:13 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-344f720f-0a42-400e-a97d-3b205129df16 tempest-GroupSnapshotsV319Test-1618305287 None] Group snapshot 6d8234b0-245e-46c5-a75b-51df09e37182: creating. {{(pid=87272) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Nov 04 10:54:13 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-344f720f-0a42-400e-a97d-3b205129df16 tempest-GroupSnapshotsV319Test-1618305287 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:54:13 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-344f720f-0a42-400e-a97d-3b205129df16 tempest-GroupSnapshotsV319Test-1618305287 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:54:13 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.remotefs [None req-344f720f-0a42-400e-a97d-3b205129df16 tempest-GroupSnapshotsV319Test-1618305287 None] Creating offline snapshot 4dc4a836-57df-438e-8832-4616e9528332 of volume d2b12b20-9c16-41bc-bc9f-afab2aa39e8a {{(pid=87272) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 04 10:54:13 devstack cinder-volume[87272]: DEBUG oslo.privsep.daemon [-] privsep: reply[6de40d86-d694-4039-b982-6b4f048f2580]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:54:13 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-344f720f-0a42-400e-a97d-3b205129df16 tempest-GroupSnapshotsV319Test-1618305287 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-d2b12b20-9c16-41bc-bc9f-afab2aa39e8a {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:54:13 devstack sudo[93379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-d2b12b20-9c16-41bc-bc9f-afab2aa39e8a Nov 04 10:54:13 devstack sudo[93379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:54:13 devstack sudo[93379]: pam_unix(sudo:session): session closed for user root Nov 04 10:54:13 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-344f720f-0a42-400e-a97d-3b205129df16 tempest-GroupSnapshotsV319Test-1618305287 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-d2b12b20-9c16-41bc-bc9f-afab2aa39e8a" returned: 0 in 0.409s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:54:13 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-344f720f-0a42-400e-a97d-3b205129df16 tempest-GroupSnapshotsV319Test-1618305287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-d2b12b20-9c16-41bc-bc9f-afab2aa39e8a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-d2b12b20-9c16-41bc-bc9f-afab2aa39e8a.4dc4a836-57df-438e-8832-4616e9528332 1G {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:54:13 devstack sudo[93384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-d2b12b20-9c16-41bc-bc9f-afab2aa39e8a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-d2b12b20-9c16-41bc-bc9f-afab2aa39e8a.4dc4a836-57df-438e-8832-4616e9528332 1G Nov 04 10:54:13 devstack sudo[93384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:54:14 devstack cinder-volume[87272]: DEBUG oslo_service.periodic_task [None req-236af0be-7f9d-4c80-b3d7-d645a9cd0dd1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87272) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 04 10:54:14 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-236af0be-7f9d-4c80-b3d7-d645a9cd0dd1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:54:14 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-236af0be-7f9d-4c80-b3d7-d645a9cd0dd1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:54:14 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-236af0be-7f9d-4c80-b3d7-d645a9cd0dd1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898': None} {{(pid=87272) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:54:14 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-236af0be-7f9d-4c80-b3d7-d645a9cd0dd1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'] {{(pid=87272) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:54:14 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-236af0be-7f9d-4c80-b3d7-d645a9cd0dd1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:54:14 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-236af0be-7f9d-4c80-b3d7-d645a9cd0dd1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:54:14 devstack sudo[93389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1 Nov 04 10:54:14 devstack sudo[93389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:54:14 devstack sudo[93384]: pam_unix(sudo:session): session closed for user root Nov 04 10:54:14 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-344f720f-0a42-400e-a97d-3b205129df16 tempest-GroupSnapshotsV319Test-1618305287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-d2b12b20-9c16-41bc-bc9f-afab2aa39e8a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-d2b12b20-9c16-41bc-bc9f-afab2aa39e8a.4dc4a836-57df-438e-8832-4616e9528332 1G" returned: 0 in 0.522s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:54:14 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-344f720f-0a42-400e-a97d-3b205129df16 tempest-GroupSnapshotsV319Test-1618305287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d2b12b20-9c16-41bc-bc9f-afab2aa39e8a -F qcow2 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-d2b12b20-9c16-41bc-bc9f-afab2aa39e8a.4dc4a836-57df-438e-8832-4616e9528332 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:54:14 devstack sudo[93392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d2b12b20-9c16-41bc-bc9f-afab2aa39e8a -F qcow2 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-d2b12b20-9c16-41bc-bc9f-afab2aa39e8a.4dc4a836-57df-438e-8832-4616e9528332 Nov 04 10:54:14 devstack sudo[93392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:54:14 devstack sudo[93389]: pam_unix(sudo:session): session closed for user root Nov 04 10:54:14 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-236af0be-7f9d-4c80-b3d7-d645a9cd0dd1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1" returned: 0 in 0.338s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:54:14 devstack cinder-volume[87272]: DEBUG cinder.manager [None req-236af0be-7f9d-4c80-b3d7-d645a9cd0dd1 None None] Notifying Schedulers of capabilities ... {{(pid=87272) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 10:54:14 devstack cinder-volume[87272]: DEBUG oslo_service.periodic_task [None req-236af0be-7f9d-4c80-b3d7-d645a9cd0dd1 None None] Running periodic task VolumeManager._thread_info {{(pid=87272) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 04 10:54:14 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-236af0be-7f9d-4c80-b3d7-d645a9cd0dd1 None None] thread count: 8 {{(pid=87272) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 04 10:54:14 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-236af0be-7f9d-4c80-b3d7-d645a9cd0dd1 None None] thread info: [<_MainThread(MainThread, started 127085713244288)>, , , , , , , ] {{(pid=87272) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 04 10:54:14 devstack sudo[93392]: pam_unix(sudo:session): session closed for user root Nov 04 10:54:14 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-344f720f-0a42-400e-a97d-3b205129df16 tempest-GroupSnapshotsV319Test-1618305287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d2b12b20-9c16-41bc-bc9f-afab2aa39e8a -F qcow2 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-d2b12b20-9c16-41bc-bc9f-afab2aa39e8a.4dc4a836-57df-438e-8832-4616e9528332" returned: 0 in 0.384s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:54:14 devstack cinder-volume[87272]: WARNING cinder.volume.drivers.remotefs [None req-344f720f-0a42-400e-a97d-3b205129df16 tempest-GroupSnapshotsV319Test-1618305287 None] /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-d2b12b20-9c16-41bc-bc9f-afab2aa39e8a.4dc4a836-57df-438e-8832-4616e9528332 is being set with open permissions: ugo+rw: NotImplementedError Nov 04 10:54:14 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-344f720f-0a42-400e-a97d-3b205129df16 tempest-GroupSnapshotsV319Test-1618305287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-d2b12b20-9c16-41bc-bc9f-afab2aa39e8a.4dc4a836-57df-438e-8832-4616e9528332 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:54:14 devstack sudo[93398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-d2b12b20-9c16-41bc-bc9f-afab2aa39e8a.4dc4a836-57df-438e-8832-4616e9528332 Nov 04 10:54:14 devstack sudo[93398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:54:15 devstack sudo[93398]: pam_unix(sudo:session): session closed for user root Nov 04 10:54:15 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-344f720f-0a42-400e-a97d-3b205129df16 tempest-GroupSnapshotsV319Test-1618305287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-d2b12b20-9c16-41bc-bc9f-afab2aa39e8a.4dc4a836-57df-438e-8832-4616e9528332" returned: 0 in 0.278s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:54:15 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-344f720f-0a42-400e-a97d-3b205129df16 tempest-GroupSnapshotsV319Test-1618305287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-d2b12b20-9c16-41bc-bc9f-afab2aa39e8a.info {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:54:15 devstack sudo[93401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-d2b12b20-9c16-41bc-bc9f-afab2aa39e8a.info Nov 04 10:54:15 devstack sudo[93401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:54:15 devstack sudo[93401]: pam_unix(sudo:session): session closed for user root Nov 04 10:54:15 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-344f720f-0a42-400e-a97d-3b205129df16 tempest-GroupSnapshotsV319Test-1618305287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-d2b12b20-9c16-41bc-bc9f-afab2aa39e8a.info" returned: 0 in 0.264s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:54:15 devstack cinder-volume[87272]: WARNING cinder.volume.drivers.remotefs [None req-344f720f-0a42-400e-a97d-3b205129df16 tempest-GroupSnapshotsV319Test-1618305287 None] /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-d2b12b20-9c16-41bc-bc9f-afab2aa39e8a.info is being set with open permissions: ugo+rw: NotImplementedError Nov 04 10:54:15 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-344f720f-0a42-400e-a97d-3b205129df16 tempest-GroupSnapshotsV319Test-1618305287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-d2b12b20-9c16-41bc-bc9f-afab2aa39e8a.info {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:54:15 devstack sudo[93404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-d2b12b20-9c16-41bc-bc9f-afab2aa39e8a.info Nov 04 10:54:15 devstack sudo[93404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:54:15 devstack sudo[93404]: pam_unix(sudo:session): session closed for user root Nov 04 10:54:15 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-344f720f-0a42-400e-a97d-3b205129df16 tempest-GroupSnapshotsV319Test-1618305287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-d2b12b20-9c16-41bc-bc9f-afab2aa39e8a.info" returned: 0 in 0.284s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:54:15 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-344f720f-0a42-400e-a97d-3b205129df16 tempest-GroupSnapshotsV319Test-1618305287 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.245s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:54:15 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-344f720f-0a42-400e-a97d-3b205129df16 tempest-GroupSnapshotsV319Test-1618305287 None] group_snapshot 6d8234b0-245e-46c5-a75b-51df09e37182: created successfully Nov 04 10:54:16 devstack cinder-volume[87272]: DEBUG cinder.volume.flows.manager.create_volume [None req-d05a1908-e5cf-4a29-b2ab-aa113817fd0f tempest-ServerActionsTestOtherA-1078392334 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87272) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 10:54:16 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-d05a1908-e5cf-4a29-b2ab-aa113817fd0f tempest-ServerActionsTestOtherA-1078392334 None] Flow 'volume_create_manager' (59654e6a-86b8-4bb2-bc1e-08f21e4abd1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:54:16 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-d05a1908-e5cf-4a29-b2ab-aa113817fd0f tempest-ServerActionsTestOtherA-1078392334 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (08780eb4-8432-473b-b27c-64faaa16387f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:54:16 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-d05a1908-e5cf-4a29-b2ab-aa113817fd0f tempest-ServerActionsTestOtherA-1078392334 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (08780eb4-8432-473b-b27c-64faaa16387f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T09:54:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1582780054',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c4579c2a-1036-4f29-a41b-8328e133426d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec81cb8bfc924c069e647d173aa0088b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T09:54:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T09:54:17Z,use_quota=True,user_id='ae2d733d411a403fb44b0a87d1459f7e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8989e4f-21e3-4f0a-9584-0d818784e883),volume_type_id=f8989e4f-21e3-4f0a-9584-0d818784e883)' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:54:16 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-d05a1908-e5cf-4a29-b2ab-aa113817fd0f tempest-ServerActionsTestOtherA-1078392334 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1bec82ac-3a06-41d4-a137-fcb4667fc7d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:54:16 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-d05a1908-e5cf-4a29-b2ab-aa113817fd0f tempest-ServerActionsTestOtherA-1078392334 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1bec82ac-3a06-41d4-a137-fcb4667fc7d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:54:16 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-d05a1908-e5cf-4a29-b2ab-aa113817fd0f tempest-ServerActionsTestOtherA-1078392334 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0feb1a09-2dd0-4982-8095-7c6890a7d154) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:54:16 devstack cinder-volume[87272]: DEBUG cinder.image.glance [None req-d05a1908-e5cf-4a29-b2ab-aa113817fd0f tempest-ServerActionsTestOtherA-1078392334 None] Creating Keystone auth plugin from conf {{(pid=87272) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 04 10:54:17 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-d05a1908-e5cf-4a29-b2ab-aa113817fd0f tempest-ServerActionsTestOtherA-1078392334 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0feb1a09-2dd0-4982-8095-7c6890a7d154) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'c4579c2a-1036-4f29-a41b-8328e133426d', 'volume_name': 'volume-c4579c2a-1036-4f29-a41b-8328e133426d', 'volume_size': 1, 'image_id': 'e21f1c05-a199-4b20-94c3-a13f8db1348a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e21f1c05-a199-4b20-94c3-a13f8db1348a', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'a0568d152f1945e380a1ac4afff5179c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'e21f1c05-a199-4b20-94c3-a13f8db1348a', 'created_at': datetime.datetime(2026, 11, 4, 9, 43, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 4, 9, 44, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e21f1c05-a199-4b20-94c3-a13f8db1348a/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:54:17 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-d05a1908-e5cf-4a29-b2ab-aa113817fd0f tempest-ServerActionsTestOtherA-1078392334 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a237c92f-497f-48ec-8e96-2ab4b551a43c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:54:17 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-d05a1908-e5cf-4a29-b2ab-aa113817fd0f tempest-ServerActionsTestOtherA-1078392334 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a237c92f-497f-48ec-8e96-2ab4b551a43c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:54:17 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-d05a1908-e5cf-4a29-b2ab-aa113817fd0f tempest-ServerActionsTestOtherA-1078392334 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec91a272-f3dc-4b12-a7bb-8776177eb779) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:54:17 devstack cinder-volume[87272]: INFO cinder.volume.flows.manager.create_volume [None req-d05a1908-e5cf-4a29-b2ab-aa113817fd0f tempest-ServerActionsTestOtherA-1078392334 None] Volume c4579c2a-1036-4f29-a41b-8328e133426d: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-c4579c2a-1036-4f29-a41b-8328e133426d', 'volume_size': 1, 'image_id': 'e21f1c05-a199-4b20-94c3-a13f8db1348a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e21f1c05-a199-4b20-94c3-a13f8db1348a', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'a0568d152f1945e380a1ac4afff5179c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'e21f1c05-a199-4b20-94c3-a13f8db1348a', 'created_at': datetime.datetime(2026, 11, 4, 9, 43, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 4, 9, 44, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e21f1c05-a199-4b20-94c3-a13f8db1348a/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Nov 04 10:54:17 devstack cinder-volume[87272]: DEBUG cinder.volume.flows.manager.create_volume [None req-d05a1908-e5cf-4a29-b2ab-aa113817fd0f tempest-ServerActionsTestOtherA-1078392334 None] Trying to clone c4579c2a-1036-4f29-a41b-8328e133426d from image e21f1c05-a199-4b20-94c3-a13f8db1348a at location (None, [{'url': 'file:///opt/stack/data/glance/images/e21f1c05-a199-4b20-94c3-a13f8db1348a', 'metadata': {}}]). {{(pid=87272) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 04 10:54:17 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-309c8034-2b1a-407f-8f7a-5d2ba4d0d29d tempest-GroupSnapshotsV319Test-1618305287 None] group_snapshot 6d8234b0-245e-46c5-a75b-51df09e37182: deleting Nov 04 10:54:17 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-309c8034-2b1a-407f-8f7a-5d2ba4d0d29d tempest-GroupSnapshotsV319Test-1618305287 None] group_snapshot 6d8234b0-245e-46c5-a75b-51df09e37182: deleting {{(pid=87272) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Nov 04 10:54:17 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-309c8034-2b1a-407f-8f7a-5d2ba4d0d29d tempest-GroupSnapshotsV319Test-1618305287 None] Acquiring lock "cinder-quobyte-d2b12b20-9c16-41bc-bc9f-afab2aa39e8a" by "delete_snapshot" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:54:17 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-309c8034-2b1a-407f-8f7a-5d2ba4d0d29d tempest-GroupSnapshotsV319Test-1618305287 None] Lock "cinder-quobyte-d2b12b20-9c16-41bc-bc9f-afab2aa39e8a" acquired by "delete_snapshot" :: waited 0.035s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:54:17 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-309c8034-2b1a-407f-8f7a-5d2ba4d0d29d tempest-GroupSnapshotsV319Test-1618305287 None] Acquiring lock "cinder-quobyte-4dc4a836-57df-438e-8832-4616e9528332" by "_delete_snapshot" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:54:17 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-309c8034-2b1a-407f-8f7a-5d2ba4d0d29d tempest-GroupSnapshotsV319Test-1618305287 None] Lock "cinder-quobyte-4dc4a836-57df-438e-8832-4616e9528332" acquired by "_delete_snapshot" :: waited 0.049s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:54:17 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.remotefs [None req-309c8034-2b1a-407f-8f7a-5d2ba4d0d29d tempest-GroupSnapshotsV319Test-1618305287 None] Deleting offline snapshot 4dc4a836-57df-438e-8832-4616e9528332 of volume d2b12b20-9c16-41bc-bc9f-afab2aa39e8a {{(pid=87272) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 04 10:54:17 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.remotefs [None req-309c8034-2b1a-407f-8f7a-5d2ba4d0d29d tempest-GroupSnapshotsV319Test-1618305287 None] snapshot_file for this snap is: volume-d2b12b20-9c16-41bc-bc9f-afab2aa39e8a.4dc4a836-57df-438e-8832-4616e9528332 {{(pid=87272) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 04 10:54:17 devstack cinder-volume[87272]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0c2518a-b476-411d-b05b-d6b4b38861f4]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:54:17 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-309c8034-2b1a-407f-8f7a-5d2ba4d0d29d tempest-GroupSnapshotsV319Test-1618305287 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-d2b12b20-9c16-41bc-bc9f-afab2aa39e8a.4dc4a836-57df-438e-8832-4616e9528332 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:54:17 devstack sudo[93428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-d2b12b20-9c16-41bc-bc9f-afab2aa39e8a.4dc4a836-57df-438e-8832-4616e9528332 Nov 04 10:54:17 devstack sudo[93428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:54:17 devstack cinder-volume[87272]: DEBUG cinder.image.image_utils [None req-d05a1908-e5cf-4a29-b2ab-aa113817fd0f tempest-ServerActionsTestOtherA-1078392334 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_e21f1c05-a199-4b20-94c3-a13f8db1348a_gfe3_xqzdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87272) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Nov 04 10:54:17 devstack cinder-volume[87272]: INFO cinder.image.image_utils [None req-d05a1908-e5cf-4a29-b2ab-aa113817fd0f tempest-ServerActionsTestOtherA-1078392334 None] Image download 20.69 MB at 20.69 MB/s Nov 04 10:54:17 devstack cinder-volume[87272]: DEBUG oslo.privsep.daemon [-] privsep: reply[230b85eb-7e31-45ed-bb3f-79f5808f0cbc]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:54:17 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-d05a1908-e5cf-4a29-b2ab-aa113817fd0f tempest-ServerActionsTestOtherA-1078392334 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e21f1c05-a199-4b20-94c3-a13f8db1348a_gfe3_xqzdevstack@QuobyteHD {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:54:17 devstack sudo[93432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e21f1c05-a199-4b20-94c3-a13f8db1348a_gfe3_xqzdevstack@QuobyteHD Nov 04 10:54:17 devstack sudo[93432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:54:17 devstack sudo[93428]: pam_unix(sudo:session): session closed for user root Nov 04 10:54:17 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-309c8034-2b1a-407f-8f7a-5d2ba4d0d29d tempest-GroupSnapshotsV319Test-1618305287 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-d2b12b20-9c16-41bc-bc9f-afab2aa39e8a.4dc4a836-57df-438e-8832-4616e9528332" returned: 0 in 0.509s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:54:17 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.remotefs [None req-309c8034-2b1a-407f-8f7a-5d2ba4d0d29d tempest-GroupSnapshotsV319Test-1618305287 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d2b12b20-9c16-41bc-bc9f-afab2aa39e8a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87272) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 10:54:17 devstack cinder-volume[87272]: DEBUG oslo.privsep.daemon [-] privsep: reply[38ee6462-7d5f-4df8-8cf1-c17f53271d52]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:54:17 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-309c8034-2b1a-407f-8f7a-5d2ba4d0d29d tempest-GroupSnapshotsV319Test-1618305287 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-d2b12b20-9c16-41bc-bc9f-afab2aa39e8a {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:54:18 devstack sudo[93437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-d2b12b20-9c16-41bc-bc9f-afab2aa39e8a Nov 04 10:54:18 devstack sudo[93437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:54:18 devstack sudo[93432]: pam_unix(sudo:session): session closed for user root Nov 04 10:54:18 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-d05a1908-e5cf-4a29-b2ab-aa113817fd0f tempest-ServerActionsTestOtherA-1078392334 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e21f1c05-a199-4b20-94c3-a13f8db1348a_gfe3_xqzdevstack@QuobyteHD" returned: 0 in 0.366s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:54:18 devstack cinder-volume[87272]: DEBUG cinder.image.image_utils [None req-d05a1908-e5cf-4a29-b2ab-aa113817fd0f tempest-ServerActionsTestOtherA-1078392334 None] Temporary image e21f1c05-a199-4b20-94c3-a13f8db1348a is fetched for user ae2d733d411a403fb44b0a87d1459f7e. {{(pid=87272) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Nov 04 10:54:18 devstack cinder-volume[87272]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7f95680-527c-4312-9b5d-d8385c172941]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:54:18 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-d05a1908-e5cf-4a29-b2ab-aa113817fd0f tempest-ServerActionsTestOtherA-1078392334 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e21f1c05-a199-4b20-94c3-a13f8db1348a_gfe3_xqzdevstack@QuobyteHD {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:54:18 devstack sudo[93442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e21f1c05-a199-4b20-94c3-a13f8db1348a_gfe3_xqzdevstack@QuobyteHD Nov 04 10:54:18 devstack sudo[93442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:54:18 devstack sudo[93437]: pam_unix(sudo:session): session closed for user root Nov 04 10:54:18 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-309c8034-2b1a-407f-8f7a-5d2ba4d0d29d tempest-GroupSnapshotsV319Test-1618305287 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-d2b12b20-9c16-41bc-bc9f-afab2aa39e8a" returned: 0 in 0.408s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:54:18 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-309c8034-2b1a-407f-8f7a-5d2ba4d0d29d tempest-GroupSnapshotsV319Test-1618305287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-d2b12b20-9c16-41bc-bc9f-afab2aa39e8a.4dc4a836-57df-438e-8832-4616e9528332 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:54:18 devstack sudo[93447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-d2b12b20-9c16-41bc-bc9f-afab2aa39e8a.4dc4a836-57df-438e-8832-4616e9528332 Nov 04 10:54:18 devstack sudo[93447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:54:18 devstack sudo[93442]: pam_unix(sudo:session): session closed for user root Nov 04 10:54:18 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-d05a1908-e5cf-4a29-b2ab-aa113817fd0f tempest-ServerActionsTestOtherA-1078392334 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e21f1c05-a199-4b20-94c3-a13f8db1348a_gfe3_xqzdevstack@QuobyteHD" returned: 0 in 0.382s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:54:18 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-d05a1908-e5cf-4a29-b2ab-aa113817fd0f tempest-ServerActionsTestOtherA-1078392334 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:54:18 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-d05a1908-e5cf-4a29-b2ab-aa113817fd0f tempest-ServerActionsTestOtherA-1078392334 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:54:18 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-d05a1908-e5cf-4a29-b2ab-aa113817fd0f tempest-ServerActionsTestOtherA-1078392334 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T09:54:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1582780054',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c4579c2a-1036-4f29-a41b-8328e133426d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec81cb8bfc924c069e647d173aa0088b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T09:54:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T09:54:17Z,use_quota=True,user_id='ae2d733d411a403fb44b0a87d1459f7e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8989e4f-21e3-4f0a-9584-0d818784e883),volume_type_id=f8989e4f-21e3-4f0a-9584-0d818784e883)}" {{(pid=87272) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 04 10:54:18 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.remotefs [None req-d05a1908-e5cf-4a29-b2ab-aa113817fd0f tempest-ServerActionsTestOtherA-1078392334 None] Creating volume c4579c2a-1036-4f29-a41b-8328e133426d {{(pid=87272) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 10:54:18 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-d05a1908-e5cf-4a29-b2ab-aa113817fd0f tempest-ServerActionsTestOtherA-1078392334 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:54:18 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-d05a1908-e5cf-4a29-b2ab-aa113817fd0f tempest-ServerActionsTestOtherA-1078392334 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:54:18 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-d05a1908-e5cf-4a29-b2ab-aa113817fd0f tempest-ServerActionsTestOtherA-1078392334 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898': None} {{(pid=87272) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:54:18 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-d05a1908-e5cf-4a29-b2ab-aa113817fd0f tempest-ServerActionsTestOtherA-1078392334 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'] {{(pid=87272) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:54:18 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-d05a1908-e5cf-4a29-b2ab-aa113817fd0f tempest-ServerActionsTestOtherA-1078392334 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:54:18 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-d05a1908-e5cf-4a29-b2ab-aa113817fd0f tempest-ServerActionsTestOtherA-1078392334 None] Selected osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898 as target Quobyte volume. {{(pid=87272) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 10:54:18 devstack cinder-volume[87272]: INFO cinder.volume.drivers.remotefs [None req-d05a1908-e5cf-4a29-b2ab-aa113817fd0f tempest-ServerActionsTestOtherA-1078392334 None] casted to osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898 Nov 04 10:54:18 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-d05a1908-e5cf-4a29-b2ab-aa113817fd0f tempest-ServerActionsTestOtherA-1078392334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-c4579c2a-1036-4f29-a41b-8328e133426d 1073741824 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:54:18 devstack sudo[93455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-c4579c2a-1036-4f29-a41b-8328e133426d 1073741824 Nov 04 10:54:18 devstack sudo[93455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:54:18 devstack sudo[93447]: pam_unix(sudo:session): session closed for user root Nov 04 10:54:18 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-309c8034-2b1a-407f-8f7a-5d2ba4d0d29d tempest-GroupSnapshotsV319Test-1618305287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-d2b12b20-9c16-41bc-bc9f-afab2aa39e8a.4dc4a836-57df-438e-8832-4616e9528332" returned: 0 in 0.410s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:54:18 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-309c8034-2b1a-407f-8f7a-5d2ba4d0d29d tempest-GroupSnapshotsV319Test-1618305287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-d2b12b20-9c16-41bc-bc9f-afab2aa39e8a.4dc4a836-57df-438e-8832-4616e9528332 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:54:18 devstack sudo[93459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-d2b12b20-9c16-41bc-bc9f-afab2aa39e8a.4dc4a836-57df-438e-8832-4616e9528332 Nov 04 10:54:18 devstack sudo[93459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:54:19 devstack sudo[93459]: pam_unix(sudo:session): session closed for user root Nov 04 10:54:19 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-309c8034-2b1a-407f-8f7a-5d2ba4d0d29d tempest-GroupSnapshotsV319Test-1618305287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-d2b12b20-9c16-41bc-bc9f-afab2aa39e8a.4dc4a836-57df-438e-8832-4616e9528332" returned: 0 in 0.292s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:54:19 devstack sudo[93455]: pam_unix(sudo:session): session closed for user root Nov 04 10:54:19 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-d05a1908-e5cf-4a29-b2ab-aa113817fd0f tempest-ServerActionsTestOtherA-1078392334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-c4579c2a-1036-4f29-a41b-8328e133426d 1073741824" returned: 0 in 0.487s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:54:19 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-309c8034-2b1a-407f-8f7a-5d2ba4d0d29d tempest-GroupSnapshotsV319Test-1618305287 None] Lock "cinder-quobyte-4dc4a836-57df-438e-8832-4616e9528332" released by "_delete_snapshot" :: held 1.783s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:54:19 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-309c8034-2b1a-407f-8f7a-5d2ba4d0d29d tempest-GroupSnapshotsV319Test-1618305287 None] Lock "cinder-quobyte-d2b12b20-9c16-41bc-bc9f-afab2aa39e8a" released by "delete_snapshot" :: held 1.844s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:54:19 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-d05a1908-e5cf-4a29-b2ab-aa113817fd0f tempest-ServerActionsTestOtherA-1078392334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-c4579c2a-1036-4f29-a41b-8328e133426d {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:54:19 devstack sudo[93466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-c4579c2a-1036-4f29-a41b-8328e133426d Nov 04 10:54:19 devstack sudo[93466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:54:19 devstack cinder-volume[87272]: WARNING cinder.quota [None req-309c8034-2b1a-407f-8f7a-5d2ba4d0d29d tempest-GroupSnapshotsV319Test-1618305287 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-2122075658 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-2122075658, it is now deprecated. Please use the default quota class for default quota. Nov 04 10:54:19 devstack cinder-volume[87272]: WARNING cinder.quota [None req-309c8034-2b1a-407f-8f7a-5d2ba4d0d29d tempest-GroupSnapshotsV319Test-1618305287 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-2122075658 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-2122075658, it is now deprecated. Please use the default quota class for default quota. Nov 04 10:54:19 devstack cinder-volume[87272]: DEBUG cinder.quota [None req-309c8034-2b1a-407f-8f7a-5d2ba4d0d29d tempest-GroupSnapshotsV319Test-1618305287 None] Created reservations ['b2d8a133-d46d-4733-afa8-b5800d244e09', 'daf79100-aa08-4674-8e88-d17492c11f87', '8503889b-147d-4a5d-95bb-d8473ef67e50', 'f31816c2-7c20-4cdf-b65c-64e1b7a0bafc'] {{(pid=87272) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 10:54:19 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-309c8034-2b1a-407f-8f7a-5d2ba4d0d29d tempest-GroupSnapshotsV319Test-1618305287 None] group_snapshot 6d8234b0-245e-46c5-a75b-51df09e37182: deleted successfully Nov 04 10:54:19 devstack sudo[93466]: pam_unix(sudo:session): session closed for user root Nov 04 10:54:19 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-d05a1908-e5cf-4a29-b2ab-aa113817fd0f tempest-ServerActionsTestOtherA-1078392334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-c4579c2a-1036-4f29-a41b-8328e133426d" returned: 0 in 0.268s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:54:19 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-d05a1908-e5cf-4a29-b2ab-aa113817fd0f tempest-ServerActionsTestOtherA-1078392334 None] <== create_volume: return (818ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'} {{(pid=87272) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 04 10:54:19 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-d05a1908-e5cf-4a29-b2ab-aa113817fd0f tempest-ServerActionsTestOtherA-1078392334 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.822s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:54:19 devstack cinder-volume[87272]: DEBUG cinder.volume.volume_utils [None req-d05a1908-e5cf-4a29-b2ab-aa113817fd0f tempest-ServerActionsTestOtherA-1078392334 None] Attempting download of e21f1c05-a199-4b20-94c3-a13f8db1348a ((None, [{'url': 'file:///opt/stack/data/glance/images/e21f1c05-a199-4b20-94c3-a13f8db1348a', 'metadata': {}}])) to volume c4579c2a-1036-4f29-a41b-8328e133426d. {{(pid=87272) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Nov 04 10:54:19 devstack cinder-volume[87272]: DEBUG oslo.privsep.daemon [-] privsep: reply[3761e6e4-d716-4f6e-9205-738f7b323b19]: (4, 'raw') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:54:19 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-d05a1908-e5cf-4a29-b2ab-aa113817fd0f tempest-ServerActionsTestOtherA-1078392334 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e21f1c05-a199-4b20-94c3-a13f8db1348a_8xmo_9zf {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:54:19 devstack sudo[93469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e21f1c05-a199-4b20-94c3-a13f8db1348a_8xmo_9zf Nov 04 10:54:19 devstack sudo[93469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:54:19 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-538f231c-0ca0-4d3f-9da0-174f9e804eb5 tempest-GroupSnapshotsV319Test-1618305287 None] Acquiring lock "cinder-quobyte-d2b12b20-9c16-41bc-bc9f-afab2aa39e8a" by "delete_volume" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:54:19 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-538f231c-0ca0-4d3f-9da0-174f9e804eb5 tempest-GroupSnapshotsV319Test-1618305287 None] Lock "cinder-quobyte-d2b12b20-9c16-41bc-bc9f-afab2aa39e8a" acquired by "delete_volume" :: waited 0.027s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:54:20 devstack cinder-volume[87272]: DEBUG oslo.privsep.daemon [-] privsep: reply[8571faaf-6910-4c5b-b05b-c58f9ea31785]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:54:20 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-538f231c-0ca0-4d3f-9da0-174f9e804eb5 tempest-GroupSnapshotsV319Test-1618305287 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-d2b12b20-9c16-41bc-bc9f-afab2aa39e8a {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:54:20 devstack sudo[93469]: pam_unix(sudo:session): session closed for user root Nov 04 10:54:20 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-d05a1908-e5cf-4a29-b2ab-aa113817fd0f tempest-ServerActionsTestOtherA-1078392334 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e21f1c05-a199-4b20-94c3-a13f8db1348a_8xmo_9zf" returned: 0 in 0.513s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:54:20 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-d05a1908-e5cf-4a29-b2ab-aa113817fd0f tempest-ServerActionsTestOtherA-1078392334 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e21f1c05-a199-4b20-94c3-a13f8db1348a_8xmo_9zf {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:54:20 devstack sudo[93473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-d2b12b20-9c16-41bc-bc9f-afab2aa39e8a Nov 04 10:54:20 devstack sudo[93473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:54:20 devstack sudo[93474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e21f1c05-a199-4b20-94c3-a13f8db1348a_8xmo_9zf Nov 04 10:54:20 devstack sudo[93474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:54:20 devstack sudo[93474]: pam_unix(sudo:session): session closed for user root Nov 04 10:54:20 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-d05a1908-e5cf-4a29-b2ab-aa113817fd0f tempest-ServerActionsTestOtherA-1078392334 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e21f1c05-a199-4b20-94c3-a13f8db1348a_8xmo_9zf" returned: 1 in 0.437s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:54:20 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-d05a1908-e5cf-4a29-b2ab-aa113817fd0f tempest-ServerActionsTestOtherA-1078392334 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e21f1c05-a199-4b20-94c3-a13f8db1348a_8xmo_9zf' failed. Not Retrying. {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 04 10:54:20 devstack cinder-volume[87272]: DEBUG oslo.privsep.daemon [-] privsep: reply[337c78f4-08fc-4688-a2d7-330cc7502dc3]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:54:20 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-d05a1908-e5cf-4a29-b2ab-aa113817fd0f tempest-ServerActionsTestOtherA-1078392334 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e21f1c05-a199-4b20-94c3-a13f8db1348a_gfe3_xqzdevstack@QuobyteHD {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:54:20 devstack sudo[93473]: pam_unix(sudo:session): session closed for user root Nov 04 10:54:20 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-538f231c-0ca0-4d3f-9da0-174f9e804eb5 tempest-GroupSnapshotsV319Test-1618305287 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-d2b12b20-9c16-41bc-bc9f-afab2aa39e8a" returned: 0 in 0.543s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:54:20 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-538f231c-0ca0-4d3f-9da0-174f9e804eb5 tempest-GroupSnapshotsV319Test-1618305287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-d2b12b20-9c16-41bc-bc9f-afab2aa39e8a {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:54:20 devstack sudo[93490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-d2b12b20-9c16-41bc-bc9f-afab2aa39e8a Nov 04 10:54:20 devstack sudo[93490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:54:20 devstack sudo[93489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e21f1c05-a199-4b20-94c3-a13f8db1348a_gfe3_xqzdevstack@QuobyteHD Nov 04 10:54:20 devstack sudo[93489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:54:20 devstack sudo[93489]: pam_unix(sudo:session): session closed for user root Nov 04 10:54:20 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-d05a1908-e5cf-4a29-b2ab-aa113817fd0f tempest-ServerActionsTestOtherA-1078392334 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e21f1c05-a199-4b20-94c3-a13f8db1348a_gfe3_xqzdevstack@QuobyteHD" returned: 0 in 0.412s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:54:20 devstack cinder-volume[87272]: DEBUG cinder.image.image_utils [None req-d05a1908-e5cf-4a29-b2ab-aa113817fd0f tempest-ServerActionsTestOtherA-1078392334 None] e21f1c05-a199-4b20-94c3-a13f8db1348a was qcow2, converting to qcow2 {{(pid=87272) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Nov 04 10:54:20 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-d05a1908-e5cf-4a29-b2ab-aa113817fd0f tempest-ServerActionsTestOtherA-1078392334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_e21f1c05-a199-4b20-94c3-a13f8db1348a_gfe3_xqzdevstack@QuobyteHD /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-c4579c2a-1036-4f29-a41b-8328e133426d {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:54:20 devstack sudo[93490]: pam_unix(sudo:session): session closed for user root Nov 04 10:54:20 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-538f231c-0ca0-4d3f-9da0-174f9e804eb5 tempest-GroupSnapshotsV319Test-1618305287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-d2b12b20-9c16-41bc-bc9f-afab2aa39e8a" returned: 0 in 0.369s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:54:20 devstack sudo[93511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_e21f1c05-a199-4b20-94c3-a13f8db1348a_gfe3_xqzdevstack@QuobyteHD /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-c4579c2a-1036-4f29-a41b-8328e133426d Nov 04 10:54:20 devstack sudo[93511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:54:20 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-538f231c-0ca0-4d3f-9da0-174f9e804eb5 tempest-GroupSnapshotsV319Test-1618305287 None] Lock "cinder-quobyte-d2b12b20-9c16-41bc-bc9f-afab2aa39e8a" released by "delete_volume" :: held 1.032s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:54:21 devstack cinder-volume[87272]: DEBUG cinder.quota [None req-538f231c-0ca0-4d3f-9da0-174f9e804eb5 tempest-GroupSnapshotsV319Test-1618305287 None] Created reservations ['e0dce900-37ad-436c-aac8-844676c0cda0'] {{(pid=87272) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 10:54:21 devstack cinder-volume[87272]: WARNING cinder.quota [None req-538f231c-0ca0-4d3f-9da0-174f9e804eb5 tempest-GroupSnapshotsV319Test-1618305287 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-2122075658 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-2122075658, it is now deprecated. Please use the default quota class for default quota. Nov 04 10:54:21 devstack cinder-volume[87272]: DEBUG cinder.quota [None req-538f231c-0ca0-4d3f-9da0-174f9e804eb5 tempest-GroupSnapshotsV319Test-1618305287 None] Created reservations ['c03df9bd-2db5-4797-b79d-1583539578be', '4e7f21b0-091e-4909-a983-991070021474', '50c93ed1-3173-4448-94cc-d2cbd5cc28f6', '10ea7a30-c455-4db2-a42c-c851aefca380'] {{(pid=87272) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 10:54:21 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-538f231c-0ca0-4d3f-9da0-174f9e804eb5 tempest-GroupSnapshotsV319Test-1618305287 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:54:21 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-538f231c-0ca0-4d3f-9da0-174f9e804eb5 tempest-GroupSnapshotsV319Test-1618305287 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:54:21 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-538f231c-0ca0-4d3f-9da0-174f9e804eb5 tempest-GroupSnapshotsV319Test-1618305287 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898': None} {{(pid=87272) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:54:21 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-538f231c-0ca0-4d3f-9da0-174f9e804eb5 tempest-GroupSnapshotsV319Test-1618305287 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'] {{(pid=87272) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:54:21 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-538f231c-0ca0-4d3f-9da0-174f9e804eb5 tempest-GroupSnapshotsV319Test-1618305287 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.059s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:54:21 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-538f231c-0ca0-4d3f-9da0-174f9e804eb5 tempest-GroupSnapshotsV319Test-1618305287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:54:21 devstack sudo[93537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1 Nov 04 10:54:21 devstack sudo[93537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:54:22 devstack sudo[93537]: pam_unix(sudo:session): session closed for user root Nov 04 10:54:22 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-538f231c-0ca0-4d3f-9da0-174f9e804eb5 tempest-GroupSnapshotsV319Test-1618305287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1" returned: 0 in 0.667s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:54:22 devstack cinder-volume[87272]: DEBUG cinder.manager [None req-538f231c-0ca0-4d3f-9da0-174f9e804eb5 tempest-GroupSnapshotsV319Test-1618305287 None] Notifying Schedulers of capabilities ... {{(pid=87272) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 10:54:22 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-538f231c-0ca0-4d3f-9da0-174f9e804eb5 tempest-GroupSnapshotsV319Test-1618305287 None] Delete group completed successfully. Nov 04 10:54:23 devstack sudo[93511]: pam_unix(sudo:session): session closed for user root Nov 04 10:54:23 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-d05a1908-e5cf-4a29-b2ab-aa113817fd0f tempest-ServerActionsTestOtherA-1078392334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_e21f1c05-a199-4b20-94c3-a13f8db1348a_gfe3_xqzdevstack@QuobyteHD /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-c4579c2a-1036-4f29-a41b-8328e133426d" returned: 0 in 2.860s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:54:23 devstack cinder-volume[87272]: DEBUG cinder.image.image_utils [None req-d05a1908-e5cf-4a29-b2ab-aa113817fd0f tempest-ServerActionsTestOtherA-1078392334 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_e21f1c05-a199-4b20-94c3-a13f8db1348a_gfe3_xqzdevstack@QuobyteHD, size 112.00 MB, duration 2.86 sec, destination /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-c4579c2a-1036-4f29-a41b-8328e133426d {{(pid=87272) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Nov 04 10:54:23 devstack cinder-volume[87272]: INFO cinder.image.image_utils [None req-d05a1908-e5cf-4a29-b2ab-aa113817fd0f tempest-ServerActionsTestOtherA-1078392334 None] Converted 112.00 MB image at 39.14 MB/s Nov 04 10:54:23 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-d05a1908-e5cf-4a29-b2ab-aa113817fd0f tempest-ServerActionsTestOtherA-1078392334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-c4579c2a-1036-4f29-a41b-8328e133426d 1G {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:54:23 devstack sudo[93547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-c4579c2a-1036-4f29-a41b-8328e133426d 1G Nov 04 10:54:23 devstack sudo[93547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:54:24 devstack sudo[93547]: pam_unix(sudo:session): session closed for user root Nov 04 10:54:24 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-d05a1908-e5cf-4a29-b2ab-aa113817fd0f tempest-ServerActionsTestOtherA-1078392334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-c4579c2a-1036-4f29-a41b-8328e133426d 1G" returned: 0 in 0.497s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:54:24 devstack cinder-volume[87272]: DEBUG cinder.volume.volume_utils [None req-d05a1908-e5cf-4a29-b2ab-aa113817fd0f tempest-ServerActionsTestOtherA-1078392334 None] Downloaded image e21f1c05-a199-4b20-94c3-a13f8db1348a ((None, [{'url': 'file:///opt/stack/data/glance/images/e21f1c05-a199-4b20-94c3-a13f8db1348a', 'metadata': {}}])) to volume c4579c2a-1036-4f29-a41b-8328e133426d successfully. {{(pid=87272) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Nov 04 10:54:24 devstack cinder-volume[87272]: DEBUG cinder.image.image_utils [None req-d05a1908-e5cf-4a29-b2ab-aa113817fd0f tempest-ServerActionsTestOtherA-1078392334 None] Temporary image e21f1c05-a199-4b20-94c3-a13f8db1348a for user ae2d733d411a403fb44b0a87d1459f7e is deleted. {{(pid=87272) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Nov 04 10:54:24 devstack cinder-volume[87272]: DEBUG cinder.volume.volume_utils [None req-d05a1908-e5cf-4a29-b2ab-aa113817fd0f tempest-ServerActionsTestOtherA-1078392334 None] Marking volume c4579c2a-1036-4f29-a41b-8328e133426d as bootable. {{(pid=87272) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Nov 04 10:54:24 devstack cinder-volume[87272]: DEBUG cinder.volume.flows.manager.create_volume [None req-d05a1908-e5cf-4a29-b2ab-aa113817fd0f tempest-ServerActionsTestOtherA-1078392334 None] Copying metadata from image e21f1c05-a199-4b20-94c3-a13f8db1348a to c4579c2a-1036-4f29-a41b-8328e133426d. {{(pid=87272) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 04 10:54:24 devstack cinder-volume[87272]: DEBUG cinder.volume.flows.manager.create_volume [None req-d05a1908-e5cf-4a29-b2ab-aa113817fd0f tempest-ServerActionsTestOtherA-1078392334 None] Creating volume glance metadata for volume c4579c2a-1036-4f29-a41b-8328e133426d backed by image e21f1c05-a199-4b20-94c3-a13f8db1348a with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'e21f1c05-a199-4b20-94c3-a13f8db1348a', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87272) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 04 10:54:24 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-d05a1908-e5cf-4a29-b2ab-aa113817fd0f tempest-ServerActionsTestOtherA-1078392334 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec91a272-f3dc-4b12-a7bb-8776177eb779) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c4579c2a-1036-4f29-a41b-8328e133426d', 'volume_size': 1, 'image_id': 'e21f1c05-a199-4b20-94c3-a13f8db1348a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e21f1c05-a199-4b20-94c3-a13f8db1348a', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'a0568d152f1945e380a1ac4afff5179c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'e21f1c05-a199-4b20-94c3-a13f8db1348a', 'created_at': datetime.datetime(2026, 11, 4, 9, 43, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 4, 9, 44, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e21f1c05-a199-4b20-94c3-a13f8db1348a/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:54:24 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-d05a1908-e5cf-4a29-b2ab-aa113817fd0f tempest-ServerActionsTestOtherA-1078392334 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (631d3230-a292-41d9-9cbd-b5b7bb267a8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:54:24 devstack cinder-volume[87272]: INFO cinder.volume.flows.manager.create_volume [None req-d05a1908-e5cf-4a29-b2ab-aa113817fd0f tempest-ServerActionsTestOtherA-1078392334 None] Volume volume-c4579c2a-1036-4f29-a41b-8328e133426d (c4579c2a-1036-4f29-a41b-8328e133426d): created successfully Nov 04 10:54:24 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-d05a1908-e5cf-4a29-b2ab-aa113817fd0f tempest-ServerActionsTestOtherA-1078392334 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (631d3230-a292-41d9-9cbd-b5b7bb267a8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:54:24 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-d05a1908-e5cf-4a29-b2ab-aa113817fd0f tempest-ServerActionsTestOtherA-1078392334 None] Flow 'volume_create_manager' (59654e6a-86b8-4bb2-bc1e-08f21e4abd1d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87272) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:54:24 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-d05a1908-e5cf-4a29-b2ab-aa113817fd0f tempest-ServerActionsTestOtherA-1078392334 None] Created volume successfully. Nov 04 10:54:24 devstack cinder-volume[87272]: DEBUG cinder.volume.flows.manager.create_volume [None req-2fad632f-12ca-4c4c-9ca0-5ddfad4da65c tempest-AttachVolumeNegativeTest-154668454 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87272) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 10:54:24 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-2fad632f-12ca-4c4c-9ca0-5ddfad4da65c tempest-AttachVolumeNegativeTest-154668454 None] Flow 'volume_create_manager' (fd23abf3-eb0a-42f3-ab50-2ed9aaef7458) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:54:24 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-2fad632f-12ca-4c4c-9ca0-5ddfad4da65c tempest-AttachVolumeNegativeTest-154668454 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac9f0609-11a2-413c-8430-de68fb8c3b9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:54:24 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-2fad632f-12ca-4c4c-9ca0-5ddfad4da65c tempest-AttachVolumeNegativeTest-154668454 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac9f0609-11a2-413c-8430-de68fb8c3b9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T09:54:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1148201739',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=22085580-85cf-4ebc-bab6-597fac3a1d82,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b4c692d677a4424ca4fe4fe85525eaa8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T09:54:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T09:54:25Z,use_quota=True,user_id='d0e11232f87d4caf9032a8c076e36fc8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8989e4f-21e3-4f0a-9584-0d818784e883),volume_type_id=f8989e4f-21e3-4f0a-9584-0d818784e883)' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:54:24 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-2fad632f-12ca-4c4c-9ca0-5ddfad4da65c tempest-AttachVolumeNegativeTest-154668454 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fad0070b-89b2-478a-9c5b-98cf1888d626) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:54:24 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-2fad632f-12ca-4c4c-9ca0-5ddfad4da65c tempest-AttachVolumeNegativeTest-154668454 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fad0070b-89b2-478a-9c5b-98cf1888d626) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:54:24 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-2fad632f-12ca-4c4c-9ca0-5ddfad4da65c tempest-AttachVolumeNegativeTest-154668454 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80d5eaa3-c64d-49e5-b388-8b2c3ebf1b1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:54:24 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-2fad632f-12ca-4c4c-9ca0-5ddfad4da65c tempest-AttachVolumeNegativeTest-154668454 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80d5eaa3-c64d-49e5-b388-8b2c3ebf1b1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '22085580-85cf-4ebc-bab6-597fac3a1d82', 'volume_name': 'volume-22085580-85cf-4ebc-bab6-597fac3a1d82', 'volume_size': 1}' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:54:24 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-2fad632f-12ca-4c4c-9ca0-5ddfad4da65c tempest-AttachVolumeNegativeTest-154668454 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (150ec756-b5e5-4cec-9618-61f1b1ead824) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:54:24 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-2fad632f-12ca-4c4c-9ca0-5ddfad4da65c tempest-AttachVolumeNegativeTest-154668454 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (150ec756-b5e5-4cec-9618-61f1b1ead824) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:54:24 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-2fad632f-12ca-4c4c-9ca0-5ddfad4da65c tempest-AttachVolumeNegativeTest-154668454 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89fc4356-a0c0-46e9-89ee-f8bd5b489d80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:54:24 devstack cinder-volume[87272]: INFO cinder.volume.flows.manager.create_volume [None req-2fad632f-12ca-4c4c-9ca0-5ddfad4da65c tempest-AttachVolumeNegativeTest-154668454 None] Volume 22085580-85cf-4ebc-bab6-597fac3a1d82: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-22085580-85cf-4ebc-bab6-597fac3a1d82', 'volume_size': 1} Nov 04 10:54:24 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-2fad632f-12ca-4c4c-9ca0-5ddfad4da65c tempest-AttachVolumeNegativeTest-154668454 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:54:24 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-2fad632f-12ca-4c4c-9ca0-5ddfad4da65c tempest-AttachVolumeNegativeTest-154668454 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:54:24 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-2fad632f-12ca-4c4c-9ca0-5ddfad4da65c tempest-AttachVolumeNegativeTest-154668454 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T09:54:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1148201739',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=22085580-85cf-4ebc-bab6-597fac3a1d82,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b4c692d677a4424ca4fe4fe85525eaa8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T09:54:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T09:54:25Z,use_quota=True,user_id='d0e11232f87d4caf9032a8c076e36fc8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8989e4f-21e3-4f0a-9584-0d818784e883),volume_type_id=f8989e4f-21e3-4f0a-9584-0d818784e883)}" {{(pid=87272) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 04 10:54:24 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.remotefs [None req-2fad632f-12ca-4c4c-9ca0-5ddfad4da65c tempest-AttachVolumeNegativeTest-154668454 None] Creating volume 22085580-85cf-4ebc-bab6-597fac3a1d82 {{(pid=87272) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 10:54:24 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-2fad632f-12ca-4c4c-9ca0-5ddfad4da65c tempest-AttachVolumeNegativeTest-154668454 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:54:24 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-2fad632f-12ca-4c4c-9ca0-5ddfad4da65c tempest-AttachVolumeNegativeTest-154668454 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:54:24 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-2fad632f-12ca-4c4c-9ca0-5ddfad4da65c tempest-AttachVolumeNegativeTest-154668454 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898': None} {{(pid=87272) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:54:24 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-2fad632f-12ca-4c4c-9ca0-5ddfad4da65c tempest-AttachVolumeNegativeTest-154668454 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'] {{(pid=87272) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:54:24 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-2fad632f-12ca-4c4c-9ca0-5ddfad4da65c tempest-AttachVolumeNegativeTest-154668454 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:54:24 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-2fad632f-12ca-4c4c-9ca0-5ddfad4da65c tempest-AttachVolumeNegativeTest-154668454 None] Selected osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898 as target Quobyte volume. {{(pid=87272) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 10:54:24 devstack cinder-volume[87272]: INFO cinder.volume.drivers.remotefs [None req-2fad632f-12ca-4c4c-9ca0-5ddfad4da65c tempest-AttachVolumeNegativeTest-154668454 None] casted to osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898 Nov 04 10:54:24 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-2fad632f-12ca-4c4c-9ca0-5ddfad4da65c tempest-AttachVolumeNegativeTest-154668454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-22085580-85cf-4ebc-bab6-597fac3a1d82 1073741824 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:54:24 devstack sudo[93553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-22085580-85cf-4ebc-bab6-597fac3a1d82 1073741824 Nov 04 10:54:24 devstack sudo[93553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:54:25 devstack sudo[93553]: pam_unix(sudo:session): session closed for user root Nov 04 10:54:25 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-2fad632f-12ca-4c4c-9ca0-5ddfad4da65c tempest-AttachVolumeNegativeTest-154668454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-22085580-85cf-4ebc-bab6-597fac3a1d82 1073741824" returned: 0 in 0.769s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:54:25 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-2fad632f-12ca-4c4c-9ca0-5ddfad4da65c tempest-AttachVolumeNegativeTest-154668454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-22085580-85cf-4ebc-bab6-597fac3a1d82 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:54:25 devstack sudo[93562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-22085580-85cf-4ebc-bab6-597fac3a1d82 Nov 04 10:54:25 devstack sudo[93562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:54:26 devstack sudo[93562]: pam_unix(sudo:session): session closed for user root Nov 04 10:54:26 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-2fad632f-12ca-4c4c-9ca0-5ddfad4da65c tempest-AttachVolumeNegativeTest-154668454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-22085580-85cf-4ebc-bab6-597fac3a1d82" returned: 0 in 0.348s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:54:26 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-2fad632f-12ca-4c4c-9ca0-5ddfad4da65c tempest-AttachVolumeNegativeTest-154668454 None] <== create_volume: return (1207ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'} {{(pid=87272) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 04 10:54:26 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-2fad632f-12ca-4c4c-9ca0-5ddfad4da65c tempest-AttachVolumeNegativeTest-154668454 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.210s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:54:26 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-2fad632f-12ca-4c4c-9ca0-5ddfad4da65c tempest-AttachVolumeNegativeTest-154668454 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89fc4356-a0c0-46e9-89ee-f8bd5b489d80) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-22085580-85cf-4ebc-bab6-597fac3a1d82', 'volume_size': 1}' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:54:26 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-2fad632f-12ca-4c4c-9ca0-5ddfad4da65c tempest-AttachVolumeNegativeTest-154668454 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a7fafe52-3276-410e-9b2e-5a7c22f850fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:54:26 devstack cinder-volume[87272]: INFO cinder.volume.flows.manager.create_volume [None req-2fad632f-12ca-4c4c-9ca0-5ddfad4da65c tempest-AttachVolumeNegativeTest-154668454 None] Volume volume-22085580-85cf-4ebc-bab6-597fac3a1d82 (22085580-85cf-4ebc-bab6-597fac3a1d82): created successfully Nov 04 10:54:26 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-2fad632f-12ca-4c4c-9ca0-5ddfad4da65c tempest-AttachVolumeNegativeTest-154668454 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a7fafe52-3276-410e-9b2e-5a7c22f850fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:54:26 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-2fad632f-12ca-4c4c-9ca0-5ddfad4da65c tempest-AttachVolumeNegativeTest-154668454 None] Flow 'volume_create_manager' (fd23abf3-eb0a-42f3-ab50-2ed9aaef7458) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87272) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:54:26 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-2fad632f-12ca-4c4c-9ca0-5ddfad4da65c tempest-AttachVolumeNegativeTest-154668454 None] Created volume successfully. Nov 04 10:54:27 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [req-8f2d408b-9b93-4bd3-a51c-1b3d6a5b4a8e req-2c0c2413-07e6-4902-9401-203ad5a3115e tempest-AttachVolumeNegativeTest-154668454 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:54:27 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [req-8f2d408b-9b93-4bd3-a51c-1b3d6a5b4a8e req-2c0c2413-07e6-4902-9401-203ad5a3115e tempest-AttachVolumeNegativeTest-154668454 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:54:27 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [req-8f2d408b-9b93-4bd3-a51c-1b3d6a5b4a8e req-2c0c2413-07e6-4902-9401-203ad5a3115e tempest-AttachVolumeNegativeTest-154668454 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.023s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:54:27 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [req-8f2d408b-9b93-4bd3-a51c-1b3d6a5b4a8e req-2c0c2413-07e6-4902-9401-203ad5a3115e tempest-AttachVolumeNegativeTest-154668454 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898', 'name': 'volume-22085580-85cf-4ebc-bab6-597fac3a1d82', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '775f515a-7825-40aa-a6bc-b41db5ed1252', 'enforce_multipath': True} {{(pid=87272) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 04 10:54:28 devstack cinder-volume[87272]: INFO cinder.volume.manager [req-8f2d408b-9b93-4bd3-a51c-1b3d6a5b4a8e req-2c0c2413-07e6-4902-9401-203ad5a3115e tempest-AttachVolumeNegativeTest-154668454 None] attachment_update completed successfully. Nov 04 10:54:30 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [req-de0ca0c3-3676-47c8-acab-ee1981ac8413 req-22aaf222-92c7-4e8b-8569-9ceecbf5ceb9 tempest-ServerActionsTestOtherA-1078392334 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:54:30 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [req-de0ca0c3-3676-47c8-acab-ee1981ac8413 req-22aaf222-92c7-4e8b-8569-9ceecbf5ceb9 tempest-ServerActionsTestOtherA-1078392334 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:54:30 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [req-de0ca0c3-3676-47c8-acab-ee1981ac8413 req-22aaf222-92c7-4e8b-8569-9ceecbf5ceb9 tempest-ServerActionsTestOtherA-1078392334 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.021s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:54:30 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [req-de0ca0c3-3676-47c8-acab-ee1981ac8413 req-22aaf222-92c7-4e8b-8569-9ceecbf5ceb9 tempest-ServerActionsTestOtherA-1078392334 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898', 'name': 'volume-c4579c2a-1036-4f29-a41b-8328e133426d', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e2b5b265-b22b-48aa-80aa-ee9db5f35472', 'enforce_multipath': True} {{(pid=87272) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 04 10:54:30 devstack cinder-volume[87272]: INFO cinder.volume.manager [req-de0ca0c3-3676-47c8-acab-ee1981ac8413 req-22aaf222-92c7-4e8b-8569-9ceecbf5ceb9 tempest-ServerActionsTestOtherA-1078392334 None] attachment_update completed successfully. Nov 04 10:54:31 devstack cinder-volume[87272]: DEBUG cinder.volume.flows.manager.create_volume [None req-9dcd70ba-c491-482d-b58e-d476b3e81c49 tempest-VolumesActionsTest-1160217311 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87272) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 10:54:31 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-9dcd70ba-c491-482d-b58e-d476b3e81c49 tempest-VolumesActionsTest-1160217311 None] Flow 'volume_create_manager' (a18acdd3-c059-424f-9c0f-c2bfb4031444) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:54:31 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-9dcd70ba-c491-482d-b58e-d476b3e81c49 tempest-VolumesActionsTest-1160217311 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9f3d990-5052-4cae-b57b-90b7cecf4728) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:54:31 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-9dcd70ba-c491-482d-b58e-d476b3e81c49 tempest-VolumesActionsTest-1160217311 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9f3d990-5052-4cae-b57b-90b7cecf4728) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T09:54:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1857010301',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc7ccdf9-146f-41fb-95a9-5c2468931770,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c0ef3372e65048f7a94648e024b3870a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T09:54:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T09:54:32Z,use_quota=True,user_id='25c3264337514f4ab8b3232ce986d59d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8989e4f-21e3-4f0a-9584-0d818784e883),volume_type_id=f8989e4f-21e3-4f0a-9584-0d818784e883)' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:54:31 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-9dcd70ba-c491-482d-b58e-d476b3e81c49 tempest-VolumesActionsTest-1160217311 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0717bc2-b6c2-4037-a506-16745cfb4d6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:54:31 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-9dcd70ba-c491-482d-b58e-d476b3e81c49 tempest-VolumesActionsTest-1160217311 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0717bc2-b6c2-4037-a506-16745cfb4d6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:54:31 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-9dcd70ba-c491-482d-b58e-d476b3e81c49 tempest-VolumesActionsTest-1160217311 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e3d5805c-ba77-402c-935c-72c5416131d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:54:31 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-9dcd70ba-c491-482d-b58e-d476b3e81c49 tempest-VolumesActionsTest-1160217311 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e3d5805c-ba77-402c-935c-72c5416131d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dc7ccdf9-146f-41fb-95a9-5c2468931770', 'volume_name': 'volume-dc7ccdf9-146f-41fb-95a9-5c2468931770', 'volume_size': 1}' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:54:31 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-9dcd70ba-c491-482d-b58e-d476b3e81c49 tempest-VolumesActionsTest-1160217311 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4fe9c29-1cd9-47dd-adf4-c8298936aab5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:54:31 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-9dcd70ba-c491-482d-b58e-d476b3e81c49 tempest-VolumesActionsTest-1160217311 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4fe9c29-1cd9-47dd-adf4-c8298936aab5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:54:31 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-9dcd70ba-c491-482d-b58e-d476b3e81c49 tempest-VolumesActionsTest-1160217311 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bac876a4-a042-484b-8b58-e2fbf556238f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:54:31 devstack cinder-volume[87272]: INFO cinder.volume.flows.manager.create_volume [None req-9dcd70ba-c491-482d-b58e-d476b3e81c49 tempest-VolumesActionsTest-1160217311 None] Volume dc7ccdf9-146f-41fb-95a9-5c2468931770: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dc7ccdf9-146f-41fb-95a9-5c2468931770', 'volume_size': 1} Nov 04 10:54:31 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-9dcd70ba-c491-482d-b58e-d476b3e81c49 tempest-VolumesActionsTest-1160217311 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:54:31 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-9dcd70ba-c491-482d-b58e-d476b3e81c49 tempest-VolumesActionsTest-1160217311 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:54:31 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-9dcd70ba-c491-482d-b58e-d476b3e81c49 tempest-VolumesActionsTest-1160217311 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T09:54:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1857010301',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc7ccdf9-146f-41fb-95a9-5c2468931770,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c0ef3372e65048f7a94648e024b3870a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T09:54:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T09:54:32Z,use_quota=True,user_id='25c3264337514f4ab8b3232ce986d59d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8989e4f-21e3-4f0a-9584-0d818784e883),volume_type_id=f8989e4f-21e3-4f0a-9584-0d818784e883)}" {{(pid=87272) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 04 10:54:31 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.remotefs [None req-9dcd70ba-c491-482d-b58e-d476b3e81c49 tempest-VolumesActionsTest-1160217311 None] Creating volume dc7ccdf9-146f-41fb-95a9-5c2468931770 {{(pid=87272) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 10:54:31 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-9dcd70ba-c491-482d-b58e-d476b3e81c49 tempest-VolumesActionsTest-1160217311 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:54:31 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-9dcd70ba-c491-482d-b58e-d476b3e81c49 tempest-VolumesActionsTest-1160217311 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:54:31 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-9dcd70ba-c491-482d-b58e-d476b3e81c49 tempest-VolumesActionsTest-1160217311 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898': None} {{(pid=87272) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:54:31 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-9dcd70ba-c491-482d-b58e-d476b3e81c49 tempest-VolumesActionsTest-1160217311 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'] {{(pid=87272) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:54:31 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-9dcd70ba-c491-482d-b58e-d476b3e81c49 tempest-VolumesActionsTest-1160217311 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:54:31 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-9dcd70ba-c491-482d-b58e-d476b3e81c49 tempest-VolumesActionsTest-1160217311 None] Selected osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898 as target Quobyte volume. {{(pid=87272) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 10:54:31 devstack cinder-volume[87272]: INFO cinder.volume.drivers.remotefs [None req-9dcd70ba-c491-482d-b58e-d476b3e81c49 tempest-VolumesActionsTest-1160217311 None] casted to osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898 Nov 04 10:54:31 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-9dcd70ba-c491-482d-b58e-d476b3e81c49 tempest-VolumesActionsTest-1160217311 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-dc7ccdf9-146f-41fb-95a9-5c2468931770 1073741824 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:54:31 devstack sudo[94006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-dc7ccdf9-146f-41fb-95a9-5c2468931770 1073741824 Nov 04 10:54:31 devstack sudo[94006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:54:32 devstack sudo[94006]: pam_unix(sudo:session): session closed for user root Nov 04 10:54:32 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-9dcd70ba-c491-482d-b58e-d476b3e81c49 tempest-VolumesActionsTest-1160217311 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-dc7ccdf9-146f-41fb-95a9-5c2468931770 1073741824" returned: 0 in 0.614s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:54:32 devstack cinder-volume[87272]: DEBUG dbcounter [-] [87272] Writing DB stats cinder:SELECT=92,cinder:UPDATE=74,cinder:INSERT=20,cinder:DELETE=2 {{(pid=87272) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 10:54:32 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-9dcd70ba-c491-482d-b58e-d476b3e81c49 tempest-VolumesActionsTest-1160217311 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-dc7ccdf9-146f-41fb-95a9-5c2468931770 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:54:32 devstack sudo[94013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-dc7ccdf9-146f-41fb-95a9-5c2468931770 Nov 04 10:54:32 devstack sudo[94013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:54:32 devstack sudo[94013]: pam_unix(sudo:session): session closed for user root Nov 04 10:54:32 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-9dcd70ba-c491-482d-b58e-d476b3e81c49 tempest-VolumesActionsTest-1160217311 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-dc7ccdf9-146f-41fb-95a9-5c2468931770" returned: 0 in 0.348s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:54:32 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-9dcd70ba-c491-482d-b58e-d476b3e81c49 tempest-VolumesActionsTest-1160217311 None] <== create_volume: return (1022ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'} {{(pid=87272) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 04 10:54:32 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-9dcd70ba-c491-482d-b58e-d476b3e81c49 tempest-VolumesActionsTest-1160217311 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.025s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:54:32 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-9dcd70ba-c491-482d-b58e-d476b3e81c49 tempest-VolumesActionsTest-1160217311 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bac876a4-a042-484b-8b58-e2fbf556238f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dc7ccdf9-146f-41fb-95a9-5c2468931770', 'volume_size': 1}' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:54:32 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-9dcd70ba-c491-482d-b58e-d476b3e81c49 tempest-VolumesActionsTest-1160217311 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9117a53d-b8f7-4415-bdfe-0bb52c8de04c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:54:32 devstack cinder-volume[87272]: DEBUG dbcounter [-] [87272] Writing DB stats cinder:SELECT=93,cinder:UPDATE=85,cinder:INSERT=26,cinder:DELETE=8 {{(pid=87272) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 10:54:32 devstack cinder-volume[87272]: INFO cinder.volume.flows.manager.create_volume [None req-9dcd70ba-c491-482d-b58e-d476b3e81c49 tempest-VolumesActionsTest-1160217311 None] Volume volume-dc7ccdf9-146f-41fb-95a9-5c2468931770 (dc7ccdf9-146f-41fb-95a9-5c2468931770): created successfully Nov 04 10:54:32 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-9dcd70ba-c491-482d-b58e-d476b3e81c49 tempest-VolumesActionsTest-1160217311 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9117a53d-b8f7-4415-bdfe-0bb52c8de04c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:54:32 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-9dcd70ba-c491-482d-b58e-d476b3e81c49 tempest-VolumesActionsTest-1160217311 None] Flow 'volume_create_manager' (a18acdd3-c059-424f-9c0f-c2bfb4031444) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87272) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:54:32 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-9dcd70ba-c491-482d-b58e-d476b3e81c49 tempest-VolumesActionsTest-1160217311 None] Created volume successfully. Nov 04 10:54:42 devstack cinder-volume[87272]: DEBUG dbcounter [-] [87272] Writing DB stats cinder:UPDATE=2,cinder:DELETE=1 {{(pid=87272) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 10:54:44 devstack cinder-volume[87272]: DEBUG cinder.volume.flows.manager.create_volume [None req-cc144b47-b1bd-4b3b-9fa6-0a7707fc9706 tempest-VolumesServicesTestJSON-1758143405 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87272) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 10:54:44 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-cc144b47-b1bd-4b3b-9fa6-0a7707fc9706 tempest-VolumesServicesTestJSON-1758143405 None] Flow 'volume_create_manager' (56ea0833-f406-4cc0-8e90-cc3cfe9d91b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:54:44 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-cc144b47-b1bd-4b3b-9fa6-0a7707fc9706 tempest-VolumesServicesTestJSON-1758143405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8cfa550f-2ce9-48e8-babb-222e1cbef8a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:54:44 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-cc144b47-b1bd-4b3b-9fa6-0a7707fc9706 tempest-VolumesServicesTestJSON-1758143405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8cfa550f-2ce9-48e8-babb-222e1cbef8a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T09:54:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-139125594',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a9b69971-435a-406e-9cdf-1bb9b156f74e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='26b4dc9dd7f24deb8ee430ee47e0834e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T09:54:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T09:54:44Z,use_quota=True,user_id='42746e66c85d481cbb2cd0171f66d441',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8989e4f-21e3-4f0a-9584-0d818784e883),volume_type_id=f8989e4f-21e3-4f0a-9584-0d818784e883)' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:54:44 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-cc144b47-b1bd-4b3b-9fa6-0a7707fc9706 tempest-VolumesServicesTestJSON-1758143405 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5eee2d76-783e-4810-b75e-8370a5711a49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:54:44 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-cc144b47-b1bd-4b3b-9fa6-0a7707fc9706 tempest-VolumesServicesTestJSON-1758143405 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5eee2d76-783e-4810-b75e-8370a5711a49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:54:44 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-cc144b47-b1bd-4b3b-9fa6-0a7707fc9706 tempest-VolumesServicesTestJSON-1758143405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb9a02d0-170f-488d-bda9-0c592e9f4de0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:54:44 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-cc144b47-b1bd-4b3b-9fa6-0a7707fc9706 tempest-VolumesServicesTestJSON-1758143405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb9a02d0-170f-488d-bda9-0c592e9f4de0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a9b69971-435a-406e-9cdf-1bb9b156f74e', 'volume_name': 'volume-a9b69971-435a-406e-9cdf-1bb9b156f74e', 'volume_size': 1}' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:54:44 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-cc144b47-b1bd-4b3b-9fa6-0a7707fc9706 tempest-VolumesServicesTestJSON-1758143405 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (65af07c2-d712-4734-ae15-5053f0433608) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:54:44 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-cc144b47-b1bd-4b3b-9fa6-0a7707fc9706 tempest-VolumesServicesTestJSON-1758143405 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (65af07c2-d712-4734-ae15-5053f0433608) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:54:44 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-cc144b47-b1bd-4b3b-9fa6-0a7707fc9706 tempest-VolumesServicesTestJSON-1758143405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c0359879-5ff2-4452-9e53-f8710393b669) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:54:44 devstack cinder-volume[87272]: INFO cinder.volume.flows.manager.create_volume [None req-cc144b47-b1bd-4b3b-9fa6-0a7707fc9706 tempest-VolumesServicesTestJSON-1758143405 None] Volume a9b69971-435a-406e-9cdf-1bb9b156f74e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a9b69971-435a-406e-9cdf-1bb9b156f74e', 'volume_size': 1} Nov 04 10:54:44 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-cc144b47-b1bd-4b3b-9fa6-0a7707fc9706 tempest-VolumesServicesTestJSON-1758143405 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:54:44 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-cc144b47-b1bd-4b3b-9fa6-0a7707fc9706 tempest-VolumesServicesTestJSON-1758143405 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:54:44 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-cc144b47-b1bd-4b3b-9fa6-0a7707fc9706 tempest-VolumesServicesTestJSON-1758143405 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T09:54:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-139125594',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a9b69971-435a-406e-9cdf-1bb9b156f74e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='26b4dc9dd7f24deb8ee430ee47e0834e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T09:54:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T09:54:44Z,use_quota=True,user_id='42746e66c85d481cbb2cd0171f66d441',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8989e4f-21e3-4f0a-9584-0d818784e883),volume_type_id=f8989e4f-21e3-4f0a-9584-0d818784e883)}" {{(pid=87272) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 04 10:54:44 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.remotefs [None req-cc144b47-b1bd-4b3b-9fa6-0a7707fc9706 tempest-VolumesServicesTestJSON-1758143405 None] Creating volume a9b69971-435a-406e-9cdf-1bb9b156f74e {{(pid=87272) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 10:54:44 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-cc144b47-b1bd-4b3b-9fa6-0a7707fc9706 tempest-VolumesServicesTestJSON-1758143405 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:54:44 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-cc144b47-b1bd-4b3b-9fa6-0a7707fc9706 tempest-VolumesServicesTestJSON-1758143405 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:54:44 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-cc144b47-b1bd-4b3b-9fa6-0a7707fc9706 tempest-VolumesServicesTestJSON-1758143405 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898': None} {{(pid=87272) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:54:44 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-cc144b47-b1bd-4b3b-9fa6-0a7707fc9706 tempest-VolumesServicesTestJSON-1758143405 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'] {{(pid=87272) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:54:44 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-cc144b47-b1bd-4b3b-9fa6-0a7707fc9706 tempest-VolumesServicesTestJSON-1758143405 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.046s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:54:44 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-cc144b47-b1bd-4b3b-9fa6-0a7707fc9706 tempest-VolumesServicesTestJSON-1758143405 None] Selected osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898 as target Quobyte volume. {{(pid=87272) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 10:54:44 devstack cinder-volume[87272]: INFO cinder.volume.drivers.remotefs [None req-cc144b47-b1bd-4b3b-9fa6-0a7707fc9706 tempest-VolumesServicesTestJSON-1758143405 None] casted to osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898 Nov 04 10:54:44 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-cc144b47-b1bd-4b3b-9fa6-0a7707fc9706 tempest-VolumesServicesTestJSON-1758143405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-a9b69971-435a-406e-9cdf-1bb9b156f74e 1073741824 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:54:44 devstack sudo[94147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-a9b69971-435a-406e-9cdf-1bb9b156f74e 1073741824 Nov 04 10:54:44 devstack sudo[94147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:54:45 devstack sudo[94147]: pam_unix(sudo:session): session closed for user root Nov 04 10:54:45 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-cc144b47-b1bd-4b3b-9fa6-0a7707fc9706 tempest-VolumesServicesTestJSON-1758143405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-a9b69971-435a-406e-9cdf-1bb9b156f74e 1073741824" returned: 0 in 1.183s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:54:45 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-cc144b47-b1bd-4b3b-9fa6-0a7707fc9706 tempest-VolumesServicesTestJSON-1758143405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-a9b69971-435a-406e-9cdf-1bb9b156f74e {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:54:45 devstack sudo[94171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-a9b69971-435a-406e-9cdf-1bb9b156f74e Nov 04 10:54:45 devstack sudo[94171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:54:46 devstack sudo[94171]: pam_unix(sudo:session): session closed for user root Nov 04 10:54:46 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-cc144b47-b1bd-4b3b-9fa6-0a7707fc9706 tempest-VolumesServicesTestJSON-1758143405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-a9b69971-435a-406e-9cdf-1bb9b156f74e" returned: 0 in 0.692s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:54:46 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-cc144b47-b1bd-4b3b-9fa6-0a7707fc9706 tempest-VolumesServicesTestJSON-1758143405 None] <== create_volume: return (2065ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'} {{(pid=87272) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 04 10:54:46 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-cc144b47-b1bd-4b3b-9fa6-0a7707fc9706 tempest-VolumesServicesTestJSON-1758143405 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.068s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:54:46 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-cc144b47-b1bd-4b3b-9fa6-0a7707fc9706 tempest-VolumesServicesTestJSON-1758143405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c0359879-5ff2-4452-9e53-f8710393b669) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a9b69971-435a-406e-9cdf-1bb9b156f74e', 'volume_size': 1}' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:54:46 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-cc144b47-b1bd-4b3b-9fa6-0a7707fc9706 tempest-VolumesServicesTestJSON-1758143405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df42e528-3532-4bd2-988a-2950fd9e422b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:54:46 devstack cinder-volume[87272]: INFO cinder.volume.flows.manager.create_volume [None req-cc144b47-b1bd-4b3b-9fa6-0a7707fc9706 tempest-VolumesServicesTestJSON-1758143405 None] Volume volume-a9b69971-435a-406e-9cdf-1bb9b156f74e (a9b69971-435a-406e-9cdf-1bb9b156f74e): created successfully Nov 04 10:54:46 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-cc144b47-b1bd-4b3b-9fa6-0a7707fc9706 tempest-VolumesServicesTestJSON-1758143405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df42e528-3532-4bd2-988a-2950fd9e422b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:54:46 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-cc144b47-b1bd-4b3b-9fa6-0a7707fc9706 tempest-VolumesServicesTestJSON-1758143405 None] Flow 'volume_create_manager' (56ea0833-f406-4cc0-8e90-cc3cfe9d91b7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87272) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:54:46 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-cc144b47-b1bd-4b3b-9fa6-0a7707fc9706 tempest-VolumesServicesTestJSON-1758143405 None] Created volume successfully. Nov 04 10:54:47 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-7d5fe6ea-9337-4be1-881f-7da73b96709b tempest-VolumesServicesTestJSON-1758143405 None] Acquiring lock "cinder-a9b69971-435a-406e-9cdf-1bb9b156f74e-delete_volume" by "delete_volume" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:54:48 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-7d5fe6ea-9337-4be1-881f-7da73b96709b tempest-VolumesServicesTestJSON-1758143405 None] Lock "cinder-a9b69971-435a-406e-9cdf-1bb9b156f74e-delete_volume" acquired by "delete_volume" :: waited 0.071s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:54:48 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-7d5fe6ea-9337-4be1-881f-7da73b96709b tempest-VolumesServicesTestJSON-1758143405 None] Acquiring lock "cinder-quobyte-a9b69971-435a-406e-9cdf-1bb9b156f74e" by "delete_volume" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:54:48 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-7d5fe6ea-9337-4be1-881f-7da73b96709b tempest-VolumesServicesTestJSON-1758143405 None] Lock "cinder-quobyte-a9b69971-435a-406e-9cdf-1bb9b156f74e" acquired by "delete_volume" :: waited 0.041s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:54:48 devstack cinder-volume[87272]: DEBUG oslo.privsep.daemon [-] privsep: reply[ceac50aa-9f2a-43d0-9da4-f156f720b776]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:54:48 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-7d5fe6ea-9337-4be1-881f-7da73b96709b tempest-VolumesServicesTestJSON-1758143405 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-a9b69971-435a-406e-9cdf-1bb9b156f74e {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:54:48 devstack sudo[94180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-a9b69971-435a-406e-9cdf-1bb9b156f74e Nov 04 10:54:48 devstack sudo[94180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:54:48 devstack sudo[94180]: pam_unix(sudo:session): session closed for user root Nov 04 10:54:48 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-7d5fe6ea-9337-4be1-881f-7da73b96709b tempest-VolumesServicesTestJSON-1758143405 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-a9b69971-435a-406e-9cdf-1bb9b156f74e" returned: 0 in 0.696s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:54:48 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-7d5fe6ea-9337-4be1-881f-7da73b96709b tempest-VolumesServicesTestJSON-1758143405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-a9b69971-435a-406e-9cdf-1bb9b156f74e {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:54:48 devstack sudo[94209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-a9b69971-435a-406e-9cdf-1bb9b156f74e Nov 04 10:54:48 devstack sudo[94209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:54:49 devstack sudo[94209]: pam_unix(sudo:session): session closed for user root Nov 04 10:54:49 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-7d5fe6ea-9337-4be1-881f-7da73b96709b tempest-VolumesServicesTestJSON-1758143405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-a9b69971-435a-406e-9cdf-1bb9b156f74e" returned: 0 in 0.792s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:54:49 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-7d5fe6ea-9337-4be1-881f-7da73b96709b tempest-VolumesServicesTestJSON-1758143405 None] Lock "cinder-quobyte-a9b69971-435a-406e-9cdf-1bb9b156f74e" released by "delete_volume" :: held 1.588s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:54:49 devstack cinder-volume[87272]: DEBUG cinder.quota [None req-7d5fe6ea-9337-4be1-881f-7da73b96709b tempest-VolumesServicesTestJSON-1758143405 None] Created reservations ['5cba25f8-399a-46c2-97a8-5bc174bc62a3', '378378ca-da27-4f97-8f16-5c09b62e93a5', '28156b1f-4bb4-46ad-a404-02c6b4816e92', '7bd8d868-79f2-418a-992e-41e77a0c3861'] {{(pid=87272) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 10:54:49 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-7d5fe6ea-9337-4be1-881f-7da73b96709b tempest-VolumesServicesTestJSON-1758143405 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:54:49 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-7d5fe6ea-9337-4be1-881f-7da73b96709b tempest-VolumesServicesTestJSON-1758143405 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:54:49 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-7d5fe6ea-9337-4be1-881f-7da73b96709b tempest-VolumesServicesTestJSON-1758143405 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898': None} {{(pid=87272) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:54:49 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-7d5fe6ea-9337-4be1-881f-7da73b96709b tempest-VolumesServicesTestJSON-1758143405 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'] {{(pid=87272) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:54:50 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-7d5fe6ea-9337-4be1-881f-7da73b96709b tempest-VolumesServicesTestJSON-1758143405 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:54:50 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-7d5fe6ea-9337-4be1-881f-7da73b96709b tempest-VolumesServicesTestJSON-1758143405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:54:50 devstack sudo[94213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1 Nov 04 10:54:50 devstack sudo[94213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:54:50 devstack sudo[94213]: pam_unix(sudo:session): session closed for user root Nov 04 10:54:50 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-7d5fe6ea-9337-4be1-881f-7da73b96709b tempest-VolumesServicesTestJSON-1758143405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1" returned: 0 in 0.626s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:54:50 devstack cinder-volume[87272]: DEBUG cinder.manager [None req-7d5fe6ea-9337-4be1-881f-7da73b96709b tempest-VolumesServicesTestJSON-1758143405 None] Notifying Schedulers of capabilities ... {{(pid=87272) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 10:54:50 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-7d5fe6ea-9337-4be1-881f-7da73b96709b tempest-VolumesServicesTestJSON-1758143405 None] Deleted volume successfully. Nov 04 10:54:50 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-7d5fe6ea-9337-4be1-881f-7da73b96709b tempest-VolumesServicesTestJSON-1758143405 None] Lock "cinder-a9b69971-435a-406e-9cdf-1bb9b156f74e-delete_volume" released by "delete_volume" :: held 2.791s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:54:57 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-afc022cb-0114-424a-84b2-175572a1fca5 tempest-VolumesActionsTest-1160217311 None] Acquiring lock "cinder-dc7ccdf9-146f-41fb-95a9-5c2468931770" by "attach_volume" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:54:57 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-afc022cb-0114-424a-84b2-175572a1fca5 tempest-VolumesActionsTest-1160217311 None] Lock "cinder-dc7ccdf9-146f-41fb-95a9-5c2468931770" acquired by "attach_volume" :: waited 0.034s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:54:57 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-afc022cb-0114-424a-84b2-175572a1fca5 tempest-VolumesActionsTest-1160217311 None] Attaching volume dc7ccdf9-146f-41fb-95a9-5c2468931770 to instance 9494c426-8a86-4fd8-958c-94456df7edd0 at mountpoint /dev/vdb on host None. Nov 04 10:54:57 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-afc022cb-0114-424a-84b2-175572a1fca5 tempest-VolumesActionsTest-1160217311 None] Attach volume completed successfully. Nov 04 10:54:57 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-afc022cb-0114-424a-84b2-175572a1fca5 tempest-VolumesActionsTest-1160217311 None] Lock "cinder-dc7ccdf9-146f-41fb-95a9-5c2468931770" released by "attach_volume" :: held 0.230s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:54:57 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-6d1ca574-0cb9-4418-b04c-63960495ec2d tempest-VolumesActionsTest-1160217311 None] Acquiring lock "cinder-dc7ccdf9-146f-41fb-95a9-5c2468931770-detach_volume" by "detach_volume" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:54:58 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-6d1ca574-0cb9-4418-b04c-63960495ec2d tempest-VolumesActionsTest-1160217311 None] Lock "cinder-dc7ccdf9-146f-41fb-95a9-5c2468931770-detach_volume" acquired by "detach_volume" :: waited 0.035s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:54:58 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-6d1ca574-0cb9-4418-b04c-63960495ec2d tempest-VolumesActionsTest-1160217311 None] Detaching volume dc7ccdf9-146f-41fb-95a9-5c2468931770 from instance 9494c426-8a86-4fd8-958c-94456df7edd0. Nov 04 10:54:58 devstack cinder-volume[87272]: INFO cinder.volume.manager [req-82ee8cba-9ed0-4833-9e1d-5dc80ff52fac req-ca49bd87-c553-4d7a-a092-9ea4cd4ee4d8 tempest-ServerActionsTestOtherA-1078392334 None] Terminate volume connection completed successfully. Nov 04 10:54:58 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [req-82ee8cba-9ed0-4833-9e1d-5dc80ff52fac req-ca49bd87-c553-4d7a-a092-9ea4cd4ee4d8 tempest-ServerActionsTestOtherA-1078392334 None] Deleting attachment e2b5b265-b22b-48aa-80aa-ee9db5f35472. {{(pid=87272) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 04 10:54:58 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-6d1ca574-0cb9-4418-b04c-63960495ec2d tempest-VolumesActionsTest-1160217311 None] Detach volume completed successfully. Nov 04 10:54:58 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-6d1ca574-0cb9-4418-b04c-63960495ec2d tempest-VolumesActionsTest-1160217311 None] Lock "cinder-dc7ccdf9-146f-41fb-95a9-5c2468931770-detach_volume" released by "detach_volume" :: held 0.218s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:55:02 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [req-82ee8cba-9ed0-4833-9e1d-5dc80ff52fac req-088dc023-7f09-4e48-bf7d-d22308f23c77 tempest-ServerActionsTestOtherA-1078392334 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:55:02 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [req-82ee8cba-9ed0-4833-9e1d-5dc80ff52fac req-088dc023-7f09-4e48-bf7d-d22308f23c77 tempest-ServerActionsTestOtherA-1078392334 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:55:02 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [req-82ee8cba-9ed0-4833-9e1d-5dc80ff52fac req-088dc023-7f09-4e48-bf7d-d22308f23c77 tempest-ServerActionsTestOtherA-1078392334 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.022s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:55:02 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [req-82ee8cba-9ed0-4833-9e1d-5dc80ff52fac req-088dc023-7f09-4e48-bf7d-d22308f23c77 tempest-ServerActionsTestOtherA-1078392334 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898', 'name': 'volume-c4579c2a-1036-4f29-a41b-8328e133426d', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '1ac8b922-9402-41ae-9a2d-7df61a4901d8', 'enforce_multipath': True} {{(pid=87272) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 04 10:55:02 devstack cinder-volume[87272]: INFO cinder.volume.manager [req-82ee8cba-9ed0-4833-9e1d-5dc80ff52fac req-088dc023-7f09-4e48-bf7d-d22308f23c77 tempest-ServerActionsTestOtherA-1078392334 None] attachment_update completed successfully. Nov 04 10:55:12 devstack cinder-volume[87272]: DEBUG dbcounter [-] [87272] Writing DB stats cinder:SELECT=19,cinder:INSERT=4,cinder:UPDATE=17,cinder:DELETE=1 {{(pid=87272) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 10:55:12 devstack cinder-volume[87272]: DEBUG dbcounter [-] [87272] Writing DB stats cinder:UPDATE=15,cinder:SELECT=24,cinder:INSERT=3,cinder:DELETE=1 {{(pid=87272) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 10:55:14 devstack cinder-volume[87272]: DEBUG oslo_service.periodic_task [None req-236af0be-7f9d-4c80-b3d7-d645a9cd0dd1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87272) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 04 10:55:14 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-236af0be-7f9d-4c80-b3d7-d645a9cd0dd1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:55:14 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-236af0be-7f9d-4c80-b3d7-d645a9cd0dd1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:55:14 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-236af0be-7f9d-4c80-b3d7-d645a9cd0dd1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898': None} {{(pid=87272) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:55:14 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-236af0be-7f9d-4c80-b3d7-d645a9cd0dd1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'] {{(pid=87272) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:55:14 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-236af0be-7f9d-4c80-b3d7-d645a9cd0dd1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:55:14 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-236af0be-7f9d-4c80-b3d7-d645a9cd0dd1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:55:14 devstack sudo[94936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1 Nov 04 10:55:14 devstack sudo[94936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:55:14 devstack sudo[94936]: pam_unix(sudo:session): session closed for user root Nov 04 10:55:14 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-236af0be-7f9d-4c80-b3d7-d645a9cd0dd1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1" returned: 0 in 0.594s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:55:14 devstack cinder-volume[87272]: DEBUG cinder.manager [None req-236af0be-7f9d-4c80-b3d7-d645a9cd0dd1 None None] Notifying Schedulers of capabilities ... {{(pid=87272) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 10:55:14 devstack cinder-volume[87272]: DEBUG oslo_service.periodic_task [None req-236af0be-7f9d-4c80-b3d7-d645a9cd0dd1 None None] Running periodic task VolumeManager._thread_info {{(pid=87272) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 04 10:55:14 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-236af0be-7f9d-4c80-b3d7-d645a9cd0dd1 None None] thread count: 28 {{(pid=87272) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 04 10:55:14 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-236af0be-7f9d-4c80-b3d7-d645a9cd0dd1 None None] thread info: [<_MainThread(MainThread, started 127085713244288)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87272) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 04 10:55:15 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-859a1e9c-f51c-467e-8476-5694986534c9 tempest-VolumesActionsTest-1160217311 None] Acquiring lock "cinder-dc7ccdf9-146f-41fb-95a9-5c2468931770" by "attach_volume" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:55:15 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-859a1e9c-f51c-467e-8476-5694986534c9 tempest-VolumesActionsTest-1160217311 None] Lock "cinder-dc7ccdf9-146f-41fb-95a9-5c2468931770" acquired by "attach_volume" :: waited 0.029s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:55:15 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-859a1e9c-f51c-467e-8476-5694986534c9 tempest-VolumesActionsTest-1160217311 None] Attaching volume dc7ccdf9-146f-41fb-95a9-5c2468931770 to instance 8d0e5f49-1c63-464e-9bd6-ad760a2cbc00 at mountpoint /dev/vdb on host None. Nov 04 10:55:15 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-859a1e9c-f51c-467e-8476-5694986534c9 tempest-VolumesActionsTest-1160217311 None] Attach volume completed successfully. Nov 04 10:55:15 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-859a1e9c-f51c-467e-8476-5694986534c9 tempest-VolumesActionsTest-1160217311 None] Lock "cinder-dc7ccdf9-146f-41fb-95a9-5c2468931770" released by "attach_volume" :: held 0.167s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:55:16 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-05a132ed-4502-4969-ac4f-edd3414c927a tempest-VolumesActionsTest-1160217311 None] Acquiring lock "cinder-dc7ccdf9-146f-41fb-95a9-5c2468931770-detach_volume" by "detach_volume" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:55:16 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-05a132ed-4502-4969-ac4f-edd3414c927a tempest-VolumesActionsTest-1160217311 None] Lock "cinder-dc7ccdf9-146f-41fb-95a9-5c2468931770-detach_volume" acquired by "detach_volume" :: waited 0.025s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:55:16 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-05a132ed-4502-4969-ac4f-edd3414c927a tempest-VolumesActionsTest-1160217311 None] Detaching volume dc7ccdf9-146f-41fb-95a9-5c2468931770 from instance 8d0e5f49-1c63-464e-9bd6-ad760a2cbc00. Nov 04 10:55:16 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-05a132ed-4502-4969-ac4f-edd3414c927a tempest-VolumesActionsTest-1160217311 None] Detach volume completed successfully. Nov 04 10:55:16 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-05a132ed-4502-4969-ac4f-edd3414c927a tempest-VolumesActionsTest-1160217311 None] Lock "cinder-dc7ccdf9-146f-41fb-95a9-5c2468931770-detach_volume" released by "detach_volume" :: held 0.102s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:55:18 devstack cinder-volume[87272]: DEBUG cinder.volume.flows.manager.create_volume [None req-93ef2aa2-d72f-4bc5-8d8e-b7b756270263 tempest-VolumesListAdminTestJSON-411668674 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87272) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 10:55:18 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-93ef2aa2-d72f-4bc5-8d8e-b7b756270263 tempest-VolumesListAdminTestJSON-411668674 None] Flow 'volume_create_manager' (e96ca333-e38f-4693-9756-5a6a72a0b294) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:55:18 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-93ef2aa2-d72f-4bc5-8d8e-b7b756270263 tempest-VolumesListAdminTestJSON-411668674 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6e5c9c0-2c87-4680-a1e8-247c5cef9082) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:55:18 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-93ef2aa2-d72f-4bc5-8d8e-b7b756270263 tempest-VolumesListAdminTestJSON-411668674 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6e5c9c0-2c87-4680-a1e8-247c5cef9082) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T09:55:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-35556094',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=97d492bd-b7cf-40b5-9d93-93c42cc40504,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5000427fdf0c4cf6a353f1a3c37d2fce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T09:55:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T09:55:18Z,use_quota=True,user_id='27c8d5f9809c4466bb157287559ad216',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8989e4f-21e3-4f0a-9584-0d818784e883),volume_type_id=f8989e4f-21e3-4f0a-9584-0d818784e883)' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:55:18 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-93ef2aa2-d72f-4bc5-8d8e-b7b756270263 tempest-VolumesListAdminTestJSON-411668674 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6406facb-9471-410e-b572-0cb02ad326bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:55:18 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-93ef2aa2-d72f-4bc5-8d8e-b7b756270263 tempest-VolumesListAdminTestJSON-411668674 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6406facb-9471-410e-b572-0cb02ad326bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:55:18 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-93ef2aa2-d72f-4bc5-8d8e-b7b756270263 tempest-VolumesListAdminTestJSON-411668674 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e7ee24bb-4a10-41c9-a0b0-d51983068d4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:55:18 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-93ef2aa2-d72f-4bc5-8d8e-b7b756270263 tempest-VolumesListAdminTestJSON-411668674 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e7ee24bb-4a10-41c9-a0b0-d51983068d4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '97d492bd-b7cf-40b5-9d93-93c42cc40504', 'volume_name': 'volume-97d492bd-b7cf-40b5-9d93-93c42cc40504', 'volume_size': 1}' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:55:18 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-93ef2aa2-d72f-4bc5-8d8e-b7b756270263 tempest-VolumesListAdminTestJSON-411668674 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78d70396-a4d3-4804-b922-14cccd1e3de4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:55:18 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-93ef2aa2-d72f-4bc5-8d8e-b7b756270263 tempest-VolumesListAdminTestJSON-411668674 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78d70396-a4d3-4804-b922-14cccd1e3de4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:55:18 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-93ef2aa2-d72f-4bc5-8d8e-b7b756270263 tempest-VolumesListAdminTestJSON-411668674 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e1a2819-3869-48e0-bcf1-8a46572aab48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:55:18 devstack cinder-volume[87272]: INFO cinder.volume.flows.manager.create_volume [None req-93ef2aa2-d72f-4bc5-8d8e-b7b756270263 tempest-VolumesListAdminTestJSON-411668674 None] Volume 97d492bd-b7cf-40b5-9d93-93c42cc40504: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-97d492bd-b7cf-40b5-9d93-93c42cc40504', 'volume_size': 1} Nov 04 10:55:18 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-93ef2aa2-d72f-4bc5-8d8e-b7b756270263 tempest-VolumesListAdminTestJSON-411668674 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:55:18 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-93ef2aa2-d72f-4bc5-8d8e-b7b756270263 tempest-VolumesListAdminTestJSON-411668674 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:55:18 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-93ef2aa2-d72f-4bc5-8d8e-b7b756270263 tempest-VolumesListAdminTestJSON-411668674 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T09:55:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-35556094',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=97d492bd-b7cf-40b5-9d93-93c42cc40504,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5000427fdf0c4cf6a353f1a3c37d2fce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T09:55:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T09:55:18Z,use_quota=True,user_id='27c8d5f9809c4466bb157287559ad216',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8989e4f-21e3-4f0a-9584-0d818784e883),volume_type_id=f8989e4f-21e3-4f0a-9584-0d818784e883)}" {{(pid=87272) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 04 10:55:18 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.remotefs [None req-93ef2aa2-d72f-4bc5-8d8e-b7b756270263 tempest-VolumesListAdminTestJSON-411668674 None] Creating volume 97d492bd-b7cf-40b5-9d93-93c42cc40504 {{(pid=87272) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 10:55:18 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-93ef2aa2-d72f-4bc5-8d8e-b7b756270263 tempest-VolumesListAdminTestJSON-411668674 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:55:18 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-93ef2aa2-d72f-4bc5-8d8e-b7b756270263 tempest-VolumesListAdminTestJSON-411668674 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:55:18 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-93ef2aa2-d72f-4bc5-8d8e-b7b756270263 tempest-VolumesListAdminTestJSON-411668674 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898': None} {{(pid=87272) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:55:18 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-93ef2aa2-d72f-4bc5-8d8e-b7b756270263 tempest-VolumesListAdminTestJSON-411668674 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'] {{(pid=87272) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:55:18 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-93ef2aa2-d72f-4bc5-8d8e-b7b756270263 tempest-VolumesListAdminTestJSON-411668674 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:55:18 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-93ef2aa2-d72f-4bc5-8d8e-b7b756270263 tempest-VolumesListAdminTestJSON-411668674 None] Selected osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898 as target Quobyte volume. {{(pid=87272) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 10:55:18 devstack cinder-volume[87272]: INFO cinder.volume.drivers.remotefs [None req-93ef2aa2-d72f-4bc5-8d8e-b7b756270263 tempest-VolumesListAdminTestJSON-411668674 None] casted to osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898 Nov 04 10:55:18 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-93ef2aa2-d72f-4bc5-8d8e-b7b756270263 tempest-VolumesListAdminTestJSON-411668674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-97d492bd-b7cf-40b5-9d93-93c42cc40504 1073741824 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:55:18 devstack sudo[94965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-97d492bd-b7cf-40b5-9d93-93c42cc40504 1073741824 Nov 04 10:55:18 devstack sudo[94965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:55:20 devstack sudo[94965]: pam_unix(sudo:session): session closed for user root Nov 04 10:55:20 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-93ef2aa2-d72f-4bc5-8d8e-b7b756270263 tempest-VolumesListAdminTestJSON-411668674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-97d492bd-b7cf-40b5-9d93-93c42cc40504 1073741824" returned: 0 in 1.238s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:55:20 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-93ef2aa2-d72f-4bc5-8d8e-b7b756270263 tempest-VolumesListAdminTestJSON-411668674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-97d492bd-b7cf-40b5-9d93-93c42cc40504 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:55:20 devstack sudo[94995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-97d492bd-b7cf-40b5-9d93-93c42cc40504 Nov 04 10:55:20 devstack sudo[94995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:55:20 devstack sudo[94995]: pam_unix(sudo:session): session closed for user root Nov 04 10:55:20 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-93ef2aa2-d72f-4bc5-8d8e-b7b756270263 tempest-VolumesListAdminTestJSON-411668674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-97d492bd-b7cf-40b5-9d93-93c42cc40504" returned: 0 in 0.748s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:55:20 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-93ef2aa2-d72f-4bc5-8d8e-b7b756270263 tempest-VolumesListAdminTestJSON-411668674 None] <== create_volume: return (2095ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'} {{(pid=87272) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 04 10:55:20 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-93ef2aa2-d72f-4bc5-8d8e-b7b756270263 tempest-VolumesListAdminTestJSON-411668674 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.098s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:55:20 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-93ef2aa2-d72f-4bc5-8d8e-b7b756270263 tempest-VolumesListAdminTestJSON-411668674 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e1a2819-3869-48e0-bcf1-8a46572aab48) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-97d492bd-b7cf-40b5-9d93-93c42cc40504', 'volume_size': 1}' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:55:20 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-93ef2aa2-d72f-4bc5-8d8e-b7b756270263 tempest-VolumesListAdminTestJSON-411668674 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a0e5eb6b-3625-4ad6-882c-72353298d661) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:55:20 devstack cinder-volume[87272]: INFO cinder.volume.flows.manager.create_volume [None req-93ef2aa2-d72f-4bc5-8d8e-b7b756270263 tempest-VolumesListAdminTestJSON-411668674 None] Volume volume-97d492bd-b7cf-40b5-9d93-93c42cc40504 (97d492bd-b7cf-40b5-9d93-93c42cc40504): created successfully Nov 04 10:55:20 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-93ef2aa2-d72f-4bc5-8d8e-b7b756270263 tempest-VolumesListAdminTestJSON-411668674 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a0e5eb6b-3625-4ad6-882c-72353298d661) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:55:21 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-93ef2aa2-d72f-4bc5-8d8e-b7b756270263 tempest-VolumesListAdminTestJSON-411668674 None] Flow 'volume_create_manager' (e96ca333-e38f-4693-9756-5a6a72a0b294) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87272) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:55:21 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-93ef2aa2-d72f-4bc5-8d8e-b7b756270263 tempest-VolumesListAdminTestJSON-411668674 None] Created volume successfully. Nov 04 10:55:22 devstack cinder-volume[87272]: DEBUG cinder.volume.flows.manager.create_volume [None req-201fdc66-82bb-48f9-922f-cc63023db2ad tempest-VolumesListAdminTestJSON-411668674 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87272) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 10:55:22 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-201fdc66-82bb-48f9-922f-cc63023db2ad tempest-VolumesListAdminTestJSON-411668674 None] Flow 'volume_create_manager' (a002d94f-e4fa-4eef-8693-07066f28d605) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:55:22 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-201fdc66-82bb-48f9-922f-cc63023db2ad tempest-VolumesListAdminTestJSON-411668674 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (05a1199a-0341-4420-9735-804ef0366023) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:55:22 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-201fdc66-82bb-48f9-922f-cc63023db2ad tempest-VolumesListAdminTestJSON-411668674 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (05a1199a-0341-4420-9735-804ef0366023) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T09:55:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1649265174',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c3b5766d-e288-49e9-8bed-02808c3d38f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5000427fdf0c4cf6a353f1a3c37d2fce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T09:55:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T09:55:23Z,use_quota=True,user_id='27c8d5f9809c4466bb157287559ad216',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8989e4f-21e3-4f0a-9584-0d818784e883),volume_type_id=f8989e4f-21e3-4f0a-9584-0d818784e883)' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:55:22 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-201fdc66-82bb-48f9-922f-cc63023db2ad tempest-VolumesListAdminTestJSON-411668674 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28460063-4fd8-4c88-a429-fab299086895) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:55:22 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-201fdc66-82bb-48f9-922f-cc63023db2ad tempest-VolumesListAdminTestJSON-411668674 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28460063-4fd8-4c88-a429-fab299086895) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:55:22 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-201fdc66-82bb-48f9-922f-cc63023db2ad tempest-VolumesListAdminTestJSON-411668674 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a510928c-946e-4431-ac6e-71b9cc57554f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:55:22 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-201fdc66-82bb-48f9-922f-cc63023db2ad tempest-VolumesListAdminTestJSON-411668674 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a510928c-946e-4431-ac6e-71b9cc57554f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c3b5766d-e288-49e9-8bed-02808c3d38f1', 'volume_name': 'volume-c3b5766d-e288-49e9-8bed-02808c3d38f1', 'volume_size': 1}' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:55:23 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-201fdc66-82bb-48f9-922f-cc63023db2ad tempest-VolumesListAdminTestJSON-411668674 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3efca7e4-a45a-4c4e-9527-8cb0adea57bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:55:23 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-201fdc66-82bb-48f9-922f-cc63023db2ad tempest-VolumesListAdminTestJSON-411668674 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3efca7e4-a45a-4c4e-9527-8cb0adea57bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:55:23 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-201fdc66-82bb-48f9-922f-cc63023db2ad tempest-VolumesListAdminTestJSON-411668674 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e70d752-3935-4b9b-8610-99ca8e7d8d3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:55:23 devstack cinder-volume[87272]: INFO cinder.volume.flows.manager.create_volume [None req-201fdc66-82bb-48f9-922f-cc63023db2ad tempest-VolumesListAdminTestJSON-411668674 None] Volume c3b5766d-e288-49e9-8bed-02808c3d38f1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c3b5766d-e288-49e9-8bed-02808c3d38f1', 'volume_size': 1} Nov 04 10:55:23 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-201fdc66-82bb-48f9-922f-cc63023db2ad tempest-VolumesListAdminTestJSON-411668674 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:55:23 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-201fdc66-82bb-48f9-922f-cc63023db2ad tempest-VolumesListAdminTestJSON-411668674 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:55:23 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-201fdc66-82bb-48f9-922f-cc63023db2ad tempest-VolumesListAdminTestJSON-411668674 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T09:55:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1649265174',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c3b5766d-e288-49e9-8bed-02808c3d38f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5000427fdf0c4cf6a353f1a3c37d2fce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T09:55:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T09:55:23Z,use_quota=True,user_id='27c8d5f9809c4466bb157287559ad216',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8989e4f-21e3-4f0a-9584-0d818784e883),volume_type_id=f8989e4f-21e3-4f0a-9584-0d818784e883)}" {{(pid=87272) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 04 10:55:23 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.remotefs [None req-201fdc66-82bb-48f9-922f-cc63023db2ad tempest-VolumesListAdminTestJSON-411668674 None] Creating volume c3b5766d-e288-49e9-8bed-02808c3d38f1 {{(pid=87272) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 10:55:23 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-201fdc66-82bb-48f9-922f-cc63023db2ad tempest-VolumesListAdminTestJSON-411668674 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:55:23 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-201fdc66-82bb-48f9-922f-cc63023db2ad tempest-VolumesListAdminTestJSON-411668674 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:55:23 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-201fdc66-82bb-48f9-922f-cc63023db2ad tempest-VolumesListAdminTestJSON-411668674 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898': None} {{(pid=87272) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:55:23 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-201fdc66-82bb-48f9-922f-cc63023db2ad tempest-VolumesListAdminTestJSON-411668674 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'] {{(pid=87272) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:55:23 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-201fdc66-82bb-48f9-922f-cc63023db2ad tempest-VolumesListAdminTestJSON-411668674 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:55:23 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-201fdc66-82bb-48f9-922f-cc63023db2ad tempest-VolumesListAdminTestJSON-411668674 None] Selected osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898 as target Quobyte volume. {{(pid=87272) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 10:55:23 devstack cinder-volume[87272]: INFO cinder.volume.drivers.remotefs [None req-201fdc66-82bb-48f9-922f-cc63023db2ad tempest-VolumesListAdminTestJSON-411668674 None] casted to osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898 Nov 04 10:55:23 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-201fdc66-82bb-48f9-922f-cc63023db2ad tempest-VolumesListAdminTestJSON-411668674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-c3b5766d-e288-49e9-8bed-02808c3d38f1 1073741824 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:55:23 devstack sudo[95091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-c3b5766d-e288-49e9-8bed-02808c3d38f1 1073741824 Nov 04 10:55:23 devstack sudo[95091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:55:23 devstack sudo[95091]: pam_unix(sudo:session): session closed for user root Nov 04 10:55:23 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-201fdc66-82bb-48f9-922f-cc63023db2ad tempest-VolumesListAdminTestJSON-411668674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-c3b5766d-e288-49e9-8bed-02808c3d38f1 1073741824" returned: 0 in 0.700s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:55:23 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-201fdc66-82bb-48f9-922f-cc63023db2ad tempest-VolumesListAdminTestJSON-411668674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-c3b5766d-e288-49e9-8bed-02808c3d38f1 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:55:23 devstack sudo[95133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-c3b5766d-e288-49e9-8bed-02808c3d38f1 Nov 04 10:55:23 devstack sudo[95133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:55:24 devstack sudo[95133]: pam_unix(sudo:session): session closed for user root Nov 04 10:55:24 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-201fdc66-82bb-48f9-922f-cc63023db2ad tempest-VolumesListAdminTestJSON-411668674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-c3b5766d-e288-49e9-8bed-02808c3d38f1" returned: 0 in 0.305s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:55:24 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-201fdc66-82bb-48f9-922f-cc63023db2ad tempest-VolumesListAdminTestJSON-411668674 None] <== create_volume: return (1079ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'} {{(pid=87272) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 04 10:55:24 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-201fdc66-82bb-48f9-922f-cc63023db2ad tempest-VolumesListAdminTestJSON-411668674 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.085s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:55:24 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-201fdc66-82bb-48f9-922f-cc63023db2ad tempest-VolumesListAdminTestJSON-411668674 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e70d752-3935-4b9b-8610-99ca8e7d8d3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c3b5766d-e288-49e9-8bed-02808c3d38f1', 'volume_size': 1}' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:55:24 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-201fdc66-82bb-48f9-922f-cc63023db2ad tempest-VolumesListAdminTestJSON-411668674 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86d52b48-3a21-4e9a-80cc-09a0ead200d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:55:24 devstack cinder-volume[87272]: INFO cinder.volume.flows.manager.create_volume [None req-201fdc66-82bb-48f9-922f-cc63023db2ad tempest-VolumesListAdminTestJSON-411668674 None] Volume volume-c3b5766d-e288-49e9-8bed-02808c3d38f1 (c3b5766d-e288-49e9-8bed-02808c3d38f1): created successfully Nov 04 10:55:24 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-201fdc66-82bb-48f9-922f-cc63023db2ad tempest-VolumesListAdminTestJSON-411668674 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86d52b48-3a21-4e9a-80cc-09a0ead200d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:55:24 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-201fdc66-82bb-48f9-922f-cc63023db2ad tempest-VolumesListAdminTestJSON-411668674 None] Flow 'volume_create_manager' (a002d94f-e4fa-4eef-8693-07066f28d605) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87272) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:55:24 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-201fdc66-82bb-48f9-922f-cc63023db2ad tempest-VolumesListAdminTestJSON-411668674 None] Created volume successfully. Nov 04 10:55:24 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-b6f6f3e7-aa5b-44e6-8e99-f4dc50b4d423 tempest-VolumesActionsTest-1160217311 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:55:24 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-b6f6f3e7-aa5b-44e6-8e99-f4dc50b4d423 tempest-VolumesActionsTest-1160217311 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:55:24 devstack cinder-volume[87272]: DEBUG oslo.privsep.daemon [-] privsep: reply[475a2851-704d-4512-9831-58921d850f86]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:55:24 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-b6f6f3e7-aa5b-44e6-8e99-f4dc50b4d423 tempest-VolumesActionsTest-1160217311 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-dc7ccdf9-146f-41fb-95a9-5c2468931770 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:55:24 devstack sudo[95137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-dc7ccdf9-146f-41fb-95a9-5c2468931770 Nov 04 10:55:24 devstack sudo[95137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:55:24 devstack sudo[95137]: pam_unix(sudo:session): session closed for user root Nov 04 10:55:24 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-b6f6f3e7-aa5b-44e6-8e99-f4dc50b4d423 tempest-VolumesActionsTest-1160217311 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-dc7ccdf9-146f-41fb-95a9-5c2468931770" returned: 0 in 0.431s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:55:24 devstack cinder-volume[87272]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e1e47ec-8ab3-4f45-b4bf-ba93c3dfd2bf]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:55:24 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-b6f6f3e7-aa5b-44e6-8e99-f4dc50b4d423 tempest-VolumesActionsTest-1160217311 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-dc7ccdf9-146f-41fb-95a9-5c2468931770 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:55:24 devstack sudo[95143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-dc7ccdf9-146f-41fb-95a9-5c2468931770 Nov 04 10:55:24 devstack sudo[95143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:55:25 devstack sudo[95143]: pam_unix(sudo:session): session closed for user root Nov 04 10:55:25 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-b6f6f3e7-aa5b-44e6-8e99-f4dc50b4d423 tempest-VolumesActionsTest-1160217311 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-dc7ccdf9-146f-41fb-95a9-5c2468931770" returned: 0 in 0.438s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:55:25 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-b6f6f3e7-aa5b-44e6-8e99-f4dc50b4d423 tempest-VolumesActionsTest-1160217311 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-dc7ccdf9-146f-41fb-95a9-5c2468931770 /opt/stack/data/cinder/conversion/dc7ccdf9-146f-41fb-95a9-5c2468931770.temp_image.338f9cdc-20e4-48ec-8074-80638e7d1d71spr_x1xk.img {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:55:25 devstack sudo[95150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-dc7ccdf9-146f-41fb-95a9-5c2468931770 /opt/stack/data/cinder/conversion/dc7ccdf9-146f-41fb-95a9-5c2468931770.temp_image.338f9cdc-20e4-48ec-8074-80638e7d1d71spr_x1xk.img Nov 04 10:55:25 devstack sudo[95150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:55:25 devstack cinder-volume[87272]: INFO cinder.volume.manager [req-79abc08c-b012-414d-bc7a-6bf1c52852bb req-29cc2175-c70e-4630-b250-f7330cb8226f tempest-AttachVolumeNegativeTest-154668454 None] Terminate volume connection completed successfully. Nov 04 10:55:25 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [req-79abc08c-b012-414d-bc7a-6bf1c52852bb req-29cc2175-c70e-4630-b250-f7330cb8226f tempest-AttachVolumeNegativeTest-154668454 None] Deleting attachment 775f515a-7825-40aa-a6bc-b41db5ed1252. {{(pid=87272) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 04 10:55:25 devstack cinder-volume[87272]: DEBUG cinder.volume.flows.manager.create_volume [None req-c7813d86-c904-4e4f-a3b9-f9b9f48fea1c tempest-VolumesListAdminTestJSON-411668674 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87272) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 10:55:25 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-c7813d86-c904-4e4f-a3b9-f9b9f48fea1c tempest-VolumesListAdminTestJSON-411668674 None] Flow 'volume_create_manager' (aa60c5f7-10fa-412e-a372-0aa60f6f51f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:55:25 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-c7813d86-c904-4e4f-a3b9-f9b9f48fea1c tempest-VolumesListAdminTestJSON-411668674 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be57456d-ce28-44c5-9da6-8f54a1096ff8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:55:25 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-c7813d86-c904-4e4f-a3b9-f9b9f48fea1c tempest-VolumesListAdminTestJSON-411668674 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be57456d-ce28-44c5-9da6-8f54a1096ff8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T09:55:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1092184902',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a2da9469-6e60-4448-81b9-46bc819ca11f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5000427fdf0c4cf6a353f1a3c37d2fce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T09:55:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T09:55:25Z,use_quota=True,user_id='27c8d5f9809c4466bb157287559ad216',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8989e4f-21e3-4f0a-9584-0d818784e883),volume_type_id=f8989e4f-21e3-4f0a-9584-0d818784e883)' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:55:25 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-c7813d86-c904-4e4f-a3b9-f9b9f48fea1c tempest-VolumesListAdminTestJSON-411668674 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (84b1cdbc-e0a3-495c-9b39-8e74b6b3e1b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:55:25 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-c7813d86-c904-4e4f-a3b9-f9b9f48fea1c tempest-VolumesListAdminTestJSON-411668674 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (84b1cdbc-e0a3-495c-9b39-8e74b6b3e1b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:55:25 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-c7813d86-c904-4e4f-a3b9-f9b9f48fea1c tempest-VolumesListAdminTestJSON-411668674 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2f812ff-ff1c-47a1-83b0-e5fd27098a0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:55:25 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-c7813d86-c904-4e4f-a3b9-f9b9f48fea1c tempest-VolumesListAdminTestJSON-411668674 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2f812ff-ff1c-47a1-83b0-e5fd27098a0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a2da9469-6e60-4448-81b9-46bc819ca11f', 'volume_name': 'volume-a2da9469-6e60-4448-81b9-46bc819ca11f', 'volume_size': 1}' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:55:25 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-c7813d86-c904-4e4f-a3b9-f9b9f48fea1c tempest-VolumesListAdminTestJSON-411668674 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6aee371b-76c7-4ee8-92b2-85e507ef6088) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:55:25 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-c7813d86-c904-4e4f-a3b9-f9b9f48fea1c tempest-VolumesListAdminTestJSON-411668674 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6aee371b-76c7-4ee8-92b2-85e507ef6088) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:55:25 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-c7813d86-c904-4e4f-a3b9-f9b9f48fea1c tempest-VolumesListAdminTestJSON-411668674 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2e4e98f-64ee-447f-9049-b12b432da9ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:55:25 devstack cinder-volume[87272]: INFO cinder.volume.flows.manager.create_volume [None req-c7813d86-c904-4e4f-a3b9-f9b9f48fea1c tempest-VolumesListAdminTestJSON-411668674 None] Volume a2da9469-6e60-4448-81b9-46bc819ca11f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a2da9469-6e60-4448-81b9-46bc819ca11f', 'volume_size': 1} Nov 04 10:55:25 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-c7813d86-c904-4e4f-a3b9-f9b9f48fea1c tempest-VolumesListAdminTestJSON-411668674 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:55:32 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-b6f6f3e7-aa5b-44e6-8e99-f4dc50b4d423 tempest-VolumesActionsTest-1160217311 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-dc7ccdf9-146f-41fb-95a9-5c2468931770 /opt/stack/data/cinder/conversion/dc7ccdf9-146f-41fb-95a9-5c2468931770.temp_image.338f9cdc-20e4-48ec-8074-80638e7d1d71spr_x1xk.img" returned: 0 in 7.572s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:55:32 devstack cinder-volume[87272]: DEBUG oslo.privsep.daemon [-] privsep: reply[365e68a8-09c7-4688-8cab-3fb7e57ff2d0]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:55:32 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-b6f6f3e7-aa5b-44e6-8e99-f4dc50b4d423 tempest-VolumesActionsTest-1160217311 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-dc7ccdf9-146f-41fb-95a9-5c2468931770 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:55:32 devstack sudo[95204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-dc7ccdf9-146f-41fb-95a9-5c2468931770 Nov 04 10:55:32 devstack sudo[95204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:55:33 devstack sudo[95204]: pam_unix(sudo:session): session closed for user root Nov 04 10:55:33 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-b6f6f3e7-aa5b-44e6-8e99-f4dc50b4d423 tempest-VolumesActionsTest-1160217311 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-dc7ccdf9-146f-41fb-95a9-5c2468931770" returned: 0 in 0.576s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:55:33 devstack cinder-volume[87272]: DEBUG cinder.image.image_utils [None req-b6f6f3e7-aa5b-44e6-8e99-f4dc50b4d423 tempest-VolumesActionsTest-1160217311 None] Image conversion details: src /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-dc7ccdf9-146f-41fb-95a9-5c2468931770, size 1024.00 MB, duration 7.57 sec, destination /opt/stack/data/cinder/conversion/dc7ccdf9-146f-41fb-95a9-5c2468931770.temp_image.338f9cdc-20e4-48ec-8074-80638e7d1d71spr_x1xk.img {{(pid=87272) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Nov 04 10:55:33 devstack cinder-volume[87272]: INFO cinder.image.image_utils [None req-b6f6f3e7-aa5b-44e6-8e99-f4dc50b4d423 tempest-VolumesActionsTest-1160217311 None] Converted 1024.00 MB image at 135.23 MB/s Nov 04 10:55:33 devstack cinder-volume[87272]: DEBUG cinder.image.image_utils [None req-b6f6f3e7-aa5b-44e6-8e99-f4dc50b4d423 tempest-VolumesActionsTest-1160217311 None] 338f9cdc-20e4-48ec-8074-80638e7d1d71 was raw, no need to convert to raw {{(pid=87272) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1162}} Nov 04 10:55:35 devstack cinder-volume[87272]: DEBUG dbcounter [-] [87272] Writing DB stats cinder:INSERT=1,cinder:SELECT=13,cinder:UPDATE=9 {{(pid=87272) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 10:55:43 devstack cinder-volume[87272]: DEBUG dbcounter [-] [87272] Writing DB stats cinder:SELECT=15,cinder:INSERT=3,cinder:UPDATE=10,cinder:DELETE=2 {{(pid=87272) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 10:55:50 devstack cinder-volume[87272]: INFO cinder.volume.manager [req-37f20598-ec80-4487-b9bd-180812e2e426 req-5c06fb0c-869e-4a8a-95ae-9fb88debd9a8 tempest-ServerActionsTestOtherA-1078392334 None] Terminate volume connection completed successfully. Nov 04 10:55:50 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [req-37f20598-ec80-4487-b9bd-180812e2e426 req-5c06fb0c-869e-4a8a-95ae-9fb88debd9a8 tempest-ServerActionsTestOtherA-1078392334 None] Deleting attachment 1ac8b922-9402-41ae-9a2d-7df61a4901d8. {{(pid=87272) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 04 10:55:50 devstack cinder-volume[87272]: DEBUG cinder.coordination [req-37f20598-ec80-4487-b9bd-180812e2e426 req-b514fcd9-5c86-4c91-b97b-7a65f139dfdf tempest-ServerActionsTestOtherA-1078392334 None] Acquiring lock "cinder-c4579c2a-1036-4f29-a41b-8328e133426d-delete_volume" by "delete_volume" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:55:50 devstack cinder-volume[87272]: DEBUG cinder.coordination [req-37f20598-ec80-4487-b9bd-180812e2e426 req-b514fcd9-5c86-4c91-b97b-7a65f139dfdf tempest-ServerActionsTestOtherA-1078392334 None] Lock "cinder-c4579c2a-1036-4f29-a41b-8328e133426d-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:55:51 devstack cinder-volume[87272]: DEBUG cinder.coordination [req-37f20598-ec80-4487-b9bd-180812e2e426 req-b514fcd9-5c86-4c91-b97b-7a65f139dfdf tempest-ServerActionsTestOtherA-1078392334 None] Acquiring lock "cinder-quobyte-c4579c2a-1036-4f29-a41b-8328e133426d" by "delete_volume" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:55:51 devstack cinder-volume[87272]: DEBUG cinder.coordination [req-37f20598-ec80-4487-b9bd-180812e2e426 req-b514fcd9-5c86-4c91-b97b-7a65f139dfdf tempest-ServerActionsTestOtherA-1078392334 None] Lock "cinder-quobyte-c4579c2a-1036-4f29-a41b-8328e133426d" acquired by "delete_volume" :: waited 0.033s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:55:51 devstack cinder-volume[87272]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e955f8e-c86f-431c-9902-8f39d8fa273f]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:55:51 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [req-37f20598-ec80-4487-b9bd-180812e2e426 req-b514fcd9-5c86-4c91-b97b-7a65f139dfdf tempest-ServerActionsTestOtherA-1078392334 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-c4579c2a-1036-4f29-a41b-8328e133426d {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:55:51 devstack sudo[95347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-c4579c2a-1036-4f29-a41b-8328e133426d Nov 04 10:55:51 devstack sudo[95347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:55:51 devstack sudo[95347]: pam_unix(sudo:session): session closed for user root Nov 04 10:55:51 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [req-37f20598-ec80-4487-b9bd-180812e2e426 req-b514fcd9-5c86-4c91-b97b-7a65f139dfdf tempest-ServerActionsTestOtherA-1078392334 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-c4579c2a-1036-4f29-a41b-8328e133426d" returned: 0 in 0.670s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:55:51 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [req-37f20598-ec80-4487-b9bd-180812e2e426 req-b514fcd9-5c86-4c91-b97b-7a65f139dfdf tempest-ServerActionsTestOtherA-1078392334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-c4579c2a-1036-4f29-a41b-8328e133426d {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:55:51 devstack sudo[95352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-c4579c2a-1036-4f29-a41b-8328e133426d Nov 04 10:55:51 devstack sudo[95352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:55:52 devstack sudo[95352]: pam_unix(sudo:session): session closed for user root Nov 04 10:55:52 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [req-37f20598-ec80-4487-b9bd-180812e2e426 req-b514fcd9-5c86-4c91-b97b-7a65f139dfdf tempest-ServerActionsTestOtherA-1078392334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-c4579c2a-1036-4f29-a41b-8328e133426d" returned: 0 in 0.318s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:55:52 devstack cinder-volume[87272]: DEBUG cinder.coordination [req-37f20598-ec80-4487-b9bd-180812e2e426 req-b514fcd9-5c86-4c91-b97b-7a65f139dfdf tempest-ServerActionsTestOtherA-1078392334 None] Lock "cinder-quobyte-c4579c2a-1036-4f29-a41b-8328e133426d" released by "delete_volume" :: held 1.118s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:55:52 devstack cinder-volume[87272]: DEBUG cinder.quota [req-37f20598-ec80-4487-b9bd-180812e2e426 req-b514fcd9-5c86-4c91-b97b-7a65f139dfdf tempest-ServerActionsTestOtherA-1078392334 None] Created reservations ['9602f1db-a67b-409a-a003-fd8c0b6e6a14', '8942de43-46e2-45de-9346-be11141f48b9', '0a4e3217-2e3a-4e9b-9377-802d20bc5a70', 'e34cbf2b-9afe-4320-8999-fafbae94b512'] {{(pid=87272) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 10:55:52 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [req-37f20598-ec80-4487-b9bd-180812e2e426 req-b514fcd9-5c86-4c91-b97b-7a65f139dfdf tempest-ServerActionsTestOtherA-1078392334 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:55:52 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [req-37f20598-ec80-4487-b9bd-180812e2e426 req-b514fcd9-5c86-4c91-b97b-7a65f139dfdf tempest-ServerActionsTestOtherA-1078392334 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:55:52 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [req-37f20598-ec80-4487-b9bd-180812e2e426 req-b514fcd9-5c86-4c91-b97b-7a65f139dfdf tempest-ServerActionsTestOtherA-1078392334 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898': None} {{(pid=87272) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:55:52 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [req-37f20598-ec80-4487-b9bd-180812e2e426 req-b514fcd9-5c86-4c91-b97b-7a65f139dfdf tempest-ServerActionsTestOtherA-1078392334 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'] {{(pid=87272) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:55:52 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [req-37f20598-ec80-4487-b9bd-180812e2e426 req-b514fcd9-5c86-4c91-b97b-7a65f139dfdf tempest-ServerActionsTestOtherA-1078392334 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:55:52 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [req-37f20598-ec80-4487-b9bd-180812e2e426 req-b514fcd9-5c86-4c91-b97b-7a65f139dfdf tempest-ServerActionsTestOtherA-1078392334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:55:52 devstack sudo[95355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1 Nov 04 10:55:52 devstack sudo[95355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:55:52 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-953fd3c4-5cbb-474b-b4a0-1881c6e7a049 tempest-ServerActionsTestOtherA-1078392334 None] Acquiring lock "cinder-c1a96b74-c5b4-4d72-bda6-bf6b762cf5ab-delete_volume" by "delete_volume" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:55:52 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-953fd3c4-5cbb-474b-b4a0-1881c6e7a049 tempest-ServerActionsTestOtherA-1078392334 None] Lock "cinder-c1a96b74-c5b4-4d72-bda6-bf6b762cf5ab-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:55:52 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-953fd3c4-5cbb-474b-b4a0-1881c6e7a049 tempest-ServerActionsTestOtherA-1078392334 None] Acquiring lock "cinder-quobyte-c1a96b74-c5b4-4d72-bda6-bf6b762cf5ab" by "delete_volume" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:55:52 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-953fd3c4-5cbb-474b-b4a0-1881c6e7a049 tempest-ServerActionsTestOtherA-1078392334 None] Lock "cinder-quobyte-c1a96b74-c5b4-4d72-bda6-bf6b762cf5ab" acquired by "delete_volume" :: waited 0.028s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:55:52 devstack cinder-volume[87272]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ec8eb7c-ea40-4823-b359-dd144e5e64ca]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:55:52 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-953fd3c4-5cbb-474b-b4a0-1881c6e7a049 tempest-ServerActionsTestOtherA-1078392334 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-c1a96b74-c5b4-4d72-bda6-bf6b762cf5ab {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:55:52 devstack sudo[95355]: pam_unix(sudo:session): session closed for user root Nov 04 10:55:52 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [req-37f20598-ec80-4487-b9bd-180812e2e426 req-b514fcd9-5c86-4c91-b97b-7a65f139dfdf tempest-ServerActionsTestOtherA-1078392334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1" returned: 0 in 0.437s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:55:52 devstack cinder-volume[87272]: DEBUG cinder.manager [req-37f20598-ec80-4487-b9bd-180812e2e426 req-b514fcd9-5c86-4c91-b97b-7a65f139dfdf tempest-ServerActionsTestOtherA-1078392334 None] Notifying Schedulers of capabilities ... {{(pid=87272) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 10:55:52 devstack cinder-volume[87272]: INFO cinder.volume.manager [req-37f20598-ec80-4487-b9bd-180812e2e426 req-b514fcd9-5c86-4c91-b97b-7a65f139dfdf tempest-ServerActionsTestOtherA-1078392334 None] Deleted volume successfully. Nov 04 10:55:52 devstack cinder-volume[87272]: DEBUG cinder.coordination [req-37f20598-ec80-4487-b9bd-180812e2e426 req-b514fcd9-5c86-4c91-b97b-7a65f139dfdf tempest-ServerActionsTestOtherA-1078392334 None] Lock "cinder-c4579c2a-1036-4f29-a41b-8328e133426d-delete_volume" released by "delete_volume" :: held 2.002s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:55:53 devstack sudo[95358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-c1a96b74-c5b4-4d72-bda6-bf6b762cf5ab Nov 04 10:55:53 devstack sudo[95358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:55:53 devstack sudo[95358]: pam_unix(sudo:session): session closed for user root Nov 04 10:55:53 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-953fd3c4-5cbb-474b-b4a0-1881c6e7a049 tempest-ServerActionsTestOtherA-1078392334 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-c1a96b74-c5b4-4d72-bda6-bf6b762cf5ab" returned: 0 in 0.471s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:55:53 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-953fd3c4-5cbb-474b-b4a0-1881c6e7a049 tempest-ServerActionsTestOtherA-1078392334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-c1a96b74-c5b4-4d72-bda6-bf6b762cf5ab {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:55:53 devstack sudo[95363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-c1a96b74-c5b4-4d72-bda6-bf6b762cf5ab Nov 04 10:55:53 devstack sudo[95363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:55:53 devstack sudo[95363]: pam_unix(sudo:session): session closed for user root Nov 04 10:55:53 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-953fd3c4-5cbb-474b-b4a0-1881c6e7a049 tempest-ServerActionsTestOtherA-1078392334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-c1a96b74-c5b4-4d72-bda6-bf6b762cf5ab" returned: 0 in 0.308s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:55:53 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-953fd3c4-5cbb-474b-b4a0-1881c6e7a049 tempest-ServerActionsTestOtherA-1078392334 None] Lock "cinder-quobyte-c1a96b74-c5b4-4d72-bda6-bf6b762cf5ab" released by "delete_volume" :: held 0.859s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:55:53 devstack cinder-volume[87272]: DEBUG cinder.quota [None req-953fd3c4-5cbb-474b-b4a0-1881c6e7a049 tempest-ServerActionsTestOtherA-1078392334 None] Created reservations ['d55c4258-a51f-49bc-a437-dbd769650bc2', 'aa4926db-721b-4b18-95a5-4a5146979b1f', '59efd92a-2855-44ba-8e6e-a91fbdcfea07', 'df35c553-ed82-4315-80b0-b57f44362166'] {{(pid=87272) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 10:55:53 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-953fd3c4-5cbb-474b-b4a0-1881c6e7a049 tempest-ServerActionsTestOtherA-1078392334 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:55:53 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-953fd3c4-5cbb-474b-b4a0-1881c6e7a049 tempest-ServerActionsTestOtherA-1078392334 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:55:53 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-953fd3c4-5cbb-474b-b4a0-1881c6e7a049 tempest-ServerActionsTestOtherA-1078392334 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898': None} {{(pid=87272) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:55:53 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-953fd3c4-5cbb-474b-b4a0-1881c6e7a049 tempest-ServerActionsTestOtherA-1078392334 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'] {{(pid=87272) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:55:53 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-953fd3c4-5cbb-474b-b4a0-1881c6e7a049 tempest-ServerActionsTestOtherA-1078392334 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:55:53 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-953fd3c4-5cbb-474b-b4a0-1881c6e7a049 tempest-ServerActionsTestOtherA-1078392334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:55:54 devstack sudo[95366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1 Nov 04 10:55:54 devstack sudo[95366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:55:54 devstack sudo[95366]: pam_unix(sudo:session): session closed for user root Nov 04 10:55:54 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-953fd3c4-5cbb-474b-b4a0-1881c6e7a049 tempest-ServerActionsTestOtherA-1078392334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1" returned: 0 in 0.451s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:55:54 devstack cinder-volume[87272]: DEBUG cinder.manager [None req-953fd3c4-5cbb-474b-b4a0-1881c6e7a049 tempest-ServerActionsTestOtherA-1078392334 None] Notifying Schedulers of capabilities ... {{(pid=87272) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 10:55:54 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-953fd3c4-5cbb-474b-b4a0-1881c6e7a049 tempest-ServerActionsTestOtherA-1078392334 None] Deleted volume successfully. Nov 04 10:55:54 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-953fd3c4-5cbb-474b-b4a0-1881c6e7a049 tempest-ServerActionsTestOtherA-1078392334 None] Lock "cinder-c1a96b74-c5b4-4d72-bda6-bf6b762cf5ab-delete_volume" released by "delete_volume" :: held 1.779s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:55:58 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-b6f6f3e7-aa5b-44e6-8e99-f4dc50b4d423 tempest-VolumesActionsTest-1160217311 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 33.958s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:55:58 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-b6f6f3e7-aa5b-44e6-8e99-f4dc50b4d423 tempest-VolumesActionsTest-1160217311 None] Uploaded volume to glance image-id: 338f9cdc-20e4-48ec-8074-80638e7d1d71. {{(pid=87272) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Nov 04 10:55:58 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-c7813d86-c904-4e4f-a3b9-f9b9f48fea1c tempest-VolumesListAdminTestJSON-411668674 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 32.855s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:55:58 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-c7813d86-c904-4e4f-a3b9-f9b9f48fea1c tempest-VolumesListAdminTestJSON-411668674 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T09:55:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1092184902',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a2da9469-6e60-4448-81b9-46bc819ca11f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5000427fdf0c4cf6a353f1a3c37d2fce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T09:55:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T09:55:25Z,use_quota=True,user_id='27c8d5f9809c4466bb157287559ad216',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8989e4f-21e3-4f0a-9584-0d818784e883),volume_type_id=f8989e4f-21e3-4f0a-9584-0d818784e883)}" {{(pid=87272) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 04 10:55:58 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.remotefs [None req-c7813d86-c904-4e4f-a3b9-f9b9f48fea1c tempest-VolumesListAdminTestJSON-411668674 None] Creating volume a2da9469-6e60-4448-81b9-46bc819ca11f {{(pid=87272) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 10:55:58 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-c7813d86-c904-4e4f-a3b9-f9b9f48fea1c tempest-VolumesListAdminTestJSON-411668674 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:55:58 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-c7813d86-c904-4e4f-a3b9-f9b9f48fea1c tempest-VolumesListAdminTestJSON-411668674 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:55:58 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-c7813d86-c904-4e4f-a3b9-f9b9f48fea1c tempest-VolumesListAdminTestJSON-411668674 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898': None} {{(pid=87272) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:55:58 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-c7813d86-c904-4e4f-a3b9-f9b9f48fea1c tempest-VolumesListAdminTestJSON-411668674 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'] {{(pid=87272) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:55:58 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-c7813d86-c904-4e4f-a3b9-f9b9f48fea1c tempest-VolumesListAdminTestJSON-411668674 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:55:58 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-c7813d86-c904-4e4f-a3b9-f9b9f48fea1c tempest-VolumesListAdminTestJSON-411668674 None] Selected osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898 as target Quobyte volume. {{(pid=87272) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 10:55:58 devstack cinder-volume[87272]: INFO cinder.volume.drivers.remotefs [None req-c7813d86-c904-4e4f-a3b9-f9b9f48fea1c tempest-VolumesListAdminTestJSON-411668674 None] casted to osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898 Nov 04 10:55:58 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-c7813d86-c904-4e4f-a3b9-f9b9f48fea1c tempest-VolumesListAdminTestJSON-411668674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-a2da9469-6e60-4448-81b9-46bc819ca11f 1073741824 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:55:58 devstack sudo[95426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-a2da9469-6e60-4448-81b9-46bc819ca11f 1073741824 Nov 04 10:55:58 devstack sudo[95426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:55:58 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-b6f6f3e7-aa5b-44e6-8e99-f4dc50b4d423 tempest-VolumesActionsTest-1160217311 None] Copy volume to image completed successfully. Nov 04 10:55:58 devstack sudo[95426]: pam_unix(sudo:session): session closed for user root Nov 04 10:55:58 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-c7813d86-c904-4e4f-a3b9-f9b9f48fea1c tempest-VolumesListAdminTestJSON-411668674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-a2da9469-6e60-4448-81b9-46bc819ca11f 1073741824" returned: 0 in 0.470s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:55:58 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-c7813d86-c904-4e4f-a3b9-f9b9f48fea1c tempest-VolumesListAdminTestJSON-411668674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-a2da9469-6e60-4448-81b9-46bc819ca11f {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:55:58 devstack sudo[95432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-a2da9469-6e60-4448-81b9-46bc819ca11f Nov 04 10:55:58 devstack sudo[95432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:55:59 devstack sudo[95432]: pam_unix(sudo:session): session closed for user root Nov 04 10:55:59 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-c7813d86-c904-4e4f-a3b9-f9b9f48fea1c tempest-VolumesListAdminTestJSON-411668674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-a2da9469-6e60-4448-81b9-46bc819ca11f" returned: 0 in 0.303s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:55:59 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-c7813d86-c904-4e4f-a3b9-f9b9f48fea1c tempest-VolumesListAdminTestJSON-411668674 None] <== create_volume: return (812ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'} {{(pid=87272) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 04 10:55:59 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-c7813d86-c904-4e4f-a3b9-f9b9f48fea1c tempest-VolumesListAdminTestJSON-411668674 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.816s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:55:59 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-c7813d86-c904-4e4f-a3b9-f9b9f48fea1c tempest-VolumesListAdminTestJSON-411668674 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2e4e98f-64ee-447f-9049-b12b432da9ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a2da9469-6e60-4448-81b9-46bc819ca11f', 'volume_size': 1}' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:55:59 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-c7813d86-c904-4e4f-a3b9-f9b9f48fea1c tempest-VolumesListAdminTestJSON-411668674 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f5db135b-9de3-4d53-90fc-64d0d2c0d098) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:55:59 devstack cinder-volume[87272]: INFO cinder.volume.flows.manager.create_volume [None req-c7813d86-c904-4e4f-a3b9-f9b9f48fea1c tempest-VolumesListAdminTestJSON-411668674 None] Volume volume-a2da9469-6e60-4448-81b9-46bc819ca11f (a2da9469-6e60-4448-81b9-46bc819ca11f): created successfully Nov 04 10:55:59 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-c7813d86-c904-4e4f-a3b9-f9b9f48fea1c tempest-VolumesListAdminTestJSON-411668674 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f5db135b-9de3-4d53-90fc-64d0d2c0d098) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:55:59 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-c7813d86-c904-4e4f-a3b9-f9b9f48fea1c tempest-VolumesListAdminTestJSON-411668674 None] Flow 'volume_create_manager' (aa60c5f7-10fa-412e-a372-0aa60f6f51f4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87272) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:55:59 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-c7813d86-c904-4e4f-a3b9-f9b9f48fea1c tempest-VolumesListAdminTestJSON-411668674 None] Created volume successfully. Nov 04 10:56:00 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-c032d5cc-1691-4be8-b96b-7f8a3f77bc7a tempest-VolumesActionsTest-1160217311 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:56:00 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-c032d5cc-1691-4be8-b96b-7f8a3f77bc7a tempest-VolumesActionsTest-1160217311 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:56:00 devstack cinder-volume[87272]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bb5586c-adf7-4bb5-88e1-fec542d752de]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:56:00 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-c032d5cc-1691-4be8-b96b-7f8a3f77bc7a tempest-VolumesActionsTest-1160217311 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-dc7ccdf9-146f-41fb-95a9-5c2468931770 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:56:00 devstack sudo[95436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-dc7ccdf9-146f-41fb-95a9-5c2468931770 Nov 04 10:56:00 devstack sudo[95436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:56:00 devstack cinder-volume[87272]: DEBUG cinder.volume.flows.manager.create_volume [None req-e0725b3d-ab80-4462-b238-8e4f1ba20a43 tempest-VolumesListAdminTestJSON-2024881125 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87272) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 10:56:00 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-e0725b3d-ab80-4462-b238-8e4f1ba20a43 tempest-VolumesListAdminTestJSON-2024881125 None] Flow 'volume_create_manager' (aa131ad4-1660-457c-959e-f4944ce541e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:56:00 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-e0725b3d-ab80-4462-b238-8e4f1ba20a43 tempest-VolumesListAdminTestJSON-2024881125 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9173f14-1dba-43f9-8425-85dc2585cd2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:56:00 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-e0725b3d-ab80-4462-b238-8e4f1ba20a43 tempest-VolumesListAdminTestJSON-2024881125 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9173f14-1dba-43f9-8425-85dc2585cd2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T09:56:00Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8ccaf32a-8148-4f0f-a79f-55cdd2fa11d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='36c1765198f84f86963ce84c429e08ef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T09:56:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T09:56:00Z,use_quota=True,user_id='5a888bbeb15647bb9aada261dc6cc6f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8989e4f-21e3-4f0a-9584-0d818784e883),volume_type_id=f8989e4f-21e3-4f0a-9584-0d818784e883)' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:56:00 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-e0725b3d-ab80-4462-b238-8e4f1ba20a43 tempest-VolumesListAdminTestJSON-2024881125 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0411d53-ed71-4111-8aa6-23237a9b26c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:56:00 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-e0725b3d-ab80-4462-b238-8e4f1ba20a43 tempest-VolumesListAdminTestJSON-2024881125 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0411d53-ed71-4111-8aa6-23237a9b26c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:56:00 devstack sudo[95436]: pam_unix(sudo:session): session closed for user root Nov 04 10:56:00 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-e0725b3d-ab80-4462-b238-8e4f1ba20a43 tempest-VolumesListAdminTestJSON-2024881125 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2097b7ea-ceeb-4f65-bc02-a1ce8ce9b8ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:56:00 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-e0725b3d-ab80-4462-b238-8e4f1ba20a43 tempest-VolumesListAdminTestJSON-2024881125 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2097b7ea-ceeb-4f65-bc02-a1ce8ce9b8ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8ccaf32a-8148-4f0f-a79f-55cdd2fa11d5', 'volume_name': 'volume-8ccaf32a-8148-4f0f-a79f-55cdd2fa11d5', 'volume_size': 1}' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:56:00 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-e0725b3d-ab80-4462-b238-8e4f1ba20a43 tempest-VolumesListAdminTestJSON-2024881125 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (269ada8a-3cca-439b-b165-097acd612d58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:56:00 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-e0725b3d-ab80-4462-b238-8e4f1ba20a43 tempest-VolumesListAdminTestJSON-2024881125 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (269ada8a-3cca-439b-b165-097acd612d58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:56:00 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-e0725b3d-ab80-4462-b238-8e4f1ba20a43 tempest-VolumesListAdminTestJSON-2024881125 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f4ae877-ca81-4f68-bb3e-b00bfbf6d1f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:56:00 devstack cinder-volume[87272]: INFO cinder.volume.flows.manager.create_volume [None req-e0725b3d-ab80-4462-b238-8e4f1ba20a43 tempest-VolumesListAdminTestJSON-2024881125 None] Volume 8ccaf32a-8148-4f0f-a79f-55cdd2fa11d5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8ccaf32a-8148-4f0f-a79f-55cdd2fa11d5', 'volume_size': 1} Nov 04 10:56:00 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-e0725b3d-ab80-4462-b238-8e4f1ba20a43 tempest-VolumesListAdminTestJSON-2024881125 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:56:00 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-c032d5cc-1691-4be8-b96b-7f8a3f77bc7a tempest-VolumesActionsTest-1160217311 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-dc7ccdf9-146f-41fb-95a9-5c2468931770" returned: 0 in 0.447s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:56:00 devstack cinder-volume[87272]: DEBUG oslo.privsep.daemon [-] privsep: reply[008c70ad-6c9e-4cf2-a9c3-e5d589600538]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:56:00 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-c032d5cc-1691-4be8-b96b-7f8a3f77bc7a tempest-VolumesActionsTest-1160217311 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-dc7ccdf9-146f-41fb-95a9-5c2468931770 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:56:00 devstack sudo[95441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-dc7ccdf9-146f-41fb-95a9-5c2468931770 Nov 04 10:56:00 devstack sudo[95441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:56:00 devstack sudo[95441]: pam_unix(sudo:session): session closed for user root Nov 04 10:56:00 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-c032d5cc-1691-4be8-b96b-7f8a3f77bc7a tempest-VolumesActionsTest-1160217311 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-dc7ccdf9-146f-41fb-95a9-5c2468931770" returned: 0 in 0.385s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:56:00 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-c032d5cc-1691-4be8-b96b-7f8a3f77bc7a tempest-VolumesActionsTest-1160217311 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-dc7ccdf9-146f-41fb-95a9-5c2468931770 /opt/stack/data/cinder/conversion/dc7ccdf9-146f-41fb-95a9-5c2468931770.temp_image.0d0aa152-97cc-4a54-9e72-48a4418e58cfkyuzl145.img {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:56:00 devstack sudo[95446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-dc7ccdf9-146f-41fb-95a9-5c2468931770 /opt/stack/data/cinder/conversion/dc7ccdf9-146f-41fb-95a9-5c2468931770.temp_image.0d0aa152-97cc-4a54-9e72-48a4418e58cfkyuzl145.img Nov 04 10:56:00 devstack sudo[95446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:56:05 devstack cinder-volume[87272]: DEBUG cinder.volume.flows.manager.create_volume [None req-1e56e4d0-bffd-4ca8-affa-bf5c266bb4c9 tempest-AttachVolumeNegativeTest-154668454 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87272) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 10:56:05 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-1e56e4d0-bffd-4ca8-affa-bf5c266bb4c9 tempest-AttachVolumeNegativeTest-154668454 None] Flow 'volume_create_manager' (c10365b2-263b-4f87-b4f4-55c1455233de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:56:05 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-1e56e4d0-bffd-4ca8-affa-bf5c266bb4c9 tempest-AttachVolumeNegativeTest-154668454 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5775f82e-2622-48f3-b3b2-b3042676f775) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:56:05 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-1e56e4d0-bffd-4ca8-affa-bf5c266bb4c9 tempest-AttachVolumeNegativeTest-154668454 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5775f82e-2622-48f3-b3b2-b3042676f775) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T09:56:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1097277986',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=559bee77-22be-4645-924a-98586a89705b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b4c692d677a4424ca4fe4fe85525eaa8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T09:56:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T09:56:05Z,use_quota=True,user_id='d0e11232f87d4caf9032a8c076e36fc8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8989e4f-21e3-4f0a-9584-0d818784e883),volume_type_id=f8989e4f-21e3-4f0a-9584-0d818784e883)' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:56:05 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-1e56e4d0-bffd-4ca8-affa-bf5c266bb4c9 tempest-AttachVolumeNegativeTest-154668454 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6dbe22fa-5c0f-42cf-94ab-f38cf5662022) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:56:05 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-1e56e4d0-bffd-4ca8-affa-bf5c266bb4c9 tempest-AttachVolumeNegativeTest-154668454 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6dbe22fa-5c0f-42cf-94ab-f38cf5662022) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:56:05 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-1e56e4d0-bffd-4ca8-affa-bf5c266bb4c9 tempest-AttachVolumeNegativeTest-154668454 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (433bc946-f562-4fe2-9953-c01c524753c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:56:05 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-1e56e4d0-bffd-4ca8-affa-bf5c266bb4c9 tempest-AttachVolumeNegativeTest-154668454 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (433bc946-f562-4fe2-9953-c01c524753c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '559bee77-22be-4645-924a-98586a89705b', 'volume_name': 'volume-559bee77-22be-4645-924a-98586a89705b', 'volume_size': 1}' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:56:05 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-1e56e4d0-bffd-4ca8-affa-bf5c266bb4c9 tempest-AttachVolumeNegativeTest-154668454 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4c1815d-f46d-405c-a7f7-af5fae190681) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:56:05 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-1e56e4d0-bffd-4ca8-affa-bf5c266bb4c9 tempest-AttachVolumeNegativeTest-154668454 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4c1815d-f46d-405c-a7f7-af5fae190681) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:56:05 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-1e56e4d0-bffd-4ca8-affa-bf5c266bb4c9 tempest-AttachVolumeNegativeTest-154668454 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b64c7aba-df08-408e-88a0-c6f842f4b5ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:56:05 devstack cinder-volume[87272]: INFO cinder.volume.flows.manager.create_volume [None req-1e56e4d0-bffd-4ca8-affa-bf5c266bb4c9 tempest-AttachVolumeNegativeTest-154668454 None] Volume 559bee77-22be-4645-924a-98586a89705b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-559bee77-22be-4645-924a-98586a89705b', 'volume_size': 1} Nov 04 10:56:05 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-1e56e4d0-bffd-4ca8-affa-bf5c266bb4c9 tempest-AttachVolumeNegativeTest-154668454 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:56:08 devstack sudo[95446]: pam_unix(sudo:session): session closed for user root Nov 04 10:56:08 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-c032d5cc-1691-4be8-b96b-7f8a3f77bc7a tempest-VolumesActionsTest-1160217311 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-dc7ccdf9-146f-41fb-95a9-5c2468931770 /opt/stack/data/cinder/conversion/dc7ccdf9-146f-41fb-95a9-5c2468931770.temp_image.0d0aa152-97cc-4a54-9e72-48a4418e58cfkyuzl145.img" returned: 0 in 7.467s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:56:08 devstack cinder-volume[87272]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0e1f96d-016d-49b3-b7eb-20e1a5afe5a7]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:56:08 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-c032d5cc-1691-4be8-b96b-7f8a3f77bc7a tempest-VolumesActionsTest-1160217311 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-dc7ccdf9-146f-41fb-95a9-5c2468931770 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:56:08 devstack sudo[95464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-dc7ccdf9-146f-41fb-95a9-5c2468931770 Nov 04 10:56:08 devstack sudo[95464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:56:08 devstack sudo[95464]: pam_unix(sudo:session): session closed for user root Nov 04 10:56:08 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-c032d5cc-1691-4be8-b96b-7f8a3f77bc7a tempest-VolumesActionsTest-1160217311 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-dc7ccdf9-146f-41fb-95a9-5c2468931770" returned: 0 in 0.540s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:56:08 devstack cinder-volume[87272]: DEBUG cinder.image.image_utils [None req-c032d5cc-1691-4be8-b96b-7f8a3f77bc7a tempest-VolumesActionsTest-1160217311 None] Image conversion details: src /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-dc7ccdf9-146f-41fb-95a9-5c2468931770, size 1024.00 MB, duration 7.47 sec, destination /opt/stack/data/cinder/conversion/dc7ccdf9-146f-41fb-95a9-5c2468931770.temp_image.0d0aa152-97cc-4a54-9e72-48a4418e58cfkyuzl145.img {{(pid=87272) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Nov 04 10:56:08 devstack cinder-volume[87272]: INFO cinder.image.image_utils [None req-c032d5cc-1691-4be8-b96b-7f8a3f77bc7a tempest-VolumesActionsTest-1160217311 None] Converted 1024.00 MB image at 137.12 MB/s Nov 04 10:56:08 devstack cinder-volume[87272]: DEBUG cinder.image.image_utils [None req-c032d5cc-1691-4be8-b96b-7f8a3f77bc7a tempest-VolumesActionsTest-1160217311 None] 0d0aa152-97cc-4a54-9e72-48a4418e58cf was raw, converting to qcow2 {{(pid=87272) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1179}} Nov 04 10:56:08 devstack cinder-volume[87272]: DEBUG oslo.privsep.daemon [-] privsep: reply[95495dc0-088e-4df2-a9ab-674058a1360d]: (4, 'raw') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:56:08 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-c032d5cc-1691-4be8-b96b-7f8a3f77bc7a tempest-VolumesActionsTest-1160217311 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/dc7ccdf9-146f-41fb-95a9-5c2468931770.temp_image.0d0aa152-97cc-4a54-9e72-48a4418e58cfkyuzl145.img {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:56:09 devstack sudo[95469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/dc7ccdf9-146f-41fb-95a9-5c2468931770.temp_image.0d0aa152-97cc-4a54-9e72-48a4418e58cfkyuzl145.img Nov 04 10:56:09 devstack sudo[95469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:56:09 devstack sudo[95469]: pam_unix(sudo:session): session closed for user root Nov 04 10:56:09 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-c032d5cc-1691-4be8-b96b-7f8a3f77bc7a tempest-VolumesActionsTest-1160217311 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/dc7ccdf9-146f-41fb-95a9-5c2468931770.temp_image.0d0aa152-97cc-4a54-9e72-48a4418e58cfkyuzl145.img" returned: 0 in 0.345s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:56:09 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-c032d5cc-1691-4be8-b96b-7f8a3f77bc7a tempest-VolumesActionsTest-1160217311 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/dc7ccdf9-146f-41fb-95a9-5c2468931770.temp_image.0d0aa152-97cc-4a54-9e72-48a4418e58cfkyuzl145.img {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:56:09 devstack sudo[95473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/dc7ccdf9-146f-41fb-95a9-5c2468931770.temp_image.0d0aa152-97cc-4a54-9e72-48a4418e58cfkyuzl145.img Nov 04 10:56:09 devstack sudo[95473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:56:09 devstack sudo[95473]: pam_unix(sudo:session): session closed for user root Nov 04 10:56:09 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-c032d5cc-1691-4be8-b96b-7f8a3f77bc7a tempest-VolumesActionsTest-1160217311 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/dc7ccdf9-146f-41fb-95a9-5c2468931770.temp_image.0d0aa152-97cc-4a54-9e72-48a4418e58cfkyuzl145.img" returned: 1 in 0.365s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:56:09 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-c032d5cc-1691-4be8-b96b-7f8a3f77bc7a tempest-VolumesActionsTest-1160217311 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/dc7ccdf9-146f-41fb-95a9-5c2468931770.temp_image.0d0aa152-97cc-4a54-9e72-48a4418e58cfkyuzl145.img' failed. Not Retrying. {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 04 10:56:09 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-c032d5cc-1691-4be8-b96b-7f8a3f77bc7a tempest-VolumesActionsTest-1160217311 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/dc7ccdf9-146f-41fb-95a9-5c2468931770.temp_image.0d0aa152-97cc-4a54-9e72-48a4418e58cfkyuzl145.img /opt/stack/data/cinder/conversion/vol_upload_jhp899iw {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:56:09 devstack sudo[95478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/dc7ccdf9-146f-41fb-95a9-5c2468931770.temp_image.0d0aa152-97cc-4a54-9e72-48a4418e58cfkyuzl145.img /opt/stack/data/cinder/conversion/vol_upload_jhp899iw Nov 04 10:56:09 devstack sudo[95478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:56:09 devstack sudo[95478]: pam_unix(sudo:session): session closed for user root Nov 04 10:56:09 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-c032d5cc-1691-4be8-b96b-7f8a3f77bc7a tempest-VolumesActionsTest-1160217311 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/dc7ccdf9-146f-41fb-95a9-5c2468931770.temp_image.0d0aa152-97cc-4a54-9e72-48a4418e58cfkyuzl145.img /opt/stack/data/cinder/conversion/vol_upload_jhp899iw" returned: 0 in 0.281s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:56:09 devstack cinder-volume[87272]: DEBUG cinder.image.image_utils [None req-c032d5cc-1691-4be8-b96b-7f8a3f77bc7a tempest-VolumesActionsTest-1160217311 None] Image conversion details: src /opt/stack/data/cinder/conversion/dc7ccdf9-146f-41fb-95a9-5c2468931770.temp_image.0d0aa152-97cc-4a54-9e72-48a4418e58cfkyuzl145.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_jhp899iw {{(pid=87272) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Nov 04 10:56:09 devstack cinder-volume[87272]: INFO cinder.image.image_utils [None req-c032d5cc-1691-4be8-b96b-7f8a3f77bc7a tempest-VolumesActionsTest-1160217311 None] Converted 1024.00 MB image at 1024.00 MB/s Nov 04 10:56:09 devstack cinder-volume[87272]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bc16d9c-bf63-43f7-84f4-80bed486d133]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:56:09 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-c032d5cc-1691-4be8-b96b-7f8a3f77bc7a tempest-VolumesActionsTest-1160217311 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_jhp899iw {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:56:10 devstack sudo[95483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_jhp899iw Nov 04 10:56:10 devstack sudo[95483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:56:10 devstack sudo[95483]: pam_unix(sudo:session): session closed for user root Nov 04 10:56:10 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-c032d5cc-1691-4be8-b96b-7f8a3f77bc7a tempest-VolumesActionsTest-1160217311 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_jhp899iw" returned: 0 in 0.318s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:56:11 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-c032d5cc-1691-4be8-b96b-7f8a3f77bc7a tempest-VolumesActionsTest-1160217311 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 11.758s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:56:11 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-c032d5cc-1691-4be8-b96b-7f8a3f77bc7a tempest-VolumesActionsTest-1160217311 None] Uploaded volume to glance image-id: 0d0aa152-97cc-4a54-9e72-48a4418e58cf. {{(pid=87272) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Nov 04 10:56:11 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-e0725b3d-ab80-4462-b238-8e4f1ba20a43 tempest-VolumesListAdminTestJSON-2024881125 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.292s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:56:11 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-e0725b3d-ab80-4462-b238-8e4f1ba20a43 tempest-VolumesListAdminTestJSON-2024881125 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T09:56:00Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8ccaf32a-8148-4f0f-a79f-55cdd2fa11d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='36c1765198f84f86963ce84c429e08ef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T09:56:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T09:56:00Z,use_quota=True,user_id='5a888bbeb15647bb9aada261dc6cc6f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8989e4f-21e3-4f0a-9584-0d818784e883),volume_type_id=f8989e4f-21e3-4f0a-9584-0d818784e883)}" {{(pid=87272) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 04 10:56:11 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.remotefs [None req-e0725b3d-ab80-4462-b238-8e4f1ba20a43 tempest-VolumesListAdminTestJSON-2024881125 None] Creating volume 8ccaf32a-8148-4f0f-a79f-55cdd2fa11d5 {{(pid=87272) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 10:56:11 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-e0725b3d-ab80-4462-b238-8e4f1ba20a43 tempest-VolumesListAdminTestJSON-2024881125 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:56:11 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-e0725b3d-ab80-4462-b238-8e4f1ba20a43 tempest-VolumesListAdminTestJSON-2024881125 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:56:11 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-e0725b3d-ab80-4462-b238-8e4f1ba20a43 tempest-VolumesListAdminTestJSON-2024881125 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898': None} {{(pid=87272) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:56:11 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-e0725b3d-ab80-4462-b238-8e4f1ba20a43 tempest-VolumesListAdminTestJSON-2024881125 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'] {{(pid=87272) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:56:11 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-e0725b3d-ab80-4462-b238-8e4f1ba20a43 tempest-VolumesListAdminTestJSON-2024881125 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:56:11 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-e0725b3d-ab80-4462-b238-8e4f1ba20a43 tempest-VolumesListAdminTestJSON-2024881125 None] Selected osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898 as target Quobyte volume. {{(pid=87272) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 10:56:11 devstack cinder-volume[87272]: INFO cinder.volume.drivers.remotefs [None req-e0725b3d-ab80-4462-b238-8e4f1ba20a43 tempest-VolumesListAdminTestJSON-2024881125 None] casted to osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898 Nov 04 10:56:11 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-e0725b3d-ab80-4462-b238-8e4f1ba20a43 tempest-VolumesListAdminTestJSON-2024881125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-8ccaf32a-8148-4f0f-a79f-55cdd2fa11d5 1073741824 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:56:11 devstack sudo[95488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-8ccaf32a-8148-4f0f-a79f-55cdd2fa11d5 1073741824 Nov 04 10:56:11 devstack sudo[95488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:56:11 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-c032d5cc-1691-4be8-b96b-7f8a3f77bc7a tempest-VolumesActionsTest-1160217311 None] Copy volume to image completed successfully. Nov 04 10:56:12 devstack sudo[95488]: pam_unix(sudo:session): session closed for user root Nov 04 10:56:12 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-e0725b3d-ab80-4462-b238-8e4f1ba20a43 tempest-VolumesListAdminTestJSON-2024881125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-8ccaf32a-8148-4f0f-a79f-55cdd2fa11d5 1073741824" returned: 0 in 0.448s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:56:12 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-e0725b3d-ab80-4462-b238-8e4f1ba20a43 tempest-VolumesListAdminTestJSON-2024881125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-8ccaf32a-8148-4f0f-a79f-55cdd2fa11d5 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:56:12 devstack sudo[95493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-8ccaf32a-8148-4f0f-a79f-55cdd2fa11d5 Nov 04 10:56:12 devstack sudo[95493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:56:12 devstack sudo[95493]: pam_unix(sudo:session): session closed for user root Nov 04 10:56:12 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-e0725b3d-ab80-4462-b238-8e4f1ba20a43 tempest-VolumesListAdminTestJSON-2024881125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-8ccaf32a-8148-4f0f-a79f-55cdd2fa11d5" returned: 0 in 0.243s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:56:12 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-e0725b3d-ab80-4462-b238-8e4f1ba20a43 tempest-VolumesListAdminTestJSON-2024881125 None] <== create_volume: return (734ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'} {{(pid=87272) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 04 10:56:12 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-e0725b3d-ab80-4462-b238-8e4f1ba20a43 tempest-VolumesListAdminTestJSON-2024881125 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.736s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:56:12 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-1e56e4d0-bffd-4ca8-affa-bf5c266bb4c9 tempest-AttachVolumeNegativeTest-154668454 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.875s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:56:12 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-1e56e4d0-bffd-4ca8-affa-bf5c266bb4c9 tempest-AttachVolumeNegativeTest-154668454 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T09:56:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1097277986',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=559bee77-22be-4645-924a-98586a89705b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b4c692d677a4424ca4fe4fe85525eaa8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T09:56:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T09:56:05Z,use_quota=True,user_id='d0e11232f87d4caf9032a8c076e36fc8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8989e4f-21e3-4f0a-9584-0d818784e883),volume_type_id=f8989e4f-21e3-4f0a-9584-0d818784e883)}" {{(pid=87272) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 04 10:56:12 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.remotefs [None req-1e56e4d0-bffd-4ca8-affa-bf5c266bb4c9 tempest-AttachVolumeNegativeTest-154668454 None] Creating volume 559bee77-22be-4645-924a-98586a89705b {{(pid=87272) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 10:56:12 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-1e56e4d0-bffd-4ca8-affa-bf5c266bb4c9 tempest-AttachVolumeNegativeTest-154668454 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:56:12 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-1e56e4d0-bffd-4ca8-affa-bf5c266bb4c9 tempest-AttachVolumeNegativeTest-154668454 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:56:12 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-1e56e4d0-bffd-4ca8-affa-bf5c266bb4c9 tempest-AttachVolumeNegativeTest-154668454 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898': None} {{(pid=87272) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:56:12 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-1e56e4d0-bffd-4ca8-affa-bf5c266bb4c9 tempest-AttachVolumeNegativeTest-154668454 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'] {{(pid=87272) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:56:12 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-1e56e4d0-bffd-4ca8-affa-bf5c266bb4c9 tempest-AttachVolumeNegativeTest-154668454 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:56:12 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-1e56e4d0-bffd-4ca8-affa-bf5c266bb4c9 tempest-AttachVolumeNegativeTest-154668454 None] Selected osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898 as target Quobyte volume. {{(pid=87272) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 10:56:12 devstack cinder-volume[87272]: INFO cinder.volume.drivers.remotefs [None req-1e56e4d0-bffd-4ca8-affa-bf5c266bb4c9 tempest-AttachVolumeNegativeTest-154668454 None] casted to osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898 Nov 04 10:56:12 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-1e56e4d0-bffd-4ca8-affa-bf5c266bb4c9 tempest-AttachVolumeNegativeTest-154668454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-559bee77-22be-4645-924a-98586a89705b 1073741824 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:56:12 devstack sudo[95496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-559bee77-22be-4645-924a-98586a89705b 1073741824 Nov 04 10:56:12 devstack sudo[95496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:56:12 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-e0725b3d-ab80-4462-b238-8e4f1ba20a43 tempest-VolumesListAdminTestJSON-2024881125 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f4ae877-ca81-4f68-bb3e-b00bfbf6d1f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8ccaf32a-8148-4f0f-a79f-55cdd2fa11d5', 'volume_size': 1}' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:56:12 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-e0725b3d-ab80-4462-b238-8e4f1ba20a43 tempest-VolumesListAdminTestJSON-2024881125 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (704bf8a8-5905-479f-b6e5-085916fb7b68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:56:12 devstack cinder-volume[87272]: INFO cinder.volume.flows.manager.create_volume [None req-e0725b3d-ab80-4462-b238-8e4f1ba20a43 tempest-VolumesListAdminTestJSON-2024881125 None] Volume volume-8ccaf32a-8148-4f0f-a79f-55cdd2fa11d5 (8ccaf32a-8148-4f0f-a79f-55cdd2fa11d5): created successfully Nov 04 10:56:12 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-e0725b3d-ab80-4462-b238-8e4f1ba20a43 tempest-VolumesListAdminTestJSON-2024881125 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (704bf8a8-5905-479f-b6e5-085916fb7b68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:56:12 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-e0725b3d-ab80-4462-b238-8e4f1ba20a43 tempest-VolumesListAdminTestJSON-2024881125 None] Flow 'volume_create_manager' (aa131ad4-1660-457c-959e-f4944ce541e3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87272) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:56:12 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-e0725b3d-ab80-4462-b238-8e4f1ba20a43 tempest-VolumesListAdminTestJSON-2024881125 None] Created volume successfully. Nov 04 10:56:13 devstack sudo[95496]: pam_unix(sudo:session): session closed for user root Nov 04 10:56:13 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-1e56e4d0-bffd-4ca8-affa-bf5c266bb4c9 tempest-AttachVolumeNegativeTest-154668454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-559bee77-22be-4645-924a-98586a89705b 1073741824" returned: 0 in 0.631s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:56:13 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-1e56e4d0-bffd-4ca8-affa-bf5c266bb4c9 tempest-AttachVolumeNegativeTest-154668454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-559bee77-22be-4645-924a-98586a89705b {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:56:13 devstack sudo[95502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-559bee77-22be-4645-924a-98586a89705b Nov 04 10:56:13 devstack sudo[95502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:56:13 devstack sudo[95502]: pam_unix(sudo:session): session closed for user root Nov 04 10:56:13 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-1e56e4d0-bffd-4ca8-affa-bf5c266bb4c9 tempest-AttachVolumeNegativeTest-154668454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-559bee77-22be-4645-924a-98586a89705b" returned: 0 in 0.348s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:56:13 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-1e56e4d0-bffd-4ca8-affa-bf5c266bb4c9 tempest-AttachVolumeNegativeTest-154668454 None] <== create_volume: return (1054ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'} {{(pid=87272) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 04 10:56:13 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-1e56e4d0-bffd-4ca8-affa-bf5c266bb4c9 tempest-AttachVolumeNegativeTest-154668454 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.057s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:56:13 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-99278be9-0936-4540-828f-51415d0813ad tempest-VolumesListAdminTestJSON-2024881125 None] Acquiring lock "cinder-8ccaf32a-8148-4f0f-a79f-55cdd2fa11d5-delete_volume" by "delete_volume" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:56:13 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-1e56e4d0-bffd-4ca8-affa-bf5c266bb4c9 tempest-AttachVolumeNegativeTest-154668454 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b64c7aba-df08-408e-88a0-c6f842f4b5ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-559bee77-22be-4645-924a-98586a89705b', 'volume_size': 1}' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:56:13 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-1e56e4d0-bffd-4ca8-affa-bf5c266bb4c9 tempest-AttachVolumeNegativeTest-154668454 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (261ebb95-a639-4a80-92e3-120e4b492483) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:56:13 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-99278be9-0936-4540-828f-51415d0813ad tempest-VolumesListAdminTestJSON-2024881125 None] Lock "cinder-8ccaf32a-8148-4f0f-a79f-55cdd2fa11d5-delete_volume" acquired by "delete_volume" :: waited 0.058s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:56:13 devstack cinder-volume[87272]: INFO cinder.volume.flows.manager.create_volume [None req-1e56e4d0-bffd-4ca8-affa-bf5c266bb4c9 tempest-AttachVolumeNegativeTest-154668454 None] Volume volume-559bee77-22be-4645-924a-98586a89705b (559bee77-22be-4645-924a-98586a89705b): created successfully Nov 04 10:56:13 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-1e56e4d0-bffd-4ca8-affa-bf5c266bb4c9 tempest-AttachVolumeNegativeTest-154668454 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (261ebb95-a639-4a80-92e3-120e4b492483) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:56:13 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-1e56e4d0-bffd-4ca8-affa-bf5c266bb4c9 tempest-AttachVolumeNegativeTest-154668454 None] Flow 'volume_create_manager' (c10365b2-263b-4f87-b4f4-55c1455233de) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87272) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:56:13 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-1e56e4d0-bffd-4ca8-affa-bf5c266bb4c9 tempest-AttachVolumeNegativeTest-154668454 None] Created volume successfully. Nov 04 10:56:13 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-99278be9-0936-4540-828f-51415d0813ad tempest-VolumesListAdminTestJSON-2024881125 None] Acquiring lock "cinder-quobyte-8ccaf32a-8148-4f0f-a79f-55cdd2fa11d5" by "delete_volume" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:56:13 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-99278be9-0936-4540-828f-51415d0813ad tempest-VolumesListAdminTestJSON-2024881125 None] Lock "cinder-quobyte-8ccaf32a-8148-4f0f-a79f-55cdd2fa11d5" acquired by "delete_volume" :: waited 0.024s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:56:13 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-88dd60d0-3ecd-4364-a819-a74b7ab1a628 tempest-VolumesActionsTest-1160217311 None] Acquiring lock "cinder-dc7ccdf9-146f-41fb-95a9-5c2468931770-delete_volume" by "delete_volume" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:56:13 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-5b58957e-3ae3-4ed5-885f-d58d383de09f tempest-VolumesListAdminTestJSON-411668674 None] Acquiring lock "cinder-a2da9469-6e60-4448-81b9-46bc819ca11f-delete_volume" by "delete_volume" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:56:13 devstack cinder-volume[87272]: DEBUG oslo.privsep.daemon [-] privsep: reply[911d277c-252a-4864-904b-2daf8fecc6ac]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:56:13 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-99278be9-0936-4540-828f-51415d0813ad tempest-VolumesListAdminTestJSON-2024881125 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-8ccaf32a-8148-4f0f-a79f-55cdd2fa11d5 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:56:13 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-5b58957e-3ae3-4ed5-885f-d58d383de09f tempest-VolumesListAdminTestJSON-411668674 None] Lock "cinder-a2da9469-6e60-4448-81b9-46bc819ca11f-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:56:13 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-88dd60d0-3ecd-4364-a819-a74b7ab1a628 tempest-VolumesActionsTest-1160217311 None] Lock "cinder-dc7ccdf9-146f-41fb-95a9-5c2468931770-delete_volume" acquired by "delete_volume" :: waited 0.067s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:56:13 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-5b58957e-3ae3-4ed5-885f-d58d383de09f tempest-VolumesListAdminTestJSON-411668674 None] Acquiring lock "cinder-quobyte-a2da9469-6e60-4448-81b9-46bc819ca11f" by "delete_volume" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:56:13 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-88dd60d0-3ecd-4364-a819-a74b7ab1a628 tempest-VolumesActionsTest-1160217311 None] Acquiring lock "cinder-quobyte-dc7ccdf9-146f-41fb-95a9-5c2468931770" by "delete_volume" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:56:13 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-5b58957e-3ae3-4ed5-885f-d58d383de09f tempest-VolumesListAdminTestJSON-411668674 None] Lock "cinder-quobyte-a2da9469-6e60-4448-81b9-46bc819ca11f" acquired by "delete_volume" :: waited 0.031s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:56:13 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-88dd60d0-3ecd-4364-a819-a74b7ab1a628 tempest-VolumesActionsTest-1160217311 None] Lock "cinder-quobyte-dc7ccdf9-146f-41fb-95a9-5c2468931770" acquired by "delete_volume" :: waited 0.041s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:56:14 devstack cinder-volume[87272]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce653511-75e0-47db-8b06-0575fd0e1811]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:56:14 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-5b58957e-3ae3-4ed5-885f-d58d383de09f tempest-VolumesListAdminTestJSON-411668674 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-a2da9469-6e60-4448-81b9-46bc819ca11f {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:56:14 devstack sudo[95505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-8ccaf32a-8148-4f0f-a79f-55cdd2fa11d5 Nov 04 10:56:14 devstack sudo[95505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:56:14 devstack cinder-volume[87272]: DEBUG oslo.privsep.daemon [-] privsep: reply[4356408c-2812-4c82-90c0-62c057a483ab]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:56:14 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-88dd60d0-3ecd-4364-a819-a74b7ab1a628 tempest-VolumesActionsTest-1160217311 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-dc7ccdf9-146f-41fb-95a9-5c2468931770 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:56:14 devstack cinder-volume[87272]: DEBUG oslo_service.periodic_task [None req-236af0be-7f9d-4c80-b3d7-d645a9cd0dd1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87272) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 04 10:56:14 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-236af0be-7f9d-4c80-b3d7-d645a9cd0dd1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:56:14 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-236af0be-7f9d-4c80-b3d7-d645a9cd0dd1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:56:14 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-236af0be-7f9d-4c80-b3d7-d645a9cd0dd1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898': None} {{(pid=87272) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:56:14 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-236af0be-7f9d-4c80-b3d7-d645a9cd0dd1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'] {{(pid=87272) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:56:14 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-236af0be-7f9d-4c80-b3d7-d645a9cd0dd1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:56:14 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-236af0be-7f9d-4c80-b3d7-d645a9cd0dd1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:56:14 devstack sudo[95511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1 Nov 04 10:56:14 devstack sudo[95511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:56:14 devstack sudo[95506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-a2da9469-6e60-4448-81b9-46bc819ca11f Nov 04 10:56:14 devstack sudo[95506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:56:14 devstack sudo[95508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-dc7ccdf9-146f-41fb-95a9-5c2468931770 Nov 04 10:56:14 devstack sudo[95508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:56:14 devstack sudo[95505]: pam_unix(sudo:session): session closed for user root Nov 04 10:56:14 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-99278be9-0936-4540-828f-51415d0813ad tempest-VolumesListAdminTestJSON-2024881125 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-8ccaf32a-8148-4f0f-a79f-55cdd2fa11d5" returned: 0 in 0.578s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:56:14 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-99278be9-0936-4540-828f-51415d0813ad tempest-VolumesListAdminTestJSON-2024881125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-8ccaf32a-8148-4f0f-a79f-55cdd2fa11d5 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:56:14 devstack sudo[95520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-8ccaf32a-8148-4f0f-a79f-55cdd2fa11d5 Nov 04 10:56:14 devstack sudo[95520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:56:14 devstack sudo[95511]: pam_unix(sudo:session): session closed for user root Nov 04 10:56:14 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-236af0be-7f9d-4c80-b3d7-d645a9cd0dd1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1" returned: 0 in 0.449s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:56:14 devstack cinder-volume[87272]: DEBUG cinder.manager [None req-236af0be-7f9d-4c80-b3d7-d645a9cd0dd1 None None] Notifying Schedulers of capabilities ... {{(pid=87272) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 10:56:14 devstack cinder-volume[87272]: DEBUG oslo_service.periodic_task [None req-236af0be-7f9d-4c80-b3d7-d645a9cd0dd1 None None] Running periodic task VolumeManager._thread_info {{(pid=87272) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 04 10:56:14 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-236af0be-7f9d-4c80-b3d7-d645a9cd0dd1 None None] thread count: 28 {{(pid=87272) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 04 10:56:14 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-236af0be-7f9d-4c80-b3d7-d645a9cd0dd1 None None] thread info: [<_MainThread(MainThread, started 127085713244288)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87272) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 04 10:56:14 devstack sudo[95506]: pam_unix(sudo:session): session closed for user root Nov 04 10:56:14 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-5b58957e-3ae3-4ed5-885f-d58d383de09f tempest-VolumesListAdminTestJSON-411668674 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-a2da9469-6e60-4448-81b9-46bc819ca11f" returned: 0 in 0.690s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:56:14 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-5b58957e-3ae3-4ed5-885f-d58d383de09f tempest-VolumesListAdminTestJSON-411668674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-a2da9469-6e60-4448-81b9-46bc819ca11f {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:56:14 devstack sudo[95508]: pam_unix(sudo:session): session closed for user root Nov 04 10:56:14 devstack sudo[95529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-a2da9469-6e60-4448-81b9-46bc819ca11f Nov 04 10:56:14 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-88dd60d0-3ecd-4364-a819-a74b7ab1a628 tempest-VolumesActionsTest-1160217311 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-dc7ccdf9-146f-41fb-95a9-5c2468931770" returned: 0 in 0.693s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:56:14 devstack sudo[95529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:56:14 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-88dd60d0-3ecd-4364-a819-a74b7ab1a628 tempest-VolumesActionsTest-1160217311 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-dc7ccdf9-146f-41fb-95a9-5c2468931770 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:56:14 devstack sudo[95531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-dc7ccdf9-146f-41fb-95a9-5c2468931770 Nov 04 10:56:14 devstack sudo[95531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:56:15 devstack sudo[95520]: pam_unix(sudo:session): session closed for user root Nov 04 10:56:15 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-99278be9-0936-4540-828f-51415d0813ad tempest-VolumesListAdminTestJSON-2024881125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-8ccaf32a-8148-4f0f-a79f-55cdd2fa11d5" returned: 0 in 0.571s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:56:15 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-99278be9-0936-4540-828f-51415d0813ad tempest-VolumesListAdminTestJSON-2024881125 None] Lock "cinder-quobyte-8ccaf32a-8148-4f0f-a79f-55cdd2fa11d5" released by "delete_volume" :: held 1.260s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:56:15 devstack sudo[95529]: pam_unix(sudo:session): session closed for user root Nov 04 10:56:15 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-5b58957e-3ae3-4ed5-885f-d58d383de09f tempest-VolumesListAdminTestJSON-411668674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-a2da9469-6e60-4448-81b9-46bc819ca11f" returned: 0 in 0.366s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:56:15 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-5b58957e-3ae3-4ed5-885f-d58d383de09f tempest-VolumesListAdminTestJSON-411668674 None] Lock "cinder-quobyte-a2da9469-6e60-4448-81b9-46bc819ca11f" released by "delete_volume" :: held 1.154s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:56:15 devstack cinder-volume[87272]: DEBUG cinder.quota [None req-99278be9-0936-4540-828f-51415d0813ad tempest-VolumesListAdminTestJSON-2024881125 None] Created reservations ['e5953ba6-aeb7-4d11-9bb9-dfe39282e3ed', 'db19e3df-e928-4456-a716-0eba2d57737b', '00264c25-4bf4-45fd-8799-92f998c5b053', 'cb261759-bb7a-4839-9d7f-9b35e5b8a96f'] {{(pid=87272) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 10:56:15 devstack sudo[95531]: pam_unix(sudo:session): session closed for user root Nov 04 10:56:15 devstack cinder-volume[87272]: DEBUG cinder.quota [None req-5b58957e-3ae3-4ed5-885f-d58d383de09f tempest-VolumesListAdminTestJSON-411668674 None] Created reservations ['b1c273d8-6212-45ac-8c2a-748298dc3b7c', '7b7ca7f2-0f48-464e-98c6-e091ebe6ee94', '2e2adbad-65a4-4398-9861-79767a3a1b08', '5c3ff949-87b9-4b02-9a4e-3335ef7f6b20'] {{(pid=87272) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 10:56:15 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-88dd60d0-3ecd-4364-a819-a74b7ab1a628 tempest-VolumesActionsTest-1160217311 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-dc7ccdf9-146f-41fb-95a9-5c2468931770" returned: 0 in 0.546s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:56:15 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-88dd60d0-3ecd-4364-a819-a74b7ab1a628 tempest-VolumesActionsTest-1160217311 None] Lock "cinder-quobyte-dc7ccdf9-146f-41fb-95a9-5c2468931770" released by "delete_volume" :: held 1.328s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:56:15 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-99278be9-0936-4540-828f-51415d0813ad tempest-VolumesListAdminTestJSON-2024881125 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:56:15 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-99278be9-0936-4540-828f-51415d0813ad tempest-VolumesListAdminTestJSON-2024881125 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:56:15 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-99278be9-0936-4540-828f-51415d0813ad tempest-VolumesListAdminTestJSON-2024881125 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898': None} {{(pid=87272) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:56:15 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-99278be9-0936-4540-828f-51415d0813ad tempest-VolumesListAdminTestJSON-2024881125 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'] {{(pid=87272) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:56:15 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-99278be9-0936-4540-828f-51415d0813ad tempest-VolumesListAdminTestJSON-2024881125 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:56:15 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-99278be9-0936-4540-828f-51415d0813ad tempest-VolumesListAdminTestJSON-2024881125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:56:15 devstack sudo[95546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1 Nov 04 10:56:15 devstack sudo[95546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:56:15 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-5b58957e-3ae3-4ed5-885f-d58d383de09f tempest-VolumesListAdminTestJSON-411668674 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:56:15 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-5b58957e-3ae3-4ed5-885f-d58d383de09f tempest-VolumesListAdminTestJSON-411668674 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:56:15 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-5b58957e-3ae3-4ed5-885f-d58d383de09f tempest-VolumesListAdminTestJSON-411668674 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898': None} {{(pid=87272) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:56:15 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-5b58957e-3ae3-4ed5-885f-d58d383de09f tempest-VolumesListAdminTestJSON-411668674 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'] {{(pid=87272) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:56:15 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-5b58957e-3ae3-4ed5-885f-d58d383de09f tempest-VolumesListAdminTestJSON-411668674 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:56:15 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-5b58957e-3ae3-4ed5-885f-d58d383de09f tempest-VolumesListAdminTestJSON-411668674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:56:15 devstack sudo[95548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1 Nov 04 10:56:15 devstack sudo[95548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:56:15 devstack cinder-volume[87272]: DEBUG cinder.quota [None req-88dd60d0-3ecd-4364-a819-a74b7ab1a628 tempest-VolumesActionsTest-1160217311 None] Created reservations ['6f4b4894-5d8e-4e33-874b-7724d1027312', '9f7f042e-7443-4948-a6b5-d19792ee60cf', 'd5bdd462-88ab-4a92-ab36-814cb3bff904', '4bd9f44f-ea29-482d-9448-f4611989546d'] {{(pid=87272) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 10:56:15 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [req-11648407-8ef6-4dcb-b096-af8208d4cf1a req-7edb35fa-30e9-4503-bd12-52a719c857b8 tempest-AttachVolumeNegativeTest-154668454 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:56:15 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [req-11648407-8ef6-4dcb-b096-af8208d4cf1a req-7edb35fa-30e9-4503-bd12-52a719c857b8 tempest-AttachVolumeNegativeTest-154668454 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:56:15 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [req-11648407-8ef6-4dcb-b096-af8208d4cf1a req-7edb35fa-30e9-4503-bd12-52a719c857b8 tempest-AttachVolumeNegativeTest-154668454 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.040s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:56:15 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [req-11648407-8ef6-4dcb-b096-af8208d4cf1a req-7edb35fa-30e9-4503-bd12-52a719c857b8 tempest-AttachVolumeNegativeTest-154668454 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898', 'name': 'volume-559bee77-22be-4645-924a-98586a89705b', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '8926f2bd-e2da-4c6e-9311-756c5e9c65f0', 'enforce_multipath': True} {{(pid=87272) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 04 10:56:15 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-88dd60d0-3ecd-4364-a819-a74b7ab1a628 tempest-VolumesActionsTest-1160217311 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:56:15 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-88dd60d0-3ecd-4364-a819-a74b7ab1a628 tempest-VolumesActionsTest-1160217311 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:56:15 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-88dd60d0-3ecd-4364-a819-a74b7ab1a628 tempest-VolumesActionsTest-1160217311 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898': None} {{(pid=87272) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:56:15 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-88dd60d0-3ecd-4364-a819-a74b7ab1a628 tempest-VolumesActionsTest-1160217311 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'] {{(pid=87272) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:56:15 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-88dd60d0-3ecd-4364-a819-a74b7ab1a628 tempest-VolumesActionsTest-1160217311 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:56:15 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-88dd60d0-3ecd-4364-a819-a74b7ab1a628 tempest-VolumesActionsTest-1160217311 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:56:15 devstack sudo[95550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1 Nov 04 10:56:15 devstack sudo[95550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:56:15 devstack cinder-volume[87272]: INFO cinder.volume.manager [req-11648407-8ef6-4dcb-b096-af8208d4cf1a req-7edb35fa-30e9-4503-bd12-52a719c857b8 tempest-AttachVolumeNegativeTest-154668454 None] attachment_update completed successfully. Nov 04 10:56:15 devstack sudo[95546]: pam_unix(sudo:session): session closed for user root Nov 04 10:56:15 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-99278be9-0936-4540-828f-51415d0813ad tempest-VolumesListAdminTestJSON-2024881125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1" returned: 0 in 0.415s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:56:15 devstack cinder-volume[87272]: DEBUG cinder.manager [None req-99278be9-0936-4540-828f-51415d0813ad tempest-VolumesListAdminTestJSON-2024881125 None] Notifying Schedulers of capabilities ... {{(pid=87272) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 10:56:15 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-99278be9-0936-4540-828f-51415d0813ad tempest-VolumesListAdminTestJSON-2024881125 None] Deleted volume successfully. Nov 04 10:56:15 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-99278be9-0936-4540-828f-51415d0813ad tempest-VolumesListAdminTestJSON-2024881125 None] Lock "cinder-8ccaf32a-8148-4f0f-a79f-55cdd2fa11d5-delete_volume" released by "delete_volume" :: held 2.293s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:56:16 devstack sudo[95548]: pam_unix(sudo:session): session closed for user root Nov 04 10:56:16 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-5b58957e-3ae3-4ed5-885f-d58d383de09f tempest-VolumesListAdminTestJSON-411668674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1" returned: 0 in 0.443s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:56:16 devstack cinder-volume[87272]: DEBUG cinder.manager [None req-5b58957e-3ae3-4ed5-885f-d58d383de09f tempest-VolumesListAdminTestJSON-411668674 None] Notifying Schedulers of capabilities ... {{(pid=87272) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 10:56:16 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-5b58957e-3ae3-4ed5-885f-d58d383de09f tempest-VolumesListAdminTestJSON-411668674 None] Deleted volume successfully. Nov 04 10:56:16 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-5b58957e-3ae3-4ed5-885f-d58d383de09f tempest-VolumesListAdminTestJSON-411668674 None] Lock "cinder-a2da9469-6e60-4448-81b9-46bc819ca11f-delete_volume" released by "delete_volume" :: held 2.211s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:56:16 devstack sudo[95550]: pam_unix(sudo:session): session closed for user root Nov 04 10:56:16 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-88dd60d0-3ecd-4364-a819-a74b7ab1a628 tempest-VolumesActionsTest-1160217311 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1" returned: 0 in 0.480s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:56:16 devstack cinder-volume[87272]: DEBUG cinder.manager [None req-88dd60d0-3ecd-4364-a819-a74b7ab1a628 tempest-VolumesActionsTest-1160217311 None] Notifying Schedulers of capabilities ... {{(pid=87272) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 10:56:16 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-88dd60d0-3ecd-4364-a819-a74b7ab1a628 tempest-VolumesActionsTest-1160217311 None] Deleted volume successfully. Nov 04 10:56:16 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-88dd60d0-3ecd-4364-a819-a74b7ab1a628 tempest-VolumesActionsTest-1160217311 None] Lock "cinder-dc7ccdf9-146f-41fb-95a9-5c2468931770-delete_volume" released by "delete_volume" :: held 2.474s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:56:16 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-85a8c80b-b865-44e9-b48b-d381d43be276 tempest-VolumesListAdminTestJSON-411668674 None] Acquiring lock "cinder-c3b5766d-e288-49e9-8bed-02808c3d38f1-delete_volume" by "delete_volume" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:56:16 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-85a8c80b-b865-44e9-b48b-d381d43be276 tempest-VolumesListAdminTestJSON-411668674 None] Lock "cinder-c3b5766d-e288-49e9-8bed-02808c3d38f1-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:56:16 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-85a8c80b-b865-44e9-b48b-d381d43be276 tempest-VolumesListAdminTestJSON-411668674 None] Acquiring lock "cinder-quobyte-c3b5766d-e288-49e9-8bed-02808c3d38f1" by "delete_volume" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:56:16 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-85a8c80b-b865-44e9-b48b-d381d43be276 tempest-VolumesListAdminTestJSON-411668674 None] Lock "cinder-quobyte-c3b5766d-e288-49e9-8bed-02808c3d38f1" acquired by "delete_volume" :: waited 0.021s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:56:16 devstack cinder-volume[87272]: DEBUG oslo.privsep.daemon [-] privsep: reply[586f7b49-1ba2-43ac-a4c9-e58877dc5cd2]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:56:16 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-85a8c80b-b865-44e9-b48b-d381d43be276 tempest-VolumesListAdminTestJSON-411668674 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-c3b5766d-e288-49e9-8bed-02808c3d38f1 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:56:16 devstack sudo[95971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-c3b5766d-e288-49e9-8bed-02808c3d38f1 Nov 04 10:56:16 devstack sudo[95971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:56:17 devstack sudo[95971]: pam_unix(sudo:session): session closed for user root Nov 04 10:56:17 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-85a8c80b-b865-44e9-b48b-d381d43be276 tempest-VolumesListAdminTestJSON-411668674 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-c3b5766d-e288-49e9-8bed-02808c3d38f1" returned: 0 in 0.495s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:56:17 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-85a8c80b-b865-44e9-b48b-d381d43be276 tempest-VolumesListAdminTestJSON-411668674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-c3b5766d-e288-49e9-8bed-02808c3d38f1 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:56:17 devstack sudo[95976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-c3b5766d-e288-49e9-8bed-02808c3d38f1 Nov 04 10:56:17 devstack sudo[95976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:56:17 devstack sudo[95976]: pam_unix(sudo:session): session closed for user root Nov 04 10:56:17 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-85a8c80b-b865-44e9-b48b-d381d43be276 tempest-VolumesListAdminTestJSON-411668674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-c3b5766d-e288-49e9-8bed-02808c3d38f1" returned: 0 in 0.320s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:56:17 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-85a8c80b-b865-44e9-b48b-d381d43be276 tempest-VolumesListAdminTestJSON-411668674 None] Lock "cinder-quobyte-c3b5766d-e288-49e9-8bed-02808c3d38f1" released by "delete_volume" :: held 0.899s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:56:17 devstack cinder-volume[87272]: DEBUG cinder.quota [None req-85a8c80b-b865-44e9-b48b-d381d43be276 tempest-VolumesListAdminTestJSON-411668674 None] Created reservations ['7627784b-3cf7-4be1-9cb8-8d8641d80f61', 'e2dfb082-f601-4327-9482-2ea06aa2bc31', '6e903464-8b06-4d53-a621-626339432050', '7787a827-a85d-4ab5-b70b-11fde9d87f5a'] {{(pid=87272) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 10:56:17 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-85a8c80b-b865-44e9-b48b-d381d43be276 tempest-VolumesListAdminTestJSON-411668674 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:56:17 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-85a8c80b-b865-44e9-b48b-d381d43be276 tempest-VolumesListAdminTestJSON-411668674 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:56:17 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-85a8c80b-b865-44e9-b48b-d381d43be276 tempest-VolumesListAdminTestJSON-411668674 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898': None} {{(pid=87272) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:56:17 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-85a8c80b-b865-44e9-b48b-d381d43be276 tempest-VolumesListAdminTestJSON-411668674 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'] {{(pid=87272) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:56:17 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-85a8c80b-b865-44e9-b48b-d381d43be276 tempest-VolumesListAdminTestJSON-411668674 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:56:17 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-85a8c80b-b865-44e9-b48b-d381d43be276 tempest-VolumesListAdminTestJSON-411668674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:56:17 devstack sudo[95979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1 Nov 04 10:56:17 devstack sudo[95979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:56:18 devstack sudo[95979]: pam_unix(sudo:session): session closed for user root Nov 04 10:56:18 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-85a8c80b-b865-44e9-b48b-d381d43be276 tempest-VolumesListAdminTestJSON-411668674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1" returned: 0 in 0.296s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:56:18 devstack cinder-volume[87272]: DEBUG cinder.manager [None req-85a8c80b-b865-44e9-b48b-d381d43be276 tempest-VolumesListAdminTestJSON-411668674 None] Notifying Schedulers of capabilities ... {{(pid=87272) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 10:56:18 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-85a8c80b-b865-44e9-b48b-d381d43be276 tempest-VolumesListAdminTestJSON-411668674 None] Deleted volume successfully. Nov 04 10:56:18 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-85a8c80b-b865-44e9-b48b-d381d43be276 tempest-VolumesListAdminTestJSON-411668674 None] Lock "cinder-c3b5766d-e288-49e9-8bed-02808c3d38f1-delete_volume" released by "delete_volume" :: held 1.613s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:56:18 devstack cinder-volume[87272]: INFO cinder.volume.manager [req-44047be0-e29d-4261-b75e-072996cf4eaf req-17790d7c-9d64-4eee-bd56-2c40c4de15b3 tempest-AttachVolumeNegativeTest-154668454 None] Terminate volume connection completed successfully. Nov 04 10:56:18 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [req-44047be0-e29d-4261-b75e-072996cf4eaf req-17790d7c-9d64-4eee-bd56-2c40c4de15b3 tempest-AttachVolumeNegativeTest-154668454 None] Deleting attachment 8926f2bd-e2da-4c6e-9311-756c5e9c65f0. {{(pid=87272) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 04 10:56:18 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-15d36250-5d0c-4c2e-8541-48a88f416004 tempest-VolumesListAdminTestJSON-411668674 None] Acquiring lock "cinder-97d492bd-b7cf-40b5-9d93-93c42cc40504-delete_volume" by "delete_volume" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:56:18 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-15d36250-5d0c-4c2e-8541-48a88f416004 tempest-VolumesListAdminTestJSON-411668674 None] Lock "cinder-97d492bd-b7cf-40b5-9d93-93c42cc40504-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:56:19 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-15d36250-5d0c-4c2e-8541-48a88f416004 tempest-VolumesListAdminTestJSON-411668674 None] Acquiring lock "cinder-quobyte-97d492bd-b7cf-40b5-9d93-93c42cc40504" by "delete_volume" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:56:19 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-15d36250-5d0c-4c2e-8541-48a88f416004 tempest-VolumesListAdminTestJSON-411668674 None] Lock "cinder-quobyte-97d492bd-b7cf-40b5-9d93-93c42cc40504" acquired by "delete_volume" :: waited 0.017s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:56:19 devstack cinder-volume[87272]: DEBUG oslo.privsep.daemon [-] privsep: reply[11c15a33-29a9-4f26-a3b1-b161d6e7a8ce]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:56:19 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-15d36250-5d0c-4c2e-8541-48a88f416004 tempest-VolumesListAdminTestJSON-411668674 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-97d492bd-b7cf-40b5-9d93-93c42cc40504 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:56:19 devstack sudo[96010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-97d492bd-b7cf-40b5-9d93-93c42cc40504 Nov 04 10:56:19 devstack sudo[96010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:56:19 devstack sudo[96010]: pam_unix(sudo:session): session closed for user root Nov 04 10:56:19 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-15d36250-5d0c-4c2e-8541-48a88f416004 tempest-VolumesListAdminTestJSON-411668674 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-97d492bd-b7cf-40b5-9d93-93c42cc40504" returned: 0 in 0.497s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:56:19 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-15d36250-5d0c-4c2e-8541-48a88f416004 tempest-VolumesListAdminTestJSON-411668674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-97d492bd-b7cf-40b5-9d93-93c42cc40504 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:56:19 devstack sudo[96015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-97d492bd-b7cf-40b5-9d93-93c42cc40504 Nov 04 10:56:19 devstack sudo[96015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:56:19 devstack sudo[96015]: pam_unix(sudo:session): session closed for user root Nov 04 10:56:19 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-15d36250-5d0c-4c2e-8541-48a88f416004 tempest-VolumesListAdminTestJSON-411668674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-97d492bd-b7cf-40b5-9d93-93c42cc40504" returned: 0 in 0.363s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:56:19 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-15d36250-5d0c-4c2e-8541-48a88f416004 tempest-VolumesListAdminTestJSON-411668674 None] Lock "cinder-quobyte-97d492bd-b7cf-40b5-9d93-93c42cc40504" released by "delete_volume" :: held 0.914s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:56:20 devstack cinder-volume[87272]: DEBUG cinder.quota [None req-15d36250-5d0c-4c2e-8541-48a88f416004 tempest-VolumesListAdminTestJSON-411668674 None] Created reservations ['e19d58d6-6124-4b65-8057-2da26858882a', '181408f4-09ec-44ca-885c-e9f642da3e98', '932bd8c9-ffdb-40a7-8d8b-cb5be380223b', '36dcbc89-4d45-4af2-ad02-fee4dbe2358b'] {{(pid=87272) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 10:56:20 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-15d36250-5d0c-4c2e-8541-48a88f416004 tempest-VolumesListAdminTestJSON-411668674 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:56:20 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-15d36250-5d0c-4c2e-8541-48a88f416004 tempest-VolumesListAdminTestJSON-411668674 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:56:20 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-15d36250-5d0c-4c2e-8541-48a88f416004 tempest-VolumesListAdminTestJSON-411668674 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898': None} {{(pid=87272) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:56:20 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-15d36250-5d0c-4c2e-8541-48a88f416004 tempest-VolumesListAdminTestJSON-411668674 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'] {{(pid=87272) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:56:20 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-15d36250-5d0c-4c2e-8541-48a88f416004 tempest-VolumesListAdminTestJSON-411668674 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:56:20 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-15d36250-5d0c-4c2e-8541-48a88f416004 tempest-VolumesListAdminTestJSON-411668674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:56:20 devstack sudo[96027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1 Nov 04 10:56:20 devstack sudo[96027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:56:20 devstack sudo[96027]: pam_unix(sudo:session): session closed for user root Nov 04 10:56:20 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-15d36250-5d0c-4c2e-8541-48a88f416004 tempest-VolumesListAdminTestJSON-411668674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1" returned: 0 in 0.459s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:56:20 devstack cinder-volume[87272]: DEBUG cinder.manager [None req-15d36250-5d0c-4c2e-8541-48a88f416004 tempest-VolumesListAdminTestJSON-411668674 None] Notifying Schedulers of capabilities ... {{(pid=87272) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 10:56:20 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-15d36250-5d0c-4c2e-8541-48a88f416004 tempest-VolumesListAdminTestJSON-411668674 None] Deleted volume successfully. Nov 04 10:56:20 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-15d36250-5d0c-4c2e-8541-48a88f416004 tempest-VolumesListAdminTestJSON-411668674 None] Lock "cinder-97d492bd-b7cf-40b5-9d93-93c42cc40504-delete_volume" released by "delete_volume" :: held 1.737s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:56:30 devstack cinder-volume[87272]: DEBUG dbcounter [-] [87272] Writing DB stats cinder:UPDATE=74,cinder:SELECT=42,cinder:INSERT=11,cinder:DELETE=6 {{(pid=87272) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 10:56:30 devstack cinder-volume[87272]: DEBUG cinder.volume.flows.manager.create_volume [None req-009c8d23-159b-476a-89fc-8ca93f6fe802 tempest-VolumesGetTest-525573675 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87272) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 10:56:30 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-009c8d23-159b-476a-89fc-8ca93f6fe802 tempest-VolumesGetTest-525573675 None] Flow 'volume_create_manager' (bce1d5fd-a3a9-40c1-a42a-281986e4606e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:56:30 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-009c8d23-159b-476a-89fc-8ca93f6fe802 tempest-VolumesGetTest-525573675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b1274c1-5765-4108-9d3d-6c194bbc2ced) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:56:30 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-009c8d23-159b-476a-89fc-8ca93f6fe802 tempest-VolumesGetTest-525573675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b1274c1-5765-4108-9d3d-6c194bbc2ced) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T09:56:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-685287486',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=675206bc-2e5f-4dff-9e4d-90e467cd555c,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='1fd08fa49c4e4d2f83d17f8aaac1b8a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T09:56:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T09:56:30Z,use_quota=True,user_id='c47ca10290f644b7a54567bf7a4cbc38',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8989e4f-21e3-4f0a-9584-0d818784e883),volume_type_id=f8989e4f-21e3-4f0a-9584-0d818784e883)' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:56:30 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-009c8d23-159b-476a-89fc-8ca93f6fe802 tempest-VolumesGetTest-525573675 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (659fff13-9a29-401e-bc98-849a16ef111d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:56:30 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-009c8d23-159b-476a-89fc-8ca93f6fe802 tempest-VolumesGetTest-525573675 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (659fff13-9a29-401e-bc98-849a16ef111d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:56:30 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-009c8d23-159b-476a-89fc-8ca93f6fe802 tempest-VolumesGetTest-525573675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fcfd3dc8-a7e8-4584-8acb-21d80c18fa05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:56:30 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-009c8d23-159b-476a-89fc-8ca93f6fe802 tempest-VolumesGetTest-525573675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fcfd3dc8-a7e8-4584-8acb-21d80c18fa05) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '675206bc-2e5f-4dff-9e4d-90e467cd555c', 'volume_name': 'volume-675206bc-2e5f-4dff-9e4d-90e467cd555c', 'volume_size': 1}' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:56:30 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-009c8d23-159b-476a-89fc-8ca93f6fe802 tempest-VolumesGetTest-525573675 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (17e39758-20ea-4ea7-ab20-296f4a05cc95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:56:30 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-009c8d23-159b-476a-89fc-8ca93f6fe802 tempest-VolumesGetTest-525573675 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (17e39758-20ea-4ea7-ab20-296f4a05cc95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:56:30 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-009c8d23-159b-476a-89fc-8ca93f6fe802 tempest-VolumesGetTest-525573675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e138c52-8d3a-4458-9209-61ff97bc8e69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:56:30 devstack cinder-volume[87272]: INFO cinder.volume.flows.manager.create_volume [None req-009c8d23-159b-476a-89fc-8ca93f6fe802 tempest-VolumesGetTest-525573675 None] Volume 675206bc-2e5f-4dff-9e4d-90e467cd555c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-675206bc-2e5f-4dff-9e4d-90e467cd555c', 'volume_size': 1} Nov 04 10:56:30 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-009c8d23-159b-476a-89fc-8ca93f6fe802 tempest-VolumesGetTest-525573675 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:56:30 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-009c8d23-159b-476a-89fc-8ca93f6fe802 tempest-VolumesGetTest-525573675 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:56:30 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-009c8d23-159b-476a-89fc-8ca93f6fe802 tempest-VolumesGetTest-525573675 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T09:56:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-685287486',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=675206bc-2e5f-4dff-9e4d-90e467cd555c,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='1fd08fa49c4e4d2f83d17f8aaac1b8a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T09:56:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T09:56:30Z,use_quota=True,user_id='c47ca10290f644b7a54567bf7a4cbc38',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8989e4f-21e3-4f0a-9584-0d818784e883),volume_type_id=f8989e4f-21e3-4f0a-9584-0d818784e883)}" {{(pid=87272) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 04 10:56:30 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.remotefs [None req-009c8d23-159b-476a-89fc-8ca93f6fe802 tempest-VolumesGetTest-525573675 None] Creating volume 675206bc-2e5f-4dff-9e4d-90e467cd555c {{(pid=87272) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 10:56:30 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-009c8d23-159b-476a-89fc-8ca93f6fe802 tempest-VolumesGetTest-525573675 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:56:30 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-009c8d23-159b-476a-89fc-8ca93f6fe802 tempest-VolumesGetTest-525573675 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:56:30 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-009c8d23-159b-476a-89fc-8ca93f6fe802 tempest-VolumesGetTest-525573675 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898': None} {{(pid=87272) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:56:30 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-009c8d23-159b-476a-89fc-8ca93f6fe802 tempest-VolumesGetTest-525573675 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'] {{(pid=87272) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:56:30 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-009c8d23-159b-476a-89fc-8ca93f6fe802 tempest-VolumesGetTest-525573675 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:56:30 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-009c8d23-159b-476a-89fc-8ca93f6fe802 tempest-VolumesGetTest-525573675 None] Selected osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898 as target Quobyte volume. {{(pid=87272) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 10:56:30 devstack cinder-volume[87272]: INFO cinder.volume.drivers.remotefs [None req-009c8d23-159b-476a-89fc-8ca93f6fe802 tempest-VolumesGetTest-525573675 None] casted to osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898 Nov 04 10:56:30 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-009c8d23-159b-476a-89fc-8ca93f6fe802 tempest-VolumesGetTest-525573675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-675206bc-2e5f-4dff-9e4d-90e467cd555c 1073741824 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:56:30 devstack sudo[96124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-675206bc-2e5f-4dff-9e4d-90e467cd555c 1073741824 Nov 04 10:56:30 devstack sudo[96124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:56:31 devstack sudo[96124]: pam_unix(sudo:session): session closed for user root Nov 04 10:56:31 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-009c8d23-159b-476a-89fc-8ca93f6fe802 tempest-VolumesGetTest-525573675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-675206bc-2e5f-4dff-9e4d-90e467cd555c 1073741824" returned: 0 in 0.547s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:56:31 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-009c8d23-159b-476a-89fc-8ca93f6fe802 tempest-VolumesGetTest-525573675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-675206bc-2e5f-4dff-9e4d-90e467cd555c {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:56:31 devstack sudo[96133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-675206bc-2e5f-4dff-9e4d-90e467cd555c Nov 04 10:56:31 devstack sudo[96133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:56:31 devstack sudo[96133]: pam_unix(sudo:session): session closed for user root Nov 04 10:56:31 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-009c8d23-159b-476a-89fc-8ca93f6fe802 tempest-VolumesGetTest-525573675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-675206bc-2e5f-4dff-9e4d-90e467cd555c" returned: 0 in 0.300s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:56:31 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-009c8d23-159b-476a-89fc-8ca93f6fe802 tempest-VolumesGetTest-525573675 None] <== create_volume: return (904ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'} {{(pid=87272) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 04 10:56:31 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-009c8d23-159b-476a-89fc-8ca93f6fe802 tempest-VolumesGetTest-525573675 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.908s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:56:31 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-009c8d23-159b-476a-89fc-8ca93f6fe802 tempest-VolumesGetTest-525573675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e138c52-8d3a-4458-9209-61ff97bc8e69) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-675206bc-2e5f-4dff-9e4d-90e467cd555c', 'volume_size': 1}' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:56:31 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-009c8d23-159b-476a-89fc-8ca93f6fe802 tempest-VolumesGetTest-525573675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b1a5cb0-cc3c-45ea-b064-7e0b11558c64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:56:31 devstack cinder-volume[87272]: INFO cinder.volume.flows.manager.create_volume [None req-009c8d23-159b-476a-89fc-8ca93f6fe802 tempest-VolumesGetTest-525573675 None] Volume volume-675206bc-2e5f-4dff-9e4d-90e467cd555c (675206bc-2e5f-4dff-9e4d-90e467cd555c): created successfully Nov 04 10:56:31 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-009c8d23-159b-476a-89fc-8ca93f6fe802 tempest-VolumesGetTest-525573675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b1a5cb0-cc3c-45ea-b064-7e0b11558c64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:56:31 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-009c8d23-159b-476a-89fc-8ca93f6fe802 tempest-VolumesGetTest-525573675 None] Flow 'volume_create_manager' (bce1d5fd-a3a9-40c1-a42a-281986e4606e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87272) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:56:31 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-009c8d23-159b-476a-89fc-8ca93f6fe802 tempest-VolumesGetTest-525573675 None] Created volume successfully. Nov 04 10:56:35 devstack cinder-volume[87272]: DEBUG cinder.volume.flows.manager.create_volume [None req-269f49df-875f-4a6d-b9e0-9ba35cf398c5 tempest-VolumesGetTest-525573675 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87272) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 10:56:35 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-269f49df-875f-4a6d-b9e0-9ba35cf398c5 tempest-VolumesGetTest-525573675 None] Flow 'volume_create_manager' (7942c6da-86ab-4cbb-9459-2c96b9a6836c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:56:35 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-269f49df-875f-4a6d-b9e0-9ba35cf398c5 tempest-VolumesGetTest-525573675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e2d114f7-47f9-4681-b8cc-113c3689cf2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:56:35 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-269f49df-875f-4a6d-b9e0-9ba35cf398c5 tempest-VolumesGetTest-525573675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e2d114f7-47f9-4681-b8cc-113c3689cf2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T09:56:34Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-712355712',display_name='tempest-VolumesGetTest-Volume-569395469',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fbec52d0-fb91-4fe4-8980-8c2b74f5dbd0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1fd08fa49c4e4d2f83d17f8aaac1b8a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T09:56:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T09:56:35Z,use_quota=True,user_id='c47ca10290f644b7a54567bf7a4cbc38',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8989e4f-21e3-4f0a-9584-0d818784e883),volume_type_id=f8989e4f-21e3-4f0a-9584-0d818784e883)' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:56:35 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-269f49df-875f-4a6d-b9e0-9ba35cf398c5 tempest-VolumesGetTest-525573675 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63e4ce6d-5f2a-4161-828f-77b561c86e59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:56:35 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-269f49df-875f-4a6d-b9e0-9ba35cf398c5 tempest-VolumesGetTest-525573675 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63e4ce6d-5f2a-4161-828f-77b561c86e59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:56:35 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-269f49df-875f-4a6d-b9e0-9ba35cf398c5 tempest-VolumesGetTest-525573675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c8cf7b96-f8de-425e-b694-3f1fc1cadbe8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:56:35 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-269f49df-875f-4a6d-b9e0-9ba35cf398c5 tempest-VolumesGetTest-525573675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c8cf7b96-f8de-425e-b694-3f1fc1cadbe8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fbec52d0-fb91-4fe4-8980-8c2b74f5dbd0', 'volume_name': 'volume-fbec52d0-fb91-4fe4-8980-8c2b74f5dbd0', 'volume_size': 1}' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:56:35 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-269f49df-875f-4a6d-b9e0-9ba35cf398c5 tempest-VolumesGetTest-525573675 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7635d1f9-7948-4680-9ffe-44410fcbe723) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:56:35 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-269f49df-875f-4a6d-b9e0-9ba35cf398c5 tempest-VolumesGetTest-525573675 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7635d1f9-7948-4680-9ffe-44410fcbe723) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:56:35 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-269f49df-875f-4a6d-b9e0-9ba35cf398c5 tempest-VolumesGetTest-525573675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af8565ef-3534-4cac-95fa-9871da595bd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:56:35 devstack cinder-volume[87272]: INFO cinder.volume.flows.manager.create_volume [None req-269f49df-875f-4a6d-b9e0-9ba35cf398c5 tempest-VolumesGetTest-525573675 None] Volume fbec52d0-fb91-4fe4-8980-8c2b74f5dbd0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fbec52d0-fb91-4fe4-8980-8c2b74f5dbd0', 'volume_size': 1} Nov 04 10:56:35 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-269f49df-875f-4a6d-b9e0-9ba35cf398c5 tempest-VolumesGetTest-525573675 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:56:36 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-269f49df-875f-4a6d-b9e0-9ba35cf398c5 tempest-VolumesGetTest-525573675 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.015s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:56:36 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-269f49df-875f-4a6d-b9e0-9ba35cf398c5 tempest-VolumesGetTest-525573675 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T09:56:34Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-712355712',display_name='tempest-VolumesGetTest-Volume-569395469',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fbec52d0-fb91-4fe4-8980-8c2b74f5dbd0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1fd08fa49c4e4d2f83d17f8aaac1b8a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T09:56:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T09:56:35Z,use_quota=True,user_id='c47ca10290f644b7a54567bf7a4cbc38',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8989e4f-21e3-4f0a-9584-0d818784e883),volume_type_id=f8989e4f-21e3-4f0a-9584-0d818784e883)}" {{(pid=87272) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 04 10:56:36 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.remotefs [None req-269f49df-875f-4a6d-b9e0-9ba35cf398c5 tempest-VolumesGetTest-525573675 None] Creating volume fbec52d0-fb91-4fe4-8980-8c2b74f5dbd0 {{(pid=87272) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 10:56:36 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-269f49df-875f-4a6d-b9e0-9ba35cf398c5 tempest-VolumesGetTest-525573675 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:56:36 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-269f49df-875f-4a6d-b9e0-9ba35cf398c5 tempest-VolumesGetTest-525573675 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:56:36 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-269f49df-875f-4a6d-b9e0-9ba35cf398c5 tempest-VolumesGetTest-525573675 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898': None} {{(pid=87272) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:56:36 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-269f49df-875f-4a6d-b9e0-9ba35cf398c5 tempest-VolumesGetTest-525573675 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'] {{(pid=87272) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:56:36 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-269f49df-875f-4a6d-b9e0-9ba35cf398c5 tempest-VolumesGetTest-525573675 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.039s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:56:36 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-269f49df-875f-4a6d-b9e0-9ba35cf398c5 tempest-VolumesGetTest-525573675 None] Selected osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898 as target Quobyte volume. {{(pid=87272) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 10:56:36 devstack cinder-volume[87272]: INFO cinder.volume.drivers.remotefs [None req-269f49df-875f-4a6d-b9e0-9ba35cf398c5 tempest-VolumesGetTest-525573675 None] casted to osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898 Nov 04 10:56:36 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-269f49df-875f-4a6d-b9e0-9ba35cf398c5 tempest-VolumesGetTest-525573675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-fbec52d0-fb91-4fe4-8980-8c2b74f5dbd0 1073741824 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:56:36 devstack sudo[96250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-fbec52d0-fb91-4fe4-8980-8c2b74f5dbd0 1073741824 Nov 04 10:56:36 devstack sudo[96250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:56:37 devstack cinder-volume[87272]: DEBUG cinder.volume.flows.manager.create_volume [None req-42106981-a3a0-4923-9be2-a94e338bb93b tempest-VolumesDeleteCascade-325138244 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87272) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 10:56:37 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-42106981-a3a0-4923-9be2-a94e338bb93b tempest-VolumesDeleteCascade-325138244 None] Flow 'volume_create_manager' (1d8c0b76-26df-4e42-bed1-b3ffc44eeba3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:56:37 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-42106981-a3a0-4923-9be2-a94e338bb93b tempest-VolumesDeleteCascade-325138244 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (19d56652-ac08-483a-9db4-6912873e2a53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:56:37 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-42106981-a3a0-4923-9be2-a94e338bb93b tempest-VolumesDeleteCascade-325138244 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (19d56652-ac08-483a-9db4-6912873e2a53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T09:56:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-2002582031',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2c023195-ecfc-4e4d-9399-d49191789da8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='96351ddf0a2247dbbc228e0b30b91b61',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T09:56:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T09:56:37Z,use_quota=True,user_id='8cee75a07c424c6a99799b186092ec14',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8989e4f-21e3-4f0a-9584-0d818784e883),volume_type_id=f8989e4f-21e3-4f0a-9584-0d818784e883)' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:56:37 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-42106981-a3a0-4923-9be2-a94e338bb93b tempest-VolumesDeleteCascade-325138244 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7006993-6241-4faa-9c06-0d169c30ad36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:56:37 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-42106981-a3a0-4923-9be2-a94e338bb93b tempest-VolumesDeleteCascade-325138244 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7006993-6241-4faa-9c06-0d169c30ad36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:56:37 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-42106981-a3a0-4923-9be2-a94e338bb93b tempest-VolumesDeleteCascade-325138244 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (62f32b7f-dd72-4539-855c-9de77041424f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:56:37 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-42106981-a3a0-4923-9be2-a94e338bb93b tempest-VolumesDeleteCascade-325138244 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (62f32b7f-dd72-4539-855c-9de77041424f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2c023195-ecfc-4e4d-9399-d49191789da8', 'volume_name': 'volume-2c023195-ecfc-4e4d-9399-d49191789da8', 'volume_size': 1}' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:56:37 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-42106981-a3a0-4923-9be2-a94e338bb93b tempest-VolumesDeleteCascade-325138244 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f43dd83a-cb44-43f8-b57d-aa716fdbf6cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:56:37 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-42106981-a3a0-4923-9be2-a94e338bb93b tempest-VolumesDeleteCascade-325138244 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f43dd83a-cb44-43f8-b57d-aa716fdbf6cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:56:37 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-42106981-a3a0-4923-9be2-a94e338bb93b tempest-VolumesDeleteCascade-325138244 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6237b958-2528-490d-9691-29490a3490c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:56:37 devstack cinder-volume[87272]: INFO cinder.volume.flows.manager.create_volume [None req-42106981-a3a0-4923-9be2-a94e338bb93b tempest-VolumesDeleteCascade-325138244 None] Volume 2c023195-ecfc-4e4d-9399-d49191789da8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2c023195-ecfc-4e4d-9399-d49191789da8', 'volume_size': 1} Nov 04 10:56:37 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-42106981-a3a0-4923-9be2-a94e338bb93b tempest-VolumesDeleteCascade-325138244 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:56:37 devstack sudo[96250]: pam_unix(sudo:session): session closed for user root Nov 04 10:56:37 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-269f49df-875f-4a6d-b9e0-9ba35cf398c5 tempest-VolumesGetTest-525573675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-fbec52d0-fb91-4fe4-8980-8c2b74f5dbd0 1073741824" returned: 0 in 1.714s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:56:37 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-269f49df-875f-4a6d-b9e0-9ba35cf398c5 tempest-VolumesGetTest-525573675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-fbec52d0-fb91-4fe4-8980-8c2b74f5dbd0 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:56:37 devstack sudo[96260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-fbec52d0-fb91-4fe4-8980-8c2b74f5dbd0 Nov 04 10:56:37 devstack sudo[96260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:56:38 devstack sudo[96260]: pam_unix(sudo:session): session closed for user root Nov 04 10:56:38 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-269f49df-875f-4a6d-b9e0-9ba35cf398c5 tempest-VolumesGetTest-525573675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-fbec52d0-fb91-4fe4-8980-8c2b74f5dbd0" returned: 0 in 0.645s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:56:38 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-269f49df-875f-4a6d-b9e0-9ba35cf398c5 tempest-VolumesGetTest-525573675 None] <== create_volume: return (2501ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'} {{(pid=87272) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 04 10:56:38 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-269f49df-875f-4a6d-b9e0-9ba35cf398c5 tempest-VolumesGetTest-525573675 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.524s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:56:38 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-42106981-a3a0-4923-9be2-a94e338bb93b tempest-VolumesDeleteCascade-325138244 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.809s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:56:38 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-42106981-a3a0-4923-9be2-a94e338bb93b tempest-VolumesDeleteCascade-325138244 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T09:56:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-2002582031',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2c023195-ecfc-4e4d-9399-d49191789da8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='96351ddf0a2247dbbc228e0b30b91b61',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T09:56:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T09:56:37Z,use_quota=True,user_id='8cee75a07c424c6a99799b186092ec14',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8989e4f-21e3-4f0a-9584-0d818784e883),volume_type_id=f8989e4f-21e3-4f0a-9584-0d818784e883)}" {{(pid=87272) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 04 10:56:38 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.remotefs [None req-42106981-a3a0-4923-9be2-a94e338bb93b tempest-VolumesDeleteCascade-325138244 None] Creating volume 2c023195-ecfc-4e4d-9399-d49191789da8 {{(pid=87272) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 10:56:38 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-42106981-a3a0-4923-9be2-a94e338bb93b tempest-VolumesDeleteCascade-325138244 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:56:38 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-42106981-a3a0-4923-9be2-a94e338bb93b tempest-VolumesDeleteCascade-325138244 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.013s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:56:38 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-42106981-a3a0-4923-9be2-a94e338bb93b tempest-VolumesDeleteCascade-325138244 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898': None} {{(pid=87272) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:56:38 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-42106981-a3a0-4923-9be2-a94e338bb93b tempest-VolumesDeleteCascade-325138244 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'] {{(pid=87272) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:56:38 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-42106981-a3a0-4923-9be2-a94e338bb93b tempest-VolumesDeleteCascade-325138244 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.034s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:56:38 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-42106981-a3a0-4923-9be2-a94e338bb93b tempest-VolumesDeleteCascade-325138244 None] Selected osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898 as target Quobyte volume. {{(pid=87272) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 10:56:38 devstack cinder-volume[87272]: INFO cinder.volume.drivers.remotefs [None req-42106981-a3a0-4923-9be2-a94e338bb93b tempest-VolumesDeleteCascade-325138244 None] casted to osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898 Nov 04 10:56:38 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-42106981-a3a0-4923-9be2-a94e338bb93b tempest-VolumesDeleteCascade-325138244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-2c023195-ecfc-4e4d-9399-d49191789da8 1073741824 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:56:38 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-269f49df-875f-4a6d-b9e0-9ba35cf398c5 tempest-VolumesGetTest-525573675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af8565ef-3534-4cac-95fa-9871da595bd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fbec52d0-fb91-4fe4-8980-8c2b74f5dbd0', 'volume_size': 1}' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:56:38 devstack sudo[96272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-2c023195-ecfc-4e4d-9399-d49191789da8 1073741824 Nov 04 10:56:38 devstack sudo[96272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:56:38 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-269f49df-875f-4a6d-b9e0-9ba35cf398c5 tempest-VolumesGetTest-525573675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (deb76eed-3dc2-418f-9c59-7e4670867f8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:56:38 devstack cinder-volume[87272]: INFO cinder.volume.flows.manager.create_volume [None req-269f49df-875f-4a6d-b9e0-9ba35cf398c5 tempest-VolumesGetTest-525573675 None] Volume volume-fbec52d0-fb91-4fe4-8980-8c2b74f5dbd0 (fbec52d0-fb91-4fe4-8980-8c2b74f5dbd0): created successfully Nov 04 10:56:38 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-269f49df-875f-4a6d-b9e0-9ba35cf398c5 tempest-VolumesGetTest-525573675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (deb76eed-3dc2-418f-9c59-7e4670867f8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:56:38 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-269f49df-875f-4a6d-b9e0-9ba35cf398c5 tempest-VolumesGetTest-525573675 None] Flow 'volume_create_manager' (7942c6da-86ab-4cbb-9459-2c96b9a6836c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87272) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:56:38 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-269f49df-875f-4a6d-b9e0-9ba35cf398c5 tempest-VolumesGetTest-525573675 None] Created volume successfully. Nov 04 10:56:39 devstack sudo[96272]: pam_unix(sudo:session): session closed for user root Nov 04 10:56:39 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-42106981-a3a0-4923-9be2-a94e338bb93b tempest-VolumesDeleteCascade-325138244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-2c023195-ecfc-4e4d-9399-d49191789da8 1073741824" returned: 0 in 1.040s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:56:39 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-42106981-a3a0-4923-9be2-a94e338bb93b tempest-VolumesDeleteCascade-325138244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-2c023195-ecfc-4e4d-9399-d49191789da8 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:56:39 devstack sudo[96283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-2c023195-ecfc-4e4d-9399-d49191789da8 Nov 04 10:56:39 devstack sudo[96283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:56:40 devstack sudo[96283]: pam_unix(sudo:session): session closed for user root Nov 04 10:56:40 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-42106981-a3a0-4923-9be2-a94e338bb93b tempest-VolumesDeleteCascade-325138244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-2c023195-ecfc-4e4d-9399-d49191789da8" returned: 0 in 0.635s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:56:40 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-42106981-a3a0-4923-9be2-a94e338bb93b tempest-VolumesDeleteCascade-325138244 None] <== create_volume: return (1779ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'} {{(pid=87272) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 04 10:56:40 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-42106981-a3a0-4923-9be2-a94e338bb93b tempest-VolumesDeleteCascade-325138244 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.797s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:56:40 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-42106981-a3a0-4923-9be2-a94e338bb93b tempest-VolumesDeleteCascade-325138244 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6237b958-2528-490d-9691-29490a3490c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2c023195-ecfc-4e4d-9399-d49191789da8', 'volume_size': 1}' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:56:40 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-42106981-a3a0-4923-9be2-a94e338bb93b tempest-VolumesDeleteCascade-325138244 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9764780d-e2fe-4f13-a5ce-12395174e2e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:56:40 devstack cinder-volume[87272]: INFO cinder.volume.flows.manager.create_volume [None req-42106981-a3a0-4923-9be2-a94e338bb93b tempest-VolumesDeleteCascade-325138244 None] Volume volume-2c023195-ecfc-4e4d-9399-d49191789da8 (2c023195-ecfc-4e4d-9399-d49191789da8): created successfully Nov 04 10:56:40 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-42106981-a3a0-4923-9be2-a94e338bb93b tempest-VolumesDeleteCascade-325138244 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9764780d-e2fe-4f13-a5ce-12395174e2e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:56:40 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-42106981-a3a0-4923-9be2-a94e338bb93b tempest-VolumesDeleteCascade-325138244 None] Flow 'volume_create_manager' (1d8c0b76-26df-4e42-bed1-b3ffc44eeba3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87272) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:56:40 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-42106981-a3a0-4923-9be2-a94e338bb93b tempest-VolumesDeleteCascade-325138244 None] Created volume successfully. Nov 04 10:56:40 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-12fad125-9449-4760-a50c-c94b94adf190 tempest-VolumesGetTest-525573675 None] Acquiring lock "cinder-fbec52d0-fb91-4fe4-8980-8c2b74f5dbd0-delete_volume" by "delete_volume" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:56:40 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-12fad125-9449-4760-a50c-c94b94adf190 tempest-VolumesGetTest-525573675 None] Lock "cinder-fbec52d0-fb91-4fe4-8980-8c2b74f5dbd0-delete_volume" acquired by "delete_volume" :: waited 0.073s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:56:40 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-12fad125-9449-4760-a50c-c94b94adf190 tempest-VolumesGetTest-525573675 None] Acquiring lock "cinder-quobyte-fbec52d0-fb91-4fe4-8980-8c2b74f5dbd0" by "delete_volume" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:56:40 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-12fad125-9449-4760-a50c-c94b94adf190 tempest-VolumesGetTest-525573675 None] Lock "cinder-quobyte-fbec52d0-fb91-4fe4-8980-8c2b74f5dbd0" acquired by "delete_volume" :: waited 0.048s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:56:40 devstack cinder-volume[87272]: DEBUG oslo.privsep.daemon [-] privsep: reply[56434c24-3e75-4da4-ac92-e8ff1dab9be2]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:56:40 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-12fad125-9449-4760-a50c-c94b94adf190 tempest-VolumesGetTest-525573675 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-fbec52d0-fb91-4fe4-8980-8c2b74f5dbd0 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:56:41 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-cfa32224-838f-4613-8f1f-d4c2e7094ffe tempest-VolumesDeleteCascade-325138244 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:56:41 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-cfa32224-838f-4613-8f1f-d4c2e7094ffe tempest-VolumesDeleteCascade-325138244 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:56:41 devstack sudo[96288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-fbec52d0-fb91-4fe4-8980-8c2b74f5dbd0 Nov 04 10:56:41 devstack sudo[96288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:56:41 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.remotefs [None req-cfa32224-838f-4613-8f1f-d4c2e7094ffe tempest-VolumesDeleteCascade-325138244 None] Creating offline snapshot 9ef43734-3813-435f-9575-38e10ea03b65 of volume 2c023195-ecfc-4e4d-9399-d49191789da8 {{(pid=87272) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 04 10:56:41 devstack cinder-volume[87272]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8f8683e-a3be-4fe9-b7d4-ed70cf4a526e]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:56:41 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-cfa32224-838f-4613-8f1f-d4c2e7094ffe tempest-VolumesDeleteCascade-325138244 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-2c023195-ecfc-4e4d-9399-d49191789da8 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:56:41 devstack sudo[96295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-2c023195-ecfc-4e4d-9399-d49191789da8 Nov 04 10:56:41 devstack sudo[96295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:56:41 devstack sudo[96288]: pam_unix(sudo:session): session closed for user root Nov 04 10:56:41 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-12fad125-9449-4760-a50c-c94b94adf190 tempest-VolumesGetTest-525573675 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-fbec52d0-fb91-4fe4-8980-8c2b74f5dbd0" returned: 0 in 0.747s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:56:41 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-12fad125-9449-4760-a50c-c94b94adf190 tempest-VolumesGetTest-525573675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-fbec52d0-fb91-4fe4-8980-8c2b74f5dbd0 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:56:41 devstack sudo[96306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-fbec52d0-fb91-4fe4-8980-8c2b74f5dbd0 Nov 04 10:56:41 devstack sudo[96306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:56:41 devstack sudo[96295]: pam_unix(sudo:session): session closed for user root Nov 04 10:56:41 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-cfa32224-838f-4613-8f1f-d4c2e7094ffe tempest-VolumesDeleteCascade-325138244 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-2c023195-ecfc-4e4d-9399-d49191789da8" returned: 0 in 0.668s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:56:41 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-cfa32224-838f-4613-8f1f-d4c2e7094ffe tempest-VolumesDeleteCascade-325138244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-2c023195-ecfc-4e4d-9399-d49191789da8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-2c023195-ecfc-4e4d-9399-d49191789da8.9ef43734-3813-435f-9575-38e10ea03b65 1G {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:56:42 devstack sudo[96313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-2c023195-ecfc-4e4d-9399-d49191789da8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-2c023195-ecfc-4e4d-9399-d49191789da8.9ef43734-3813-435f-9575-38e10ea03b65 1G Nov 04 10:56:42 devstack sudo[96313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:56:42 devstack sudo[96306]: pam_unix(sudo:session): session closed for user root Nov 04 10:56:42 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-12fad125-9449-4760-a50c-c94b94adf190 tempest-VolumesGetTest-525573675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-fbec52d0-fb91-4fe4-8980-8c2b74f5dbd0" returned: 0 in 0.471s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:56:42 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-12fad125-9449-4760-a50c-c94b94adf190 tempest-VolumesGetTest-525573675 None] Lock "cinder-quobyte-fbec52d0-fb91-4fe4-8980-8c2b74f5dbd0" released by "delete_volume" :: held 1.312s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:56:42 devstack cinder-volume[87272]: DEBUG cinder.quota [None req-12fad125-9449-4760-a50c-c94b94adf190 tempest-VolumesGetTest-525573675 None] Created reservations ['487be6b5-c5f4-42d0-a826-cb9ba6d23d34', 'eae0fd76-3120-4de7-ab7f-bb4bf30c76fa', '80b93bce-c12b-4401-8085-b4078a3dacea', 'f39b2c1d-4289-4b00-ac94-fbfbaa8695f1'] {{(pid=87272) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 10:56:42 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-12fad125-9449-4760-a50c-c94b94adf190 tempest-VolumesGetTest-525573675 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:56:42 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-12fad125-9449-4760-a50c-c94b94adf190 tempest-VolumesGetTest-525573675 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:56:42 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-12fad125-9449-4760-a50c-c94b94adf190 tempest-VolumesGetTest-525573675 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898': None} {{(pid=87272) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:56:42 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-12fad125-9449-4760-a50c-c94b94adf190 tempest-VolumesGetTest-525573675 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'] {{(pid=87272) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:56:42 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-12fad125-9449-4760-a50c-c94b94adf190 tempest-VolumesGetTest-525573675 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:56:42 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-12fad125-9449-4760-a50c-c94b94adf190 tempest-VolumesGetTest-525573675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:56:42 devstack sudo[96340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1 Nov 04 10:56:42 devstack sudo[96340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:56:42 devstack sudo[96313]: pam_unix(sudo:session): session closed for user root Nov 04 10:56:42 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-cfa32224-838f-4613-8f1f-d4c2e7094ffe tempest-VolumesDeleteCascade-325138244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-2c023195-ecfc-4e4d-9399-d49191789da8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-2c023195-ecfc-4e4d-9399-d49191789da8.9ef43734-3813-435f-9575-38e10ea03b65 1G" returned: 0 in 0.976s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:56:42 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-cfa32224-838f-4613-8f1f-d4c2e7094ffe tempest-VolumesDeleteCascade-325138244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2c023195-ecfc-4e4d-9399-d49191789da8 -F qcow2 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-2c023195-ecfc-4e4d-9399-d49191789da8.9ef43734-3813-435f-9575-38e10ea03b65 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:56:42 devstack sudo[96343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2c023195-ecfc-4e4d-9399-d49191789da8 -F qcow2 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-2c023195-ecfc-4e4d-9399-d49191789da8.9ef43734-3813-435f-9575-38e10ea03b65 Nov 04 10:56:42 devstack sudo[96343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:56:43 devstack sudo[96340]: pam_unix(sudo:session): session closed for user root Nov 04 10:56:43 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-12fad125-9449-4760-a50c-c94b94adf190 tempest-VolumesGetTest-525573675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1" returned: 0 in 0.483s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:56:43 devstack cinder-volume[87272]: DEBUG cinder.manager [None req-12fad125-9449-4760-a50c-c94b94adf190 tempest-VolumesGetTest-525573675 None] Notifying Schedulers of capabilities ... {{(pid=87272) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 10:56:43 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-12fad125-9449-4760-a50c-c94b94adf190 tempest-VolumesGetTest-525573675 None] Deleted volume successfully. Nov 04 10:56:43 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-12fad125-9449-4760-a50c-c94b94adf190 tempest-VolumesGetTest-525573675 None] Lock "cinder-fbec52d0-fb91-4fe4-8980-8c2b74f5dbd0-delete_volume" released by "delete_volume" :: held 2.333s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:56:43 devstack sudo[96343]: pam_unix(sudo:session): session closed for user root Nov 04 10:56:43 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-cfa32224-838f-4613-8f1f-d4c2e7094ffe tempest-VolumesDeleteCascade-325138244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2c023195-ecfc-4e4d-9399-d49191789da8 -F qcow2 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-2c023195-ecfc-4e4d-9399-d49191789da8.9ef43734-3813-435f-9575-38e10ea03b65" returned: 0 in 0.383s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:56:43 devstack cinder-volume[87272]: WARNING cinder.volume.drivers.remotefs [None req-cfa32224-838f-4613-8f1f-d4c2e7094ffe tempest-VolumesDeleteCascade-325138244 None] /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-2c023195-ecfc-4e4d-9399-d49191789da8.9ef43734-3813-435f-9575-38e10ea03b65 is being set with open permissions: ugo+rw Nov 04 10:56:43 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-cfa32224-838f-4613-8f1f-d4c2e7094ffe tempest-VolumesDeleteCascade-325138244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-2c023195-ecfc-4e4d-9399-d49191789da8.9ef43734-3813-435f-9575-38e10ea03b65 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:56:43 devstack sudo[96349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-2c023195-ecfc-4e4d-9399-d49191789da8.9ef43734-3813-435f-9575-38e10ea03b65 Nov 04 10:56:43 devstack sudo[96349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:56:43 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-77e1b153-b5e9-4b42-982d-13873798f8e2 tempest-VolumesGetTest-525573675 None] Acquiring lock "cinder-675206bc-2e5f-4dff-9e4d-90e467cd555c-delete_volume" by "delete_volume" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:56:43 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-77e1b153-b5e9-4b42-982d-13873798f8e2 tempest-VolumesGetTest-525573675 None] Lock "cinder-675206bc-2e5f-4dff-9e4d-90e467cd555c-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:56:43 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-77e1b153-b5e9-4b42-982d-13873798f8e2 tempest-VolumesGetTest-525573675 None] Acquiring lock "cinder-quobyte-675206bc-2e5f-4dff-9e4d-90e467cd555c" by "delete_volume" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:56:43 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-77e1b153-b5e9-4b42-982d-13873798f8e2 tempest-VolumesGetTest-525573675 None] Lock "cinder-quobyte-675206bc-2e5f-4dff-9e4d-90e467cd555c" acquired by "delete_volume" :: waited 0.034s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:56:43 devstack cinder-volume[87272]: DEBUG oslo.privsep.daemon [-] privsep: reply[29421f8c-4080-463e-a40a-b973c913667b]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:56:43 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-77e1b153-b5e9-4b42-982d-13873798f8e2 tempest-VolumesGetTest-525573675 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-675206bc-2e5f-4dff-9e4d-90e467cd555c {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:56:43 devstack sudo[96351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-675206bc-2e5f-4dff-9e4d-90e467cd555c Nov 04 10:56:43 devstack sudo[96351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:56:43 devstack sudo[96349]: pam_unix(sudo:session): session closed for user root Nov 04 10:56:43 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-cfa32224-838f-4613-8f1f-d4c2e7094ffe tempest-VolumesDeleteCascade-325138244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-2c023195-ecfc-4e4d-9399-d49191789da8.9ef43734-3813-435f-9575-38e10ea03b65" returned: 0 in 0.570s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:56:43 devstack cinder-volume[87272]: DEBUG dbcounter [-] [87272] Writing DB stats cinder:SELECT=72,cinder:INSERT=24,cinder:UPDATE=81,cinder:DELETE=5 {{(pid=87272) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 10:56:44 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-cfa32224-838f-4613-8f1f-d4c2e7094ffe tempest-VolumesDeleteCascade-325138244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-2c023195-ecfc-4e4d-9399-d49191789da8.info {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:56:44 devstack sudo[96356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-2c023195-ecfc-4e4d-9399-d49191789da8.info Nov 04 10:56:44 devstack sudo[96356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:56:44 devstack sudo[96351]: pam_unix(sudo:session): session closed for user root Nov 04 10:56:44 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-77e1b153-b5e9-4b42-982d-13873798f8e2 tempest-VolumesGetTest-525573675 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-675206bc-2e5f-4dff-9e4d-90e467cd555c" returned: 0 in 0.969s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:56:44 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-77e1b153-b5e9-4b42-982d-13873798f8e2 tempest-VolumesGetTest-525573675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-675206bc-2e5f-4dff-9e4d-90e467cd555c {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:56:44 devstack sudo[96370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-675206bc-2e5f-4dff-9e4d-90e467cd555c Nov 04 10:56:44 devstack sudo[96370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:56:44 devstack sudo[96356]: pam_unix(sudo:session): session closed for user root Nov 04 10:56:44 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-cfa32224-838f-4613-8f1f-d4c2e7094ffe tempest-VolumesDeleteCascade-325138244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-2c023195-ecfc-4e4d-9399-d49191789da8.info" returned: 0 in 0.847s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:56:44 devstack cinder-volume[87272]: WARNING cinder.volume.drivers.remotefs [None req-cfa32224-838f-4613-8f1f-d4c2e7094ffe tempest-VolumesDeleteCascade-325138244 None] /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-2c023195-ecfc-4e4d-9399-d49191789da8.info is being set with open permissions: ugo+rw Nov 04 10:56:44 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-cfa32224-838f-4613-8f1f-d4c2e7094ffe tempest-VolumesDeleteCascade-325138244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-2c023195-ecfc-4e4d-9399-d49191789da8.info {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:56:45 devstack sudo[96378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-2c023195-ecfc-4e4d-9399-d49191789da8.info Nov 04 10:56:45 devstack sudo[96378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:56:45 devstack sudo[96370]: pam_unix(sudo:session): session closed for user root Nov 04 10:56:45 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-77e1b153-b5e9-4b42-982d-13873798f8e2 tempest-VolumesGetTest-525573675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-675206bc-2e5f-4dff-9e4d-90e467cd555c" returned: 0 in 0.706s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:56:45 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-77e1b153-b5e9-4b42-982d-13873798f8e2 tempest-VolumesGetTest-525573675 None] Lock "cinder-quobyte-675206bc-2e5f-4dff-9e4d-90e467cd555c" released by "delete_volume" :: held 1.782s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:56:45 devstack cinder-volume[87272]: DEBUG cinder.quota [None req-77e1b153-b5e9-4b42-982d-13873798f8e2 tempest-VolumesGetTest-525573675 None] Created reservations ['4f9555df-de87-4d05-8868-fa37206d1c0f', 'c7965bf7-fe1f-471d-9f43-9c3b1ea85d22', 'dd59e872-7970-4842-9b7d-601a9217fc9b', '21f4f89c-720c-44a3-b31f-2df01d8edb5d'] {{(pid=87272) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 10:56:45 devstack sudo[96378]: pam_unix(sudo:session): session closed for user root Nov 04 10:56:45 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-cfa32224-838f-4613-8f1f-d4c2e7094ffe tempest-VolumesDeleteCascade-325138244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-2c023195-ecfc-4e4d-9399-d49191789da8.info" returned: 0 in 0.848s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:56:45 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-cfa32224-838f-4613-8f1f-d4c2e7094ffe tempest-VolumesDeleteCascade-325138244 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.596s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:56:45 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-cfa32224-838f-4613-8f1f-d4c2e7094ffe tempest-VolumesDeleteCascade-325138244 None] Create snapshot completed successfully Nov 04 10:56:45 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-77e1b153-b5e9-4b42-982d-13873798f8e2 tempest-VolumesGetTest-525573675 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:56:45 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-77e1b153-b5e9-4b42-982d-13873798f8e2 tempest-VolumesGetTest-525573675 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:56:45 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-77e1b153-b5e9-4b42-982d-13873798f8e2 tempest-VolumesGetTest-525573675 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898': None} {{(pid=87272) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:56:46 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-77e1b153-b5e9-4b42-982d-13873798f8e2 tempest-VolumesGetTest-525573675 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'] {{(pid=87272) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:56:46 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-77e1b153-b5e9-4b42-982d-13873798f8e2 tempest-VolumesGetTest-525573675 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.038s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:56:46 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-77e1b153-b5e9-4b42-982d-13873798f8e2 tempest-VolumesGetTest-525573675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:56:46 devstack sudo[96423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1 Nov 04 10:56:46 devstack sudo[96423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:56:47 devstack sudo[96423]: pam_unix(sudo:session): session closed for user root Nov 04 10:56:47 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-77e1b153-b5e9-4b42-982d-13873798f8e2 tempest-VolumesGetTest-525573675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1" returned: 0 in 1.050s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:56:47 devstack cinder-volume[87272]: DEBUG cinder.manager [None req-77e1b153-b5e9-4b42-982d-13873798f8e2 tempest-VolumesGetTest-525573675 None] Notifying Schedulers of capabilities ... {{(pid=87272) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 10:56:47 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-77e1b153-b5e9-4b42-982d-13873798f8e2 tempest-VolumesGetTest-525573675 None] Deleted volume successfully. Nov 04 10:56:47 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-77e1b153-b5e9-4b42-982d-13873798f8e2 tempest-VolumesGetTest-525573675 None] Lock "cinder-675206bc-2e5f-4dff-9e4d-90e467cd555c-delete_volume" released by "delete_volume" :: held 3.832s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:56:49 devstack cinder-volume[87272]: DEBUG cinder.volume.flows.manager.create_volume [None req-d5f0d884-19bd-4daa-a137-edf925f04b37 tempest-VolumesGetTest-525573675 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87272) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 10:56:49 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-d5f0d884-19bd-4daa-a137-edf925f04b37 tempest-VolumesGetTest-525573675 None] Flow 'volume_create_manager' (8258bbfd-e5f5-4c50-941f-f7331243f015) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:56:49 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-d5f0d884-19bd-4daa-a137-edf925f04b37 tempest-VolumesGetTest-525573675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (21f4a808-faf2-48cb-b82d-64ae2edb2194) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:56:49 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-d5f0d884-19bd-4daa-a137-edf925f04b37 tempest-VolumesGetTest-525573675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (21f4a808-faf2-48cb-b82d-64ae2edb2194) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T09:56:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-87787012',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b967890f-4f4c-4181-b0c6-dc06f815759a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1fd08fa49c4e4d2f83d17f8aaac1b8a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T09:56:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T09:56:49Z,use_quota=True,user_id='c47ca10290f644b7a54567bf7a4cbc38',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8989e4f-21e3-4f0a-9584-0d818784e883),volume_type_id=f8989e4f-21e3-4f0a-9584-0d818784e883)' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:56:49 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-d5f0d884-19bd-4daa-a137-edf925f04b37 tempest-VolumesGetTest-525573675 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b298973c-2a3d-4128-8673-3a3b26113462) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:56:49 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-d5f0d884-19bd-4daa-a137-edf925f04b37 tempest-VolumesGetTest-525573675 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b298973c-2a3d-4128-8673-3a3b26113462) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:56:49 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-d5f0d884-19bd-4daa-a137-edf925f04b37 tempest-VolumesGetTest-525573675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e7c2b051-a963-481b-9e95-8bcb959c4c8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:56:49 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-d5f0d884-19bd-4daa-a137-edf925f04b37 tempest-VolumesGetTest-525573675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e7c2b051-a963-481b-9e95-8bcb959c4c8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b967890f-4f4c-4181-b0c6-dc06f815759a', 'volume_name': 'volume-b967890f-4f4c-4181-b0c6-dc06f815759a', 'volume_size': 1}' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:56:49 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-d5f0d884-19bd-4daa-a137-edf925f04b37 tempest-VolumesGetTest-525573675 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21a959d8-e26f-4538-a4e7-0a0e0bc4a9d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:56:49 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-d5f0d884-19bd-4daa-a137-edf925f04b37 tempest-VolumesGetTest-525573675 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21a959d8-e26f-4538-a4e7-0a0e0bc4a9d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:56:49 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-d5f0d884-19bd-4daa-a137-edf925f04b37 tempest-VolumesGetTest-525573675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f242639f-b3f8-45a2-8e17-9bdb3e70741b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:56:49 devstack cinder-volume[87272]: INFO cinder.volume.flows.manager.create_volume [None req-d5f0d884-19bd-4daa-a137-edf925f04b37 tempest-VolumesGetTest-525573675 None] Volume b967890f-4f4c-4181-b0c6-dc06f815759a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b967890f-4f4c-4181-b0c6-dc06f815759a', 'volume_size': 1} Nov 04 10:56:49 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-d5f0d884-19bd-4daa-a137-edf925f04b37 tempest-VolumesGetTest-525573675 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:56:49 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-d5f0d884-19bd-4daa-a137-edf925f04b37 tempest-VolumesGetTest-525573675 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:56:49 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-d5f0d884-19bd-4daa-a137-edf925f04b37 tempest-VolumesGetTest-525573675 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T09:56:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-87787012',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b967890f-4f4c-4181-b0c6-dc06f815759a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1fd08fa49c4e4d2f83d17f8aaac1b8a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T09:56:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T09:56:49Z,use_quota=True,user_id='c47ca10290f644b7a54567bf7a4cbc38',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8989e4f-21e3-4f0a-9584-0d818784e883),volume_type_id=f8989e4f-21e3-4f0a-9584-0d818784e883)}" {{(pid=87272) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 04 10:56:49 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.remotefs [None req-d5f0d884-19bd-4daa-a137-edf925f04b37 tempest-VolumesGetTest-525573675 None] Creating volume b967890f-4f4c-4181-b0c6-dc06f815759a {{(pid=87272) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 10:56:49 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-d5f0d884-19bd-4daa-a137-edf925f04b37 tempest-VolumesGetTest-525573675 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:56:49 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-d5f0d884-19bd-4daa-a137-edf925f04b37 tempest-VolumesGetTest-525573675 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:56:49 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-d5f0d884-19bd-4daa-a137-edf925f04b37 tempest-VolumesGetTest-525573675 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898': None} {{(pid=87272) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:56:49 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-d5f0d884-19bd-4daa-a137-edf925f04b37 tempest-VolumesGetTest-525573675 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'] {{(pid=87272) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:56:49 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-d5f0d884-19bd-4daa-a137-edf925f04b37 tempest-VolumesGetTest-525573675 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.032s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:56:49 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-d5f0d884-19bd-4daa-a137-edf925f04b37 tempest-VolumesGetTest-525573675 None] Selected osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898 as target Quobyte volume. {{(pid=87272) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 10:56:49 devstack cinder-volume[87272]: INFO cinder.volume.drivers.remotefs [None req-d5f0d884-19bd-4daa-a137-edf925f04b37 tempest-VolumesGetTest-525573675 None] casted to osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898 Nov 04 10:56:49 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-d5f0d884-19bd-4daa-a137-edf925f04b37 tempest-VolumesGetTest-525573675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-b967890f-4f4c-4181-b0c6-dc06f815759a 1073741824 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:56:49 devstack sudo[96468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-b967890f-4f4c-4181-b0c6-dc06f815759a 1073741824 Nov 04 10:56:49 devstack sudo[96468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:56:49 devstack cinder-volume[87272]: DEBUG cinder.volume.flows.manager.create_volume [None req-cc26726f-dc9f-4cde-b957-4789f8dc34d3 tempest-ServerRescueNegativeTestJSON-1618815521 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87272) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 10:56:49 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-cc26726f-dc9f-4cde-b957-4789f8dc34d3 tempest-ServerRescueNegativeTestJSON-1618815521 None] Flow 'volume_create_manager' (c17dec3c-1262-444b-9063-dd074511ff04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:56:49 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-cc26726f-dc9f-4cde-b957-4789f8dc34d3 tempest-ServerRescueNegativeTestJSON-1618815521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ddb2d67-b518-407e-ad17-2b125be492e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:56:50 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-cc26726f-dc9f-4cde-b957-4789f8dc34d3 tempest-ServerRescueNegativeTestJSON-1618815521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ddb2d67-b518-407e-ad17-2b125be492e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T09:56:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1155283651',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=610fcbcf-206b-4795-b197-c6e328f2faed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c134c1fa87842049f57021aeee7d357',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T09:56:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T09:56:50Z,use_quota=True,user_id='cf07b178f087422b99abea3542e9059b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8989e4f-21e3-4f0a-9584-0d818784e883),volume_type_id=f8989e4f-21e3-4f0a-9584-0d818784e883)' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:56:50 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-cc26726f-dc9f-4cde-b957-4789f8dc34d3 tempest-ServerRescueNegativeTestJSON-1618815521 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (98dd9c12-ea5b-4768-ab2f-6003844f4af8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:56:50 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-cc26726f-dc9f-4cde-b957-4789f8dc34d3 tempest-ServerRescueNegativeTestJSON-1618815521 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (98dd9c12-ea5b-4768-ab2f-6003844f4af8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:56:50 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-cc26726f-dc9f-4cde-b957-4789f8dc34d3 tempest-ServerRescueNegativeTestJSON-1618815521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a3d7c6cb-17d3-45db-80fe-9f5cb0503088) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:56:50 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-cc26726f-dc9f-4cde-b957-4789f8dc34d3 tempest-ServerRescueNegativeTestJSON-1618815521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a3d7c6cb-17d3-45db-80fe-9f5cb0503088) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '610fcbcf-206b-4795-b197-c6e328f2faed', 'volume_name': 'volume-610fcbcf-206b-4795-b197-c6e328f2faed', 'volume_size': 1}' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:56:50 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-cc26726f-dc9f-4cde-b957-4789f8dc34d3 tempest-ServerRescueNegativeTestJSON-1618815521 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4cb212cf-5780-4515-8033-af25a00f6a4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:56:50 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-cc26726f-dc9f-4cde-b957-4789f8dc34d3 tempest-ServerRescueNegativeTestJSON-1618815521 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4cb212cf-5780-4515-8033-af25a00f6a4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:56:50 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-cc26726f-dc9f-4cde-b957-4789f8dc34d3 tempest-ServerRescueNegativeTestJSON-1618815521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (689caea3-9cae-4443-a298-98d6b5b44400) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:56:50 devstack cinder-volume[87272]: INFO cinder.volume.flows.manager.create_volume [None req-cc26726f-dc9f-4cde-b957-4789f8dc34d3 tempest-ServerRescueNegativeTestJSON-1618815521 None] Volume 610fcbcf-206b-4795-b197-c6e328f2faed: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-610fcbcf-206b-4795-b197-c6e328f2faed', 'volume_size': 1} Nov 04 10:56:50 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-cc26726f-dc9f-4cde-b957-4789f8dc34d3 tempest-ServerRescueNegativeTestJSON-1618815521 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:56:50 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-aa937a2d-1299-4b4d-8d84-144bc3e81337 tempest-VolumesDeleteCascade-325138244 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:56:50 devstack sudo[96468]: pam_unix(sudo:session): session closed for user root Nov 04 10:56:50 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-d5f0d884-19bd-4daa-a137-edf925f04b37 tempest-VolumesGetTest-525573675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-b967890f-4f4c-4181-b0c6-dc06f815759a 1073741824" returned: 0 in 1.201s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:56:50 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-d5f0d884-19bd-4daa-a137-edf925f04b37 tempest-VolumesGetTest-525573675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-b967890f-4f4c-4181-b0c6-dc06f815759a {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:56:50 devstack sudo[96476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-b967890f-4f4c-4181-b0c6-dc06f815759a Nov 04 10:56:51 devstack sudo[96476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:56:51 devstack sudo[96476]: pam_unix(sudo:session): session closed for user root Nov 04 10:56:51 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-d5f0d884-19bd-4daa-a137-edf925f04b37 tempest-VolumesGetTest-525573675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-b967890f-4f4c-4181-b0c6-dc06f815759a" returned: 0 in 0.533s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:56:51 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-d5f0d884-19bd-4daa-a137-edf925f04b37 tempest-VolumesGetTest-525573675 None] <== create_volume: return (1832ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'} {{(pid=87272) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 04 10:56:51 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-d5f0d884-19bd-4daa-a137-edf925f04b37 tempest-VolumesGetTest-525573675 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.852s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:56:51 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-cc26726f-dc9f-4cde-b957-4789f8dc34d3 tempest-ServerRescueNegativeTestJSON-1618815521 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.365s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:56:51 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-cc26726f-dc9f-4cde-b957-4789f8dc34d3 tempest-ServerRescueNegativeTestJSON-1618815521 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T09:56:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1155283651',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=610fcbcf-206b-4795-b197-c6e328f2faed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c134c1fa87842049f57021aeee7d357',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T09:56:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T09:56:50Z,use_quota=True,user_id='cf07b178f087422b99abea3542e9059b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8989e4f-21e3-4f0a-9584-0d818784e883),volume_type_id=f8989e4f-21e3-4f0a-9584-0d818784e883)}" {{(pid=87272) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 04 10:56:51 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.remotefs [None req-cc26726f-dc9f-4cde-b957-4789f8dc34d3 tempest-ServerRescueNegativeTestJSON-1618815521 None] Creating volume 610fcbcf-206b-4795-b197-c6e328f2faed {{(pid=87272) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 10:56:51 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-cc26726f-dc9f-4cde-b957-4789f8dc34d3 tempest-ServerRescueNegativeTestJSON-1618815521 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:56:51 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-cc26726f-dc9f-4cde-b957-4789f8dc34d3 tempest-ServerRescueNegativeTestJSON-1618815521 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:56:51 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-cc26726f-dc9f-4cde-b957-4789f8dc34d3 tempest-ServerRescueNegativeTestJSON-1618815521 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898': None} {{(pid=87272) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:56:51 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-cc26726f-dc9f-4cde-b957-4789f8dc34d3 tempest-ServerRescueNegativeTestJSON-1618815521 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'] {{(pid=87272) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:56:51 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-cc26726f-dc9f-4cde-b957-4789f8dc34d3 tempest-ServerRescueNegativeTestJSON-1618815521 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.037s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:56:51 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-cc26726f-dc9f-4cde-b957-4789f8dc34d3 tempest-ServerRescueNegativeTestJSON-1618815521 None] Selected osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898 as target Quobyte volume. {{(pid=87272) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 10:56:51 devstack cinder-volume[87272]: INFO cinder.volume.drivers.remotefs [None req-cc26726f-dc9f-4cde-b957-4789f8dc34d3 tempest-ServerRescueNegativeTestJSON-1618815521 None] casted to osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898 Nov 04 10:56:51 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-cc26726f-dc9f-4cde-b957-4789f8dc34d3 tempest-ServerRescueNegativeTestJSON-1618815521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-610fcbcf-206b-4795-b197-c6e328f2faed 1073741824 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:56:51 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-d5f0d884-19bd-4daa-a137-edf925f04b37 tempest-VolumesGetTest-525573675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f242639f-b3f8-45a2-8e17-9bdb3e70741b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b967890f-4f4c-4181-b0c6-dc06f815759a', 'volume_size': 1}' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:56:51 devstack sudo[96479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-610fcbcf-206b-4795-b197-c6e328f2faed 1073741824 Nov 04 10:56:51 devstack sudo[96479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:56:51 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-d5f0d884-19bd-4daa-a137-edf925f04b37 tempest-VolumesGetTest-525573675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7fdac4e3-5852-4995-8986-6633bab256f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:56:51 devstack cinder-volume[87272]: INFO cinder.volume.flows.manager.create_volume [None req-d5f0d884-19bd-4daa-a137-edf925f04b37 tempest-VolumesGetTest-525573675 None] Volume volume-b967890f-4f4c-4181-b0c6-dc06f815759a (b967890f-4f4c-4181-b0c6-dc06f815759a): created successfully Nov 04 10:56:51 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-d5f0d884-19bd-4daa-a137-edf925f04b37 tempest-VolumesGetTest-525573675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7fdac4e3-5852-4995-8986-6633bab256f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:56:51 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-d5f0d884-19bd-4daa-a137-edf925f04b37 tempest-VolumesGetTest-525573675 None] Flow 'volume_create_manager' (8258bbfd-e5f5-4c50-941f-f7331243f015) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87272) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:56:51 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-d5f0d884-19bd-4daa-a137-edf925f04b37 tempest-VolumesGetTest-525573675 None] Created volume successfully. Nov 04 10:56:52 devstack sudo[96479]: pam_unix(sudo:session): session closed for user root Nov 04 10:56:52 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-cc26726f-dc9f-4cde-b957-4789f8dc34d3 tempest-ServerRescueNegativeTestJSON-1618815521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-610fcbcf-206b-4795-b197-c6e328f2faed 1073741824" returned: 0 in 0.954s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:56:52 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-cc26726f-dc9f-4cde-b957-4789f8dc34d3 tempest-ServerRescueNegativeTestJSON-1618815521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-610fcbcf-206b-4795-b197-c6e328f2faed {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:56:52 devstack sudo[96539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-610fcbcf-206b-4795-b197-c6e328f2faed Nov 04 10:56:52 devstack sudo[96539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:56:53 devstack sudo[96539]: pam_unix(sudo:session): session closed for user root Nov 04 10:56:53 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-cc26726f-dc9f-4cde-b957-4789f8dc34d3 tempest-ServerRescueNegativeTestJSON-1618815521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-610fcbcf-206b-4795-b197-c6e328f2faed" returned: 0 in 0.570s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:56:53 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-cc26726f-dc9f-4cde-b957-4789f8dc34d3 tempest-ServerRescueNegativeTestJSON-1618815521 None] <== create_volume: return (1666ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'} {{(pid=87272) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 04 10:56:53 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-cc26726f-dc9f-4cde-b957-4789f8dc34d3 tempest-ServerRescueNegativeTestJSON-1618815521 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.670s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:56:53 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-aa937a2d-1299-4b4d-8d84-144bc3e81337 tempest-VolumesDeleteCascade-325138244 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.039s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:56:53 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.remotefs [None req-aa937a2d-1299-4b4d-8d84-144bc3e81337 tempest-VolumesDeleteCascade-325138244 None] Creating offline snapshot d9acf3e2-0a94-4b8c-b608-ff3bb83f0b85 of volume 2c023195-ecfc-4e4d-9399-d49191789da8 {{(pid=87272) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 04 10:56:53 devstack cinder-volume[87272]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2f7f772-ee17-4956-8030-630a216288fb]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:56:53 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-aa937a2d-1299-4b4d-8d84-144bc3e81337 tempest-VolumesDeleteCascade-325138244 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-2c023195-ecfc-4e4d-9399-d49191789da8.9ef43734-3813-435f-9575-38e10ea03b65 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:56:53 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-cc26726f-dc9f-4cde-b957-4789f8dc34d3 tempest-ServerRescueNegativeTestJSON-1618815521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (689caea3-9cae-4443-a298-98d6b5b44400) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-610fcbcf-206b-4795-b197-c6e328f2faed', 'volume_size': 1}' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:56:53 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-cc26726f-dc9f-4cde-b957-4789f8dc34d3 tempest-ServerRescueNegativeTestJSON-1618815521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (47b4c0f3-cd2a-4916-87dc-848977c5e0f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:56:53 devstack cinder-volume[87272]: INFO cinder.volume.flows.manager.create_volume [None req-cc26726f-dc9f-4cde-b957-4789f8dc34d3 tempest-ServerRescueNegativeTestJSON-1618815521 None] Volume volume-610fcbcf-206b-4795-b197-c6e328f2faed (610fcbcf-206b-4795-b197-c6e328f2faed): created successfully Nov 04 10:56:53 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-cc26726f-dc9f-4cde-b957-4789f8dc34d3 tempest-ServerRescueNegativeTestJSON-1618815521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (47b4c0f3-cd2a-4916-87dc-848977c5e0f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:56:53 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-cc26726f-dc9f-4cde-b957-4789f8dc34d3 tempest-ServerRescueNegativeTestJSON-1618815521 None] Flow 'volume_create_manager' (c17dec3c-1262-444b-9063-dd074511ff04) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87272) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:56:53 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-cc26726f-dc9f-4cde-b957-4789f8dc34d3 tempest-ServerRescueNegativeTestJSON-1618815521 None] Created volume successfully. Nov 04 10:56:53 devstack cinder-volume[87272]: DEBUG cinder.volume.flows.manager.create_volume [None req-a673f4ff-ae94-42a6-a2fe-44dacaef6465 tempest-VolumesGetTest-525573675 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87272) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 10:56:53 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-a673f4ff-ae94-42a6-a2fe-44dacaef6465 tempest-VolumesGetTest-525573675 None] Flow 'volume_create_manager' (ecc3a620-87e9-44b3-85f6-8ed37d440a11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:56:53 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-a673f4ff-ae94-42a6-a2fe-44dacaef6465 tempest-VolumesGetTest-525573675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (612a0b3d-fa86-45fa-ac1d-2935f41ff1df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:56:53 devstack sudo[96542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-2c023195-ecfc-4e4d-9399-d49191789da8.9ef43734-3813-435f-9575-38e10ea03b65 Nov 04 10:56:53 devstack sudo[96542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:56:53 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-a673f4ff-ae94-42a6-a2fe-44dacaef6465 tempest-VolumesGetTest-525573675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (612a0b3d-fa86-45fa-ac1d-2935f41ff1df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T09:56:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1456057135',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48647ff2-6d0c-41ed-9ea2-fc1ca5c2c836,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='1fd08fa49c4e4d2f83d17f8aaac1b8a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T09:56:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=b967890f-4f4c-4181-b0c6-dc06f815759a,status='creating',terminated_at=None,updated_at=2026-11-04T09:56:53Z,use_quota=True,user_id='c47ca10290f644b7a54567bf7a4cbc38',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8989e4f-21e3-4f0a-9584-0d818784e883),volume_type_id=f8989e4f-21e3-4f0a-9584-0d818784e883)' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:56:53 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-a673f4ff-ae94-42a6-a2fe-44dacaef6465 tempest-VolumesGetTest-525573675 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f315c49-58cc-4ee9-b76b-0ca651b3819d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:56:53 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-a673f4ff-ae94-42a6-a2fe-44dacaef6465 tempest-VolumesGetTest-525573675 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f315c49-58cc-4ee9-b76b-0ca651b3819d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:56:53 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-a673f4ff-ae94-42a6-a2fe-44dacaef6465 tempest-VolumesGetTest-525573675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (816b3f0a-cf7b-4c46-b2ea-b4d6cab1db20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:56:53 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-a673f4ff-ae94-42a6-a2fe-44dacaef6465 tempest-VolumesGetTest-525573675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (816b3f0a-cf7b-4c46-b2ea-b4d6cab1db20) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '48647ff2-6d0c-41ed-9ea2-fc1ca5c2c836', 'volume_name': 'volume-48647ff2-6d0c-41ed-9ea2-fc1ca5c2c836', 'volume_size': 1, 'source_volid': 'b967890f-4f4c-4181-b0c6-dc06f815759a', 'source_volstatus': 'available'}' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:56:53 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-a673f4ff-ae94-42a6-a2fe-44dacaef6465 tempest-VolumesGetTest-525573675 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (14d15711-ce4b-4d34-bf14-1d82d70bfbdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:56:53 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-a673f4ff-ae94-42a6-a2fe-44dacaef6465 tempest-VolumesGetTest-525573675 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (14d15711-ce4b-4d34-bf14-1d82d70bfbdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:56:53 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-a673f4ff-ae94-42a6-a2fe-44dacaef6465 tempest-VolumesGetTest-525573675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f7a688e3-1c62-41cd-b516-316f1ac38d71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:56:53 devstack cinder-volume[87272]: INFO cinder.volume.flows.manager.create_volume [None req-a673f4ff-ae94-42a6-a2fe-44dacaef6465 tempest-VolumesGetTest-525573675 None] Volume 48647ff2-6d0c-41ed-9ea2-fc1ca5c2c836: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-48647ff2-6d0c-41ed-9ea2-fc1ca5c2c836', 'volume_size': 1, 'source_volid': 'b967890f-4f4c-4181-b0c6-dc06f815759a', 'source_volstatus': 'available'} Nov 04 10:56:53 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-a673f4ff-ae94-42a6-a2fe-44dacaef6465 tempest-VolumesGetTest-525573675 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:56:53 devstack sudo[96542]: pam_unix(sudo:session): session closed for user root Nov 04 10:56:53 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-aa937a2d-1299-4b4d-8d84-144bc3e81337 tempest-VolumesDeleteCascade-325138244 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-2c023195-ecfc-4e4d-9399-d49191789da8.9ef43734-3813-435f-9575-38e10ea03b65" returned: 0 in 0.632s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:56:53 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.remotefs [None req-aa937a2d-1299-4b4d-8d84-144bc3e81337 tempest-VolumesDeleteCascade-325138244 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2c023195-ecfc-4e4d-9399-d49191789da8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87272) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 10:56:53 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-aa937a2d-1299-4b4d-8d84-144bc3e81337 tempest-VolumesDeleteCascade-325138244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-2c023195-ecfc-4e4d-9399-d49191789da8.9ef43734-3813-435f-9575-38e10ea03b65,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-2c023195-ecfc-4e4d-9399-d49191789da8.d9acf3e2-0a94-4b8c-b608-ff3bb83f0b85 1G {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:56:53 devstack sudo[96548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-2c023195-ecfc-4e4d-9399-d49191789da8.9ef43734-3813-435f-9575-38e10ea03b65,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-2c023195-ecfc-4e4d-9399-d49191789da8.d9acf3e2-0a94-4b8c-b608-ff3bb83f0b85 1G Nov 04 10:56:53 devstack sudo[96548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:56:54 devstack sudo[96548]: pam_unix(sudo:session): session closed for user root Nov 04 10:56:54 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-aa937a2d-1299-4b4d-8d84-144bc3e81337 tempest-VolumesDeleteCascade-325138244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-2c023195-ecfc-4e4d-9399-d49191789da8.9ef43734-3813-435f-9575-38e10ea03b65,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-2c023195-ecfc-4e4d-9399-d49191789da8.d9acf3e2-0a94-4b8c-b608-ff3bb83f0b85 1G" returned: 0 in 0.494s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:56:54 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-aa937a2d-1299-4b4d-8d84-144bc3e81337 tempest-VolumesDeleteCascade-325138244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2c023195-ecfc-4e4d-9399-d49191789da8.9ef43734-3813-435f-9575-38e10ea03b65 -F qcow2 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-2c023195-ecfc-4e4d-9399-d49191789da8.d9acf3e2-0a94-4b8c-b608-ff3bb83f0b85 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:56:54 devstack sudo[96554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2c023195-ecfc-4e4d-9399-d49191789da8.9ef43734-3813-435f-9575-38e10ea03b65 -F qcow2 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-2c023195-ecfc-4e4d-9399-d49191789da8.d9acf3e2-0a94-4b8c-b608-ff3bb83f0b85 Nov 04 10:56:54 devstack sudo[96554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:56:54 devstack sudo[96554]: pam_unix(sudo:session): session closed for user root Nov 04 10:56:54 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-aa937a2d-1299-4b4d-8d84-144bc3e81337 tempest-VolumesDeleteCascade-325138244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2c023195-ecfc-4e4d-9399-d49191789da8.9ef43734-3813-435f-9575-38e10ea03b65 -F qcow2 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-2c023195-ecfc-4e4d-9399-d49191789da8.d9acf3e2-0a94-4b8c-b608-ff3bb83f0b85" returned: 0 in 0.520s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:56:54 devstack cinder-volume[87272]: WARNING cinder.volume.drivers.remotefs [None req-aa937a2d-1299-4b4d-8d84-144bc3e81337 tempest-VolumesDeleteCascade-325138244 None] /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-2c023195-ecfc-4e4d-9399-d49191789da8.d9acf3e2-0a94-4b8c-b608-ff3bb83f0b85 is being set with open permissions: ugo+rw Nov 04 10:56:54 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-aa937a2d-1299-4b4d-8d84-144bc3e81337 tempest-VolumesDeleteCascade-325138244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-2c023195-ecfc-4e4d-9399-d49191789da8.d9acf3e2-0a94-4b8c-b608-ff3bb83f0b85 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:56:55 devstack sudo[96559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-2c023195-ecfc-4e4d-9399-d49191789da8.d9acf3e2-0a94-4b8c-b608-ff3bb83f0b85 Nov 04 10:56:55 devstack sudo[96559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:56:55 devstack sudo[96559]: pam_unix(sudo:session): session closed for user root Nov 04 10:56:55 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-aa937a2d-1299-4b4d-8d84-144bc3e81337 tempest-VolumesDeleteCascade-325138244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-2c023195-ecfc-4e4d-9399-d49191789da8.d9acf3e2-0a94-4b8c-b608-ff3bb83f0b85" returned: 0 in 0.600s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:56:55 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-aa937a2d-1299-4b4d-8d84-144bc3e81337 tempest-VolumesDeleteCascade-325138244 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.477s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:56:55 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-a673f4ff-ae94-42a6-a2fe-44dacaef6465 tempest-VolumesGetTest-525573675 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 1.965s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:56:55 devstack cinder-volume[87272]: INFO cinder.volume.drivers.remotefs [None req-a673f4ff-ae94-42a6-a2fe-44dacaef6465 tempest-VolumesGetTest-525573675 None] Cloning volume b967890f-4f4c-4181-b0c6-dc06f815759a to volume 48647ff2-6d0c-41ed-9ea2-fc1ca5c2c836 Nov 04 10:56:55 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-aa937a2d-1299-4b4d-8d84-144bc3e81337 tempest-VolumesDeleteCascade-325138244 None] Create snapshot completed successfully Nov 04 10:56:55 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.remotefs [None req-a673f4ff-ae94-42a6-a2fe-44dacaef6465 tempest-VolumesGetTest-525573675 None] Creating offline snapshot 8fac0f1c-84fb-4b2c-8fbb-96d4cb0c0fc9 of volume b967890f-4f4c-4181-b0c6-dc06f815759a {{(pid=87272) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 04 10:56:55 devstack cinder-volume[87272]: DEBUG oslo.privsep.daemon [-] privsep: reply[7992a476-a90c-4cf9-8be4-de40ecef4efd]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:56:55 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-a673f4ff-ae94-42a6-a2fe-44dacaef6465 tempest-VolumesGetTest-525573675 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-b967890f-4f4c-4181-b0c6-dc06f815759a {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:56:56 devstack sudo[96562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-b967890f-4f4c-4181-b0c6-dc06f815759a Nov 04 10:56:56 devstack sudo[96562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:56:56 devstack sudo[96562]: pam_unix(sudo:session): session closed for user root Nov 04 10:56:56 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-a673f4ff-ae94-42a6-a2fe-44dacaef6465 tempest-VolumesGetTest-525573675 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-b967890f-4f4c-4181-b0c6-dc06f815759a" returned: 0 in 0.625s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:56:56 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-a673f4ff-ae94-42a6-a2fe-44dacaef6465 tempest-VolumesGetTest-525573675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-b967890f-4f4c-4181-b0c6-dc06f815759a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-b967890f-4f4c-4181-b0c6-dc06f815759a.8fac0f1c-84fb-4b2c-8fbb-96d4cb0c0fc9 1G {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:56:56 devstack sudo[96574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-b967890f-4f4c-4181-b0c6-dc06f815759a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-b967890f-4f4c-4181-b0c6-dc06f815759a.8fac0f1c-84fb-4b2c-8fbb-96d4cb0c0fc9 1G Nov 04 10:56:56 devstack sudo[96574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:56:56 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-2f5a35bc-3b0e-4e12-b39c-3e747c505895 tempest-VolumesDeleteCascade-325138244 None] Acquiring lock "cinder-2c023195-ecfc-4e4d-9399-d49191789da8-delete_volume" by "delete_volume" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:56:56 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-2f5a35bc-3b0e-4e12-b39c-3e747c505895 tempest-VolumesDeleteCascade-325138244 None] Lock "cinder-2c023195-ecfc-4e4d-9399-d49191789da8-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:56:57 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-2f5a35bc-3b0e-4e12-b39c-3e747c505895 tempest-VolumesDeleteCascade-325138244 None] Performing cascade delete. {{(pid=87272) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Nov 04 10:56:57 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-2f5a35bc-3b0e-4e12-b39c-3e747c505895 tempest-VolumesDeleteCascade-325138244 None] Acquiring lock "cinder-9ef43734-3813-435f-9575-38e10ea03b65-delete_snapshot" by "delete_snapshot" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:56:57 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-2f5a35bc-3b0e-4e12-b39c-3e747c505895 tempest-VolumesDeleteCascade-325138244 None] Lock "cinder-9ef43734-3813-435f-9575-38e10ea03b65-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:56:57 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-2f5a35bc-3b0e-4e12-b39c-3e747c505895 tempest-VolumesDeleteCascade-325138244 None] Acquiring lock "cinder-quobyte-2c023195-ecfc-4e4d-9399-d49191789da8" by "delete_snapshot" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:56:57 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-2f5a35bc-3b0e-4e12-b39c-3e747c505895 tempest-VolumesDeleteCascade-325138244 None] Lock "cinder-quobyte-2c023195-ecfc-4e4d-9399-d49191789da8" acquired by "delete_snapshot" :: waited 0.031s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:56:57 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-2f5a35bc-3b0e-4e12-b39c-3e747c505895 tempest-VolumesDeleteCascade-325138244 None] Acquiring lock "cinder-quobyte-9ef43734-3813-435f-9575-38e10ea03b65" by "_delete_snapshot" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:56:57 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-2f5a35bc-3b0e-4e12-b39c-3e747c505895 tempest-VolumesDeleteCascade-325138244 None] Lock "cinder-quobyte-9ef43734-3813-435f-9575-38e10ea03b65" acquired by "_delete_snapshot" :: waited 0.046s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:56:57 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.remotefs [None req-2f5a35bc-3b0e-4e12-b39c-3e747c505895 tempest-VolumesDeleteCascade-325138244 None] Deleting offline snapshot 9ef43734-3813-435f-9575-38e10ea03b65 of volume 2c023195-ecfc-4e4d-9399-d49191789da8 {{(pid=87272) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 04 10:56:57 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.remotefs [None req-2f5a35bc-3b0e-4e12-b39c-3e747c505895 tempest-VolumesDeleteCascade-325138244 None] snapshot_file for this snap is: volume-2c023195-ecfc-4e4d-9399-d49191789da8.9ef43734-3813-435f-9575-38e10ea03b65 {{(pid=87272) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 04 10:56:57 devstack cinder-volume[87272]: DEBUG oslo.privsep.daemon [-] privsep: reply[01ffec70-d63e-4c05-bfef-dca61f5fe28a]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:56:57 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-2f5a35bc-3b0e-4e12-b39c-3e747c505895 tempest-VolumesDeleteCascade-325138244 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-2c023195-ecfc-4e4d-9399-d49191789da8.9ef43734-3813-435f-9575-38e10ea03b65 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:56:57 devstack sudo[96574]: pam_unix(sudo:session): session closed for user root Nov 04 10:56:57 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-a673f4ff-ae94-42a6-a2fe-44dacaef6465 tempest-VolumesGetTest-525573675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-b967890f-4f4c-4181-b0c6-dc06f815759a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-b967890f-4f4c-4181-b0c6-dc06f815759a.8fac0f1c-84fb-4b2c-8fbb-96d4cb0c0fc9 1G" returned: 0 in 0.989s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:56:57 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-a673f4ff-ae94-42a6-a2fe-44dacaef6465 tempest-VolumesGetTest-525573675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b967890f-4f4c-4181-b0c6-dc06f815759a -F qcow2 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-b967890f-4f4c-4181-b0c6-dc06f815759a.8fac0f1c-84fb-4b2c-8fbb-96d4cb0c0fc9 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:56:57 devstack sudo[96589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b967890f-4f4c-4181-b0c6-dc06f815759a -F qcow2 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-b967890f-4f4c-4181-b0c6-dc06f815759a.8fac0f1c-84fb-4b2c-8fbb-96d4cb0c0fc9 Nov 04 10:56:57 devstack sudo[96589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:56:57 devstack sudo[96587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-2c023195-ecfc-4e4d-9399-d49191789da8.9ef43734-3813-435f-9575-38e10ea03b65 Nov 04 10:56:57 devstack sudo[96587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:56:57 devstack sudo[96587]: pam_unix(sudo:session): session closed for user root Nov 04 10:56:57 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-2f5a35bc-3b0e-4e12-b39c-3e747c505895 tempest-VolumesDeleteCascade-325138244 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-2c023195-ecfc-4e4d-9399-d49191789da8.9ef43734-3813-435f-9575-38e10ea03b65" returned: 0 in 0.637s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:56:57 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.remotefs [None req-2f5a35bc-3b0e-4e12-b39c-3e747c505895 tempest-VolumesDeleteCascade-325138244 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2c023195-ecfc-4e4d-9399-d49191789da8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87272) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 10:56:58 devstack cinder-volume[87272]: DEBUG oslo.privsep.daemon [-] privsep: reply[3908e0a6-c04c-4d14-bdea-8d4e6ac407ac]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:56:58 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-2f5a35bc-3b0e-4e12-b39c-3e747c505895 tempest-VolumesDeleteCascade-325138244 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-2c023195-ecfc-4e4d-9399-d49191789da8 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:56:58 devstack sudo[96589]: pam_unix(sudo:session): session closed for user root Nov 04 10:56:58 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-a673f4ff-ae94-42a6-a2fe-44dacaef6465 tempest-VolumesGetTest-525573675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b967890f-4f4c-4181-b0c6-dc06f815759a -F qcow2 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-b967890f-4f4c-4181-b0c6-dc06f815759a.8fac0f1c-84fb-4b2c-8fbb-96d4cb0c0fc9" returned: 0 in 0.631s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:56:58 devstack cinder-volume[87272]: WARNING cinder.volume.drivers.remotefs [None req-a673f4ff-ae94-42a6-a2fe-44dacaef6465 tempest-VolumesGetTest-525573675 None] /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-b967890f-4f4c-4181-b0c6-dc06f815759a.8fac0f1c-84fb-4b2c-8fbb-96d4cb0c0fc9 is being set with open permissions: ugo+rw Nov 04 10:56:58 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-a673f4ff-ae94-42a6-a2fe-44dacaef6465 tempest-VolumesGetTest-525573675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-b967890f-4f4c-4181-b0c6-dc06f815759a.8fac0f1c-84fb-4b2c-8fbb-96d4cb0c0fc9 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:56:58 devstack sudo[96621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-b967890f-4f4c-4181-b0c6-dc06f815759a.8fac0f1c-84fb-4b2c-8fbb-96d4cb0c0fc9 Nov 04 10:56:58 devstack sudo[96621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:56:58 devstack sudo[96620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-2c023195-ecfc-4e4d-9399-d49191789da8 Nov 04 10:56:58 devstack sudo[96620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:56:58 devstack sudo[96620]: pam_unix(sudo:session): session closed for user root Nov 04 10:56:58 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-2f5a35bc-3b0e-4e12-b39c-3e747c505895 tempest-VolumesDeleteCascade-325138244 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-2c023195-ecfc-4e4d-9399-d49191789da8" returned: 0 in 0.618s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:56:58 devstack sudo[96621]: pam_unix(sudo:session): session closed for user root Nov 04 10:56:58 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-a673f4ff-ae94-42a6-a2fe-44dacaef6465 tempest-VolumesGetTest-525573675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-b967890f-4f4c-4181-b0c6-dc06f815759a.8fac0f1c-84fb-4b2c-8fbb-96d4cb0c0fc9" returned: 0 in 0.672s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:56:58 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-a673f4ff-ae94-42a6-a2fe-44dacaef6465 tempest-VolumesGetTest-525573675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-b967890f-4f4c-4181-b0c6-dc06f815759a.info {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:56:58 devstack cinder-volume[87272]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d94c621-be2c-4c0f-bf8b-78cc8ba95780]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:56:58 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-2f5a35bc-3b0e-4e12-b39c-3e747c505895 tempest-VolumesDeleteCascade-325138244 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-2c023195-ecfc-4e4d-9399-d49191789da8.d9acf3e2-0a94-4b8c-b608-ff3bb83f0b85 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:56:58 devstack sudo[96628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-b967890f-4f4c-4181-b0c6-dc06f815759a.info Nov 04 10:56:58 devstack sudo[96628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:56:59 devstack sudo[96629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-2c023195-ecfc-4e4d-9399-d49191789da8.d9acf3e2-0a94-4b8c-b608-ff3bb83f0b85 Nov 04 10:56:59 devstack sudo[96629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:56:59 devstack sudo[96628]: pam_unix(sudo:session): session closed for user root Nov 04 10:56:59 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-a673f4ff-ae94-42a6-a2fe-44dacaef6465 tempest-VolumesGetTest-525573675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-b967890f-4f4c-4181-b0c6-dc06f815759a.info" returned: 0 in 0.421s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:56:59 devstack cinder-volume[87272]: WARNING cinder.volume.drivers.remotefs [None req-a673f4ff-ae94-42a6-a2fe-44dacaef6465 tempest-VolumesGetTest-525573675 None] /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-b967890f-4f4c-4181-b0c6-dc06f815759a.info is being set with open permissions: ugo+rw Nov 04 10:56:59 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-a673f4ff-ae94-42a6-a2fe-44dacaef6465 tempest-VolumesGetTest-525573675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-b967890f-4f4c-4181-b0c6-dc06f815759a.info {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:56:59 devstack sudo[96633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-b967890f-4f4c-4181-b0c6-dc06f815759a.info Nov 04 10:56:59 devstack sudo[96633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:56:59 devstack sudo[96629]: pam_unix(sudo:session): session closed for user root Nov 04 10:56:59 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-2f5a35bc-3b0e-4e12-b39c-3e747c505895 tempest-VolumesDeleteCascade-325138244 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-2c023195-ecfc-4e4d-9399-d49191789da8.d9acf3e2-0a94-4b8c-b608-ff3bb83f0b85" returned: 0 in 0.833s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:56:59 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.remotefs [None req-2f5a35bc-3b0e-4e12-b39c-3e747c505895 tempest-VolumesDeleteCascade-325138244 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2c023195-ecfc-4e4d-9399-d49191789da8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87272) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 10:56:59 devstack sudo[96633]: pam_unix(sudo:session): session closed for user root Nov 04 10:56:59 devstack cinder-volume[87272]: DEBUG oslo.privsep.daemon [-] privsep: reply[32130a81-4a97-4ee6-9155-728f031a99d8]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:56:59 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-2f5a35bc-3b0e-4e12-b39c-3e747c505895 tempest-VolumesDeleteCascade-325138244 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-2c023195-ecfc-4e4d-9399-d49191789da8.9ef43734-3813-435f-9575-38e10ea03b65 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:56:59 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-a673f4ff-ae94-42a6-a2fe-44dacaef6465 tempest-VolumesGetTest-525573675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-b967890f-4f4c-4181-b0c6-dc06f815759a.info" returned: 0 in 0.516s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:56:59 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-a673f4ff-ae94-42a6-a2fe-44dacaef6465 tempest-VolumesGetTest-525573675 None] Acquiring lock "cinder-quobyte-48647ff2-6d0c-41ed-9ea2-fc1ca5c2c836" by "_copy_volume_from_snapshot" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:56:59 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-a673f4ff-ae94-42a6-a2fe-44dacaef6465 tempest-VolumesGetTest-525573675 None] Lock "cinder-quobyte-48647ff2-6d0c-41ed-9ea2-fc1ca5c2c836" acquired by "_copy_volume_from_snapshot" :: waited 0.073s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:56:59 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-a673f4ff-ae94-42a6-a2fe-44dacaef6465 tempest-VolumesGetTest-525573675 None] snapshot: 8fac0f1c-84fb-4b2c-8fbb-96d4cb0c0fc9, volume: 48647ff2-6d0c-41ed-9ea2-fc1ca5c2c836, {{(pid=87272) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 04 10:56:59 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-a673f4ff-ae94-42a6-a2fe-44dacaef6465 tempest-VolumesGetTest-525573675 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:56:59 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-a673f4ff-ae94-42a6-a2fe-44dacaef6465 tempest-VolumesGetTest-525573675 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:56:59 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-a673f4ff-ae94-42a6-a2fe-44dacaef6465 tempest-VolumesGetTest-525573675 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898': None} {{(pid=87272) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:56:59 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-a673f4ff-ae94-42a6-a2fe-44dacaef6465 tempest-VolumesGetTest-525573675 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'] {{(pid=87272) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:56:59 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-a673f4ff-ae94-42a6-a2fe-44dacaef6465 tempest-VolumesGetTest-525573675 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.031s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:57:00 devstack cinder-volume[87272]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c7227e5-9cd7-448a-9725-b2ffe59d88e7]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:57:00 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-a673f4ff-ae94-42a6-a2fe-44dacaef6465 tempest-VolumesGetTest-525573675 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-b967890f-4f4c-4181-b0c6-dc06f815759a.8fac0f1c-84fb-4b2c-8fbb-96d4cb0c0fc9 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:57:00 devstack sudo[96640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-2c023195-ecfc-4e4d-9399-d49191789da8.9ef43734-3813-435f-9575-38e10ea03b65 Nov 04 10:57:00 devstack sudo[96640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:57:00 devstack sudo[96642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-b967890f-4f4c-4181-b0c6-dc06f815759a.8fac0f1c-84fb-4b2c-8fbb-96d4cb0c0fc9 Nov 04 10:57:00 devstack sudo[96642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:57:00 devstack sudo[96640]: pam_unix(sudo:session): session closed for user root Nov 04 10:57:00 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-2f5a35bc-3b0e-4e12-b39c-3e747c505895 tempest-VolumesDeleteCascade-325138244 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-2c023195-ecfc-4e4d-9399-d49191789da8.9ef43734-3813-435f-9575-38e10ea03b65" returned: 0 in 1.211s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:57:00 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.remotefs [None req-2f5a35bc-3b0e-4e12-b39c-3e747c505895 tempest-VolumesDeleteCascade-325138244 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2c023195-ecfc-4e4d-9399-d49191789da8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87272) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 10:57:00 devstack cinder-volume[87272]: DEBUG oslo.privsep.daemon [-] privsep: reply[d16825dc-899b-46e3-a6d0-3aa407683b37]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:57:00 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-2f5a35bc-3b0e-4e12-b39c-3e747c505895 tempest-VolumesDeleteCascade-325138244 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-2c023195-ecfc-4e4d-9399-d49191789da8 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:57:01 devstack sudo[96642]: pam_unix(sudo:session): session closed for user root Nov 04 10:57:01 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-a673f4ff-ae94-42a6-a2fe-44dacaef6465 tempest-VolumesGetTest-525573675 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-b967890f-4f4c-4181-b0c6-dc06f815759a.8fac0f1c-84fb-4b2c-8fbb-96d4cb0c0fc9" returned: 0 in 1.120s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:57:01 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.remotefs [None req-a673f4ff-ae94-42a6-a2fe-44dacaef6465 tempest-VolumesGetTest-525573675 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b967890f-4f4c-4181-b0c6-dc06f815759a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87272) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 10:57:01 devstack cinder-volume[87272]: DEBUG oslo.privsep.daemon [-] privsep: reply[796e405a-8b43-4383-bc7b-7a141ed7b1ee]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:57:01 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-a673f4ff-ae94-42a6-a2fe-44dacaef6465 tempest-VolumesGetTest-525573675 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-b967890f-4f4c-4181-b0c6-dc06f815759a {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:57:01 devstack sudo[96650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-2c023195-ecfc-4e4d-9399-d49191789da8 Nov 04 10:57:01 devstack sudo[96650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:57:01 devstack sudo[96653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-b967890f-4f4c-4181-b0c6-dc06f815759a Nov 04 10:57:01 devstack sudo[96653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:57:02 devstack sudo[96650]: pam_unix(sudo:session): session closed for user root Nov 04 10:57:02 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-2f5a35bc-3b0e-4e12-b39c-3e747c505895 tempest-VolumesDeleteCascade-325138244 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-2c023195-ecfc-4e4d-9399-d49191789da8" returned: 0 in 1.116s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:57:02 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-2f5a35bc-3b0e-4e12-b39c-3e747c505895 tempest-VolumesDeleteCascade-325138244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-2c023195-ecfc-4e4d-9399-d49191789da8.9ef43734-3813-435f-9575-38e10ea03b65 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:57:02 devstack sudo[96676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-2c023195-ecfc-4e4d-9399-d49191789da8.9ef43734-3813-435f-9575-38e10ea03b65 Nov 04 10:57:02 devstack sudo[96676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:57:02 devstack sudo[96653]: pam_unix(sudo:session): session closed for user root Nov 04 10:57:02 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-a673f4ff-ae94-42a6-a2fe-44dacaef6465 tempest-VolumesGetTest-525573675 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-b967890f-4f4c-4181-b0c6-dc06f815759a" returned: 0 in 1.235s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:57:02 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-a673f4ff-ae94-42a6-a2fe-44dacaef6465 tempest-VolumesGetTest-525573675 None] will copy from snapshot at /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-b967890f-4f4c-4181-b0c6-dc06f815759a {{(pid=87272) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 04 10:57:02 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-a673f4ff-ae94-42a6-a2fe-44dacaef6465 tempest-VolumesGetTest-525573675 None] Creating direct copy from snapshot {{(pid=87272) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 04 10:57:02 devstack cinder-volume[87272]: DEBUG cinder.utils [None req-a673f4ff-ae94-42a6-a2fe-44dacaef6465 tempest-VolumesGetTest-525573675 None] Path /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-48647ff2-6d0c-41ed-9ea2-fc1ca5c2c836 not found in is_blk_device check {{(pid=87272) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Nov 04 10:57:02 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-a673f4ff-ae94-42a6-a2fe-44dacaef6465 tempest-VolumesGetTest-525573675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-b967890f-4f4c-4181-b0c6-dc06f815759a /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-48647ff2-6d0c-41ed-9ea2-fc1ca5c2c836 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:57:02 devstack sudo[96683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-b967890f-4f4c-4181-b0c6-dc06f815759a /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-48647ff2-6d0c-41ed-9ea2-fc1ca5c2c836 Nov 04 10:57:02 devstack sudo[96683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:57:03 devstack sudo[96676]: pam_unix(sudo:session): session closed for user root Nov 04 10:57:03 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-2f5a35bc-3b0e-4e12-b39c-3e747c505895 tempest-VolumesDeleteCascade-325138244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-2c023195-ecfc-4e4d-9399-d49191789da8.9ef43734-3813-435f-9575-38e10ea03b65" returned: 0 in 0.933s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:57:03 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-2f5a35bc-3b0e-4e12-b39c-3e747c505895 tempest-VolumesDeleteCascade-325138244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-2c023195-ecfc-4e4d-9399-d49191789da8.9ef43734-3813-435f-9575-38e10ea03b65 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:57:03 devstack sudo[96693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-2c023195-ecfc-4e4d-9399-d49191789da8.9ef43734-3813-435f-9575-38e10ea03b65 Nov 04 10:57:03 devstack sudo[96693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:57:03 devstack sudo[96693]: pam_unix(sudo:session): session closed for user root Nov 04 10:57:03 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-2f5a35bc-3b0e-4e12-b39c-3e747c505895 tempest-VolumesDeleteCascade-325138244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-2c023195-ecfc-4e4d-9399-d49191789da8.9ef43734-3813-435f-9575-38e10ea03b65" returned: 0 in 0.423s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:57:03 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-2f5a35bc-3b0e-4e12-b39c-3e747c505895 tempest-VolumesDeleteCascade-325138244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2c023195-ecfc-4e4d-9399-d49191789da8 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-2c023195-ecfc-4e4d-9399-d49191789da8.d9acf3e2-0a94-4b8c-b608-ff3bb83f0b85 -F qcow2 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:57:03 devstack sudo[96709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2c023195-ecfc-4e4d-9399-d49191789da8 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-2c023195-ecfc-4e4d-9399-d49191789da8.d9acf3e2-0a94-4b8c-b608-ff3bb83f0b85 -F qcow2 Nov 04 10:57:03 devstack sudo[96709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:57:04 devstack sudo[96709]: pam_unix(sudo:session): session closed for user root Nov 04 10:57:04 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-2f5a35bc-3b0e-4e12-b39c-3e747c505895 tempest-VolumesDeleteCascade-325138244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2c023195-ecfc-4e4d-9399-d49191789da8 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-2c023195-ecfc-4e4d-9399-d49191789da8.d9acf3e2-0a94-4b8c-b608-ff3bb83f0b85 -F qcow2" returned: 0 in 1.013s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:57:04 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-2f5a35bc-3b0e-4e12-b39c-3e747c505895 tempest-VolumesDeleteCascade-325138244 None] Lock "cinder-quobyte-9ef43734-3813-435f-9575-38e10ea03b65" released by "_delete_snapshot" :: held 7.334s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:57:04 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-2f5a35bc-3b0e-4e12-b39c-3e747c505895 tempest-VolumesDeleteCascade-325138244 None] Lock "cinder-quobyte-2c023195-ecfc-4e4d-9399-d49191789da8" released by "delete_snapshot" :: held 7.408s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:57:04 devstack cinder-volume[87272]: DEBUG cinder.quota [None req-2f5a35bc-3b0e-4e12-b39c-3e747c505895 tempest-VolumesDeleteCascade-325138244 None] Created reservations ['b406b5db-004c-432d-847f-f9ac345ab47e', '61b645e5-eb9f-4eb7-94d5-b789696a7431', 'a7ebf4f7-64ab-4ee4-9463-036503d2247b', '0a44ae59-95cf-40e3-99bd-146c8cf83b42'] {{(pid=87272) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 10:57:05 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-2f5a35bc-3b0e-4e12-b39c-3e747c505895 tempest-VolumesDeleteCascade-325138244 None] Delete snapshot completed successfully. Nov 04 10:57:05 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-2f5a35bc-3b0e-4e12-b39c-3e747c505895 tempest-VolumesDeleteCascade-325138244 None] Lock "cinder-9ef43734-3813-435f-9575-38e10ea03b65-delete_snapshot" released by "delete_snapshot" :: held 7.957s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:57:05 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-2f5a35bc-3b0e-4e12-b39c-3e747c505895 tempest-VolumesDeleteCascade-325138244 None] Acquiring lock "cinder-d9acf3e2-0a94-4b8c-b608-ff3bb83f0b85-delete_snapshot" by "delete_snapshot" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:57:05 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-2f5a35bc-3b0e-4e12-b39c-3e747c505895 tempest-VolumesDeleteCascade-325138244 None] Lock "cinder-d9acf3e2-0a94-4b8c-b608-ff3bb83f0b85-delete_snapshot" acquired by "delete_snapshot" :: waited 0.047s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:57:05 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-2f5a35bc-3b0e-4e12-b39c-3e747c505895 tempest-VolumesDeleteCascade-325138244 None] Acquiring lock "cinder-quobyte-2c023195-ecfc-4e4d-9399-d49191789da8" by "delete_snapshot" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:57:05 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-2f5a35bc-3b0e-4e12-b39c-3e747c505895 tempest-VolumesDeleteCascade-325138244 None] Lock "cinder-quobyte-2c023195-ecfc-4e4d-9399-d49191789da8" acquired by "delete_snapshot" :: waited 0.055s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:57:05 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-2f5a35bc-3b0e-4e12-b39c-3e747c505895 tempest-VolumesDeleteCascade-325138244 None] Acquiring lock "cinder-quobyte-d9acf3e2-0a94-4b8c-b608-ff3bb83f0b85" by "_delete_snapshot" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:57:05 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-2f5a35bc-3b0e-4e12-b39c-3e747c505895 tempest-VolumesDeleteCascade-325138244 None] Lock "cinder-quobyte-d9acf3e2-0a94-4b8c-b608-ff3bb83f0b85" acquired by "_delete_snapshot" :: waited 0.047s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:57:05 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.remotefs [None req-2f5a35bc-3b0e-4e12-b39c-3e747c505895 tempest-VolumesDeleteCascade-325138244 None] Deleting offline snapshot d9acf3e2-0a94-4b8c-b608-ff3bb83f0b85 of volume 2c023195-ecfc-4e4d-9399-d49191789da8 {{(pid=87272) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 04 10:57:05 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.remotefs [None req-2f5a35bc-3b0e-4e12-b39c-3e747c505895 tempest-VolumesDeleteCascade-325138244 None] snapshot_file for this snap is: volume-2c023195-ecfc-4e4d-9399-d49191789da8.d9acf3e2-0a94-4b8c-b608-ff3bb83f0b85 {{(pid=87272) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 04 10:57:05 devstack cinder-volume[87272]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef2cfbda-0647-47b4-a4cf-c069760cd187]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:57:05 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-2f5a35bc-3b0e-4e12-b39c-3e747c505895 tempest-VolumesDeleteCascade-325138244 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-2c023195-ecfc-4e4d-9399-d49191789da8.d9acf3e2-0a94-4b8c-b608-ff3bb83f0b85 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:57:05 devstack sudo[96752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-2c023195-ecfc-4e4d-9399-d49191789da8.d9acf3e2-0a94-4b8c-b608-ff3bb83f0b85 Nov 04 10:57:05 devstack sudo[96752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:57:06 devstack sudo[96752]: pam_unix(sudo:session): session closed for user root Nov 04 10:57:06 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-2f5a35bc-3b0e-4e12-b39c-3e747c505895 tempest-VolumesDeleteCascade-325138244 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-2c023195-ecfc-4e4d-9399-d49191789da8.d9acf3e2-0a94-4b8c-b608-ff3bb83f0b85" returned: 0 in 1.012s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:57:06 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.remotefs [None req-2f5a35bc-3b0e-4e12-b39c-3e747c505895 tempest-VolumesDeleteCascade-325138244 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2c023195-ecfc-4e4d-9399-d49191789da8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87272) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 10:57:06 devstack cinder-volume[87272]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ae58484-3e8c-4367-af88-6f3ba3639cc5]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:57:06 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-2f5a35bc-3b0e-4e12-b39c-3e747c505895 tempest-VolumesDeleteCascade-325138244 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-2c023195-ecfc-4e4d-9399-d49191789da8 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:57:06 devstack sudo[96777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-2c023195-ecfc-4e4d-9399-d49191789da8 Nov 04 10:57:06 devstack sudo[96777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:57:07 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-ee9e695e-2925-434b-b975-cfa43d13cc43 tempest-ServerRescueNegativeTestJSON-1618815521 None] Acquiring lock "cinder-610fcbcf-206b-4795-b197-c6e328f2faed-delete_volume" by "delete_volume" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:57:07 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-ee9e695e-2925-434b-b975-cfa43d13cc43 tempest-ServerRescueNegativeTestJSON-1618815521 None] Lock "cinder-610fcbcf-206b-4795-b197-c6e328f2faed-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:57:07 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-ee9e695e-2925-434b-b975-cfa43d13cc43 tempest-ServerRescueNegativeTestJSON-1618815521 None] Acquiring lock "cinder-quobyte-610fcbcf-206b-4795-b197-c6e328f2faed" by "delete_volume" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:57:07 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-ee9e695e-2925-434b-b975-cfa43d13cc43 tempest-ServerRescueNegativeTestJSON-1618815521 None] Lock "cinder-quobyte-610fcbcf-206b-4795-b197-c6e328f2faed" acquired by "delete_volume" :: waited 0.038s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:57:07 devstack cinder-volume[87272]: DEBUG oslo.privsep.daemon [-] privsep: reply[87bae33d-e632-4c5a-9d55-7b6f4c1cd943]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:57:07 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-ee9e695e-2925-434b-b975-cfa43d13cc43 tempest-ServerRescueNegativeTestJSON-1618815521 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-610fcbcf-206b-4795-b197-c6e328f2faed {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:57:07 devstack sudo[96780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-610fcbcf-206b-4795-b197-c6e328f2faed Nov 04 10:57:07 devstack sudo[96780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:57:07 devstack sudo[96777]: pam_unix(sudo:session): session closed for user root Nov 04 10:57:07 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-2f5a35bc-3b0e-4e12-b39c-3e747c505895 tempest-VolumesDeleteCascade-325138244 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-2c023195-ecfc-4e4d-9399-d49191789da8" returned: 0 in 1.082s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:57:07 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-2f5a35bc-3b0e-4e12-b39c-3e747c505895 tempest-VolumesDeleteCascade-325138244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-2c023195-ecfc-4e4d-9399-d49191789da8.d9acf3e2-0a94-4b8c-b608-ff3bb83f0b85 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:57:07 devstack sudo[96786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-2c023195-ecfc-4e4d-9399-d49191789da8.d9acf3e2-0a94-4b8c-b608-ff3bb83f0b85 Nov 04 10:57:07 devstack sudo[96786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:57:08 devstack sudo[96780]: pam_unix(sudo:session): session closed for user root Nov 04 10:57:08 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-ee9e695e-2925-434b-b975-cfa43d13cc43 tempest-ServerRescueNegativeTestJSON-1618815521 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-610fcbcf-206b-4795-b197-c6e328f2faed" returned: 0 in 1.003s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:57:08 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-ee9e695e-2925-434b-b975-cfa43d13cc43 tempest-ServerRescueNegativeTestJSON-1618815521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-610fcbcf-206b-4795-b197-c6e328f2faed {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:57:08 devstack sudo[96795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-610fcbcf-206b-4795-b197-c6e328f2faed Nov 04 10:57:08 devstack sudo[96795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:57:08 devstack sudo[96786]: pam_unix(sudo:session): session closed for user root Nov 04 10:57:08 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-2f5a35bc-3b0e-4e12-b39c-3e747c505895 tempest-VolumesDeleteCascade-325138244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-2c023195-ecfc-4e4d-9399-d49191789da8.d9acf3e2-0a94-4b8c-b608-ff3bb83f0b85" returned: 0 in 1.026s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:57:08 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-2f5a35bc-3b0e-4e12-b39c-3e747c505895 tempest-VolumesDeleteCascade-325138244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-2c023195-ecfc-4e4d-9399-d49191789da8.d9acf3e2-0a94-4b8c-b608-ff3bb83f0b85 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:57:08 devstack sudo[96797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-2c023195-ecfc-4e4d-9399-d49191789da8.d9acf3e2-0a94-4b8c-b608-ff3bb83f0b85 Nov 04 10:57:08 devstack sudo[96797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:57:09 devstack sudo[96795]: pam_unix(sudo:session): session closed for user root Nov 04 10:57:09 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-ee9e695e-2925-434b-b975-cfa43d13cc43 tempest-ServerRescueNegativeTestJSON-1618815521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-610fcbcf-206b-4795-b197-c6e328f2faed" returned: 0 in 0.826s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:57:09 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-ee9e695e-2925-434b-b975-cfa43d13cc43 tempest-ServerRescueNegativeTestJSON-1618815521 None] Lock "cinder-quobyte-610fcbcf-206b-4795-b197-c6e328f2faed" released by "delete_volume" :: held 2.015s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:57:09 devstack cinder-volume[87272]: DEBUG cinder.quota [None req-ee9e695e-2925-434b-b975-cfa43d13cc43 tempest-ServerRescueNegativeTestJSON-1618815521 None] Created reservations ['27f9ad5b-c83e-45c6-b4fb-bf403e24aaaa', 'fe03dff0-e2c8-4a90-9278-c0e902cfdeea', '90ef4388-7573-40bb-9637-c88e53282402', '2b53537f-a749-4bbd-9792-0d1d2d286a5a'] {{(pid=87272) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 10:57:09 devstack sudo[96797]: pam_unix(sudo:session): session closed for user root Nov 04 10:57:09 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-2f5a35bc-3b0e-4e12-b39c-3e747c505895 tempest-VolumesDeleteCascade-325138244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-2c023195-ecfc-4e4d-9399-d49191789da8.d9acf3e2-0a94-4b8c-b608-ff3bb83f0b85" returned: 0 in 0.875s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:57:09 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-ee9e695e-2925-434b-b975-cfa43d13cc43 tempest-ServerRescueNegativeTestJSON-1618815521 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:57:09 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-ee9e695e-2925-434b-b975-cfa43d13cc43 tempest-ServerRescueNegativeTestJSON-1618815521 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:57:09 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-ee9e695e-2925-434b-b975-cfa43d13cc43 tempest-ServerRescueNegativeTestJSON-1618815521 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898': None} {{(pid=87272) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:57:09 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-ee9e695e-2925-434b-b975-cfa43d13cc43 tempest-ServerRescueNegativeTestJSON-1618815521 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'] {{(pid=87272) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:57:09 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-ee9e695e-2925-434b-b975-cfa43d13cc43 tempest-ServerRescueNegativeTestJSON-1618815521 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:57:09 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-ee9e695e-2925-434b-b975-cfa43d13cc43 tempest-ServerRescueNegativeTestJSON-1618815521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:57:09 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-2f5a35bc-3b0e-4e12-b39c-3e747c505895 tempest-VolumesDeleteCascade-325138244 None] Lock "cinder-quobyte-d9acf3e2-0a94-4b8c-b608-ff3bb83f0b85" released by "_delete_snapshot" :: held 4.410s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:57:09 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-2f5a35bc-3b0e-4e12-b39c-3e747c505895 tempest-VolumesDeleteCascade-325138244 None] Lock "cinder-quobyte-2c023195-ecfc-4e4d-9399-d49191789da8" released by "delete_snapshot" :: held 4.486s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:57:09 devstack sudo[96801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1 Nov 04 10:57:09 devstack sudo[96801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:57:10 devstack cinder-volume[87272]: DEBUG cinder.quota [None req-2f5a35bc-3b0e-4e12-b39c-3e747c505895 tempest-VolumesDeleteCascade-325138244 None] Created reservations ['c5bb32c4-38b6-43c3-aba1-deedcf348422', '82d46b19-831b-49de-9eb0-c0656acf8053', '41ee7ae4-23d1-4ac7-9225-f241d417f501', 'b3704b21-5fe5-48db-ae53-02a449d17f52'] {{(pid=87272) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 10:57:10 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-2f5a35bc-3b0e-4e12-b39c-3e747c505895 tempest-VolumesDeleteCascade-325138244 None] Delete snapshot completed successfully. Nov 04 10:57:10 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-2f5a35bc-3b0e-4e12-b39c-3e747c505895 tempest-VolumesDeleteCascade-325138244 None] Lock "cinder-d9acf3e2-0a94-4b8c-b608-ff3bb83f0b85-delete_snapshot" released by "delete_snapshot" :: held 5.402s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:57:10 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-2f5a35bc-3b0e-4e12-b39c-3e747c505895 tempest-VolumesDeleteCascade-325138244 None] Snapshots deleted, issuing volume delete {{(pid=87272) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Nov 04 10:57:10 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-2f5a35bc-3b0e-4e12-b39c-3e747c505895 tempest-VolumesDeleteCascade-325138244 None] Acquiring lock "cinder-quobyte-2c023195-ecfc-4e4d-9399-d49191789da8" by "delete_volume" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:57:10 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-2f5a35bc-3b0e-4e12-b39c-3e747c505895 tempest-VolumesDeleteCascade-325138244 None] Lock "cinder-quobyte-2c023195-ecfc-4e4d-9399-d49191789da8" acquired by "delete_volume" :: waited 0.090s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:57:10 devstack sudo[96801]: pam_unix(sudo:session): session closed for user root Nov 04 10:57:10 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-ee9e695e-2925-434b-b975-cfa43d13cc43 tempest-ServerRescueNegativeTestJSON-1618815521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1" returned: 0 in 1.076s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:57:10 devstack cinder-volume[87272]: DEBUG cinder.manager [None req-ee9e695e-2925-434b-b975-cfa43d13cc43 tempest-ServerRescueNegativeTestJSON-1618815521 None] Notifying Schedulers of capabilities ... {{(pid=87272) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 10:57:10 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-ee9e695e-2925-434b-b975-cfa43d13cc43 tempest-ServerRescueNegativeTestJSON-1618815521 None] Deleted volume successfully. Nov 04 10:57:10 devstack cinder-volume[87272]: DEBUG oslo.privsep.daemon [-] privsep: reply[afd61a6d-35db-4d5d-b53a-34f0b3a818b8]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:57:10 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-2f5a35bc-3b0e-4e12-b39c-3e747c505895 tempest-VolumesDeleteCascade-325138244 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-2c023195-ecfc-4e4d-9399-d49191789da8 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:57:10 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-ee9e695e-2925-434b-b975-cfa43d13cc43 tempest-ServerRescueNegativeTestJSON-1618815521 None] Lock "cinder-610fcbcf-206b-4795-b197-c6e328f2faed-delete_volume" released by "delete_volume" :: held 3.875s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:57:11 devstack sudo[96811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-2c023195-ecfc-4e4d-9399-d49191789da8 Nov 04 10:57:11 devstack sudo[96811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:57:12 devstack sudo[96811]: pam_unix(sudo:session): session closed for user root Nov 04 10:57:12 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-2f5a35bc-3b0e-4e12-b39c-3e747c505895 tempest-VolumesDeleteCascade-325138244 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-2c023195-ecfc-4e4d-9399-d49191789da8" returned: 0 in 1.866s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:57:12 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-2f5a35bc-3b0e-4e12-b39c-3e747c505895 tempest-VolumesDeleteCascade-325138244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-2c023195-ecfc-4e4d-9399-d49191789da8 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:57:12 devstack sudo[96835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-2c023195-ecfc-4e4d-9399-d49191789da8 Nov 04 10:57:12 devstack sudo[96835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:57:13 devstack sudo[96835]: pam_unix(sudo:session): session closed for user root Nov 04 10:57:13 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-2f5a35bc-3b0e-4e12-b39c-3e747c505895 tempest-VolumesDeleteCascade-325138244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-2c023195-ecfc-4e4d-9399-d49191789da8" returned: 0 in 1.095s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:57:13 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-2f5a35bc-3b0e-4e12-b39c-3e747c505895 tempest-VolumesDeleteCascade-325138244 None] Lock "cinder-quobyte-2c023195-ecfc-4e4d-9399-d49191789da8" released by "delete_volume" :: held 3.192s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:57:14 devstack cinder-volume[87272]: DEBUG cinder.quota [None req-2f5a35bc-3b0e-4e12-b39c-3e747c505895 tempest-VolumesDeleteCascade-325138244 None] Created reservations ['7d92b121-ff9c-40cf-a710-591123a2cd46', 'ff80eb81-845d-48eb-94f0-92d1e9c28722', '1d490b27-b9aa-4476-85d7-b8b13f2fc8bd', '8efcbdd7-f744-4806-b132-5e0e898593c9'] {{(pid=87272) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 10:57:14 devstack cinder-volume[87272]: DEBUG oslo_service.periodic_task [None req-236af0be-7f9d-4c80-b3d7-d645a9cd0dd1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87272) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 04 10:57:14 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-236af0be-7f9d-4c80-b3d7-d645a9cd0dd1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:57:14 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-236af0be-7f9d-4c80-b3d7-d645a9cd0dd1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:57:14 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-236af0be-7f9d-4c80-b3d7-d645a9cd0dd1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898': None} {{(pid=87272) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:57:14 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-236af0be-7f9d-4c80-b3d7-d645a9cd0dd1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'] {{(pid=87272) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:57:14 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-236af0be-7f9d-4c80-b3d7-d645a9cd0dd1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.043s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:57:14 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-236af0be-7f9d-4c80-b3d7-d645a9cd0dd1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:57:14 devstack sudo[96838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1 Nov 04 10:57:14 devstack sudo[96838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:57:14 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-2f5a35bc-3b0e-4e12-b39c-3e747c505895 tempest-VolumesDeleteCascade-325138244 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:57:14 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-2f5a35bc-3b0e-4e12-b39c-3e747c505895 tempest-VolumesDeleteCascade-325138244 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:57:14 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-2f5a35bc-3b0e-4e12-b39c-3e747c505895 tempest-VolumesDeleteCascade-325138244 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898': None} {{(pid=87272) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:57:14 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-2f5a35bc-3b0e-4e12-b39c-3e747c505895 tempest-VolumesDeleteCascade-325138244 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'] {{(pid=87272) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:57:14 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-2f5a35bc-3b0e-4e12-b39c-3e747c505895 tempest-VolumesDeleteCascade-325138244 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:57:14 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-2f5a35bc-3b0e-4e12-b39c-3e747c505895 tempest-VolumesDeleteCascade-325138244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:57:14 devstack sudo[96841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1 Nov 04 10:57:14 devstack sudo[96841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:57:15 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-2f5a35bc-3b0e-4e12-b39c-3e747c505895 tempest-VolumesDeleteCascade-325138244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1" returned: 0 in 0.695s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:57:15 devstack sudo[96841]: pam_unix(sudo:session): session closed for user root Nov 04 10:57:15 devstack cinder-volume[87272]: DEBUG cinder.manager [None req-2f5a35bc-3b0e-4e12-b39c-3e747c505895 tempest-VolumesDeleteCascade-325138244 None] Notifying Schedulers of capabilities ... {{(pid=87272) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 10:57:15 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-2f5a35bc-3b0e-4e12-b39c-3e747c505895 tempest-VolumesDeleteCascade-325138244 None] Deleted volume successfully. Nov 04 10:57:15 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-2f5a35bc-3b0e-4e12-b39c-3e747c505895 tempest-VolumesDeleteCascade-325138244 None] Lock "cinder-2c023195-ecfc-4e4d-9399-d49191789da8-delete_volume" released by "delete_volume" :: held 18.507s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:57:15 devstack sudo[96838]: pam_unix(sudo:session): session closed for user root Nov 04 10:57:15 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-236af0be-7f9d-4c80-b3d7-d645a9cd0dd1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1" returned: 0 in 1.545s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:57:15 devstack cinder-volume[87272]: DEBUG cinder.manager [None req-236af0be-7f9d-4c80-b3d7-d645a9cd0dd1 None None] Notifying Schedulers of capabilities ... {{(pid=87272) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 10:57:15 devstack cinder-volume[87272]: DEBUG oslo_service.periodic_task [None req-236af0be-7f9d-4c80-b3d7-d645a9cd0dd1 None None] Running periodic task VolumeManager._thread_info {{(pid=87272) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 04 10:57:15 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-236af0be-7f9d-4c80-b3d7-d645a9cd0dd1 None None] thread count: 28 {{(pid=87272) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 04 10:57:15 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-236af0be-7f9d-4c80-b3d7-d645a9cd0dd1 None None] thread info: [<_MainThread(MainThread, started 127085713244288)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87272) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 04 10:57:15 devstack sudo[96683]: pam_unix(sudo:session): session closed for user root Nov 04 10:57:16 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-a673f4ff-ae94-42a6-a2fe-44dacaef6465 tempest-VolumesGetTest-525573675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-b967890f-4f4c-4181-b0c6-dc06f815759a /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-48647ff2-6d0c-41ed-9ea2-fc1ca5c2c836" returned: 0 in 13.529s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:57:16 devstack cinder-volume[87272]: DEBUG cinder.image.image_utils [None req-a673f4ff-ae94-42a6-a2fe-44dacaef6465 tempest-VolumesGetTest-525573675 None] Image conversion details: src /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-b967890f-4f4c-4181-b0c6-dc06f815759a, size 1024.00 MB, duration 13.53 sec, destination /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-48647ff2-6d0c-41ed-9ea2-fc1ca5c2c836 {{(pid=87272) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Nov 04 10:57:16 devstack cinder-volume[87272]: INFO cinder.image.image_utils [None req-a673f4ff-ae94-42a6-a2fe-44dacaef6465 tempest-VolumesGetTest-525573675 None] Converted 1024.00 MB image at 75.67 MB/s Nov 04 10:57:16 devstack cinder-volume[87272]: WARNING cinder.volume.drivers.remotefs [None req-a673f4ff-ae94-42a6-a2fe-44dacaef6465 tempest-VolumesGetTest-525573675 None] /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-48647ff2-6d0c-41ed-9ea2-fc1ca5c2c836 is being set with open permissions: ugo+rw Nov 04 10:57:16 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-a673f4ff-ae94-42a6-a2fe-44dacaef6465 tempest-VolumesGetTest-525573675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-48647ff2-6d0c-41ed-9ea2-fc1ca5c2c836 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:57:16 devstack sudo[96848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-48647ff2-6d0c-41ed-9ea2-fc1ca5c2c836 Nov 04 10:57:16 devstack sudo[96848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:57:16 devstack sudo[96848]: pam_unix(sudo:session): session closed for user root Nov 04 10:57:16 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-a673f4ff-ae94-42a6-a2fe-44dacaef6465 tempest-VolumesGetTest-525573675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-48647ff2-6d0c-41ed-9ea2-fc1ca5c2c836" returned: 0 in 0.574s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:57:16 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-a673f4ff-ae94-42a6-a2fe-44dacaef6465 tempest-VolumesGetTest-525573675 None] Lock "cinder-quobyte-48647ff2-6d0c-41ed-9ea2-fc1ca5c2c836" released by "_copy_volume_from_snapshot" :: held 16.749s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:57:16 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-a673f4ff-ae94-42a6-a2fe-44dacaef6465 tempest-VolumesGetTest-525573675 None] Acquiring lock "cinder-quobyte-8fac0f1c-84fb-4b2c-8fbb-96d4cb0c0fc9" by "_delete_snapshot" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:57:16 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-a673f4ff-ae94-42a6-a2fe-44dacaef6465 tempest-VolumesGetTest-525573675 None] Lock "cinder-quobyte-8fac0f1c-84fb-4b2c-8fbb-96d4cb0c0fc9" acquired by "_delete_snapshot" :: waited 0.034s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:57:16 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.remotefs [None req-a673f4ff-ae94-42a6-a2fe-44dacaef6465 tempest-VolumesGetTest-525573675 None] Deleting offline snapshot 8fac0f1c-84fb-4b2c-8fbb-96d4cb0c0fc9 of volume b967890f-4f4c-4181-b0c6-dc06f815759a {{(pid=87272) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 04 10:57:16 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.remotefs [None req-a673f4ff-ae94-42a6-a2fe-44dacaef6465 tempest-VolumesGetTest-525573675 None] snapshot_file for this snap is: volume-b967890f-4f4c-4181-b0c6-dc06f815759a.8fac0f1c-84fb-4b2c-8fbb-96d4cb0c0fc9 {{(pid=87272) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 04 10:57:16 devstack cinder-volume[87272]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ea91691-b8de-4563-953b-5ca47f4ae24c]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:57:16 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-a673f4ff-ae94-42a6-a2fe-44dacaef6465 tempest-VolumesGetTest-525573675 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-b967890f-4f4c-4181-b0c6-dc06f815759a.8fac0f1c-84fb-4b2c-8fbb-96d4cb0c0fc9 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:57:16 devstack sudo[96851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-b967890f-4f4c-4181-b0c6-dc06f815759a.8fac0f1c-84fb-4b2c-8fbb-96d4cb0c0fc9 Nov 04 10:57:16 devstack sudo[96851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:57:17 devstack cinder-volume[87272]: DEBUG cinder.volume.flows.manager.create_volume [None req-1a1c9195-c612-4af9-92cd-973b88da9a38 tempest-VolumesDeleteCascade-325138244 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87272) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 10:57:17 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-1a1c9195-c612-4af9-92cd-973b88da9a38 tempest-VolumesDeleteCascade-325138244 None] Flow 'volume_create_manager' (69a5f30e-f7dc-43af-b302-b515b877f537) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:57:17 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-1a1c9195-c612-4af9-92cd-973b88da9a38 tempest-VolumesDeleteCascade-325138244 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13e50686-c65c-412b-84f7-58af28ae35e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:57:17 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-1a1c9195-c612-4af9-92cd-973b88da9a38 tempest-VolumesDeleteCascade-325138244 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13e50686-c65c-412b-84f7-58af28ae35e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T09:57:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1441716629',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d339fd56-0927-4197-bb3c-0af46ad5b40d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='96351ddf0a2247dbbc228e0b30b91b61',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T09:57:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T09:57:17Z,use_quota=True,user_id='8cee75a07c424c6a99799b186092ec14',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8989e4f-21e3-4f0a-9584-0d818784e883),volume_type_id=f8989e4f-21e3-4f0a-9584-0d818784e883)' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:57:17 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-1a1c9195-c612-4af9-92cd-973b88da9a38 tempest-VolumesDeleteCascade-325138244 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d66f42b9-33f3-4635-92ff-30649a849b43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:57:17 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-1a1c9195-c612-4af9-92cd-973b88da9a38 tempest-VolumesDeleteCascade-325138244 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d66f42b9-33f3-4635-92ff-30649a849b43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:57:17 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-1a1c9195-c612-4af9-92cd-973b88da9a38 tempest-VolumesDeleteCascade-325138244 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (abd270bb-02ae-4a6d-ba82-fbea415d6f35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:57:17 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-1a1c9195-c612-4af9-92cd-973b88da9a38 tempest-VolumesDeleteCascade-325138244 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (abd270bb-02ae-4a6d-ba82-fbea415d6f35) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd339fd56-0927-4197-bb3c-0af46ad5b40d', 'volume_name': 'volume-d339fd56-0927-4197-bb3c-0af46ad5b40d', 'volume_size': 1}' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:57:17 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-1a1c9195-c612-4af9-92cd-973b88da9a38 tempest-VolumesDeleteCascade-325138244 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (10940e4c-de71-4941-9c0b-6d1df69782bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:57:17 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-1a1c9195-c612-4af9-92cd-973b88da9a38 tempest-VolumesDeleteCascade-325138244 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (10940e4c-de71-4941-9c0b-6d1df69782bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:57:17 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-1a1c9195-c612-4af9-92cd-973b88da9a38 tempest-VolumesDeleteCascade-325138244 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (315c71df-b30b-45d3-8ec0-205564c45234) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:57:17 devstack cinder-volume[87272]: INFO cinder.volume.flows.manager.create_volume [None req-1a1c9195-c612-4af9-92cd-973b88da9a38 tempest-VolumesDeleteCascade-325138244 None] Volume d339fd56-0927-4197-bb3c-0af46ad5b40d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d339fd56-0927-4197-bb3c-0af46ad5b40d', 'volume_size': 1} Nov 04 10:57:17 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-1a1c9195-c612-4af9-92cd-973b88da9a38 tempest-VolumesDeleteCascade-325138244 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:57:17 devstack sudo[96851]: pam_unix(sudo:session): session closed for user root Nov 04 10:57:17 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-a673f4ff-ae94-42a6-a2fe-44dacaef6465 tempest-VolumesGetTest-525573675 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-b967890f-4f4c-4181-b0c6-dc06f815759a.8fac0f1c-84fb-4b2c-8fbb-96d4cb0c0fc9" returned: 0 in 0.732s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:57:17 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.remotefs [None req-a673f4ff-ae94-42a6-a2fe-44dacaef6465 tempest-VolumesGetTest-525573675 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b967890f-4f4c-4181-b0c6-dc06f815759a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87272) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 10:57:17 devstack cinder-volume[87272]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f394148-9ad4-481a-8797-4bd32a94aaa2]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:57:17 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-a673f4ff-ae94-42a6-a2fe-44dacaef6465 tempest-VolumesGetTest-525573675 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-b967890f-4f4c-4181-b0c6-dc06f815759a {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:57:17 devstack sudo[96858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-b967890f-4f4c-4181-b0c6-dc06f815759a Nov 04 10:57:17 devstack sudo[96858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:57:18 devstack sudo[96858]: pam_unix(sudo:session): session closed for user root Nov 04 10:57:18 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-a673f4ff-ae94-42a6-a2fe-44dacaef6465 tempest-VolumesGetTest-525573675 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-b967890f-4f4c-4181-b0c6-dc06f815759a" returned: 0 in 0.734s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:57:18 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-a673f4ff-ae94-42a6-a2fe-44dacaef6465 tempest-VolumesGetTest-525573675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-b967890f-4f4c-4181-b0c6-dc06f815759a.8fac0f1c-84fb-4b2c-8fbb-96d4cb0c0fc9 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:57:18 devstack sudo[96885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-b967890f-4f4c-4181-b0c6-dc06f815759a.8fac0f1c-84fb-4b2c-8fbb-96d4cb0c0fc9 Nov 04 10:57:18 devstack sudo[96885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:57:18 devstack sudo[96885]: pam_unix(sudo:session): session closed for user root Nov 04 10:57:18 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-a673f4ff-ae94-42a6-a2fe-44dacaef6465 tempest-VolumesGetTest-525573675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-b967890f-4f4c-4181-b0c6-dc06f815759a.8fac0f1c-84fb-4b2c-8fbb-96d4cb0c0fc9" returned: 0 in 0.432s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:57:18 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-a673f4ff-ae94-42a6-a2fe-44dacaef6465 tempest-VolumesGetTest-525573675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-b967890f-4f4c-4181-b0c6-dc06f815759a.8fac0f1c-84fb-4b2c-8fbb-96d4cb0c0fc9 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:57:18 devstack sudo[96891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-b967890f-4f4c-4181-b0c6-dc06f815759a.8fac0f1c-84fb-4b2c-8fbb-96d4cb0c0fc9 Nov 04 10:57:18 devstack sudo[96891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:57:19 devstack cinder-volume[87272]: DEBUG cinder.volume.flows.manager.create_volume [None req-b83df7aa-82be-4316-98a2-bc8e251c140d tempest-AttachVolumeNegativeTest-154668454 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87272) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 10:57:19 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-b83df7aa-82be-4316-98a2-bc8e251c140d tempest-AttachVolumeNegativeTest-154668454 None] Flow 'volume_create_manager' (b9237995-2431-46da-9385-81397273d959) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:57:19 devstack sudo[96891]: pam_unix(sudo:session): session closed for user root Nov 04 10:57:19 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-b83df7aa-82be-4316-98a2-bc8e251c140d tempest-AttachVolumeNegativeTest-154668454 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9103a862-ebd5-462e-9be9-6048786ab644) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:57:19 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-a673f4ff-ae94-42a6-a2fe-44dacaef6465 tempest-VolumesGetTest-525573675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-b967890f-4f4c-4181-b0c6-dc06f815759a.8fac0f1c-84fb-4b2c-8fbb-96d4cb0c0fc9" returned: 0 in 0.413s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:57:19 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-b83df7aa-82be-4316-98a2-bc8e251c140d tempest-AttachVolumeNegativeTest-154668454 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9103a862-ebd5-462e-9be9-6048786ab644) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T09:57:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1172157734',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2959388a-38d4-410b-a6d8-20185d76ebc7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b4c692d677a4424ca4fe4fe85525eaa8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T09:57:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T09:57:19Z,use_quota=True,user_id='d0e11232f87d4caf9032a8c076e36fc8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8989e4f-21e3-4f0a-9584-0d818784e883),volume_type_id=f8989e4f-21e3-4f0a-9584-0d818784e883)' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:57:19 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-b83df7aa-82be-4316-98a2-bc8e251c140d tempest-AttachVolumeNegativeTest-154668454 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c45a5f4-ba84-4f0f-8183-e987460715ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:57:19 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-b83df7aa-82be-4316-98a2-bc8e251c140d tempest-AttachVolumeNegativeTest-154668454 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c45a5f4-ba84-4f0f-8183-e987460715ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:57:19 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-b83df7aa-82be-4316-98a2-bc8e251c140d tempest-AttachVolumeNegativeTest-154668454 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bfbc71ca-d219-4247-b0e5-5db7b929e810) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:57:19 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-b83df7aa-82be-4316-98a2-bc8e251c140d tempest-AttachVolumeNegativeTest-154668454 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bfbc71ca-d219-4247-b0e5-5db7b929e810) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2959388a-38d4-410b-a6d8-20185d76ebc7', 'volume_name': 'volume-2959388a-38d4-410b-a6d8-20185d76ebc7', 'volume_size': 1}' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:57:19 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-b83df7aa-82be-4316-98a2-bc8e251c140d tempest-AttachVolumeNegativeTest-154668454 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29e688c8-be30-4327-9969-62a00f648c0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:57:19 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-b83df7aa-82be-4316-98a2-bc8e251c140d tempest-AttachVolumeNegativeTest-154668454 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29e688c8-be30-4327-9969-62a00f648c0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:57:19 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-b83df7aa-82be-4316-98a2-bc8e251c140d tempest-AttachVolumeNegativeTest-154668454 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f9ac103-6e7d-41dc-9a1a-e983a35c6741) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:57:19 devstack cinder-volume[87272]: INFO cinder.volume.flows.manager.create_volume [None req-b83df7aa-82be-4316-98a2-bc8e251c140d tempest-AttachVolumeNegativeTest-154668454 None] Volume 2959388a-38d4-410b-a6d8-20185d76ebc7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2959388a-38d4-410b-a6d8-20185d76ebc7', 'volume_size': 1} Nov 04 10:57:19 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-b83df7aa-82be-4316-98a2-bc8e251c140d tempest-AttachVolumeNegativeTest-154668454 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:57:19 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-a673f4ff-ae94-42a6-a2fe-44dacaef6465 tempest-VolumesGetTest-525573675 None] Lock "cinder-quobyte-8fac0f1c-84fb-4b2c-8fbb-96d4cb0c0fc9" released by "_delete_snapshot" :: held 2.515s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:57:19 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-a673f4ff-ae94-42a6-a2fe-44dacaef6465 tempest-VolumesGetTest-525573675 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 23.563s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:57:19 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-1a1c9195-c612-4af9-92cd-973b88da9a38 tempest-VolumesDeleteCascade-325138244 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.966s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:57:19 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-1a1c9195-c612-4af9-92cd-973b88da9a38 tempest-VolumesDeleteCascade-325138244 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T09:57:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1441716629',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d339fd56-0927-4197-bb3c-0af46ad5b40d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='96351ddf0a2247dbbc228e0b30b91b61',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T09:57:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T09:57:17Z,use_quota=True,user_id='8cee75a07c424c6a99799b186092ec14',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8989e4f-21e3-4f0a-9584-0d818784e883),volume_type_id=f8989e4f-21e3-4f0a-9584-0d818784e883)}" {{(pid=87272) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 04 10:57:19 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.remotefs [None req-1a1c9195-c612-4af9-92cd-973b88da9a38 tempest-VolumesDeleteCascade-325138244 None] Creating volume d339fd56-0927-4197-bb3c-0af46ad5b40d {{(pid=87272) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 10:57:19 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-1a1c9195-c612-4af9-92cd-973b88da9a38 tempest-VolumesDeleteCascade-325138244 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:57:19 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-1a1c9195-c612-4af9-92cd-973b88da9a38 tempest-VolumesDeleteCascade-325138244 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:57:19 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-1a1c9195-c612-4af9-92cd-973b88da9a38 tempest-VolumesDeleteCascade-325138244 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898': None} {{(pid=87272) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:57:19 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-1a1c9195-c612-4af9-92cd-973b88da9a38 tempest-VolumesDeleteCascade-325138244 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'] {{(pid=87272) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:57:19 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-1a1c9195-c612-4af9-92cd-973b88da9a38 tempest-VolumesDeleteCascade-325138244 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:57:19 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-1a1c9195-c612-4af9-92cd-973b88da9a38 tempest-VolumesDeleteCascade-325138244 None] Selected osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898 as target Quobyte volume. {{(pid=87272) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 10:57:19 devstack cinder-volume[87272]: INFO cinder.volume.drivers.remotefs [None req-1a1c9195-c612-4af9-92cd-973b88da9a38 tempest-VolumesDeleteCascade-325138244 None] casted to osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898 Nov 04 10:57:19 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-1a1c9195-c612-4af9-92cd-973b88da9a38 tempest-VolumesDeleteCascade-325138244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-d339fd56-0927-4197-bb3c-0af46ad5b40d 1073741824 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:57:19 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-a673f4ff-ae94-42a6-a2fe-44dacaef6465 tempest-VolumesGetTest-525573675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f7a688e3-1c62-41cd-b516-316f1ac38d71) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-48647ff2-6d0c-41ed-9ea2-fc1ca5c2c836', 'volume_size': 1, 'source_volid': 'b967890f-4f4c-4181-b0c6-dc06f815759a', 'source_volstatus': 'available'}' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:57:19 devstack sudo[96896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-d339fd56-0927-4197-bb3c-0af46ad5b40d 1073741824 Nov 04 10:57:19 devstack sudo[96896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:57:19 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-a673f4ff-ae94-42a6-a2fe-44dacaef6465 tempest-VolumesGetTest-525573675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9762b80b-18a4-4dbb-a613-657a6fbd5ead) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:57:19 devstack cinder-volume[87272]: INFO cinder.volume.flows.manager.create_volume [None req-a673f4ff-ae94-42a6-a2fe-44dacaef6465 tempest-VolumesGetTest-525573675 None] Volume volume-48647ff2-6d0c-41ed-9ea2-fc1ca5c2c836 (48647ff2-6d0c-41ed-9ea2-fc1ca5c2c836): created successfully Nov 04 10:57:19 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-a673f4ff-ae94-42a6-a2fe-44dacaef6465 tempest-VolumesGetTest-525573675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9762b80b-18a4-4dbb-a613-657a6fbd5ead) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:57:19 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-a673f4ff-ae94-42a6-a2fe-44dacaef6465 tempest-VolumesGetTest-525573675 None] Flow 'volume_create_manager' (ecc3a620-87e9-44b3-85f6-8ed37d440a11) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87272) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:57:19 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-a673f4ff-ae94-42a6-a2fe-44dacaef6465 tempest-VolumesGetTest-525573675 None] Created volume successfully. Nov 04 10:57:19 devstack sudo[96896]: pam_unix(sudo:session): session closed for user root Nov 04 10:57:19 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-1a1c9195-c612-4af9-92cd-973b88da9a38 tempest-VolumesDeleteCascade-325138244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-d339fd56-0927-4197-bb3c-0af46ad5b40d 1073741824" returned: 0 in 0.538s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:57:19 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-1a1c9195-c612-4af9-92cd-973b88da9a38 tempest-VolumesDeleteCascade-325138244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-d339fd56-0927-4197-bb3c-0af46ad5b40d {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:57:19 devstack sudo[96902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-d339fd56-0927-4197-bb3c-0af46ad5b40d Nov 04 10:57:19 devstack sudo[96902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:57:20 devstack sudo[96902]: pam_unix(sudo:session): session closed for user root Nov 04 10:57:20 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-1a1c9195-c612-4af9-92cd-973b88da9a38 tempest-VolumesDeleteCascade-325138244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-d339fd56-0927-4197-bb3c-0af46ad5b40d" returned: 0 in 0.282s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:57:20 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-1a1c9195-c612-4af9-92cd-973b88da9a38 tempest-VolumesDeleteCascade-325138244 None] <== create_volume: return (880ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'} {{(pid=87272) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 04 10:57:20 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-1a1c9195-c612-4af9-92cd-973b88da9a38 tempest-VolumesDeleteCascade-325138244 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.884s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:57:20 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-b83df7aa-82be-4316-98a2-bc8e251c140d tempest-AttachVolumeNegativeTest-154668454 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.940s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:57:20 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-b83df7aa-82be-4316-98a2-bc8e251c140d tempest-AttachVolumeNegativeTest-154668454 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T09:57:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1172157734',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2959388a-38d4-410b-a6d8-20185d76ebc7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b4c692d677a4424ca4fe4fe85525eaa8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T09:57:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T09:57:19Z,use_quota=True,user_id='d0e11232f87d4caf9032a8c076e36fc8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8989e4f-21e3-4f0a-9584-0d818784e883),volume_type_id=f8989e4f-21e3-4f0a-9584-0d818784e883)}" {{(pid=87272) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 04 10:57:20 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.remotefs [None req-b83df7aa-82be-4316-98a2-bc8e251c140d tempest-AttachVolumeNegativeTest-154668454 None] Creating volume 2959388a-38d4-410b-a6d8-20185d76ebc7 {{(pid=87272) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 10:57:20 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-b83df7aa-82be-4316-98a2-bc8e251c140d tempest-AttachVolumeNegativeTest-154668454 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:57:20 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-b83df7aa-82be-4316-98a2-bc8e251c140d tempest-AttachVolumeNegativeTest-154668454 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:57:20 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-b83df7aa-82be-4316-98a2-bc8e251c140d tempest-AttachVolumeNegativeTest-154668454 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898': None} {{(pid=87272) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:57:20 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-b83df7aa-82be-4316-98a2-bc8e251c140d tempest-AttachVolumeNegativeTest-154668454 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'] {{(pid=87272) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:57:20 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-b83df7aa-82be-4316-98a2-bc8e251c140d tempest-AttachVolumeNegativeTest-154668454 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:57:20 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-b83df7aa-82be-4316-98a2-bc8e251c140d tempest-AttachVolumeNegativeTest-154668454 None] Selected osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898 as target Quobyte volume. {{(pid=87272) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 10:57:20 devstack cinder-volume[87272]: INFO cinder.volume.drivers.remotefs [None req-b83df7aa-82be-4316-98a2-bc8e251c140d tempest-AttachVolumeNegativeTest-154668454 None] casted to osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898 Nov 04 10:57:20 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-b83df7aa-82be-4316-98a2-bc8e251c140d tempest-AttachVolumeNegativeTest-154668454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-2959388a-38d4-410b-a6d8-20185d76ebc7 1073741824 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:57:20 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-1a1c9195-c612-4af9-92cd-973b88da9a38 tempest-VolumesDeleteCascade-325138244 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (315c71df-b30b-45d3-8ec0-205564c45234) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d339fd56-0927-4197-bb3c-0af46ad5b40d', 'volume_size': 1}' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:57:20 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-1a1c9195-c612-4af9-92cd-973b88da9a38 tempest-VolumesDeleteCascade-325138244 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca23ca96-bad9-4771-abfa-7ad9e04ecf33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:57:20 devstack sudo[96905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-2959388a-38d4-410b-a6d8-20185d76ebc7 1073741824 Nov 04 10:57:20 devstack sudo[96905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:57:20 devstack cinder-volume[87272]: INFO cinder.volume.flows.manager.create_volume [None req-1a1c9195-c612-4af9-92cd-973b88da9a38 tempest-VolumesDeleteCascade-325138244 None] Volume volume-d339fd56-0927-4197-bb3c-0af46ad5b40d (d339fd56-0927-4197-bb3c-0af46ad5b40d): created successfully Nov 04 10:57:20 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-1a1c9195-c612-4af9-92cd-973b88da9a38 tempest-VolumesDeleteCascade-325138244 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca23ca96-bad9-4771-abfa-7ad9e04ecf33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:57:20 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-1a1c9195-c612-4af9-92cd-973b88da9a38 tempest-VolumesDeleteCascade-325138244 None] Flow 'volume_create_manager' (69a5f30e-f7dc-43af-b302-b515b877f537) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87272) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:57:20 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-1a1c9195-c612-4af9-92cd-973b88da9a38 tempest-VolumesDeleteCascade-325138244 None] Created volume successfully. Nov 04 10:57:20 devstack sudo[96905]: pam_unix(sudo:session): session closed for user root Nov 04 10:57:20 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-b83df7aa-82be-4316-98a2-bc8e251c140d tempest-AttachVolumeNegativeTest-154668454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-2959388a-38d4-410b-a6d8-20185d76ebc7 1073741824" returned: 0 in 0.574s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:57:20 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-b83df7aa-82be-4316-98a2-bc8e251c140d tempest-AttachVolumeNegativeTest-154668454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-2959388a-38d4-410b-a6d8-20185d76ebc7 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:57:20 devstack sudo[96916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-2959388a-38d4-410b-a6d8-20185d76ebc7 Nov 04 10:57:20 devstack sudo[96916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:57:21 devstack sudo[96916]: pam_unix(sudo:session): session closed for user root Nov 04 10:57:21 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-b83df7aa-82be-4316-98a2-bc8e251c140d tempest-AttachVolumeNegativeTest-154668454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-2959388a-38d4-410b-a6d8-20185d76ebc7" returned: 0 in 0.387s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:57:21 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-b83df7aa-82be-4316-98a2-bc8e251c140d tempest-AttachVolumeNegativeTest-154668454 None] <== create_volume: return (1013ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'} {{(pid=87272) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 04 10:57:21 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-b83df7aa-82be-4316-98a2-bc8e251c140d tempest-AttachVolumeNegativeTest-154668454 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.030s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:57:21 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-b83df7aa-82be-4316-98a2-bc8e251c140d tempest-AttachVolumeNegativeTest-154668454 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f9ac103-6e7d-41dc-9a1a-e983a35c6741) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2959388a-38d4-410b-a6d8-20185d76ebc7', 'volume_size': 1}' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:57:21 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-b83df7aa-82be-4316-98a2-bc8e251c140d tempest-AttachVolumeNegativeTest-154668454 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c865afe8-a6f0-4a9e-9446-b159881c864b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:57:21 devstack cinder-volume[87272]: INFO cinder.volume.flows.manager.create_volume [None req-b83df7aa-82be-4316-98a2-bc8e251c140d tempest-AttachVolumeNegativeTest-154668454 None] Volume volume-2959388a-38d4-410b-a6d8-20185d76ebc7 (2959388a-38d4-410b-a6d8-20185d76ebc7): created successfully Nov 04 10:57:21 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-b83df7aa-82be-4316-98a2-bc8e251c140d tempest-AttachVolumeNegativeTest-154668454 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c865afe8-a6f0-4a9e-9446-b159881c864b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:57:21 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-b83df7aa-82be-4316-98a2-bc8e251c140d tempest-AttachVolumeNegativeTest-154668454 None] Flow 'volume_create_manager' (b9237995-2431-46da-9385-81397273d959) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87272) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:57:21 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-b83df7aa-82be-4316-98a2-bc8e251c140d tempest-AttachVolumeNegativeTest-154668454 None] Created volume successfully. Nov 04 10:57:21 devstack cinder-volume[87272]: DEBUG cinder.volume.flows.manager.create_volume [None req-6770869c-e57b-4516-ad87-8850294de153 tempest-VolumesGetTest-525573675 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87272) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 10:57:21 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-6770869c-e57b-4516-ad87-8850294de153 tempest-VolumesGetTest-525573675 None] Flow 'volume_create_manager' (1f6d5ed3-fe11-4bfb-8bd1-9bb5dde0cef1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:57:21 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-6770869c-e57b-4516-ad87-8850294de153 tempest-VolumesGetTest-525573675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87edb66f-9eac-4e37-a2a4-4badbccdf2cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:57:21 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-6770869c-e57b-4516-ad87-8850294de153 tempest-VolumesGetTest-525573675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87edb66f-9eac-4e37-a2a4-4badbccdf2cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T09:57:21Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1332956189',display_name='tempest-VolumesGetTest-Volume-1946084580',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4824bdf7-474d-4f87-aaec-e3d7c69d3e81,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1fd08fa49c4e4d2f83d17f8aaac1b8a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T09:57:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T09:57:21Z,use_quota=True,user_id='c47ca10290f644b7a54567bf7a4cbc38',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8989e4f-21e3-4f0a-9584-0d818784e883),volume_type_id=f8989e4f-21e3-4f0a-9584-0d818784e883)' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:57:21 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-6770869c-e57b-4516-ad87-8850294de153 tempest-VolumesGetTest-525573675 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6478cb74-d050-4602-bec0-30bab497294c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:57:21 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-6770869c-e57b-4516-ad87-8850294de153 tempest-VolumesGetTest-525573675 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6478cb74-d050-4602-bec0-30bab497294c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:57:21 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-6770869c-e57b-4516-ad87-8850294de153 tempest-VolumesGetTest-525573675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (84203c00-b4c0-43ae-8320-16b18d84f559) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:57:21 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-6770869c-e57b-4516-ad87-8850294de153 tempest-VolumesGetTest-525573675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (84203c00-b4c0-43ae-8320-16b18d84f559) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4824bdf7-474d-4f87-aaec-e3d7c69d3e81', 'volume_name': 'volume-4824bdf7-474d-4f87-aaec-e3d7c69d3e81', 'volume_size': 1}' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:57:21 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-6770869c-e57b-4516-ad87-8850294de153 tempest-VolumesGetTest-525573675 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a24e5837-97a6-4d8b-a7b8-7362abf0250b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:57:21 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-6770869c-e57b-4516-ad87-8850294de153 tempest-VolumesGetTest-525573675 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a24e5837-97a6-4d8b-a7b8-7362abf0250b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:57:21 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-6770869c-e57b-4516-ad87-8850294de153 tempest-VolumesGetTest-525573675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (69eda0bd-7b8f-4129-b1d9-2c240ba4935a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:57:21 devstack cinder-volume[87272]: INFO cinder.volume.flows.manager.create_volume [None req-6770869c-e57b-4516-ad87-8850294de153 tempest-VolumesGetTest-525573675 None] Volume 4824bdf7-474d-4f87-aaec-e3d7c69d3e81: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4824bdf7-474d-4f87-aaec-e3d7c69d3e81', 'volume_size': 1} Nov 04 10:57:21 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-6770869c-e57b-4516-ad87-8850294de153 tempest-VolumesGetTest-525573675 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:57:21 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-6770869c-e57b-4516-ad87-8850294de153 tempest-VolumesGetTest-525573675 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:57:21 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-6770869c-e57b-4516-ad87-8850294de153 tempest-VolumesGetTest-525573675 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T09:57:21Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1332956189',display_name='tempest-VolumesGetTest-Volume-1946084580',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4824bdf7-474d-4f87-aaec-e3d7c69d3e81,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1fd08fa49c4e4d2f83d17f8aaac1b8a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T09:57:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T09:57:21Z,use_quota=True,user_id='c47ca10290f644b7a54567bf7a4cbc38',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8989e4f-21e3-4f0a-9584-0d818784e883),volume_type_id=f8989e4f-21e3-4f0a-9584-0d818784e883)}" {{(pid=87272) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 04 10:57:21 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.remotefs [None req-6770869c-e57b-4516-ad87-8850294de153 tempest-VolumesGetTest-525573675 None] Creating volume 4824bdf7-474d-4f87-aaec-e3d7c69d3e81 {{(pid=87272) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 10:57:21 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-6770869c-e57b-4516-ad87-8850294de153 tempest-VolumesGetTest-525573675 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:57:21 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-6770869c-e57b-4516-ad87-8850294de153 tempest-VolumesGetTest-525573675 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:57:21 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-6770869c-e57b-4516-ad87-8850294de153 tempest-VolumesGetTest-525573675 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898': None} {{(pid=87272) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:57:21 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-6770869c-e57b-4516-ad87-8850294de153 tempest-VolumesGetTest-525573675 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'] {{(pid=87272) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:57:21 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-6770869c-e57b-4516-ad87-8850294de153 tempest-VolumesGetTest-525573675 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:57:21 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-6770869c-e57b-4516-ad87-8850294de153 tempest-VolumesGetTest-525573675 None] Selected osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898 as target Quobyte volume. {{(pid=87272) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 10:57:21 devstack cinder-volume[87272]: INFO cinder.volume.drivers.remotefs [None req-6770869c-e57b-4516-ad87-8850294de153 tempest-VolumesGetTest-525573675 None] casted to osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898 Nov 04 10:57:21 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-6770869c-e57b-4516-ad87-8850294de153 tempest-VolumesGetTest-525573675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-4824bdf7-474d-4f87-aaec-e3d7c69d3e81 1073741824 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:57:21 devstack sudo[96919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-4824bdf7-474d-4f87-aaec-e3d7c69d3e81 1073741824 Nov 04 10:57:21 devstack sudo[96919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:57:21 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-77ef958b-6447-4e78-9252-5a5032782294 tempest-VolumesDeleteCascade-325138244 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:57:21 devstack sudo[96919]: pam_unix(sudo:session): session closed for user root Nov 04 10:57:21 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-6770869c-e57b-4516-ad87-8850294de153 tempest-VolumesGetTest-525573675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-4824bdf7-474d-4f87-aaec-e3d7c69d3e81 1073741824" returned: 0 in 0.522s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:57:21 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-6770869c-e57b-4516-ad87-8850294de153 tempest-VolumesGetTest-525573675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-4824bdf7-474d-4f87-aaec-e3d7c69d3e81 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:57:21 devstack sudo[96926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-4824bdf7-474d-4f87-aaec-e3d7c69d3e81 Nov 04 10:57:21 devstack sudo[96926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:57:22 devstack sudo[96926]: pam_unix(sudo:session): session closed for user root Nov 04 10:57:22 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-6770869c-e57b-4516-ad87-8850294de153 tempest-VolumesGetTest-525573675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-4824bdf7-474d-4f87-aaec-e3d7c69d3e81" returned: 0 in 0.309s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:57:22 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-6770869c-e57b-4516-ad87-8850294de153 tempest-VolumesGetTest-525573675 None] <== create_volume: return (881ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'} {{(pid=87272) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 04 10:57:22 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-6770869c-e57b-4516-ad87-8850294de153 tempest-VolumesGetTest-525573675 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.884s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:57:22 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-77ef958b-6447-4e78-9252-5a5032782294 tempest-VolumesDeleteCascade-325138244 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.731s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:57:22 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.remotefs [None req-77ef958b-6447-4e78-9252-5a5032782294 tempest-VolumesDeleteCascade-325138244 None] Creating offline snapshot c804ce3f-540d-4b28-9324-7446595de07a of volume d339fd56-0927-4197-bb3c-0af46ad5b40d {{(pid=87272) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 04 10:57:22 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-6770869c-e57b-4516-ad87-8850294de153 tempest-VolumesGetTest-525573675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (69eda0bd-7b8f-4129-b1d9-2c240ba4935a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4824bdf7-474d-4f87-aaec-e3d7c69d3e81', 'volume_size': 1}' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:57:22 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-6770869c-e57b-4516-ad87-8850294de153 tempest-VolumesGetTest-525573675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (738d7bb6-4386-42a8-a066-7b029a5aad98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:57:22 devstack cinder-volume[87272]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa8c9906-7645-48e2-ab88-05fcbe7bdd33]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:57:22 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-77ef958b-6447-4e78-9252-5a5032782294 tempest-VolumesDeleteCascade-325138244 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-d339fd56-0927-4197-bb3c-0af46ad5b40d {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:57:22 devstack cinder-volume[87272]: INFO cinder.volume.flows.manager.create_volume [None req-6770869c-e57b-4516-ad87-8850294de153 tempest-VolumesGetTest-525573675 None] Volume volume-4824bdf7-474d-4f87-aaec-e3d7c69d3e81 (4824bdf7-474d-4f87-aaec-e3d7c69d3e81): created successfully Nov 04 10:57:22 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-6770869c-e57b-4516-ad87-8850294de153 tempest-VolumesGetTest-525573675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (738d7bb6-4386-42a8-a066-7b029a5aad98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:57:22 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-6770869c-e57b-4516-ad87-8850294de153 tempest-VolumesGetTest-525573675 None] Flow 'volume_create_manager' (1f6d5ed3-fe11-4bfb-8bd1-9bb5dde0cef1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87272) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:57:22 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-6770869c-e57b-4516-ad87-8850294de153 tempest-VolumesGetTest-525573675 None] Created volume successfully. Nov 04 10:57:22 devstack sudo[96932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-d339fd56-0927-4197-bb3c-0af46ad5b40d Nov 04 10:57:22 devstack sudo[96932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:57:22 devstack sudo[96932]: pam_unix(sudo:session): session closed for user root Nov 04 10:57:22 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-77ef958b-6447-4e78-9252-5a5032782294 tempest-VolumesDeleteCascade-325138244 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-d339fd56-0927-4197-bb3c-0af46ad5b40d" returned: 0 in 0.495s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:57:22 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-77ef958b-6447-4e78-9252-5a5032782294 tempest-VolumesDeleteCascade-325138244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-d339fd56-0927-4197-bb3c-0af46ad5b40d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-d339fd56-0927-4197-bb3c-0af46ad5b40d.c804ce3f-540d-4b28-9324-7446595de07a 1G {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:57:22 devstack sudo[96946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-d339fd56-0927-4197-bb3c-0af46ad5b40d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-d339fd56-0927-4197-bb3c-0af46ad5b40d.c804ce3f-540d-4b28-9324-7446595de07a 1G Nov 04 10:57:22 devstack sudo[96946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:57:22 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [req-0f82197c-275e-4299-bfff-e55aa83cc64e req-d95fef0c-ba94-4b8c-91d4-a98e3bf86d63 tempest-AttachVolumeNegativeTest-154668454 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:57:23 devstack sudo[96946]: pam_unix(sudo:session): session closed for user root Nov 04 10:57:23 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-77ef958b-6447-4e78-9252-5a5032782294 tempest-VolumesDeleteCascade-325138244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-d339fd56-0927-4197-bb3c-0af46ad5b40d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-d339fd56-0927-4197-bb3c-0af46ad5b40d.c804ce3f-540d-4b28-9324-7446595de07a 1G" returned: 0 in 0.473s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:57:23 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-77ef958b-6447-4e78-9252-5a5032782294 tempest-VolumesDeleteCascade-325138244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d339fd56-0927-4197-bb3c-0af46ad5b40d -F qcow2 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-d339fd56-0927-4197-bb3c-0af46ad5b40d.c804ce3f-540d-4b28-9324-7446595de07a {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:57:23 devstack sudo[96951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d339fd56-0927-4197-bb3c-0af46ad5b40d -F qcow2 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-d339fd56-0927-4197-bb3c-0af46ad5b40d.c804ce3f-540d-4b28-9324-7446595de07a Nov 04 10:57:23 devstack sudo[96951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:57:23 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-4298bef4-b21e-4719-a162-531b503727d4 tempest-VolumesGetTest-525573675 None] Acquiring lock "cinder-4824bdf7-474d-4f87-aaec-e3d7c69d3e81-delete_volume" by "delete_volume" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:57:23 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-4298bef4-b21e-4719-a162-531b503727d4 tempest-VolumesGetTest-525573675 None] Lock "cinder-4824bdf7-474d-4f87-aaec-e3d7c69d3e81-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:57:23 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-4298bef4-b21e-4719-a162-531b503727d4 tempest-VolumesGetTest-525573675 None] Acquiring lock "cinder-quobyte-4824bdf7-474d-4f87-aaec-e3d7c69d3e81" by "delete_volume" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:57:23 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-4298bef4-b21e-4719-a162-531b503727d4 tempest-VolumesGetTest-525573675 None] Lock "cinder-quobyte-4824bdf7-474d-4f87-aaec-e3d7c69d3e81" acquired by "delete_volume" :: waited 0.020s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:57:23 devstack cinder-volume[87272]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6f80c59-8f31-4512-b6b9-97d53b0e9028]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:57:23 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-4298bef4-b21e-4719-a162-531b503727d4 tempest-VolumesGetTest-525573675 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-4824bdf7-474d-4f87-aaec-e3d7c69d3e81 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:57:23 devstack sudo[96951]: pam_unix(sudo:session): session closed for user root Nov 04 10:57:23 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-77ef958b-6447-4e78-9252-5a5032782294 tempest-VolumesDeleteCascade-325138244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d339fd56-0927-4197-bb3c-0af46ad5b40d -F qcow2 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-d339fd56-0927-4197-bb3c-0af46ad5b40d.c804ce3f-540d-4b28-9324-7446595de07a" returned: 0 in 0.334s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:57:23 devstack cinder-volume[87272]: WARNING cinder.volume.drivers.remotefs [None req-77ef958b-6447-4e78-9252-5a5032782294 tempest-VolumesDeleteCascade-325138244 None] /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-d339fd56-0927-4197-bb3c-0af46ad5b40d.c804ce3f-540d-4b28-9324-7446595de07a is being set with open permissions: ugo+rw Nov 04 10:57:23 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-77ef958b-6447-4e78-9252-5a5032782294 tempest-VolumesDeleteCascade-325138244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-d339fd56-0927-4197-bb3c-0af46ad5b40d.c804ce3f-540d-4b28-9324-7446595de07a {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:57:23 devstack sudo[96957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-d339fd56-0927-4197-bb3c-0af46ad5b40d.c804ce3f-540d-4b28-9324-7446595de07a Nov 04 10:57:23 devstack sudo[96957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:57:23 devstack sudo[96956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-4824bdf7-474d-4f87-aaec-e3d7c69d3e81 Nov 04 10:57:23 devstack sudo[96956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:57:23 devstack sudo[96957]: pam_unix(sudo:session): session closed for user root Nov 04 10:57:23 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-77ef958b-6447-4e78-9252-5a5032782294 tempest-VolumesDeleteCascade-325138244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-d339fd56-0927-4197-bb3c-0af46ad5b40d.c804ce3f-540d-4b28-9324-7446595de07a" returned: 0 in 0.257s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:57:23 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-77ef958b-6447-4e78-9252-5a5032782294 tempest-VolumesDeleteCascade-325138244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-d339fd56-0927-4197-bb3c-0af46ad5b40d.info {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:57:24 devstack sudo[96978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-d339fd56-0927-4197-bb3c-0af46ad5b40d.info Nov 04 10:57:24 devstack sudo[96978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:57:24 devstack sudo[96956]: pam_unix(sudo:session): session closed for user root Nov 04 10:57:24 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-4298bef4-b21e-4719-a162-531b503727d4 tempest-VolumesGetTest-525573675 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-4824bdf7-474d-4f87-aaec-e3d7c69d3e81" returned: 0 in 0.499s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:57:24 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-4298bef4-b21e-4719-a162-531b503727d4 tempest-VolumesGetTest-525573675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-4824bdf7-474d-4f87-aaec-e3d7c69d3e81 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:57:24 devstack sudo[97000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-4824bdf7-474d-4f87-aaec-e3d7c69d3e81 Nov 04 10:57:24 devstack sudo[97000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:57:24 devstack sudo[96978]: pam_unix(sudo:session): session closed for user root Nov 04 10:57:24 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-77ef958b-6447-4e78-9252-5a5032782294 tempest-VolumesDeleteCascade-325138244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-d339fd56-0927-4197-bb3c-0af46ad5b40d.info" returned: 0 in 0.336s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:57:24 devstack cinder-volume[87272]: WARNING cinder.volume.drivers.remotefs [None req-77ef958b-6447-4e78-9252-5a5032782294 tempest-VolumesDeleteCascade-325138244 None] /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-d339fd56-0927-4197-bb3c-0af46ad5b40d.info is being set with open permissions: ugo+rw Nov 04 10:57:24 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-77ef958b-6447-4e78-9252-5a5032782294 tempest-VolumesDeleteCascade-325138244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-d339fd56-0927-4197-bb3c-0af46ad5b40d.info {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:57:24 devstack sudo[97003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-d339fd56-0927-4197-bb3c-0af46ad5b40d.info Nov 04 10:57:24 devstack sudo[97003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:57:24 devstack sudo[97000]: pam_unix(sudo:session): session closed for user root Nov 04 10:57:24 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-4298bef4-b21e-4719-a162-531b503727d4 tempest-VolumesGetTest-525573675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-4824bdf7-474d-4f87-aaec-e3d7c69d3e81" returned: 0 in 0.440s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:57:24 devstack sudo[97003]: pam_unix(sudo:session): session closed for user root Nov 04 10:57:24 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-77ef958b-6447-4e78-9252-5a5032782294 tempest-VolumesDeleteCascade-325138244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-d339fd56-0927-4197-bb3c-0af46ad5b40d.info" returned: 0 in 0.266s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:57:24 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-77ef958b-6447-4e78-9252-5a5032782294 tempest-VolumesDeleteCascade-325138244 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.325s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:57:24 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-4298bef4-b21e-4719-a162-531b503727d4 tempest-VolumesGetTest-525573675 None] Lock "cinder-quobyte-4824bdf7-474d-4f87-aaec-e3d7c69d3e81" released by "delete_volume" :: held 1.026s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:57:24 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [req-0f82197c-275e-4299-bfff-e55aa83cc64e req-d95fef0c-ba94-4b8c-91d4-a98e3bf86d63 tempest-AttachVolumeNegativeTest-154668454 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.722s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:57:24 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [req-0f82197c-275e-4299-bfff-e55aa83cc64e req-d95fef0c-ba94-4b8c-91d4-a98e3bf86d63 tempest-AttachVolumeNegativeTest-154668454 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.058s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:57:24 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-77ef958b-6447-4e78-9252-5a5032782294 tempest-VolumesDeleteCascade-325138244 None] Create snapshot completed successfully Nov 04 10:57:24 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [req-0f82197c-275e-4299-bfff-e55aa83cc64e req-d95fef0c-ba94-4b8c-91d4-a98e3bf86d63 tempest-AttachVolumeNegativeTest-154668454 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898', 'name': 'volume-2959388a-38d4-410b-a6d8-20185d76ebc7', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '7f8de6d3-769d-4030-b9d1-b01c4b80a879', 'enforce_multipath': True} {{(pid=87272) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 04 10:57:24 devstack cinder-volume[87272]: DEBUG cinder.quota [None req-4298bef4-b21e-4719-a162-531b503727d4 tempest-VolumesGetTest-525573675 None] Created reservations ['2d31114f-e9a5-4fe5-801e-eafad93e47f5', '2141c967-f44e-4e8e-b976-e6db45df6c99', 'c71885ce-a62f-44b3-a514-4718a8181cfe', '0e81b404-a774-4a34-9db9-c626e0a3aba6'] {{(pid=87272) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 10:57:24 devstack cinder-volume[87272]: INFO cinder.volume.manager [req-0f82197c-275e-4299-bfff-e55aa83cc64e req-d95fef0c-ba94-4b8c-91d4-a98e3bf86d63 tempest-AttachVolumeNegativeTest-154668454 None] attachment_update completed successfully. Nov 04 10:57:24 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-4298bef4-b21e-4719-a162-531b503727d4 tempest-VolumesGetTest-525573675 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:57:24 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-4298bef4-b21e-4719-a162-531b503727d4 tempest-VolumesGetTest-525573675 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:57:24 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-4298bef4-b21e-4719-a162-531b503727d4 tempest-VolumesGetTest-525573675 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898': None} {{(pid=87272) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:57:24 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-4298bef4-b21e-4719-a162-531b503727d4 tempest-VolumesGetTest-525573675 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'] {{(pid=87272) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:57:24 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-4298bef4-b21e-4719-a162-531b503727d4 tempest-VolumesGetTest-525573675 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:57:24 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-4298bef4-b21e-4719-a162-531b503727d4 tempest-VolumesGetTest-525573675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:57:24 devstack sudo[97009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1 Nov 04 10:57:24 devstack sudo[97009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:57:25 devstack sudo[97009]: pam_unix(sudo:session): session closed for user root Nov 04 10:57:25 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-4298bef4-b21e-4719-a162-531b503727d4 tempest-VolumesGetTest-525573675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1" returned: 0 in 0.375s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:57:25 devstack cinder-volume[87272]: DEBUG cinder.manager [None req-4298bef4-b21e-4719-a162-531b503727d4 tempest-VolumesGetTest-525573675 None] Notifying Schedulers of capabilities ... {{(pid=87272) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 10:57:25 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-4298bef4-b21e-4719-a162-531b503727d4 tempest-VolumesGetTest-525573675 None] Deleted volume successfully. Nov 04 10:57:25 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-4298bef4-b21e-4719-a162-531b503727d4 tempest-VolumesGetTest-525573675 None] Lock "cinder-4824bdf7-474d-4f87-aaec-e3d7c69d3e81-delete_volume" released by "delete_volume" :: held 1.845s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:57:26 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-082c927b-26fb-4d91-b6be-8e85de5aa9d8 tempest-VolumesGetTest-525573675 None] Acquiring lock "cinder-48647ff2-6d0c-41ed-9ea2-fc1ca5c2c836-delete_volume" by "delete_volume" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:57:26 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-082c927b-26fb-4d91-b6be-8e85de5aa9d8 tempest-VolumesGetTest-525573675 None] Lock "cinder-48647ff2-6d0c-41ed-9ea2-fc1ca5c2c836-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:57:26 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-082c927b-26fb-4d91-b6be-8e85de5aa9d8 tempest-VolumesGetTest-525573675 None] Acquiring lock "cinder-quobyte-48647ff2-6d0c-41ed-9ea2-fc1ca5c2c836" by "delete_volume" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:57:26 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-082c927b-26fb-4d91-b6be-8e85de5aa9d8 tempest-VolumesGetTest-525573675 None] Lock "cinder-quobyte-48647ff2-6d0c-41ed-9ea2-fc1ca5c2c836" acquired by "delete_volume" :: waited 0.025s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:57:26 devstack cinder-volume[87272]: DEBUG oslo.privsep.daemon [-] privsep: reply[820a8de5-d361-4eae-9a5f-29d242766cec]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:57:26 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-082c927b-26fb-4d91-b6be-8e85de5aa9d8 tempest-VolumesGetTest-525573675 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-48647ff2-6d0c-41ed-9ea2-fc1ca5c2c836 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:57:26 devstack sudo[97432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-48647ff2-6d0c-41ed-9ea2-fc1ca5c2c836 Nov 04 10:57:26 devstack sudo[97432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:57:26 devstack sudo[97432]: pam_unix(sudo:session): session closed for user root Nov 04 10:57:26 devstack cinder-volume[87272]: DEBUG cinder.volume.flows.manager.create_volume [None req-a3547542-cece-491f-ac42-cd1edb562d2d tempest-VolumesDeleteCascade-325138244 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87272) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 10:57:26 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-082c927b-26fb-4d91-b6be-8e85de5aa9d8 tempest-VolumesGetTest-525573675 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-48647ff2-6d0c-41ed-9ea2-fc1ca5c2c836" returned: 0 in 0.570s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:57:26 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-082c927b-26fb-4d91-b6be-8e85de5aa9d8 tempest-VolumesGetTest-525573675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-48647ff2-6d0c-41ed-9ea2-fc1ca5c2c836 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:57:26 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-a3547542-cece-491f-ac42-cd1edb562d2d tempest-VolumesDeleteCascade-325138244 None] Flow 'volume_create_manager' (ae72c96b-f727-43b6-a1f2-9ad9ab3545be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:57:26 devstack sudo[97439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-48647ff2-6d0c-41ed-9ea2-fc1ca5c2c836 Nov 04 10:57:26 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-a3547542-cece-491f-ac42-cd1edb562d2d tempest-VolumesDeleteCascade-325138244 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eee5523f-a0cd-4b85-bd0c-2dc7e0bd6819) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:57:26 devstack sudo[97439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:57:26 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-a3547542-cece-491f-ac42-cd1edb562d2d tempest-VolumesDeleteCascade-325138244 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eee5523f-a0cd-4b85-bd0c-2dc7e0bd6819) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T09:57:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-670975405',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e5fd4389-40f6-4dcd-a39b-482331222ac7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='96351ddf0a2247dbbc228e0b30b91b61',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T09:57:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=c804ce3f-540d-4b28-9324-7446595de07a,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T09:57:27Z,use_quota=True,user_id='8cee75a07c424c6a99799b186092ec14',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8989e4f-21e3-4f0a-9584-0d818784e883),volume_type_id=f8989e4f-21e3-4f0a-9584-0d818784e883)' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:57:26 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-a3547542-cece-491f-ac42-cd1edb562d2d tempest-VolumesDeleteCascade-325138244 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (36c24a1d-317f-4a34-90dd-446af973745c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:57:26 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-a3547542-cece-491f-ac42-cd1edb562d2d tempest-VolumesDeleteCascade-325138244 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (36c24a1d-317f-4a34-90dd-446af973745c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:57:26 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-a3547542-cece-491f-ac42-cd1edb562d2d tempest-VolumesDeleteCascade-325138244 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (119f1fde-a4a4-4609-8e2b-6433e897d131) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:57:26 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-a3547542-cece-491f-ac42-cd1edb562d2d tempest-VolumesDeleteCascade-325138244 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (119f1fde-a4a4-4609-8e2b-6433e897d131) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'e5fd4389-40f6-4dcd-a39b-482331222ac7', 'volume_name': 'volume-e5fd4389-40f6-4dcd-a39b-482331222ac7', 'volume_size': 1, 'snapshot_id': 'c804ce3f-540d-4b28-9324-7446595de07a'}' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:57:26 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-a3547542-cece-491f-ac42-cd1edb562d2d tempest-VolumesDeleteCascade-325138244 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (99b1699f-2a9c-4d11-8b15-ee3cfa7b19bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:57:26 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-a3547542-cece-491f-ac42-cd1edb562d2d tempest-VolumesDeleteCascade-325138244 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (99b1699f-2a9c-4d11-8b15-ee3cfa7b19bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:57:26 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-a3547542-cece-491f-ac42-cd1edb562d2d tempest-VolumesDeleteCascade-325138244 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4b5a539-fe4c-465c-84d7-f63608641eee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:57:26 devstack cinder-volume[87272]: INFO cinder.volume.flows.manager.create_volume [None req-a3547542-cece-491f-ac42-cd1edb562d2d tempest-VolumesDeleteCascade-325138244 None] Volume e5fd4389-40f6-4dcd-a39b-482331222ac7: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-e5fd4389-40f6-4dcd-a39b-482331222ac7', 'volume_size': 1, 'snapshot_id': 'c804ce3f-540d-4b28-9324-7446595de07a'} Nov 04 10:57:26 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-a3547542-cece-491f-ac42-cd1edb562d2d tempest-VolumesDeleteCascade-325138244 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:57:26 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-a3547542-cece-491f-ac42-cd1edb562d2d tempest-VolumesDeleteCascade-325138244 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:57:26 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-a3547542-cece-491f-ac42-cd1edb562d2d tempest-VolumesDeleteCascade-325138244 None] Acquiring lock "cinder-quobyte-c804ce3f-540d-4b28-9324-7446595de07a-e5fd4389-40f6-4dcd-a39b-482331222ac7" by "_create_volume_from_snapshot" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:57:26 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-a3547542-cece-491f-ac42-cd1edb562d2d tempest-VolumesDeleteCascade-325138244 None] Lock "cinder-quobyte-c804ce3f-540d-4b28-9324-7446595de07a-e5fd4389-40f6-4dcd-a39b-482331222ac7" acquired by "_create_volume_from_snapshot" :: waited 0.032s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:57:26 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-a3547542-cece-491f-ac42-cd1edb562d2d tempest-VolumesDeleteCascade-325138244 None] Creating volume e5fd4389-40f6-4dcd-a39b-482331222ac7 from snapshot c804ce3f-540d-4b28-9324-7446595de07a {{(pid=87272) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 04 10:57:26 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-a3547542-cece-491f-ac42-cd1edb562d2d tempest-VolumesDeleteCascade-325138244 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:57:26 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-a3547542-cece-491f-ac42-cd1edb562d2d tempest-VolumesDeleteCascade-325138244 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:57:26 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-a3547542-cece-491f-ac42-cd1edb562d2d tempest-VolumesDeleteCascade-325138244 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898': None} {{(pid=87272) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:57:26 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-a3547542-cece-491f-ac42-cd1edb562d2d tempest-VolumesDeleteCascade-325138244 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'] {{(pid=87272) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:57:26 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-a3547542-cece-491f-ac42-cd1edb562d2d tempest-VolumesDeleteCascade-325138244 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:57:26 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-a3547542-cece-491f-ac42-cd1edb562d2d tempest-VolumesDeleteCascade-325138244 None] Selected osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898 as target Quobyte volume. {{(pid=87272) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 10:57:26 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-a3547542-cece-491f-ac42-cd1edb562d2d tempest-VolumesDeleteCascade-325138244 None] Acquiring lock "cinder-quobyte-e5fd4389-40f6-4dcd-a39b-482331222ac7" by "_copy_volume_from_snapshot" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:57:27 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-a3547542-cece-491f-ac42-cd1edb562d2d tempest-VolumesDeleteCascade-325138244 None] Lock "cinder-quobyte-e5fd4389-40f6-4dcd-a39b-482331222ac7" acquired by "_copy_volume_from_snapshot" :: waited 0.062s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:57:27 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-a3547542-cece-491f-ac42-cd1edb562d2d tempest-VolumesDeleteCascade-325138244 None] snapshot: c804ce3f-540d-4b28-9324-7446595de07a, volume: e5fd4389-40f6-4dcd-a39b-482331222ac7, {{(pid=87272) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 04 10:57:27 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-a3547542-cece-491f-ac42-cd1edb562d2d tempest-VolumesDeleteCascade-325138244 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:57:27 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-a3547542-cece-491f-ac42-cd1edb562d2d tempest-VolumesDeleteCascade-325138244 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:57:27 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-a3547542-cece-491f-ac42-cd1edb562d2d tempest-VolumesDeleteCascade-325138244 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898': None} {{(pid=87272) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:57:27 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-a3547542-cece-491f-ac42-cd1edb562d2d tempest-VolumesDeleteCascade-325138244 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'] {{(pid=87272) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:57:27 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-a3547542-cece-491f-ac42-cd1edb562d2d tempest-VolumesDeleteCascade-325138244 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:57:27 devstack cinder-volume[87272]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cd671ea-f78a-4872-a71e-b9f8c528feec]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:57:27 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-a3547542-cece-491f-ac42-cd1edb562d2d tempest-VolumesDeleteCascade-325138244 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-d339fd56-0927-4197-bb3c-0af46ad5b40d.c804ce3f-540d-4b28-9324-7446595de07a {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:57:27 devstack sudo[97441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-d339fd56-0927-4197-bb3c-0af46ad5b40d.c804ce3f-540d-4b28-9324-7446595de07a Nov 04 10:57:27 devstack sudo[97441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:57:27 devstack sudo[97439]: pam_unix(sudo:session): session closed for user root Nov 04 10:57:27 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-082c927b-26fb-4d91-b6be-8e85de5aa9d8 tempest-VolumesGetTest-525573675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-48647ff2-6d0c-41ed-9ea2-fc1ca5c2c836" returned: 0 in 0.548s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:57:27 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-082c927b-26fb-4d91-b6be-8e85de5aa9d8 tempest-VolumesGetTest-525573675 None] Lock "cinder-quobyte-48647ff2-6d0c-41ed-9ea2-fc1ca5c2c836" released by "delete_volume" :: held 1.178s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:57:27 devstack cinder-volume[87272]: DEBUG cinder.quota [None req-082c927b-26fb-4d91-b6be-8e85de5aa9d8 tempest-VolumesGetTest-525573675 None] Created reservations ['f8bb8f07-a032-4a8f-952b-535c86465a24', '6be9b2b6-ff38-461e-a7f3-1e22f5da4b7f', '2cd2d301-fa42-45c9-9f34-d0809af9ce0d', '38b5efcd-5ab4-4495-be10-da74c21d80a1'] {{(pid=87272) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 10:57:27 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-082c927b-26fb-4d91-b6be-8e85de5aa9d8 tempest-VolumesGetTest-525573675 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:57:27 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-082c927b-26fb-4d91-b6be-8e85de5aa9d8 tempest-VolumesGetTest-525573675 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:57:27 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-082c927b-26fb-4d91-b6be-8e85de5aa9d8 tempest-VolumesGetTest-525573675 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898': None} {{(pid=87272) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:57:27 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-082c927b-26fb-4d91-b6be-8e85de5aa9d8 tempest-VolumesGetTest-525573675 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'] {{(pid=87272) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:57:27 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-082c927b-26fb-4d91-b6be-8e85de5aa9d8 tempest-VolumesGetTest-525573675 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:57:27 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-082c927b-26fb-4d91-b6be-8e85de5aa9d8 tempest-VolumesGetTest-525573675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:57:27 devstack sudo[97470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1 Nov 04 10:57:27 devstack sudo[97470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:57:27 devstack cinder-volume[87272]: INFO cinder.volume.manager [req-146bef19-5f63-438e-beef-cf9fd05cb8f1 req-db4948b7-beb8-464f-9ac7-bf393173d3b7 tempest-AttachVolumeNegativeTest-154668454 None] Terminate volume connection completed successfully. Nov 04 10:57:27 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [req-146bef19-5f63-438e-beef-cf9fd05cb8f1 req-db4948b7-beb8-464f-9ac7-bf393173d3b7 tempest-AttachVolumeNegativeTest-154668454 None] Deleting attachment 7f8de6d3-769d-4030-b9d1-b01c4b80a879. {{(pid=87272) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 04 10:57:27 devstack sudo[97441]: pam_unix(sudo:session): session closed for user root Nov 04 10:57:27 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-a3547542-cece-491f-ac42-cd1edb562d2d tempest-VolumesDeleteCascade-325138244 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-d339fd56-0927-4197-bb3c-0af46ad5b40d.c804ce3f-540d-4b28-9324-7446595de07a" returned: 0 in 0.593s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:57:27 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.remotefs [None req-a3547542-cece-491f-ac42-cd1edb562d2d tempest-VolumesDeleteCascade-325138244 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d339fd56-0927-4197-bb3c-0af46ad5b40d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87272) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 10:57:27 devstack cinder-volume[87272]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f7e0587-5088-4c69-b0d9-0d01f9ebd6c6]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:57:27 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-a3547542-cece-491f-ac42-cd1edb562d2d tempest-VolumesDeleteCascade-325138244 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-d339fd56-0927-4197-bb3c-0af46ad5b40d {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:57:27 devstack sudo[97470]: pam_unix(sudo:session): session closed for user root Nov 04 10:57:27 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-082c927b-26fb-4d91-b6be-8e85de5aa9d8 tempest-VolumesGetTest-525573675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1" returned: 0 in 0.390s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:57:27 devstack cinder-volume[87272]: DEBUG cinder.manager [None req-082c927b-26fb-4d91-b6be-8e85de5aa9d8 tempest-VolumesGetTest-525573675 None] Notifying Schedulers of capabilities ... {{(pid=87272) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 10:57:27 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-082c927b-26fb-4d91-b6be-8e85de5aa9d8 tempest-VolumesGetTest-525573675 None] Deleted volume successfully. Nov 04 10:57:27 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-082c927b-26fb-4d91-b6be-8e85de5aa9d8 tempest-VolumesGetTest-525573675 None] Lock "cinder-48647ff2-6d0c-41ed-9ea2-fc1ca5c2c836-delete_volume" released by "delete_volume" :: held 1.862s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:57:27 devstack sudo[97475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-d339fd56-0927-4197-bb3c-0af46ad5b40d Nov 04 10:57:27 devstack sudo[97475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:57:28 devstack sudo[97475]: pam_unix(sudo:session): session closed for user root Nov 04 10:57:28 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-a3547542-cece-491f-ac42-cd1edb562d2d tempest-VolumesDeleteCascade-325138244 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-d339fd56-0927-4197-bb3c-0af46ad5b40d" returned: 0 in 0.504s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:57:28 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-a3547542-cece-491f-ac42-cd1edb562d2d tempest-VolumesDeleteCascade-325138244 None] will copy from snapshot at /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-d339fd56-0927-4197-bb3c-0af46ad5b40d {{(pid=87272) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 04 10:57:28 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-a3547542-cece-491f-ac42-cd1edb562d2d tempest-VolumesDeleteCascade-325138244 None] Creating direct copy from snapshot {{(pid=87272) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 04 10:57:28 devstack cinder-volume[87272]: DEBUG cinder.utils [None req-a3547542-cece-491f-ac42-cd1edb562d2d tempest-VolumesDeleteCascade-325138244 None] Path /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-e5fd4389-40f6-4dcd-a39b-482331222ac7 not found in is_blk_device check {{(pid=87272) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Nov 04 10:57:28 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-a3547542-cece-491f-ac42-cd1edb562d2d tempest-VolumesDeleteCascade-325138244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-d339fd56-0927-4197-bb3c-0af46ad5b40d /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-e5fd4389-40f6-4dcd-a39b-482331222ac7 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:57:28 devstack sudo[97481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-d339fd56-0927-4197-bb3c-0af46ad5b40d /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-e5fd4389-40f6-4dcd-a39b-482331222ac7 Nov 04 10:57:28 devstack sudo[97481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:57:28 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-05b87d67-b859-4a9c-9ae3-649303b8a661 tempest-VolumesGetTest-525573675 None] Acquiring lock "cinder-b967890f-4f4c-4181-b0c6-dc06f815759a-delete_volume" by "delete_volume" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:57:28 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-05b87d67-b859-4a9c-9ae3-649303b8a661 tempest-VolumesGetTest-525573675 None] Lock "cinder-b967890f-4f4c-4181-b0c6-dc06f815759a-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:57:28 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-05b87d67-b859-4a9c-9ae3-649303b8a661 tempest-VolumesGetTest-525573675 None] Acquiring lock "cinder-quobyte-b967890f-4f4c-4181-b0c6-dc06f815759a" by "delete_volume" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:57:28 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-05b87d67-b859-4a9c-9ae3-649303b8a661 tempest-VolumesGetTest-525573675 None] Lock "cinder-quobyte-b967890f-4f4c-4181-b0c6-dc06f815759a" acquired by "delete_volume" :: waited 0.019s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:57:28 devstack cinder-volume[87272]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba1df019-e8ce-474b-a244-d265bdfe4463]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:57:28 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-05b87d67-b859-4a9c-9ae3-649303b8a661 tempest-VolumesGetTest-525573675 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-b967890f-4f4c-4181-b0c6-dc06f815759a {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:57:28 devstack sudo[97490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-b967890f-4f4c-4181-b0c6-dc06f815759a Nov 04 10:57:28 devstack sudo[97490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:57:29 devstack sudo[97490]: pam_unix(sudo:session): session closed for user root Nov 04 10:57:29 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-05b87d67-b859-4a9c-9ae3-649303b8a661 tempest-VolumesGetTest-525573675 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-b967890f-4f4c-4181-b0c6-dc06f815759a" returned: 0 in 0.712s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:57:29 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-05b87d67-b859-4a9c-9ae3-649303b8a661 tempest-VolumesGetTest-525573675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-b967890f-4f4c-4181-b0c6-dc06f815759a {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:57:29 devstack sudo[97517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-b967890f-4f4c-4181-b0c6-dc06f815759a Nov 04 10:57:29 devstack sudo[97517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:57:30 devstack sudo[97517]: pam_unix(sudo:session): session closed for user root Nov 04 10:57:30 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-05b87d67-b859-4a9c-9ae3-649303b8a661 tempest-VolumesGetTest-525573675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-b967890f-4f4c-4181-b0c6-dc06f815759a" returned: 0 in 0.771s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:57:30 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-05b87d67-b859-4a9c-9ae3-649303b8a661 tempest-VolumesGetTest-525573675 None] Lock "cinder-quobyte-b967890f-4f4c-4181-b0c6-dc06f815759a" released by "delete_volume" :: held 1.608s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:57:30 devstack cinder-volume[87272]: DEBUG dbcounter [-] [87272] Writing DB stats cinder:SELECT=91,cinder:UPDATE=92,cinder:DELETE=11,cinder:INSERT=19 {{(pid=87272) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 10:57:30 devstack cinder-volume[87272]: DEBUG cinder.quota [None req-05b87d67-b859-4a9c-9ae3-649303b8a661 tempest-VolumesGetTest-525573675 None] Created reservations ['0b12fa72-d43b-4812-96b2-10ff5cf19521', '29654467-a452-438a-8e69-3db1b9682506', '10765be8-b645-4afc-9301-150f60451319', '5e1b3a51-f99b-41b3-9db6-74a728c369c0'] {{(pid=87272) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 10:57:30 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-05b87d67-b859-4a9c-9ae3-649303b8a661 tempest-VolumesGetTest-525573675 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:57:30 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-05b87d67-b859-4a9c-9ae3-649303b8a661 tempest-VolumesGetTest-525573675 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:57:30 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-05b87d67-b859-4a9c-9ae3-649303b8a661 tempest-VolumesGetTest-525573675 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898': None} {{(pid=87272) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:57:30 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-05b87d67-b859-4a9c-9ae3-649303b8a661 tempest-VolumesGetTest-525573675 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'] {{(pid=87272) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:57:30 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-05b87d67-b859-4a9c-9ae3-649303b8a661 tempest-VolumesGetTest-525573675 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:57:30 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-05b87d67-b859-4a9c-9ae3-649303b8a661 tempest-VolumesGetTest-525573675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:57:30 devstack sudo[97522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1 Nov 04 10:57:30 devstack sudo[97522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:57:30 devstack sudo[97522]: pam_unix(sudo:session): session closed for user root Nov 04 10:57:31 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-05b87d67-b859-4a9c-9ae3-649303b8a661 tempest-VolumesGetTest-525573675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1" returned: 0 in 0.380s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:57:31 devstack cinder-volume[87272]: DEBUG cinder.manager [None req-05b87d67-b859-4a9c-9ae3-649303b8a661 tempest-VolumesGetTest-525573675 None] Notifying Schedulers of capabilities ... {{(pid=87272) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 10:57:31 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-05b87d67-b859-4a9c-9ae3-649303b8a661 tempest-VolumesGetTest-525573675 None] Deleted volume successfully. Nov 04 10:57:31 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-05b87d67-b859-4a9c-9ae3-649303b8a661 tempest-VolumesGetTest-525573675 None] Lock "cinder-b967890f-4f4c-4181-b0c6-dc06f815759a-delete_volume" released by "delete_volume" :: held 2.558s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:57:33 devstack cinder-volume[87272]: DEBUG cinder.volume.flows.manager.create_volume [None req-44718b46-4696-48a3-b73c-24b762a8dbda tempest-VolumesGetTest-525573675 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87272) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 10:57:33 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-44718b46-4696-48a3-b73c-24b762a8dbda tempest-VolumesGetTest-525573675 None] Flow 'volume_create_manager' (28aa99d7-f7ee-4e34-9e7f-277e78119366) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:57:33 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-44718b46-4696-48a3-b73c-24b762a8dbda tempest-VolumesGetTest-525573675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e1249a14-fb67-47b1-ae3a-e5b65ae381eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:57:33 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-44718b46-4696-48a3-b73c-24b762a8dbda tempest-VolumesGetTest-525573675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e1249a14-fb67-47b1-ae3a-e5b65ae381eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T09:57:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-442228757',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae81e230-5a51-40ed-97f2-75ef03aa2183,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='1fd08fa49c4e4d2f83d17f8aaac1b8a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T09:57:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T09:57:34Z,use_quota=True,user_id='c47ca10290f644b7a54567bf7a4cbc38',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8989e4f-21e3-4f0a-9584-0d818784e883),volume_type_id=f8989e4f-21e3-4f0a-9584-0d818784e883)' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:57:33 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-44718b46-4696-48a3-b73c-24b762a8dbda tempest-VolumesGetTest-525573675 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (55aedff1-1055-4291-9848-f174213b7ba5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:57:33 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-44718b46-4696-48a3-b73c-24b762a8dbda tempest-VolumesGetTest-525573675 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (55aedff1-1055-4291-9848-f174213b7ba5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:57:34 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-44718b46-4696-48a3-b73c-24b762a8dbda tempest-VolumesGetTest-525573675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80ed3f2a-7620-42f0-a5dd-83e3b72a9b2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:57:34 devstack cinder-volume[87272]: DEBUG cinder.image.glance [None req-44718b46-4696-48a3-b73c-24b762a8dbda tempest-VolumesGetTest-525573675 None] Creating Keystone auth plugin from conf {{(pid=87272) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 04 10:57:34 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-44718b46-4696-48a3-b73c-24b762a8dbda tempest-VolumesGetTest-525573675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80ed3f2a-7620-42f0-a5dd-83e3b72a9b2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'ae81e230-5a51-40ed-97f2-75ef03aa2183', 'volume_name': 'volume-ae81e230-5a51-40ed-97f2-75ef03aa2183', 'volume_size': 1, 'image_id': 'e21f1c05-a199-4b20-94c3-a13f8db1348a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e21f1c05-a199-4b20-94c3-a13f8db1348a', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'a0568d152f1945e380a1ac4afff5179c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'e21f1c05-a199-4b20-94c3-a13f8db1348a', 'created_at': datetime.datetime(2026, 11, 4, 9, 43, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 4, 9, 44, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e21f1c05-a199-4b20-94c3-a13f8db1348a/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:57:34 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-44718b46-4696-48a3-b73c-24b762a8dbda tempest-VolumesGetTest-525573675 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d574c98a-e865-424a-be65-992719c0e62d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:57:34 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-44718b46-4696-48a3-b73c-24b762a8dbda tempest-VolumesGetTest-525573675 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d574c98a-e865-424a-be65-992719c0e62d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:57:34 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-44718b46-4696-48a3-b73c-24b762a8dbda tempest-VolumesGetTest-525573675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11ed766b-7ee5-4dc4-bf99-040c3c99cd8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:57:34 devstack cinder-volume[87272]: INFO cinder.volume.flows.manager.create_volume [None req-44718b46-4696-48a3-b73c-24b762a8dbda tempest-VolumesGetTest-525573675 None] Volume ae81e230-5a51-40ed-97f2-75ef03aa2183: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-ae81e230-5a51-40ed-97f2-75ef03aa2183', 'volume_size': 1, 'image_id': 'e21f1c05-a199-4b20-94c3-a13f8db1348a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e21f1c05-a199-4b20-94c3-a13f8db1348a', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'a0568d152f1945e380a1ac4afff5179c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'e21f1c05-a199-4b20-94c3-a13f8db1348a', 'created_at': datetime.datetime(2026, 11, 4, 9, 43, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 4, 9, 44, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e21f1c05-a199-4b20-94c3-a13f8db1348a/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Nov 04 10:57:34 devstack cinder-volume[87272]: DEBUG cinder.volume.flows.manager.create_volume [None req-44718b46-4696-48a3-b73c-24b762a8dbda tempest-VolumesGetTest-525573675 None] Trying to clone ae81e230-5a51-40ed-97f2-75ef03aa2183 from image e21f1c05-a199-4b20-94c3-a13f8db1348a at location (None, [{'url': 'file:///opt/stack/data/glance/images/e21f1c05-a199-4b20-94c3-a13f8db1348a', 'metadata': {}}]). {{(pid=87272) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 04 10:57:35 devstack cinder-volume[87272]: DEBUG cinder.image.image_utils [None req-44718b46-4696-48a3-b73c-24b762a8dbda tempest-VolumesGetTest-525573675 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_e21f1c05-a199-4b20-94c3-a13f8db1348a_5ped0cdcdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87272) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Nov 04 10:57:35 devstack cinder-volume[87272]: INFO cinder.image.image_utils [None req-44718b46-4696-48a3-b73c-24b762a8dbda tempest-VolumesGetTest-525573675 None] Image download 20.69 MB at 20.69 MB/s Nov 04 10:57:35 devstack cinder-volume[87272]: DEBUG oslo.privsep.daemon [-] privsep: reply[03fb0251-cd50-4e51-a954-e5e03eabf66c]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:57:35 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-44718b46-4696-48a3-b73c-24b762a8dbda tempest-VolumesGetTest-525573675 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e21f1c05-a199-4b20-94c3-a13f8db1348a_5ped0cdcdevstack@QuobyteHD {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:57:35 devstack sudo[97529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e21f1c05-a199-4b20-94c3-a13f8db1348a_5ped0cdcdevstack@QuobyteHD Nov 04 10:57:35 devstack sudo[97529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:57:36 devstack sudo[97529]: pam_unix(sudo:session): session closed for user root Nov 04 10:57:36 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-44718b46-4696-48a3-b73c-24b762a8dbda tempest-VolumesGetTest-525573675 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e21f1c05-a199-4b20-94c3-a13f8db1348a_5ped0cdcdevstack@QuobyteHD" returned: 0 in 0.752s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:57:36 devstack cinder-volume[87272]: DEBUG cinder.image.image_utils [None req-44718b46-4696-48a3-b73c-24b762a8dbda tempest-VolumesGetTest-525573675 None] Temporary image e21f1c05-a199-4b20-94c3-a13f8db1348a is fetched for user c47ca10290f644b7a54567bf7a4cbc38. {{(pid=87272) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Nov 04 10:57:36 devstack cinder-volume[87272]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d57e53e-bd4d-4b6f-b6cb-c57ec657a4db]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:57:36 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-44718b46-4696-48a3-b73c-24b762a8dbda tempest-VolumesGetTest-525573675 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e21f1c05-a199-4b20-94c3-a13f8db1348a_5ped0cdcdevstack@QuobyteHD {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:57:36 devstack sudo[97536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e21f1c05-a199-4b20-94c3-a13f8db1348a_5ped0cdcdevstack@QuobyteHD Nov 04 10:57:36 devstack sudo[97536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:57:36 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-b55239b3-b28c-4766-8295-2a1614f1901e tempest-AttachVolumeNegativeTest-154668454 None] Acquiring lock "cinder-2959388a-38d4-410b-a6d8-20185d76ebc7-delete_volume" by "delete_volume" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:57:36 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-b55239b3-b28c-4766-8295-2a1614f1901e tempest-AttachVolumeNegativeTest-154668454 None] Lock "cinder-2959388a-38d4-410b-a6d8-20185d76ebc7-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:57:36 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-b55239b3-b28c-4766-8295-2a1614f1901e tempest-AttachVolumeNegativeTest-154668454 None] Acquiring lock "cinder-quobyte-2959388a-38d4-410b-a6d8-20185d76ebc7" by "delete_volume" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:57:36 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-b55239b3-b28c-4766-8295-2a1614f1901e tempest-AttachVolumeNegativeTest-154668454 None] Lock "cinder-quobyte-2959388a-38d4-410b-a6d8-20185d76ebc7" acquired by "delete_volume" :: waited 0.042s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:57:36 devstack cinder-volume[87272]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b44da19-ac33-42ec-b4ff-9d693c649ca2]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:57:36 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-b55239b3-b28c-4766-8295-2a1614f1901e tempest-AttachVolumeNegativeTest-154668454 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-2959388a-38d4-410b-a6d8-20185d76ebc7 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:57:37 devstack sudo[97538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-2959388a-38d4-410b-a6d8-20185d76ebc7 Nov 04 10:57:37 devstack sudo[97538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:57:37 devstack sudo[97536]: pam_unix(sudo:session): session closed for user root Nov 04 10:57:37 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-44718b46-4696-48a3-b73c-24b762a8dbda tempest-VolumesGetTest-525573675 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e21f1c05-a199-4b20-94c3-a13f8db1348a_5ped0cdcdevstack@QuobyteHD" returned: 0 in 0.862s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:57:37 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-44718b46-4696-48a3-b73c-24b762a8dbda tempest-VolumesGetTest-525573675 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:57:37 devstack sudo[97538]: pam_unix(sudo:session): session closed for user root Nov 04 10:57:37 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-b55239b3-b28c-4766-8295-2a1614f1901e tempest-AttachVolumeNegativeTest-154668454 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-2959388a-38d4-410b-a6d8-20185d76ebc7" returned: 0 in 0.712s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:57:37 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-b55239b3-b28c-4766-8295-2a1614f1901e tempest-AttachVolumeNegativeTest-154668454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-2959388a-38d4-410b-a6d8-20185d76ebc7 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:57:37 devstack sudo[97546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-2959388a-38d4-410b-a6d8-20185d76ebc7 Nov 04 10:57:37 devstack sudo[97546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:57:37 devstack sudo[97481]: pam_unix(sudo:session): session closed for user root Nov 04 10:57:37 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-a3547542-cece-491f-ac42-cd1edb562d2d tempest-VolumesDeleteCascade-325138244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-d339fd56-0927-4197-bb3c-0af46ad5b40d /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-e5fd4389-40f6-4dcd-a39b-482331222ac7" returned: 0 in 9.448s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:57:37 devstack cinder-volume[87272]: DEBUG cinder.image.image_utils [None req-a3547542-cece-491f-ac42-cd1edb562d2d tempest-VolumesDeleteCascade-325138244 None] Image conversion details: src /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-d339fd56-0927-4197-bb3c-0af46ad5b40d, size 1024.00 MB, duration 9.45 sec, destination /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-e5fd4389-40f6-4dcd-a39b-482331222ac7 {{(pid=87272) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Nov 04 10:57:37 devstack cinder-volume[87272]: INFO cinder.image.image_utils [None req-a3547542-cece-491f-ac42-cd1edb562d2d tempest-VolumesDeleteCascade-325138244 None] Converted 1024.00 MB image at 108.37 MB/s Nov 04 10:57:37 devstack cinder-volume[87272]: WARNING cinder.volume.drivers.remotefs [None req-a3547542-cece-491f-ac42-cd1edb562d2d tempest-VolumesDeleteCascade-325138244 None] /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-e5fd4389-40f6-4dcd-a39b-482331222ac7 is being set with open permissions: ugo+rw Nov 04 10:57:37 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-a3547542-cece-491f-ac42-cd1edb562d2d tempest-VolumesDeleteCascade-325138244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-e5fd4389-40f6-4dcd-a39b-482331222ac7 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:57:37 devstack sudo[97548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-e5fd4389-40f6-4dcd-a39b-482331222ac7 Nov 04 10:57:37 devstack sudo[97548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:57:37 devstack sudo[97546]: pam_unix(sudo:session): session closed for user root Nov 04 10:57:37 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-b55239b3-b28c-4766-8295-2a1614f1901e tempest-AttachVolumeNegativeTest-154668454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-2959388a-38d4-410b-a6d8-20185d76ebc7" returned: 0 in 0.371s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:57:37 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-b55239b3-b28c-4766-8295-2a1614f1901e tempest-AttachVolumeNegativeTest-154668454 None] Lock "cinder-quobyte-2959388a-38d4-410b-a6d8-20185d76ebc7" released by "delete_volume" :: held 1.199s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:57:37 devstack cinder-volume[87272]: DEBUG cinder.quota [None req-b55239b3-b28c-4766-8295-2a1614f1901e tempest-AttachVolumeNegativeTest-154668454 None] Created reservations ['7e43f1af-a923-4b51-b9a4-50e884cc6d90', 'd99f4850-7c9a-441b-a843-d71870f0f6df', 'f3f4c4bc-2abf-4563-b300-c754a3d9a294', '71c85b62-ff37-4a7c-85ec-dfdc1da0ace7'] {{(pid=87272) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 10:57:38 devstack sudo[97548]: pam_unix(sudo:session): session closed for user root Nov 04 10:57:38 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-a3547542-cece-491f-ac42-cd1edb562d2d tempest-VolumesDeleteCascade-325138244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-e5fd4389-40f6-4dcd-a39b-482331222ac7" returned: 0 in 0.282s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:57:38 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-a3547542-cece-491f-ac42-cd1edb562d2d tempest-VolumesDeleteCascade-325138244 None] Lock "cinder-quobyte-e5fd4389-40f6-4dcd-a39b-482331222ac7" released by "_copy_volume_from_snapshot" :: held 10.987s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:57:38 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-b55239b3-b28c-4766-8295-2a1614f1901e tempest-AttachVolumeNegativeTest-154668454 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:57:38 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-b55239b3-b28c-4766-8295-2a1614f1901e tempest-AttachVolumeNegativeTest-154668454 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:57:38 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-b55239b3-b28c-4766-8295-2a1614f1901e tempest-AttachVolumeNegativeTest-154668454 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898': None} {{(pid=87272) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:57:38 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-b55239b3-b28c-4766-8295-2a1614f1901e tempest-AttachVolumeNegativeTest-154668454 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'] {{(pid=87272) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:57:38 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-b55239b3-b28c-4766-8295-2a1614f1901e tempest-AttachVolumeNegativeTest-154668454 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:57:38 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-b55239b3-b28c-4766-8295-2a1614f1901e tempest-AttachVolumeNegativeTest-154668454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:57:38 devstack sudo[97552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1 Nov 04 10:57:38 devstack sudo[97552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:57:38 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-a3547542-cece-491f-ac42-cd1edb562d2d tempest-VolumesDeleteCascade-325138244 None] Lock "cinder-quobyte-c804ce3f-540d-4b28-9324-7446595de07a-e5fd4389-40f6-4dcd-a39b-482331222ac7" released by "_create_volume_from_snapshot" :: held 11.146s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:57:38 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-a3547542-cece-491f-ac42-cd1edb562d2d tempest-VolumesDeleteCascade-325138244 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.179s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:57:38 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-44718b46-4696-48a3-b73c-24b762a8dbda tempest-VolumesGetTest-525573675 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.970s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:57:38 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-44718b46-4696-48a3-b73c-24b762a8dbda tempest-VolumesGetTest-525573675 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T09:57:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-442228757',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae81e230-5a51-40ed-97f2-75ef03aa2183,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='1fd08fa49c4e4d2f83d17f8aaac1b8a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T09:57:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T09:57:34Z,use_quota=True,user_id='c47ca10290f644b7a54567bf7a4cbc38',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8989e4f-21e3-4f0a-9584-0d818784e883),volume_type_id=f8989e4f-21e3-4f0a-9584-0d818784e883)}" {{(pid=87272) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 04 10:57:38 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.remotefs [None req-44718b46-4696-48a3-b73c-24b762a8dbda tempest-VolumesGetTest-525573675 None] Creating volume ae81e230-5a51-40ed-97f2-75ef03aa2183 {{(pid=87272) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 10:57:38 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-44718b46-4696-48a3-b73c-24b762a8dbda tempest-VolumesGetTest-525573675 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:57:38 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-44718b46-4696-48a3-b73c-24b762a8dbda tempest-VolumesGetTest-525573675 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:57:38 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-44718b46-4696-48a3-b73c-24b762a8dbda tempest-VolumesGetTest-525573675 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898': None} {{(pid=87272) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:57:38 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-44718b46-4696-48a3-b73c-24b762a8dbda tempest-VolumesGetTest-525573675 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'] {{(pid=87272) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:57:38 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-44718b46-4696-48a3-b73c-24b762a8dbda tempest-VolumesGetTest-525573675 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:57:38 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-44718b46-4696-48a3-b73c-24b762a8dbda tempest-VolumesGetTest-525573675 None] Selected osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898 as target Quobyte volume. {{(pid=87272) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 10:57:38 devstack cinder-volume[87272]: INFO cinder.volume.drivers.remotefs [None req-44718b46-4696-48a3-b73c-24b762a8dbda tempest-VolumesGetTest-525573675 None] casted to osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898 Nov 04 10:57:38 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-44718b46-4696-48a3-b73c-24b762a8dbda tempest-VolumesGetTest-525573675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-ae81e230-5a51-40ed-97f2-75ef03aa2183 1073741824 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:57:38 devstack sudo[97554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-ae81e230-5a51-40ed-97f2-75ef03aa2183 1073741824 Nov 04 10:57:38 devstack sudo[97554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:57:38 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-a3547542-cece-491f-ac42-cd1edb562d2d tempest-VolumesDeleteCascade-325138244 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4b5a539-fe4c-465c-84d7-f63608641eee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e5fd4389-40f6-4dcd-a39b-482331222ac7', 'volume_size': 1, 'snapshot_id': 'c804ce3f-540d-4b28-9324-7446595de07a'}' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:57:38 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-a3547542-cece-491f-ac42-cd1edb562d2d tempest-VolumesDeleteCascade-325138244 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e7a590e5-3faa-47f8-bc09-33e984d293d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:57:38 devstack cinder-volume[87272]: INFO cinder.volume.flows.manager.create_volume [None req-a3547542-cece-491f-ac42-cd1edb562d2d tempest-VolumesDeleteCascade-325138244 None] Volume volume-e5fd4389-40f6-4dcd-a39b-482331222ac7 (e5fd4389-40f6-4dcd-a39b-482331222ac7): created successfully Nov 04 10:57:38 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-a3547542-cece-491f-ac42-cd1edb562d2d tempest-VolumesDeleteCascade-325138244 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e7a590e5-3faa-47f8-bc09-33e984d293d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:57:38 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-a3547542-cece-491f-ac42-cd1edb562d2d tempest-VolumesDeleteCascade-325138244 None] Flow 'volume_create_manager' (ae72c96b-f727-43b6-a1f2-9ad9ab3545be) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87272) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:57:38 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-a3547542-cece-491f-ac42-cd1edb562d2d tempest-VolumesDeleteCascade-325138244 None] Created volume successfully. Nov 04 10:57:38 devstack sudo[97552]: pam_unix(sudo:session): session closed for user root Nov 04 10:57:38 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-b55239b3-b28c-4766-8295-2a1614f1901e tempest-AttachVolumeNegativeTest-154668454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1" returned: 0 in 0.273s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:57:38 devstack cinder-volume[87272]: DEBUG cinder.manager [None req-b55239b3-b28c-4766-8295-2a1614f1901e tempest-AttachVolumeNegativeTest-154668454 None] Notifying Schedulers of capabilities ... {{(pid=87272) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 10:57:38 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-b55239b3-b28c-4766-8295-2a1614f1901e tempest-AttachVolumeNegativeTest-154668454 None] Deleted volume successfully. Nov 04 10:57:38 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-b55239b3-b28c-4766-8295-2a1614f1901e tempest-AttachVolumeNegativeTest-154668454 None] Lock "cinder-2959388a-38d4-410b-a6d8-20185d76ebc7-delete_volume" released by "delete_volume" :: held 1.807s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:57:38 devstack sudo[97554]: pam_unix(sudo:session): session closed for user root Nov 04 10:57:38 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-44718b46-4696-48a3-b73c-24b762a8dbda tempest-VolumesGetTest-525573675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-ae81e230-5a51-40ed-97f2-75ef03aa2183 1073741824" returned: 0 in 0.548s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:57:38 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-44718b46-4696-48a3-b73c-24b762a8dbda tempest-VolumesGetTest-525573675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-ae81e230-5a51-40ed-97f2-75ef03aa2183 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:57:38 devstack sudo[97561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-ae81e230-5a51-40ed-97f2-75ef03aa2183 Nov 04 10:57:38 devstack sudo[97561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:57:38 devstack sudo[97561]: pam_unix(sudo:session): session closed for user root Nov 04 10:57:38 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-44718b46-4696-48a3-b73c-24b762a8dbda tempest-VolumesGetTest-525573675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-ae81e230-5a51-40ed-97f2-75ef03aa2183" returned: 0 in 0.276s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:57:38 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-44718b46-4696-48a3-b73c-24b762a8dbda tempest-VolumesGetTest-525573675 None] <== create_volume: return (868ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'} {{(pid=87272) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 04 10:57:38 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-44718b46-4696-48a3-b73c-24b762a8dbda tempest-VolumesGetTest-525573675 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.873s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:57:39 devstack cinder-volume[87272]: DEBUG cinder.volume.volume_utils [None req-44718b46-4696-48a3-b73c-24b762a8dbda tempest-VolumesGetTest-525573675 None] Attempting download of e21f1c05-a199-4b20-94c3-a13f8db1348a ((None, [{'url': 'file:///opt/stack/data/glance/images/e21f1c05-a199-4b20-94c3-a13f8db1348a', 'metadata': {}}])) to volume ae81e230-5a51-40ed-97f2-75ef03aa2183. {{(pid=87272) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Nov 04 10:57:39 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-1d4ece22-8e02-4354-a25e-d3a17c130529 tempest-AttachVolumeNegativeTest-154668454 None] Acquiring lock "cinder-559bee77-22be-4645-924a-98586a89705b-delete_volume" by "delete_volume" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:57:39 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-1d4ece22-8e02-4354-a25e-d3a17c130529 tempest-AttachVolumeNegativeTest-154668454 None] Lock "cinder-559bee77-22be-4645-924a-98586a89705b-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:57:39 devstack cinder-volume[87272]: DEBUG oslo.privsep.daemon [-] privsep: reply[00467c26-f0b4-4e91-9fea-ad4742ac6e84]: (4, 'raw') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:57:39 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-44718b46-4696-48a3-b73c-24b762a8dbda tempest-VolumesGetTest-525573675 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e21f1c05-a199-4b20-94c3-a13f8db1348a_6n2g30iu {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:57:39 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-1d4ece22-8e02-4354-a25e-d3a17c130529 tempest-AttachVolumeNegativeTest-154668454 None] Acquiring lock "cinder-quobyte-559bee77-22be-4645-924a-98586a89705b" by "delete_volume" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:57:39 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-1d4ece22-8e02-4354-a25e-d3a17c130529 tempest-AttachVolumeNegativeTest-154668454 None] Lock "cinder-quobyte-559bee77-22be-4645-924a-98586a89705b" acquired by "delete_volume" :: waited 0.024s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:57:39 devstack cinder-volume[87272]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5467831-5413-4f1b-a3a7-a86f805ddf02]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:57:39 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-1d4ece22-8e02-4354-a25e-d3a17c130529 tempest-AttachVolumeNegativeTest-154668454 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-559bee77-22be-4645-924a-98586a89705b {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:57:39 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-251a5c0a-5521-459e-a7b7-e2a5efda616f tempest-VolumesDeleteCascade-325138244 None] Acquiring lock "cinder-d339fd56-0927-4197-bb3c-0af46ad5b40d-delete_volume" by "delete_volume" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:57:39 devstack sudo[97564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e21f1c05-a199-4b20-94c3-a13f8db1348a_6n2g30iu Nov 04 10:57:39 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-251a5c0a-5521-459e-a7b7-e2a5efda616f tempest-VolumesDeleteCascade-325138244 None] Lock "cinder-d339fd56-0927-4197-bb3c-0af46ad5b40d-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:57:39 devstack sudo[97564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:57:39 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-251a5c0a-5521-459e-a7b7-e2a5efda616f tempest-VolumesDeleteCascade-325138244 None] Performing cascade delete. {{(pid=87272) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Nov 04 10:57:39 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-251a5c0a-5521-459e-a7b7-e2a5efda616f tempest-VolumesDeleteCascade-325138244 None] Acquiring lock "cinder-c804ce3f-540d-4b28-9324-7446595de07a-delete_snapshot" by "delete_snapshot" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:57:39 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-251a5c0a-5521-459e-a7b7-e2a5efda616f tempest-VolumesDeleteCascade-325138244 None] Lock "cinder-c804ce3f-540d-4b28-9324-7446595de07a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:57:39 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-251a5c0a-5521-459e-a7b7-e2a5efda616f tempest-VolumesDeleteCascade-325138244 None] Acquiring lock "cinder-quobyte-d339fd56-0927-4197-bb3c-0af46ad5b40d" by "delete_snapshot" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:57:39 devstack sudo[97565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-559bee77-22be-4645-924a-98586a89705b Nov 04 10:57:39 devstack sudo[97565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:57:39 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-251a5c0a-5521-459e-a7b7-e2a5efda616f tempest-VolumesDeleteCascade-325138244 None] Lock "cinder-quobyte-d339fd56-0927-4197-bb3c-0af46ad5b40d" acquired by "delete_snapshot" :: waited 0.034s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:57:39 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-251a5c0a-5521-459e-a7b7-e2a5efda616f tempest-VolumesDeleteCascade-325138244 None] Acquiring lock "cinder-quobyte-c804ce3f-540d-4b28-9324-7446595de07a" by "_delete_snapshot" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:57:39 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-251a5c0a-5521-459e-a7b7-e2a5efda616f tempest-VolumesDeleteCascade-325138244 None] Lock "cinder-quobyte-c804ce3f-540d-4b28-9324-7446595de07a" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:57:39 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.remotefs [None req-251a5c0a-5521-459e-a7b7-e2a5efda616f tempest-VolumesDeleteCascade-325138244 None] Deleting offline snapshot c804ce3f-540d-4b28-9324-7446595de07a of volume d339fd56-0927-4197-bb3c-0af46ad5b40d {{(pid=87272) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 04 10:57:39 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.remotefs [None req-251a5c0a-5521-459e-a7b7-e2a5efda616f tempest-VolumesDeleteCascade-325138244 None] snapshot_file for this snap is: volume-d339fd56-0927-4197-bb3c-0af46ad5b40d.c804ce3f-540d-4b28-9324-7446595de07a {{(pid=87272) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 04 10:57:39 devstack cinder-volume[87272]: DEBUG oslo.privsep.daemon [-] privsep: reply[f58b6c63-7d7e-4bd2-bf9c-b794e1438b5f]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:57:39 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-251a5c0a-5521-459e-a7b7-e2a5efda616f tempest-VolumesDeleteCascade-325138244 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-d339fd56-0927-4197-bb3c-0af46ad5b40d.c804ce3f-540d-4b28-9324-7446595de07a {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:57:39 devstack sudo[97564]: pam_unix(sudo:session): session closed for user root Nov 04 10:57:39 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-44718b46-4696-48a3-b73c-24b762a8dbda tempest-VolumesGetTest-525573675 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e21f1c05-a199-4b20-94c3-a13f8db1348a_6n2g30iu" returned: 0 in 0.412s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:57:39 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-44718b46-4696-48a3-b73c-24b762a8dbda tempest-VolumesGetTest-525573675 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e21f1c05-a199-4b20-94c3-a13f8db1348a_6n2g30iu {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:57:39 devstack sudo[97568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-d339fd56-0927-4197-bb3c-0af46ad5b40d.c804ce3f-540d-4b28-9324-7446595de07a Nov 04 10:57:39 devstack sudo[97568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:57:39 devstack sudo[97571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e21f1c05-a199-4b20-94c3-a13f8db1348a_6n2g30iu Nov 04 10:57:39 devstack sudo[97571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:57:39 devstack sudo[97565]: pam_unix(sudo:session): session closed for user root Nov 04 10:57:39 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-1d4ece22-8e02-4354-a25e-d3a17c130529 tempest-AttachVolumeNegativeTest-154668454 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-559bee77-22be-4645-924a-98586a89705b" returned: 0 in 0.470s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:57:39 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-1d4ece22-8e02-4354-a25e-d3a17c130529 tempest-AttachVolumeNegativeTest-154668454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-559bee77-22be-4645-924a-98586a89705b {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:57:39 devstack sudo[97577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-559bee77-22be-4645-924a-98586a89705b Nov 04 10:57:39 devstack sudo[97577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:57:40 devstack sudo[97577]: pam_unix(sudo:session): session closed for user root Nov 04 10:57:40 devstack sudo[97571]: pam_unix(sudo:session): session closed for user root Nov 04 10:57:40 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-1d4ece22-8e02-4354-a25e-d3a17c130529 tempest-AttachVolumeNegativeTest-154668454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-559bee77-22be-4645-924a-98586a89705b" returned: 0 in 0.434s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:57:40 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-44718b46-4696-48a3-b73c-24b762a8dbda tempest-VolumesGetTest-525573675 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e21f1c05-a199-4b20-94c3-a13f8db1348a_6n2g30iu" returned: 1 in 0.596s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:57:40 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-44718b46-4696-48a3-b73c-24b762a8dbda tempest-VolumesGetTest-525573675 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e21f1c05-a199-4b20-94c3-a13f8db1348a_6n2g30iu' failed. Not Retrying. {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 04 10:57:40 devstack sudo[97568]: pam_unix(sudo:session): session closed for user root Nov 04 10:57:40 devstack cinder-volume[87272]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4e1203a-88c4-4154-af5a-6f8b67ef56fd]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:57:40 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-44718b46-4696-48a3-b73c-24b762a8dbda tempest-VolumesGetTest-525573675 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e21f1c05-a199-4b20-94c3-a13f8db1348a_5ped0cdcdevstack@QuobyteHD {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:57:40 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-1d4ece22-8e02-4354-a25e-d3a17c130529 tempest-AttachVolumeNegativeTest-154668454 None] Lock "cinder-quobyte-559bee77-22be-4645-924a-98586a89705b" released by "delete_volume" :: held 0.993s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:57:40 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-251a5c0a-5521-459e-a7b7-e2a5efda616f tempest-VolumesDeleteCascade-325138244 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-d339fd56-0927-4197-bb3c-0af46ad5b40d.c804ce3f-540d-4b28-9324-7446595de07a" returned: 0 in 0.686s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:57:40 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.remotefs [None req-251a5c0a-5521-459e-a7b7-e2a5efda616f tempest-VolumesDeleteCascade-325138244 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d339fd56-0927-4197-bb3c-0af46ad5b40d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87272) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 10:57:40 devstack cinder-volume[87272]: DEBUG oslo.privsep.daemon [-] privsep: reply[04ed2bc7-ef1b-4c97-96df-d3670ab20ce5]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:57:40 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-251a5c0a-5521-459e-a7b7-e2a5efda616f tempest-VolumesDeleteCascade-325138244 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-d339fd56-0927-4197-bb3c-0af46ad5b40d {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:57:40 devstack cinder-volume[87272]: DEBUG cinder.quota [None req-1d4ece22-8e02-4354-a25e-d3a17c130529 tempest-AttachVolumeNegativeTest-154668454 None] Created reservations ['af12755f-ce69-4ce1-9bc9-9e71a48383a2', '926fc63b-72e7-4b0d-b7b2-31bcfae7b8d8', '77e926ab-32e3-4a4e-8206-100fd6dd4dc2', 'ca1f414a-962d-4459-9ba4-7459c08a3bfe'] {{(pid=87272) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 10:57:40 devstack sudo[97586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e21f1c05-a199-4b20-94c3-a13f8db1348a_5ped0cdcdevstack@QuobyteHD Nov 04 10:57:40 devstack sudo[97586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:57:40 devstack sudo[97587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-d339fd56-0927-4197-bb3c-0af46ad5b40d Nov 04 10:57:40 devstack sudo[97587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:57:40 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-1d4ece22-8e02-4354-a25e-d3a17c130529 tempest-AttachVolumeNegativeTest-154668454 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:57:40 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-1d4ece22-8e02-4354-a25e-d3a17c130529 tempest-AttachVolumeNegativeTest-154668454 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:57:40 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-1d4ece22-8e02-4354-a25e-d3a17c130529 tempest-AttachVolumeNegativeTest-154668454 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898': None} {{(pid=87272) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:57:40 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-1d4ece22-8e02-4354-a25e-d3a17c130529 tempest-AttachVolumeNegativeTest-154668454 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'] {{(pid=87272) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:57:40 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-1d4ece22-8e02-4354-a25e-d3a17c130529 tempest-AttachVolumeNegativeTest-154668454 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:57:40 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-1d4ece22-8e02-4354-a25e-d3a17c130529 tempest-AttachVolumeNegativeTest-154668454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:57:40 devstack sudo[97590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1 Nov 04 10:57:40 devstack sudo[97590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:57:40 devstack sudo[97586]: pam_unix(sudo:session): session closed for user root Nov 04 10:57:40 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-44718b46-4696-48a3-b73c-24b762a8dbda tempest-VolumesGetTest-525573675 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e21f1c05-a199-4b20-94c3-a13f8db1348a_5ped0cdcdevstack@QuobyteHD" returned: 0 in 0.490s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:57:40 devstack cinder-volume[87272]: DEBUG cinder.image.image_utils [None req-44718b46-4696-48a3-b73c-24b762a8dbda tempest-VolumesGetTest-525573675 None] e21f1c05-a199-4b20-94c3-a13f8db1348a was qcow2, converting to qcow2 {{(pid=87272) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Nov 04 10:57:40 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-44718b46-4696-48a3-b73c-24b762a8dbda tempest-VolumesGetTest-525573675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_e21f1c05-a199-4b20-94c3-a13f8db1348a_5ped0cdcdevstack@QuobyteHD /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-ae81e230-5a51-40ed-97f2-75ef03aa2183 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:57:40 devstack sudo[97597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_e21f1c05-a199-4b20-94c3-a13f8db1348a_5ped0cdcdevstack@QuobyteHD /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-ae81e230-5a51-40ed-97f2-75ef03aa2183 Nov 04 10:57:40 devstack sudo[97597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:57:40 devstack sudo[97590]: pam_unix(sudo:session): session closed for user root Nov 04 10:57:40 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-1d4ece22-8e02-4354-a25e-d3a17c130529 tempest-AttachVolumeNegativeTest-154668454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1" returned: 0 in 0.363s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:57:40 devstack cinder-volume[87272]: DEBUG cinder.manager [None req-1d4ece22-8e02-4354-a25e-d3a17c130529 tempest-AttachVolumeNegativeTest-154668454 None] Notifying Schedulers of capabilities ... {{(pid=87272) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 10:57:40 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-1d4ece22-8e02-4354-a25e-d3a17c130529 tempest-AttachVolumeNegativeTest-154668454 None] Deleted volume successfully. Nov 04 10:57:40 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-1d4ece22-8e02-4354-a25e-d3a17c130529 tempest-AttachVolumeNegativeTest-154668454 None] Lock "cinder-559bee77-22be-4645-924a-98586a89705b-delete_volume" released by "delete_volume" :: held 1.783s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:57:40 devstack sudo[97587]: pam_unix(sudo:session): session closed for user root Nov 04 10:57:40 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-251a5c0a-5521-459e-a7b7-e2a5efda616f tempest-VolumesDeleteCascade-325138244 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-d339fd56-0927-4197-bb3c-0af46ad5b40d" returned: 0 in 0.732s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:57:40 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-251a5c0a-5521-459e-a7b7-e2a5efda616f tempest-VolumesDeleteCascade-325138244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-d339fd56-0927-4197-bb3c-0af46ad5b40d.c804ce3f-540d-4b28-9324-7446595de07a {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:57:40 devstack sudo[97603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-d339fd56-0927-4197-bb3c-0af46ad5b40d.c804ce3f-540d-4b28-9324-7446595de07a Nov 04 10:57:40 devstack sudo[97603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:57:41 devstack sudo[97603]: pam_unix(sudo:session): session closed for user root Nov 04 10:57:41 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-251a5c0a-5521-459e-a7b7-e2a5efda616f tempest-VolumesDeleteCascade-325138244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-d339fd56-0927-4197-bb3c-0af46ad5b40d.c804ce3f-540d-4b28-9324-7446595de07a" returned: 0 in 0.477s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:57:41 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-251a5c0a-5521-459e-a7b7-e2a5efda616f tempest-VolumesDeleteCascade-325138244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-d339fd56-0927-4197-bb3c-0af46ad5b40d.c804ce3f-540d-4b28-9324-7446595de07a {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:57:41 devstack sudo[97620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-d339fd56-0927-4197-bb3c-0af46ad5b40d.c804ce3f-540d-4b28-9324-7446595de07a Nov 04 10:57:41 devstack sudo[97620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:57:41 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-eca0dff6-b4f8-4094-973d-f87e55cd666e tempest-AttachVolumeNegativeTest-154668454 None] Acquiring lock "cinder-22085580-85cf-4ebc-bab6-597fac3a1d82-delete_volume" by "delete_volume" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:57:41 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-eca0dff6-b4f8-4094-973d-f87e55cd666e tempest-AttachVolumeNegativeTest-154668454 None] Lock "cinder-22085580-85cf-4ebc-bab6-597fac3a1d82-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:57:41 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-eca0dff6-b4f8-4094-973d-f87e55cd666e tempest-AttachVolumeNegativeTest-154668454 None] Acquiring lock "cinder-quobyte-22085580-85cf-4ebc-bab6-597fac3a1d82" by "delete_volume" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:57:41 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-eca0dff6-b4f8-4094-973d-f87e55cd666e tempest-AttachVolumeNegativeTest-154668454 None] Lock "cinder-quobyte-22085580-85cf-4ebc-bab6-597fac3a1d82" acquired by "delete_volume" :: waited 0.023s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:57:41 devstack cinder-volume[87272]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca15150c-36c4-4c2f-910a-bddec2544e02]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:57:41 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-eca0dff6-b4f8-4094-973d-f87e55cd666e tempest-AttachVolumeNegativeTest-154668454 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-22085580-85cf-4ebc-bab6-597fac3a1d82 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:57:41 devstack sudo[97620]: pam_unix(sudo:session): session closed for user root Nov 04 10:57:41 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-251a5c0a-5521-459e-a7b7-e2a5efda616f tempest-VolumesDeleteCascade-325138244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-d339fd56-0927-4197-bb3c-0af46ad5b40d.c804ce3f-540d-4b28-9324-7446595de07a" returned: 0 in 0.427s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:57:41 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-251a5c0a-5521-459e-a7b7-e2a5efda616f tempest-VolumesDeleteCascade-325138244 None] Lock "cinder-quobyte-c804ce3f-540d-4b28-9324-7446595de07a" released by "_delete_snapshot" :: held 2.499s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:57:41 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-251a5c0a-5521-459e-a7b7-e2a5efda616f tempest-VolumesDeleteCascade-325138244 None] Lock "cinder-quobyte-d339fd56-0927-4197-bb3c-0af46ad5b40d" released by "delete_snapshot" :: held 2.550s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:57:42 devstack sudo[97623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-22085580-85cf-4ebc-bab6-597fac3a1d82 Nov 04 10:57:42 devstack sudo[97623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:57:42 devstack cinder-volume[87272]: DEBUG cinder.quota [None req-251a5c0a-5521-459e-a7b7-e2a5efda616f tempest-VolumesDeleteCascade-325138244 None] Created reservations ['6e25003d-d3e4-4e4c-80e7-420118df5590', 'd102dd65-4858-4cb4-a8d9-72ef68c7d154', '9ada2c6a-3263-4d4c-9f95-23d556c88696', '5b9aba98-8753-444c-9ca0-766fc2fec14d'] {{(pid=87272) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 10:57:42 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-251a5c0a-5521-459e-a7b7-e2a5efda616f tempest-VolumesDeleteCascade-325138244 None] Delete snapshot completed successfully. Nov 04 10:57:42 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-251a5c0a-5521-459e-a7b7-e2a5efda616f tempest-VolumesDeleteCascade-325138244 None] Lock "cinder-c804ce3f-540d-4b28-9324-7446595de07a-delete_snapshot" released by "delete_snapshot" :: held 2.843s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:57:42 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-251a5c0a-5521-459e-a7b7-e2a5efda616f tempest-VolumesDeleteCascade-325138244 None] Snapshots deleted, issuing volume delete {{(pid=87272) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Nov 04 10:57:42 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-251a5c0a-5521-459e-a7b7-e2a5efda616f tempest-VolumesDeleteCascade-325138244 None] Acquiring lock "cinder-quobyte-d339fd56-0927-4197-bb3c-0af46ad5b40d" by "delete_volume" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:57:42 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-251a5c0a-5521-459e-a7b7-e2a5efda616f tempest-VolumesDeleteCascade-325138244 None] Lock "cinder-quobyte-d339fd56-0927-4197-bb3c-0af46ad5b40d" acquired by "delete_volume" :: waited 0.024s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:57:42 devstack cinder-volume[87272]: DEBUG oslo.privsep.daemon [-] privsep: reply[006bca1b-ecd4-45f2-bf3e-87e707c3462c]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:57:42 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-251a5c0a-5521-459e-a7b7-e2a5efda616f tempest-VolumesDeleteCascade-325138244 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-d339fd56-0927-4197-bb3c-0af46ad5b40d {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:57:42 devstack sudo[97623]: pam_unix(sudo:session): session closed for user root Nov 04 10:57:42 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-eca0dff6-b4f8-4094-973d-f87e55cd666e tempest-AttachVolumeNegativeTest-154668454 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-22085580-85cf-4ebc-bab6-597fac3a1d82" returned: 0 in 0.569s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:57:42 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-eca0dff6-b4f8-4094-973d-f87e55cd666e tempest-AttachVolumeNegativeTest-154668454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-22085580-85cf-4ebc-bab6-597fac3a1d82 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:57:42 devstack sudo[97630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-22085580-85cf-4ebc-bab6-597fac3a1d82 Nov 04 10:57:42 devstack sudo[97630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:57:42 devstack sudo[97628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-d339fd56-0927-4197-bb3c-0af46ad5b40d Nov 04 10:57:42 devstack sudo[97628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:57:42 devstack sudo[97630]: pam_unix(sudo:session): session closed for user root Nov 04 10:57:42 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-eca0dff6-b4f8-4094-973d-f87e55cd666e tempest-AttachVolumeNegativeTest-154668454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-22085580-85cf-4ebc-bab6-597fac3a1d82" returned: 0 in 0.366s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:57:42 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-eca0dff6-b4f8-4094-973d-f87e55cd666e tempest-AttachVolumeNegativeTest-154668454 None] Lock "cinder-quobyte-22085580-85cf-4ebc-bab6-597fac3a1d82" released by "delete_volume" :: held 1.001s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:57:42 devstack cinder-volume[87272]: DEBUG cinder.quota [None req-eca0dff6-b4f8-4094-973d-f87e55cd666e tempest-AttachVolumeNegativeTest-154668454 None] Created reservations ['9aa2ec85-e8fc-4fb4-ba51-c73220f4bccb', 'c3955cb2-e342-4fd9-812e-ee12d8349561', 'b79b178b-241d-44e1-b348-b456a604a544', 'c7927465-9d06-4da1-a746-75cac97844a0'] {{(pid=87272) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 10:57:42 devstack sudo[97628]: pam_unix(sudo:session): session closed for user root Nov 04 10:57:42 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-251a5c0a-5521-459e-a7b7-e2a5efda616f tempest-VolumesDeleteCascade-325138244 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-d339fd56-0927-4197-bb3c-0af46ad5b40d" returned: 0 in 0.587s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:57:42 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-251a5c0a-5521-459e-a7b7-e2a5efda616f tempest-VolumesDeleteCascade-325138244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-d339fd56-0927-4197-bb3c-0af46ad5b40d {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:57:42 devstack sudo[97637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-d339fd56-0927-4197-bb3c-0af46ad5b40d Nov 04 10:57:42 devstack sudo[97637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:57:43 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-eca0dff6-b4f8-4094-973d-f87e55cd666e tempest-AttachVolumeNegativeTest-154668454 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:57:43 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-eca0dff6-b4f8-4094-973d-f87e55cd666e tempest-AttachVolumeNegativeTest-154668454 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:57:43 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-eca0dff6-b4f8-4094-973d-f87e55cd666e tempest-AttachVolumeNegativeTest-154668454 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898': None} {{(pid=87272) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:57:43 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-eca0dff6-b4f8-4094-973d-f87e55cd666e tempest-AttachVolumeNegativeTest-154668454 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'] {{(pid=87272) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:57:43 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-eca0dff6-b4f8-4094-973d-f87e55cd666e tempest-AttachVolumeNegativeTest-154668454 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:57:43 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-eca0dff6-b4f8-4094-973d-f87e55cd666e tempest-AttachVolumeNegativeTest-154668454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:57:43 devstack sudo[97639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1 Nov 04 10:57:43 devstack sudo[97639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:57:43 devstack sudo[97637]: pam_unix(sudo:session): session closed for user root Nov 04 10:57:43 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-251a5c0a-5521-459e-a7b7-e2a5efda616f tempest-VolumesDeleteCascade-325138244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-d339fd56-0927-4197-bb3c-0af46ad5b40d" returned: 0 in 0.366s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:57:43 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-251a5c0a-5521-459e-a7b7-e2a5efda616f tempest-VolumesDeleteCascade-325138244 None] Lock "cinder-quobyte-d339fd56-0927-4197-bb3c-0af46ad5b40d" released by "delete_volume" :: held 1.064s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:57:43 devstack cinder-volume[87272]: DEBUG cinder.quota [None req-251a5c0a-5521-459e-a7b7-e2a5efda616f tempest-VolumesDeleteCascade-325138244 None] Created reservations ['68dc0678-572d-43ed-85ff-b46d88390f2d', '7683f493-a980-4aef-ae7a-d3caed38169d', 'a64d514b-3052-49cb-8f0a-ce5ad972521d', 'fc5988e0-1fb0-44d9-aa9c-d849e7b51880'] {{(pid=87272) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 10:57:43 devstack sudo[97639]: pam_unix(sudo:session): session closed for user root Nov 04 10:57:43 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-eca0dff6-b4f8-4094-973d-f87e55cd666e tempest-AttachVolumeNegativeTest-154668454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1" returned: 0 in 0.376s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:57:43 devstack cinder-volume[87272]: DEBUG cinder.manager [None req-eca0dff6-b4f8-4094-973d-f87e55cd666e tempest-AttachVolumeNegativeTest-154668454 None] Notifying Schedulers of capabilities ... {{(pid=87272) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 10:57:43 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-eca0dff6-b4f8-4094-973d-f87e55cd666e tempest-AttachVolumeNegativeTest-154668454 None] Deleted volume successfully. Nov 04 10:57:43 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-eca0dff6-b4f8-4094-973d-f87e55cd666e tempest-AttachVolumeNegativeTest-154668454 None] Lock "cinder-22085580-85cf-4ebc-bab6-597fac3a1d82-delete_volume" released by "delete_volume" :: held 1.791s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:57:43 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-251a5c0a-5521-459e-a7b7-e2a5efda616f tempest-VolumesDeleteCascade-325138244 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:57:43 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-251a5c0a-5521-459e-a7b7-e2a5efda616f tempest-VolumesDeleteCascade-325138244 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:57:43 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-251a5c0a-5521-459e-a7b7-e2a5efda616f tempest-VolumesDeleteCascade-325138244 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898': None} {{(pid=87272) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:57:43 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-251a5c0a-5521-459e-a7b7-e2a5efda616f tempest-VolumesDeleteCascade-325138244 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'] {{(pid=87272) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:57:43 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-251a5c0a-5521-459e-a7b7-e2a5efda616f tempest-VolumesDeleteCascade-325138244 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:57:43 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-251a5c0a-5521-459e-a7b7-e2a5efda616f tempest-VolumesDeleteCascade-325138244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:57:43 devstack sudo[97643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1 Nov 04 10:57:43 devstack sudo[97643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:57:43 devstack sudo[97597]: pam_unix(sudo:session): session closed for user root Nov 04 10:57:43 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-44718b46-4696-48a3-b73c-24b762a8dbda tempest-VolumesGetTest-525573675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_e21f1c05-a199-4b20-94c3-a13f8db1348a_5ped0cdcdevstack@QuobyteHD /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-ae81e230-5a51-40ed-97f2-75ef03aa2183" returned: 0 in 2.975s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:57:43 devstack cinder-volume[87272]: DEBUG cinder.image.image_utils [None req-44718b46-4696-48a3-b73c-24b762a8dbda tempest-VolumesGetTest-525573675 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_e21f1c05-a199-4b20-94c3-a13f8db1348a_5ped0cdcdevstack@QuobyteHD, size 112.00 MB, duration 2.98 sec, destination /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-ae81e230-5a51-40ed-97f2-75ef03aa2183 {{(pid=87272) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Nov 04 10:57:43 devstack cinder-volume[87272]: INFO cinder.image.image_utils [None req-44718b46-4696-48a3-b73c-24b762a8dbda tempest-VolumesGetTest-525573675 None] Converted 112.00 MB image at 37.62 MB/s Nov 04 10:57:43 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-44718b46-4696-48a3-b73c-24b762a8dbda tempest-VolumesGetTest-525573675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-ae81e230-5a51-40ed-97f2-75ef03aa2183 1G {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:57:43 devstack sudo[97645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-ae81e230-5a51-40ed-97f2-75ef03aa2183 1G Nov 04 10:57:43 devstack sudo[97645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:57:43 devstack sudo[97643]: pam_unix(sudo:session): session closed for user root Nov 04 10:57:43 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-251a5c0a-5521-459e-a7b7-e2a5efda616f tempest-VolumesDeleteCascade-325138244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1" returned: 0 in 0.470s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:57:43 devstack cinder-volume[87272]: DEBUG cinder.manager [None req-251a5c0a-5521-459e-a7b7-e2a5efda616f tempest-VolumesDeleteCascade-325138244 None] Notifying Schedulers of capabilities ... {{(pid=87272) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 10:57:44 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-251a5c0a-5521-459e-a7b7-e2a5efda616f tempest-VolumesDeleteCascade-325138244 None] Deleted volume successfully. Nov 04 10:57:44 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-251a5c0a-5521-459e-a7b7-e2a5efda616f tempest-VolumesDeleteCascade-325138244 None] Lock "cinder-d339fd56-0927-4197-bb3c-0af46ad5b40d-delete_volume" released by "delete_volume" :: held 4.781s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:57:44 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-2338d2a0-c5cb-4a10-a9c9-7363c658b26f tempest-VolumesDeleteCascade-325138244 None] Acquiring lock "cinder-e5fd4389-40f6-4dcd-a39b-482331222ac7-delete_volume" by "delete_volume" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:57:44 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-2338d2a0-c5cb-4a10-a9c9-7363c658b26f tempest-VolumesDeleteCascade-325138244 None] Lock "cinder-e5fd4389-40f6-4dcd-a39b-482331222ac7-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:57:44 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-2338d2a0-c5cb-4a10-a9c9-7363c658b26f tempest-VolumesDeleteCascade-325138244 None] Acquiring lock "cinder-quobyte-e5fd4389-40f6-4dcd-a39b-482331222ac7" by "delete_volume" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:57:44 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-2338d2a0-c5cb-4a10-a9c9-7363c658b26f tempest-VolumesDeleteCascade-325138244 None] Lock "cinder-quobyte-e5fd4389-40f6-4dcd-a39b-482331222ac7" acquired by "delete_volume" :: waited 0.016s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:57:44 devstack sudo[97645]: pam_unix(sudo:session): session closed for user root Nov 04 10:57:44 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-44718b46-4696-48a3-b73c-24b762a8dbda tempest-VolumesGetTest-525573675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-ae81e230-5a51-40ed-97f2-75ef03aa2183 1G" returned: 0 in 0.599s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:57:44 devstack cinder-volume[87272]: DEBUG cinder.volume.volume_utils [None req-44718b46-4696-48a3-b73c-24b762a8dbda tempest-VolumesGetTest-525573675 None] Downloaded image e21f1c05-a199-4b20-94c3-a13f8db1348a ((None, [{'url': 'file:///opt/stack/data/glance/images/e21f1c05-a199-4b20-94c3-a13f8db1348a', 'metadata': {}}])) to volume ae81e230-5a51-40ed-97f2-75ef03aa2183 successfully. {{(pid=87272) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Nov 04 10:57:44 devstack cinder-volume[87272]: DEBUG cinder.image.image_utils [None req-44718b46-4696-48a3-b73c-24b762a8dbda tempest-VolumesGetTest-525573675 None] Temporary image e21f1c05-a199-4b20-94c3-a13f8db1348a for user c47ca10290f644b7a54567bf7a4cbc38 is deleted. {{(pid=87272) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Nov 04 10:57:44 devstack cinder-volume[87272]: DEBUG cinder.volume.volume_utils [None req-44718b46-4696-48a3-b73c-24b762a8dbda tempest-VolumesGetTest-525573675 None] Marking volume ae81e230-5a51-40ed-97f2-75ef03aa2183 as bootable. {{(pid=87272) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Nov 04 10:57:44 devstack cinder-volume[87272]: DEBUG oslo.privsep.daemon [-] privsep: reply[924138c0-99c1-478e-b6ee-9a34424e62d2]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:57:44 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-2338d2a0-c5cb-4a10-a9c9-7363c658b26f tempest-VolumesDeleteCascade-325138244 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-e5fd4389-40f6-4dcd-a39b-482331222ac7 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:57:44 devstack cinder-volume[87272]: DEBUG cinder.volume.flows.manager.create_volume [None req-44718b46-4696-48a3-b73c-24b762a8dbda tempest-VolumesGetTest-525573675 None] Copying metadata from image e21f1c05-a199-4b20-94c3-a13f8db1348a to ae81e230-5a51-40ed-97f2-75ef03aa2183. {{(pid=87272) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 04 10:57:44 devstack cinder-volume[87272]: DEBUG cinder.volume.flows.manager.create_volume [None req-44718b46-4696-48a3-b73c-24b762a8dbda tempest-VolumesGetTest-525573675 None] Creating volume glance metadata for volume ae81e230-5a51-40ed-97f2-75ef03aa2183 backed by image e21f1c05-a199-4b20-94c3-a13f8db1348a with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'e21f1c05-a199-4b20-94c3-a13f8db1348a', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87272) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 04 10:57:44 devstack cinder-volume[87272]: DEBUG dbcounter [-] [87272] Writing DB stats cinder:SELECT=101,cinder:INSERT=37,cinder:UPDATE=121,cinder:DELETE=10 {{(pid=87272) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 10:57:44 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-44718b46-4696-48a3-b73c-24b762a8dbda tempest-VolumesGetTest-525573675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11ed766b-7ee5-4dc4-bf99-040c3c99cd8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ae81e230-5a51-40ed-97f2-75ef03aa2183', 'volume_size': 1, 'image_id': 'e21f1c05-a199-4b20-94c3-a13f8db1348a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e21f1c05-a199-4b20-94c3-a13f8db1348a', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'a0568d152f1945e380a1ac4afff5179c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'e21f1c05-a199-4b20-94c3-a13f8db1348a', 'created_at': datetime.datetime(2026, 11, 4, 9, 43, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 4, 9, 44, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e21f1c05-a199-4b20-94c3-a13f8db1348a/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:57:44 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-44718b46-4696-48a3-b73c-24b762a8dbda tempest-VolumesGetTest-525573675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (176d36cc-c107-4b96-a8be-cba14a0cd2dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:57:44 devstack sudo[97651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-e5fd4389-40f6-4dcd-a39b-482331222ac7 Nov 04 10:57:44 devstack sudo[97651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:57:44 devstack cinder-volume[87272]: INFO cinder.volume.flows.manager.create_volume [None req-44718b46-4696-48a3-b73c-24b762a8dbda tempest-VolumesGetTest-525573675 None] Volume volume-ae81e230-5a51-40ed-97f2-75ef03aa2183 (ae81e230-5a51-40ed-97f2-75ef03aa2183): created successfully Nov 04 10:57:44 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-44718b46-4696-48a3-b73c-24b762a8dbda tempest-VolumesGetTest-525573675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (176d36cc-c107-4b96-a8be-cba14a0cd2dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:57:44 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-44718b46-4696-48a3-b73c-24b762a8dbda tempest-VolumesGetTest-525573675 None] Flow 'volume_create_manager' (28aa99d7-f7ee-4e34-9e7f-277e78119366) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87272) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:57:44 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-44718b46-4696-48a3-b73c-24b762a8dbda tempest-VolumesGetTest-525573675 None] Created volume successfully. Nov 04 10:57:44 devstack sudo[97651]: pam_unix(sudo:session): session closed for user root Nov 04 10:57:44 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-2338d2a0-c5cb-4a10-a9c9-7363c658b26f tempest-VolumesDeleteCascade-325138244 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-e5fd4389-40f6-4dcd-a39b-482331222ac7" returned: 0 in 0.538s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:57:44 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-2338d2a0-c5cb-4a10-a9c9-7363c658b26f tempest-VolumesDeleteCascade-325138244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-e5fd4389-40f6-4dcd-a39b-482331222ac7 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:57:44 devstack sudo[97656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-e5fd4389-40f6-4dcd-a39b-482331222ac7 Nov 04 10:57:44 devstack sudo[97656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:57:45 devstack sudo[97656]: pam_unix(sudo:session): session closed for user root Nov 04 10:57:45 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-2338d2a0-c5cb-4a10-a9c9-7363c658b26f tempest-VolumesDeleteCascade-325138244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-e5fd4389-40f6-4dcd-a39b-482331222ac7" returned: 0 in 0.351s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:57:45 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-2338d2a0-c5cb-4a10-a9c9-7363c658b26f tempest-VolumesDeleteCascade-325138244 None] Lock "cinder-quobyte-e5fd4389-40f6-4dcd-a39b-482331222ac7" released by "delete_volume" :: held 0.957s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:57:45 devstack cinder-volume[87272]: DEBUG cinder.quota [None req-2338d2a0-c5cb-4a10-a9c9-7363c658b26f tempest-VolumesDeleteCascade-325138244 None] Created reservations ['4616d0be-6308-4774-b4b5-283ca779b36b', 'd84c47fa-8646-4efd-b984-2b98c70968e3', 'c0468c76-80a0-42d1-8c4f-4b699fcb9731', 'f4f99fd8-9657-43bb-b0d3-9fb5649898e8'] {{(pid=87272) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 10:57:45 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-2338d2a0-c5cb-4a10-a9c9-7363c658b26f tempest-VolumesDeleteCascade-325138244 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:57:45 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-2338d2a0-c5cb-4a10-a9c9-7363c658b26f tempest-VolumesDeleteCascade-325138244 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:57:45 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-2338d2a0-c5cb-4a10-a9c9-7363c658b26f tempest-VolumesDeleteCascade-325138244 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898': None} {{(pid=87272) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:57:45 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-2338d2a0-c5cb-4a10-a9c9-7363c658b26f tempest-VolumesDeleteCascade-325138244 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'] {{(pid=87272) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:57:45 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-2338d2a0-c5cb-4a10-a9c9-7363c658b26f tempest-VolumesDeleteCascade-325138244 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:57:45 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-2338d2a0-c5cb-4a10-a9c9-7363c658b26f tempest-VolumesDeleteCascade-325138244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:57:45 devstack sudo[97659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1 Nov 04 10:57:45 devstack sudo[97659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:57:45 devstack sudo[97659]: pam_unix(sudo:session): session closed for user root Nov 04 10:57:45 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-2338d2a0-c5cb-4a10-a9c9-7363c658b26f tempest-VolumesDeleteCascade-325138244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1" returned: 0 in 0.299s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:57:45 devstack cinder-volume[87272]: DEBUG cinder.manager [None req-2338d2a0-c5cb-4a10-a9c9-7363c658b26f tempest-VolumesDeleteCascade-325138244 None] Notifying Schedulers of capabilities ... {{(pid=87272) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 10:57:45 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-2338d2a0-c5cb-4a10-a9c9-7363c658b26f tempest-VolumesDeleteCascade-325138244 None] Deleted volume successfully. Nov 04 10:57:45 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-2338d2a0-c5cb-4a10-a9c9-7363c658b26f tempest-VolumesDeleteCascade-325138244 None] Lock "cinder-e5fd4389-40f6-4dcd-a39b-482331222ac7-delete_volume" released by "delete_volume" :: held 1.650s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:57:45 devstack cinder-volume[87272]: DEBUG cinder.volume.flows.manager.create_volume [None req-b13300e0-bee1-4892-b0c3-10abd9a36aed tempest-VolumesGetTest-525573675 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87272) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 10:57:45 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-b13300e0-bee1-4892-b0c3-10abd9a36aed tempest-VolumesGetTest-525573675 None] Flow 'volume_create_manager' (cacb000b-4397-48ef-aa86-71c70f7fa302) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:57:45 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-b13300e0-bee1-4892-b0c3-10abd9a36aed tempest-VolumesGetTest-525573675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ba634c8-0f5c-422f-b92d-6e3ceb286387) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:57:45 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-b13300e0-bee1-4892-b0c3-10abd9a36aed tempest-VolumesGetTest-525573675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ba634c8-0f5c-422f-b92d-6e3ceb286387) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T09:57:45Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-514513271',display_name='tempest-VolumesGetTest-Volume-1423411673',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1a6687a6-15b3-4a1c-b134-451fe770a748,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1fd08fa49c4e4d2f83d17f8aaac1b8a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T09:57:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T09:57:46Z,use_quota=True,user_id='c47ca10290f644b7a54567bf7a4cbc38',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8989e4f-21e3-4f0a-9584-0d818784e883),volume_type_id=f8989e4f-21e3-4f0a-9584-0d818784e883)' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:57:45 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-b13300e0-bee1-4892-b0c3-10abd9a36aed tempest-VolumesGetTest-525573675 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f7e617f-c479-448f-8dc2-bf2a728e8fb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:57:45 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-b13300e0-bee1-4892-b0c3-10abd9a36aed tempest-VolumesGetTest-525573675 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f7e617f-c479-448f-8dc2-bf2a728e8fb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:57:45 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-b13300e0-bee1-4892-b0c3-10abd9a36aed tempest-VolumesGetTest-525573675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a2419a7d-5a6d-4733-be78-14f3fc9328cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:57:45 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-b13300e0-bee1-4892-b0c3-10abd9a36aed tempest-VolumesGetTest-525573675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a2419a7d-5a6d-4733-be78-14f3fc9328cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1a6687a6-15b3-4a1c-b134-451fe770a748', 'volume_name': 'volume-1a6687a6-15b3-4a1c-b134-451fe770a748', 'volume_size': 1}' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:57:46 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-b13300e0-bee1-4892-b0c3-10abd9a36aed tempest-VolumesGetTest-525573675 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c7db4e3-fdc7-4065-b2f2-84de057ea78e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:57:46 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-b13300e0-bee1-4892-b0c3-10abd9a36aed tempest-VolumesGetTest-525573675 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c7db4e3-fdc7-4065-b2f2-84de057ea78e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:57:46 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-b13300e0-bee1-4892-b0c3-10abd9a36aed tempest-VolumesGetTest-525573675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cdc71c33-c674-4a13-8e06-18e221ac0f3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:57:46 devstack cinder-volume[87272]: INFO cinder.volume.flows.manager.create_volume [None req-b13300e0-bee1-4892-b0c3-10abd9a36aed tempest-VolumesGetTest-525573675 None] Volume 1a6687a6-15b3-4a1c-b134-451fe770a748: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1a6687a6-15b3-4a1c-b134-451fe770a748', 'volume_size': 1} Nov 04 10:57:46 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-b13300e0-bee1-4892-b0c3-10abd9a36aed tempest-VolumesGetTest-525573675 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:57:46 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-b13300e0-bee1-4892-b0c3-10abd9a36aed tempest-VolumesGetTest-525573675 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:57:46 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-b13300e0-bee1-4892-b0c3-10abd9a36aed tempest-VolumesGetTest-525573675 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T09:57:45Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-514513271',display_name='tempest-VolumesGetTest-Volume-1423411673',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1a6687a6-15b3-4a1c-b134-451fe770a748,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1fd08fa49c4e4d2f83d17f8aaac1b8a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T09:57:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T09:57:46Z,use_quota=True,user_id='c47ca10290f644b7a54567bf7a4cbc38',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8989e4f-21e3-4f0a-9584-0d818784e883),volume_type_id=f8989e4f-21e3-4f0a-9584-0d818784e883)}" {{(pid=87272) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 04 10:57:46 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.remotefs [None req-b13300e0-bee1-4892-b0c3-10abd9a36aed tempest-VolumesGetTest-525573675 None] Creating volume 1a6687a6-15b3-4a1c-b134-451fe770a748 {{(pid=87272) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 10:57:46 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-b13300e0-bee1-4892-b0c3-10abd9a36aed tempest-VolumesGetTest-525573675 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:57:46 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-b13300e0-bee1-4892-b0c3-10abd9a36aed tempest-VolumesGetTest-525573675 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:57:46 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-b13300e0-bee1-4892-b0c3-10abd9a36aed tempest-VolumesGetTest-525573675 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898': None} {{(pid=87272) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:57:46 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-b13300e0-bee1-4892-b0c3-10abd9a36aed tempest-VolumesGetTest-525573675 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'] {{(pid=87272) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:57:46 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-b13300e0-bee1-4892-b0c3-10abd9a36aed tempest-VolumesGetTest-525573675 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:57:46 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-b13300e0-bee1-4892-b0c3-10abd9a36aed tempest-VolumesGetTest-525573675 None] Selected osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898 as target Quobyte volume. {{(pid=87272) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 10:57:46 devstack cinder-volume[87272]: INFO cinder.volume.drivers.remotefs [None req-b13300e0-bee1-4892-b0c3-10abd9a36aed tempest-VolumesGetTest-525573675 None] casted to osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898 Nov 04 10:57:46 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-b13300e0-bee1-4892-b0c3-10abd9a36aed tempest-VolumesGetTest-525573675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-1a6687a6-15b3-4a1c-b134-451fe770a748 1073741824 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:57:46 devstack sudo[97662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-1a6687a6-15b3-4a1c-b134-451fe770a748 1073741824 Nov 04 10:57:46 devstack sudo[97662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:57:46 devstack sudo[97662]: pam_unix(sudo:session): session closed for user root Nov 04 10:57:46 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-b13300e0-bee1-4892-b0c3-10abd9a36aed tempest-VolumesGetTest-525573675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-1a6687a6-15b3-4a1c-b134-451fe770a748 1073741824" returned: 0 in 0.729s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:57:46 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-b13300e0-bee1-4892-b0c3-10abd9a36aed tempest-VolumesGetTest-525573675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-1a6687a6-15b3-4a1c-b134-451fe770a748 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:57:46 devstack sudo[97670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-1a6687a6-15b3-4a1c-b134-451fe770a748 Nov 04 10:57:46 devstack sudo[97670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:57:47 devstack sudo[97670]: pam_unix(sudo:session): session closed for user root Nov 04 10:57:47 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-b13300e0-bee1-4892-b0c3-10abd9a36aed tempest-VolumesGetTest-525573675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-1a6687a6-15b3-4a1c-b134-451fe770a748" returned: 0 in 0.429s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:57:47 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-b13300e0-bee1-4892-b0c3-10abd9a36aed tempest-VolumesGetTest-525573675 None] <== create_volume: return (1277ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'} {{(pid=87272) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 04 10:57:47 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-b13300e0-bee1-4892-b0c3-10abd9a36aed tempest-VolumesGetTest-525573675 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.279s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:57:47 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-b13300e0-bee1-4892-b0c3-10abd9a36aed tempest-VolumesGetTest-525573675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cdc71c33-c674-4a13-8e06-18e221ac0f3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1a6687a6-15b3-4a1c-b134-451fe770a748', 'volume_size': 1}' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:57:47 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-b13300e0-bee1-4892-b0c3-10abd9a36aed tempest-VolumesGetTest-525573675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d35a5a3e-0b59-4e21-89b7-09e8230dcdcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:57:47 devstack cinder-volume[87272]: INFO cinder.volume.flows.manager.create_volume [None req-b13300e0-bee1-4892-b0c3-10abd9a36aed tempest-VolumesGetTest-525573675 None] Volume volume-1a6687a6-15b3-4a1c-b134-451fe770a748 (1a6687a6-15b3-4a1c-b134-451fe770a748): created successfully Nov 04 10:57:47 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-b13300e0-bee1-4892-b0c3-10abd9a36aed tempest-VolumesGetTest-525573675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d35a5a3e-0b59-4e21-89b7-09e8230dcdcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:57:47 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-b13300e0-bee1-4892-b0c3-10abd9a36aed tempest-VolumesGetTest-525573675 None] Flow 'volume_create_manager' (cacb000b-4397-48ef-aa86-71c70f7fa302) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87272) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:57:47 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-b13300e0-bee1-4892-b0c3-10abd9a36aed tempest-VolumesGetTest-525573675 None] Created volume successfully. Nov 04 10:57:48 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-6e90b87f-b4f1-44be-9b15-b330d1516413 tempest-VolumesGetTest-525573675 None] Acquiring lock "cinder-1a6687a6-15b3-4a1c-b134-451fe770a748-delete_volume" by "delete_volume" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:57:48 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-6e90b87f-b4f1-44be-9b15-b330d1516413 tempest-VolumesGetTest-525573675 None] Lock "cinder-1a6687a6-15b3-4a1c-b134-451fe770a748-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:57:48 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-6e90b87f-b4f1-44be-9b15-b330d1516413 tempest-VolumesGetTest-525573675 None] Acquiring lock "cinder-quobyte-1a6687a6-15b3-4a1c-b134-451fe770a748" by "delete_volume" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:57:48 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-6e90b87f-b4f1-44be-9b15-b330d1516413 tempest-VolumesGetTest-525573675 None] Lock "cinder-quobyte-1a6687a6-15b3-4a1c-b134-451fe770a748" acquired by "delete_volume" :: waited 0.036s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:57:48 devstack cinder-volume[87272]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ff735fa-0db2-44f7-bfc5-f7b47d03f897]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:57:48 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-6e90b87f-b4f1-44be-9b15-b330d1516413 tempest-VolumesGetTest-525573675 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-1a6687a6-15b3-4a1c-b134-451fe770a748 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:57:48 devstack sudo[97675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-1a6687a6-15b3-4a1c-b134-451fe770a748 Nov 04 10:57:48 devstack sudo[97675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:57:48 devstack sudo[97675]: pam_unix(sudo:session): session closed for user root Nov 04 10:57:48 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-6e90b87f-b4f1-44be-9b15-b330d1516413 tempest-VolumesGetTest-525573675 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-1a6687a6-15b3-4a1c-b134-451fe770a748" returned: 0 in 0.415s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:57:48 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-6e90b87f-b4f1-44be-9b15-b330d1516413 tempest-VolumesGetTest-525573675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-1a6687a6-15b3-4a1c-b134-451fe770a748 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:57:48 devstack sudo[97680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-1a6687a6-15b3-4a1c-b134-451fe770a748 Nov 04 10:57:48 devstack sudo[97680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:57:49 devstack sudo[97680]: pam_unix(sudo:session): session closed for user root Nov 04 10:57:49 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-6e90b87f-b4f1-44be-9b15-b330d1516413 tempest-VolumesGetTest-525573675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-1a6687a6-15b3-4a1c-b134-451fe770a748" returned: 0 in 0.271s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:57:49 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-6e90b87f-b4f1-44be-9b15-b330d1516413 tempest-VolumesGetTest-525573675 None] Lock "cinder-quobyte-1a6687a6-15b3-4a1c-b134-451fe770a748" released by "delete_volume" :: held 0.747s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:57:49 devstack cinder-volume[87272]: DEBUG cinder.quota [None req-6e90b87f-b4f1-44be-9b15-b330d1516413 tempest-VolumesGetTest-525573675 None] Created reservations ['8fcd264f-7220-4706-86e3-133ed31d7eeb', '0cacc8ce-d8eb-42dd-884e-ceb686321b8e', '714efede-c5e1-4bd4-a262-ca43ffbae1b8', 'b357a10a-30d1-4ba8-9131-9b6b0ef6dc15'] {{(pid=87272) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 10:57:49 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-6e90b87f-b4f1-44be-9b15-b330d1516413 tempest-VolumesGetTest-525573675 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:57:49 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-6e90b87f-b4f1-44be-9b15-b330d1516413 tempest-VolumesGetTest-525573675 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:57:49 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-6e90b87f-b4f1-44be-9b15-b330d1516413 tempest-VolumesGetTest-525573675 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898': None} {{(pid=87272) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:57:49 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-6e90b87f-b4f1-44be-9b15-b330d1516413 tempest-VolumesGetTest-525573675 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'] {{(pid=87272) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:57:49 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-6e90b87f-b4f1-44be-9b15-b330d1516413 tempest-VolumesGetTest-525573675 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:57:49 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-6e90b87f-b4f1-44be-9b15-b330d1516413 tempest-VolumesGetTest-525573675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:57:49 devstack sudo[97683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1 Nov 04 10:57:49 devstack sudo[97683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:57:49 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-7d672f3e-f12f-46b6-8d41-ecc8b157dc5d tempest-VolumesGetTest-525573675 None] Acquiring lock "cinder-ae81e230-5a51-40ed-97f2-75ef03aa2183-delete_volume" by "delete_volume" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:57:49 devstack sudo[97683]: pam_unix(sudo:session): session closed for user root Nov 04 10:57:49 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-7d672f3e-f12f-46b6-8d41-ecc8b157dc5d tempest-VolumesGetTest-525573675 None] Lock "cinder-ae81e230-5a51-40ed-97f2-75ef03aa2183-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:57:49 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-6e90b87f-b4f1-44be-9b15-b330d1516413 tempest-VolumesGetTest-525573675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1" returned: 0 in 0.528s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:57:49 devstack cinder-volume[87272]: DEBUG cinder.manager [None req-6e90b87f-b4f1-44be-9b15-b330d1516413 tempest-VolumesGetTest-525573675 None] Notifying Schedulers of capabilities ... {{(pid=87272) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 10:57:49 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-6e90b87f-b4f1-44be-9b15-b330d1516413 tempest-VolumesGetTest-525573675 None] Deleted volume successfully. Nov 04 10:57:49 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-6e90b87f-b4f1-44be-9b15-b330d1516413 tempest-VolumesGetTest-525573675 None] Lock "cinder-1a6687a6-15b3-4a1c-b134-451fe770a748-delete_volume" released by "delete_volume" :: held 1.604s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:57:49 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-7d672f3e-f12f-46b6-8d41-ecc8b157dc5d tempest-VolumesGetTest-525573675 None] Acquiring lock "cinder-quobyte-ae81e230-5a51-40ed-97f2-75ef03aa2183" by "delete_volume" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:57:50 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-7d672f3e-f12f-46b6-8d41-ecc8b157dc5d tempest-VolumesGetTest-525573675 None] Lock "cinder-quobyte-ae81e230-5a51-40ed-97f2-75ef03aa2183" acquired by "delete_volume" :: waited 0.030s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:57:50 devstack cinder-volume[87272]: DEBUG oslo.privsep.daemon [-] privsep: reply[15173467-ca82-40e0-b852-7c4b1b4864da]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:57:50 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-7d672f3e-f12f-46b6-8d41-ecc8b157dc5d tempest-VolumesGetTest-525573675 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-ae81e230-5a51-40ed-97f2-75ef03aa2183 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:57:50 devstack sudo[97689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-ae81e230-5a51-40ed-97f2-75ef03aa2183 Nov 04 10:57:50 devstack sudo[97689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:57:50 devstack sudo[97689]: pam_unix(sudo:session): session closed for user root Nov 04 10:57:50 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-7d672f3e-f12f-46b6-8d41-ecc8b157dc5d tempest-VolumesGetTest-525573675 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-ae81e230-5a51-40ed-97f2-75ef03aa2183" returned: 0 in 0.558s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:57:50 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-7d672f3e-f12f-46b6-8d41-ecc8b157dc5d tempest-VolumesGetTest-525573675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-ae81e230-5a51-40ed-97f2-75ef03aa2183 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:57:50 devstack sudo[97694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-ae81e230-5a51-40ed-97f2-75ef03aa2183 Nov 04 10:57:50 devstack sudo[97694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:57:51 devstack sudo[97694]: pam_unix(sudo:session): session closed for user root Nov 04 10:57:51 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-7d672f3e-f12f-46b6-8d41-ecc8b157dc5d tempest-VolumesGetTest-525573675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-ae81e230-5a51-40ed-97f2-75ef03aa2183" returned: 0 in 0.446s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:57:51 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-7d672f3e-f12f-46b6-8d41-ecc8b157dc5d tempest-VolumesGetTest-525573675 None] Lock "cinder-quobyte-ae81e230-5a51-40ed-97f2-75ef03aa2183" released by "delete_volume" :: held 1.073s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:57:51 devstack cinder-volume[87272]: DEBUG cinder.quota [None req-7d672f3e-f12f-46b6-8d41-ecc8b157dc5d tempest-VolumesGetTest-525573675 None] Created reservations ['bd6d9397-a258-435d-aa28-f969c62cbe1c', 'ed8eb1ec-05c1-45de-b817-6064c0f01047', '0bd66629-6175-4547-95e6-6057736ff293', 'c88d9601-aa1b-4289-acfd-2bf7977a03fc'] {{(pid=87272) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 10:57:51 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-7d672f3e-f12f-46b6-8d41-ecc8b157dc5d tempest-VolumesGetTest-525573675 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:57:51 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-7d672f3e-f12f-46b6-8d41-ecc8b157dc5d tempest-VolumesGetTest-525573675 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:57:51 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-7d672f3e-f12f-46b6-8d41-ecc8b157dc5d tempest-VolumesGetTest-525573675 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898': None} {{(pid=87272) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:57:51 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-7d672f3e-f12f-46b6-8d41-ecc8b157dc5d tempest-VolumesGetTest-525573675 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'] {{(pid=87272) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:57:51 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-7d672f3e-f12f-46b6-8d41-ecc8b157dc5d tempest-VolumesGetTest-525573675 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:57:51 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-7d672f3e-f12f-46b6-8d41-ecc8b157dc5d tempest-VolumesGetTest-525573675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:57:51 devstack sudo[97698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1 Nov 04 10:57:51 devstack sudo[97698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:57:51 devstack sudo[97698]: pam_unix(sudo:session): session closed for user root Nov 04 10:57:51 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-7d672f3e-f12f-46b6-8d41-ecc8b157dc5d tempest-VolumesGetTest-525573675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1" returned: 0 in 0.302s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:57:51 devstack cinder-volume[87272]: DEBUG cinder.manager [None req-7d672f3e-f12f-46b6-8d41-ecc8b157dc5d tempest-VolumesGetTest-525573675 None] Notifying Schedulers of capabilities ... {{(pid=87272) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 10:57:51 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-7d672f3e-f12f-46b6-8d41-ecc8b157dc5d tempest-VolumesGetTest-525573675 None] Deleted volume successfully. Nov 04 10:57:51 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-7d672f3e-f12f-46b6-8d41-ecc8b157dc5d tempest-VolumesGetTest-525573675 None] Lock "cinder-ae81e230-5a51-40ed-97f2-75ef03aa2183-delete_volume" released by "delete_volume" :: held 1.848s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:57:53 devstack cinder-volume[87272]: DEBUG cinder.volume.flows.manager.create_volume [None req-c8296aff-4024-430e-9684-7c98b8f75551 tempest-VolumesMetadataTest-1691151577 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87272) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 10:57:53 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-c8296aff-4024-430e-9684-7c98b8f75551 tempest-VolumesMetadataTest-1691151577 None] Flow 'volume_create_manager' (a7517de5-f4e5-4cdf-b845-2c5ecc4e49ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:57:53 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-c8296aff-4024-430e-9684-7c98b8f75551 tempest-VolumesMetadataTest-1691151577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b72828d3-2f33-4a6e-986d-2df9ff83a30f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:57:53 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-c8296aff-4024-430e-9684-7c98b8f75551 tempest-VolumesMetadataTest-1691151577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b72828d3-2f33-4a6e-986d-2df9ff83a30f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T09:57:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-152062274',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9fda3548-b621-4f04-b2e8-d4e1323f6466,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6206f4fc2d864eefa76f828327efb344',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T09:57:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T09:57:53Z,use_quota=True,user_id='e6162eb2cd0543208a31db2b5abaa0f3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8989e4f-21e3-4f0a-9584-0d818784e883),volume_type_id=f8989e4f-21e3-4f0a-9584-0d818784e883)' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:57:53 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-c8296aff-4024-430e-9684-7c98b8f75551 tempest-VolumesMetadataTest-1691151577 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f0cd1e1a-e268-488e-ab8a-b79587a3c2a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:57:53 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-c8296aff-4024-430e-9684-7c98b8f75551 tempest-VolumesMetadataTest-1691151577 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f0cd1e1a-e268-488e-ab8a-b79587a3c2a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:57:53 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-c8296aff-4024-430e-9684-7c98b8f75551 tempest-VolumesMetadataTest-1691151577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4fe2c3e5-0932-43d0-b985-c7ccce3ca479) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:57:53 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-c8296aff-4024-430e-9684-7c98b8f75551 tempest-VolumesMetadataTest-1691151577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4fe2c3e5-0932-43d0-b985-c7ccce3ca479) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9fda3548-b621-4f04-b2e8-d4e1323f6466', 'volume_name': 'volume-9fda3548-b621-4f04-b2e8-d4e1323f6466', 'volume_size': 1}' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:57:53 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-c8296aff-4024-430e-9684-7c98b8f75551 tempest-VolumesMetadataTest-1691151577 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3113b7ef-7c54-4c18-aeae-32d10ad2380d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:57:53 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-c8296aff-4024-430e-9684-7c98b8f75551 tempest-VolumesMetadataTest-1691151577 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3113b7ef-7c54-4c18-aeae-32d10ad2380d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:57:53 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-c8296aff-4024-430e-9684-7c98b8f75551 tempest-VolumesMetadataTest-1691151577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4807f650-2d8b-4689-8d77-098fa3500da5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:57:53 devstack cinder-volume[87272]: INFO cinder.volume.flows.manager.create_volume [None req-c8296aff-4024-430e-9684-7c98b8f75551 tempest-VolumesMetadataTest-1691151577 None] Volume 9fda3548-b621-4f04-b2e8-d4e1323f6466: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9fda3548-b621-4f04-b2e8-d4e1323f6466', 'volume_size': 1} Nov 04 10:57:53 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-c8296aff-4024-430e-9684-7c98b8f75551 tempest-VolumesMetadataTest-1691151577 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:57:53 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-c8296aff-4024-430e-9684-7c98b8f75551 tempest-VolumesMetadataTest-1691151577 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:57:53 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-c8296aff-4024-430e-9684-7c98b8f75551 tempest-VolumesMetadataTest-1691151577 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T09:57:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-152062274',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9fda3548-b621-4f04-b2e8-d4e1323f6466,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6206f4fc2d864eefa76f828327efb344',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T09:57:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T09:57:53Z,use_quota=True,user_id='e6162eb2cd0543208a31db2b5abaa0f3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8989e4f-21e3-4f0a-9584-0d818784e883),volume_type_id=f8989e4f-21e3-4f0a-9584-0d818784e883)}" {{(pid=87272) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 04 10:57:53 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.remotefs [None req-c8296aff-4024-430e-9684-7c98b8f75551 tempest-VolumesMetadataTest-1691151577 None] Creating volume 9fda3548-b621-4f04-b2e8-d4e1323f6466 {{(pid=87272) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 10:57:53 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-c8296aff-4024-430e-9684-7c98b8f75551 tempest-VolumesMetadataTest-1691151577 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:57:53 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-c8296aff-4024-430e-9684-7c98b8f75551 tempest-VolumesMetadataTest-1691151577 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:57:53 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-c8296aff-4024-430e-9684-7c98b8f75551 tempest-VolumesMetadataTest-1691151577 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898': None} {{(pid=87272) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:57:53 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-c8296aff-4024-430e-9684-7c98b8f75551 tempest-VolumesMetadataTest-1691151577 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'] {{(pid=87272) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:57:53 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-c8296aff-4024-430e-9684-7c98b8f75551 tempest-VolumesMetadataTest-1691151577 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:57:53 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-c8296aff-4024-430e-9684-7c98b8f75551 tempest-VolumesMetadataTest-1691151577 None] Selected osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898 as target Quobyte volume. {{(pid=87272) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 10:57:53 devstack cinder-volume[87272]: INFO cinder.volume.drivers.remotefs [None req-c8296aff-4024-430e-9684-7c98b8f75551 tempest-VolumesMetadataTest-1691151577 None] casted to osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898 Nov 04 10:57:53 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-c8296aff-4024-430e-9684-7c98b8f75551 tempest-VolumesMetadataTest-1691151577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-9fda3548-b621-4f04-b2e8-d4e1323f6466 1073741824 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:57:53 devstack sudo[97719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-9fda3548-b621-4f04-b2e8-d4e1323f6466 1073741824 Nov 04 10:57:53 devstack sudo[97719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:57:53 devstack sudo[97719]: pam_unix(sudo:session): session closed for user root Nov 04 10:57:53 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-c8296aff-4024-430e-9684-7c98b8f75551 tempest-VolumesMetadataTest-1691151577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-9fda3548-b621-4f04-b2e8-d4e1323f6466 1073741824" returned: 0 in 0.782s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:57:54 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-c8296aff-4024-430e-9684-7c98b8f75551 tempest-VolumesMetadataTest-1691151577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-9fda3548-b621-4f04-b2e8-d4e1323f6466 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:57:54 devstack sudo[97725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-9fda3548-b621-4f04-b2e8-d4e1323f6466 Nov 04 10:57:54 devstack sudo[97725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:57:54 devstack sudo[97725]: pam_unix(sudo:session): session closed for user root Nov 04 10:57:54 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-c8296aff-4024-430e-9684-7c98b8f75551 tempest-VolumesMetadataTest-1691151577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-9fda3548-b621-4f04-b2e8-d4e1323f6466" returned: 0 in 0.359s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:57:54 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-c8296aff-4024-430e-9684-7c98b8f75551 tempest-VolumesMetadataTest-1691151577 None] <== create_volume: return (1275ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'} {{(pid=87272) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 04 10:57:54 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-c8296aff-4024-430e-9684-7c98b8f75551 tempest-VolumesMetadataTest-1691151577 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.281s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:57:54 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-c8296aff-4024-430e-9684-7c98b8f75551 tempest-VolumesMetadataTest-1691151577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4807f650-2d8b-4689-8d77-098fa3500da5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9fda3548-b621-4f04-b2e8-d4e1323f6466', 'volume_size': 1}' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:57:54 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-c8296aff-4024-430e-9684-7c98b8f75551 tempest-VolumesMetadataTest-1691151577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba7bca31-c3fe-4de6-bbef-365e652a8056) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:57:54 devstack cinder-volume[87272]: INFO cinder.volume.flows.manager.create_volume [None req-c8296aff-4024-430e-9684-7c98b8f75551 tempest-VolumesMetadataTest-1691151577 None] Volume volume-9fda3548-b621-4f04-b2e8-d4e1323f6466 (9fda3548-b621-4f04-b2e8-d4e1323f6466): created successfully Nov 04 10:57:54 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-c8296aff-4024-430e-9684-7c98b8f75551 tempest-VolumesMetadataTest-1691151577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba7bca31-c3fe-4de6-bbef-365e652a8056) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:57:54 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-c8296aff-4024-430e-9684-7c98b8f75551 tempest-VolumesMetadataTest-1691151577 None] Flow 'volume_create_manager' (a7517de5-f4e5-4cdf-b845-2c5ecc4e49ef) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87272) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:57:54 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-c8296aff-4024-430e-9684-7c98b8f75551 tempest-VolumesMetadataTest-1691151577 None] Created volume successfully. Nov 04 10:57:56 devstack cinder-volume[87272]: DEBUG cinder.volume.flows.manager.create_volume [req-879d9f89-a51d-4421-a7b7-67a109efde6d req-d7ab974e-db7a-42b4-b2e0-564ae1a82233 tempest-VolumesSnapshotsTestJSON-935757216 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87272) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 10:57:56 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [req-879d9f89-a51d-4421-a7b7-67a109efde6d req-d7ab974e-db7a-42b4-b2e0-564ae1a82233 tempest-VolumesSnapshotsTestJSON-935757216 None] Flow 'volume_create_manager' (42a59319-5e14-4c0a-a443-a04468a887ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:57:56 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [req-879d9f89-a51d-4421-a7b7-67a109efde6d req-d7ab974e-db7a-42b4-b2e0-564ae1a82233 tempest-VolumesSnapshotsTestJSON-935757216 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c20d62d1-dd98-4c60-a211-647447824e9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:57:57 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [req-879d9f89-a51d-4421-a7b7-67a109efde6d req-d7ab974e-db7a-42b4-b2e0-564ae1a82233 tempest-VolumesSnapshotsTestJSON-935757216 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c20d62d1-dd98-4c60-a211-647447824e9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T09:57:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1952169560',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b29532ee-0002-4ed5-8e3b-d3c404fa6321,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a50e5d73057d461ebe7fc54f07da2530',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T09:57:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T09:57:57Z,use_quota=True,user_id='0914c88a156e4f86a6f0740cbe0b5d79',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8989e4f-21e3-4f0a-9584-0d818784e883),volume_type_id=f8989e4f-21e3-4f0a-9584-0d818784e883)' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:57:57 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [req-879d9f89-a51d-4421-a7b7-67a109efde6d req-d7ab974e-db7a-42b4-b2e0-564ae1a82233 tempest-VolumesSnapshotsTestJSON-935757216 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fed91fc1-64fd-45fe-894d-c670c8b9eeb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:57:57 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [req-879d9f89-a51d-4421-a7b7-67a109efde6d req-d7ab974e-db7a-42b4-b2e0-564ae1a82233 tempest-VolumesSnapshotsTestJSON-935757216 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fed91fc1-64fd-45fe-894d-c670c8b9eeb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:57:57 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [req-879d9f89-a51d-4421-a7b7-67a109efde6d req-d7ab974e-db7a-42b4-b2e0-564ae1a82233 tempest-VolumesSnapshotsTestJSON-935757216 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (24ddf96b-4953-4943-8f61-712d11ff6536) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:57:57 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [req-879d9f89-a51d-4421-a7b7-67a109efde6d req-d7ab974e-db7a-42b4-b2e0-564ae1a82233 tempest-VolumesSnapshotsTestJSON-935757216 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (24ddf96b-4953-4943-8f61-712d11ff6536) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b29532ee-0002-4ed5-8e3b-d3c404fa6321', 'volume_name': 'volume-b29532ee-0002-4ed5-8e3b-d3c404fa6321', 'volume_size': 1}' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:57:57 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [req-879d9f89-a51d-4421-a7b7-67a109efde6d req-d7ab974e-db7a-42b4-b2e0-564ae1a82233 tempest-VolumesSnapshotsTestJSON-935757216 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2590b322-2ff8-4d80-bd52-b151466f86fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:57:57 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [req-879d9f89-a51d-4421-a7b7-67a109efde6d req-d7ab974e-db7a-42b4-b2e0-564ae1a82233 tempest-VolumesSnapshotsTestJSON-935757216 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2590b322-2ff8-4d80-bd52-b151466f86fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:57:57 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [req-879d9f89-a51d-4421-a7b7-67a109efde6d req-d7ab974e-db7a-42b4-b2e0-564ae1a82233 tempest-VolumesSnapshotsTestJSON-935757216 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d1f1b16-f662-441b-9fb2-cce7238589a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:57:57 devstack cinder-volume[87272]: INFO cinder.volume.flows.manager.create_volume [req-879d9f89-a51d-4421-a7b7-67a109efde6d req-d7ab974e-db7a-42b4-b2e0-564ae1a82233 tempest-VolumesSnapshotsTestJSON-935757216 None] Volume b29532ee-0002-4ed5-8e3b-d3c404fa6321: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b29532ee-0002-4ed5-8e3b-d3c404fa6321', 'volume_size': 1} Nov 04 10:57:57 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [req-879d9f89-a51d-4421-a7b7-67a109efde6d req-d7ab974e-db7a-42b4-b2e0-564ae1a82233 tempest-VolumesSnapshotsTestJSON-935757216 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:57:57 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [req-879d9f89-a51d-4421-a7b7-67a109efde6d req-d7ab974e-db7a-42b4-b2e0-564ae1a82233 tempest-VolumesSnapshotsTestJSON-935757216 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:57:57 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [req-879d9f89-a51d-4421-a7b7-67a109efde6d req-d7ab974e-db7a-42b4-b2e0-564ae1a82233 tempest-VolumesSnapshotsTestJSON-935757216 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T09:57:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1952169560',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b29532ee-0002-4ed5-8e3b-d3c404fa6321,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a50e5d73057d461ebe7fc54f07da2530',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T09:57:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T09:57:57Z,use_quota=True,user_id='0914c88a156e4f86a6f0740cbe0b5d79',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8989e4f-21e3-4f0a-9584-0d818784e883),volume_type_id=f8989e4f-21e3-4f0a-9584-0d818784e883)}" {{(pid=87272) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 04 10:57:57 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.remotefs [req-879d9f89-a51d-4421-a7b7-67a109efde6d req-d7ab974e-db7a-42b4-b2e0-564ae1a82233 tempest-VolumesSnapshotsTestJSON-935757216 None] Creating volume b29532ee-0002-4ed5-8e3b-d3c404fa6321 {{(pid=87272) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 10:57:57 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [req-879d9f89-a51d-4421-a7b7-67a109efde6d req-d7ab974e-db7a-42b4-b2e0-564ae1a82233 tempest-VolumesSnapshotsTestJSON-935757216 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:57:57 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [req-879d9f89-a51d-4421-a7b7-67a109efde6d req-d7ab974e-db7a-42b4-b2e0-564ae1a82233 tempest-VolumesSnapshotsTestJSON-935757216 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:57:57 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [req-879d9f89-a51d-4421-a7b7-67a109efde6d req-d7ab974e-db7a-42b4-b2e0-564ae1a82233 tempest-VolumesSnapshotsTestJSON-935757216 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898': None} {{(pid=87272) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:57:57 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [req-879d9f89-a51d-4421-a7b7-67a109efde6d req-d7ab974e-db7a-42b4-b2e0-564ae1a82233 tempest-VolumesSnapshotsTestJSON-935757216 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'] {{(pid=87272) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:57:57 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [req-879d9f89-a51d-4421-a7b7-67a109efde6d req-d7ab974e-db7a-42b4-b2e0-564ae1a82233 tempest-VolumesSnapshotsTestJSON-935757216 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:57:57 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [req-879d9f89-a51d-4421-a7b7-67a109efde6d req-d7ab974e-db7a-42b4-b2e0-564ae1a82233 tempest-VolumesSnapshotsTestJSON-935757216 None] Selected osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898 as target Quobyte volume. {{(pid=87272) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 10:57:57 devstack cinder-volume[87272]: INFO cinder.volume.drivers.remotefs [req-879d9f89-a51d-4421-a7b7-67a109efde6d req-d7ab974e-db7a-42b4-b2e0-564ae1a82233 tempest-VolumesSnapshotsTestJSON-935757216 None] casted to osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898 Nov 04 10:57:57 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [req-879d9f89-a51d-4421-a7b7-67a109efde6d req-d7ab974e-db7a-42b4-b2e0-564ae1a82233 tempest-VolumesSnapshotsTestJSON-935757216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-b29532ee-0002-4ed5-8e3b-d3c404fa6321 1073741824 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:57:57 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-9b169e5f-ccac-4144-94c5-7cf5fd7d6e6e tempest-VolumesMetadataTest-1691151577 None] Acquiring lock "cinder-9fda3548-b621-4f04-b2e8-d4e1323f6466-delete_volume" by "delete_volume" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:57:57 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-9b169e5f-ccac-4144-94c5-7cf5fd7d6e6e tempest-VolumesMetadataTest-1691151577 None] Lock "cinder-9fda3548-b621-4f04-b2e8-d4e1323f6466-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:57:57 devstack sudo[97781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-b29532ee-0002-4ed5-8e3b-d3c404fa6321 1073741824 Nov 04 10:57:57 devstack sudo[97781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:57:57 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-9b169e5f-ccac-4144-94c5-7cf5fd7d6e6e tempest-VolumesMetadataTest-1691151577 None] Acquiring lock "cinder-quobyte-9fda3548-b621-4f04-b2e8-d4e1323f6466" by "delete_volume" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:57:57 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-9b169e5f-ccac-4144-94c5-7cf5fd7d6e6e tempest-VolumesMetadataTest-1691151577 None] Lock "cinder-quobyte-9fda3548-b621-4f04-b2e8-d4e1323f6466" acquired by "delete_volume" :: waited 0.043s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:57:57 devstack cinder-volume[87272]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4a7a0f0-a76d-46dc-807c-eb7e4365f2a6]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:57:57 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-9b169e5f-ccac-4144-94c5-7cf5fd7d6e6e tempest-VolumesMetadataTest-1691151577 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-9fda3548-b621-4f04-b2e8-d4e1323f6466 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:57:57 devstack sudo[97788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-9fda3548-b621-4f04-b2e8-d4e1323f6466 Nov 04 10:57:57 devstack sudo[97788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:57:58 devstack sudo[97788]: pam_unix(sudo:session): session closed for user root Nov 04 10:57:58 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-9b169e5f-ccac-4144-94c5-7cf5fd7d6e6e tempest-VolumesMetadataTest-1691151577 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-9fda3548-b621-4f04-b2e8-d4e1323f6466" returned: 0 in 0.793s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:57:58 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-9b169e5f-ccac-4144-94c5-7cf5fd7d6e6e tempest-VolumesMetadataTest-1691151577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-9fda3548-b621-4f04-b2e8-d4e1323f6466 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:57:58 devstack sudo[97781]: pam_unix(sudo:session): session closed for user root Nov 04 10:57:58 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [req-879d9f89-a51d-4421-a7b7-67a109efde6d req-d7ab974e-db7a-42b4-b2e0-564ae1a82233 tempest-VolumesSnapshotsTestJSON-935757216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-b29532ee-0002-4ed5-8e3b-d3c404fa6321 1073741824" returned: 0 in 1.125s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:57:58 devstack sudo[97806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-9fda3548-b621-4f04-b2e8-d4e1323f6466 Nov 04 10:57:58 devstack sudo[97806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:57:58 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [req-879d9f89-a51d-4421-a7b7-67a109efde6d req-d7ab974e-db7a-42b4-b2e0-564ae1a82233 tempest-VolumesSnapshotsTestJSON-935757216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-b29532ee-0002-4ed5-8e3b-d3c404fa6321 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:57:58 devstack sudo[97808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-b29532ee-0002-4ed5-8e3b-d3c404fa6321 Nov 04 10:57:58 devstack sudo[97808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:57:58 devstack sudo[97808]: pam_unix(sudo:session): session closed for user root Nov 04 10:57:58 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [req-879d9f89-a51d-4421-a7b7-67a109efde6d req-d7ab974e-db7a-42b4-b2e0-564ae1a82233 tempest-VolumesSnapshotsTestJSON-935757216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-b29532ee-0002-4ed5-8e3b-d3c404fa6321" returned: 0 in 0.482s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:57:58 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [req-879d9f89-a51d-4421-a7b7-67a109efde6d req-d7ab974e-db7a-42b4-b2e0-564ae1a82233 tempest-VolumesSnapshotsTestJSON-935757216 None] <== create_volume: return (1704ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'} {{(pid=87272) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 04 10:57:58 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [req-879d9f89-a51d-4421-a7b7-67a109efde6d req-d7ab974e-db7a-42b4-b2e0-564ae1a82233 tempest-VolumesSnapshotsTestJSON-935757216 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.708s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:57:58 devstack sudo[97806]: pam_unix(sudo:session): session closed for user root Nov 04 10:57:58 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [req-879d9f89-a51d-4421-a7b7-67a109efde6d req-d7ab974e-db7a-42b4-b2e0-564ae1a82233 tempest-VolumesSnapshotsTestJSON-935757216 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d1f1b16-f662-441b-9fb2-cce7238589a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b29532ee-0002-4ed5-8e3b-d3c404fa6321', 'volume_size': 1}' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:57:58 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [req-879d9f89-a51d-4421-a7b7-67a109efde6d req-d7ab974e-db7a-42b4-b2e0-564ae1a82233 tempest-VolumesSnapshotsTestJSON-935757216 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b64e49c-79fd-48df-be7b-1c4fae1f8401) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:57:58 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-9b169e5f-ccac-4144-94c5-7cf5fd7d6e6e tempest-VolumesMetadataTest-1691151577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-9fda3548-b621-4f04-b2e8-d4e1323f6466" returned: 0 in 0.645s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:57:58 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-9b169e5f-ccac-4144-94c5-7cf5fd7d6e6e tempest-VolumesMetadataTest-1691151577 None] Lock "cinder-quobyte-9fda3548-b621-4f04-b2e8-d4e1323f6466" released by "delete_volume" :: held 1.525s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:57:58 devstack cinder-volume[87272]: INFO cinder.volume.flows.manager.create_volume [req-879d9f89-a51d-4421-a7b7-67a109efde6d req-d7ab974e-db7a-42b4-b2e0-564ae1a82233 tempest-VolumesSnapshotsTestJSON-935757216 None] Volume volume-b29532ee-0002-4ed5-8e3b-d3c404fa6321 (b29532ee-0002-4ed5-8e3b-d3c404fa6321): created successfully Nov 04 10:57:58 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [req-879d9f89-a51d-4421-a7b7-67a109efde6d req-d7ab974e-db7a-42b4-b2e0-564ae1a82233 tempest-VolumesSnapshotsTestJSON-935757216 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b64e49c-79fd-48df-be7b-1c4fae1f8401) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:57:58 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [req-879d9f89-a51d-4421-a7b7-67a109efde6d req-d7ab974e-db7a-42b4-b2e0-564ae1a82233 tempest-VolumesSnapshotsTestJSON-935757216 None] Flow 'volume_create_manager' (42a59319-5e14-4c0a-a443-a04468a887ff) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87272) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:57:58 devstack cinder-volume[87272]: INFO cinder.volume.manager [req-879d9f89-a51d-4421-a7b7-67a109efde6d req-d7ab974e-db7a-42b4-b2e0-564ae1a82233 tempest-VolumesSnapshotsTestJSON-935757216 None] Created volume successfully. Nov 04 10:57:59 devstack cinder-volume[87272]: DEBUG cinder.quota [None req-9b169e5f-ccac-4144-94c5-7cf5fd7d6e6e tempest-VolumesMetadataTest-1691151577 None] Created reservations ['c298932b-277d-4d8b-beb2-e1646a241fef', '4135e6bd-f1b7-4c14-9fa7-241f8b8de55c', 'b64b1ee9-6bc9-49b5-949a-c2f3b57a4388', '87991d07-56ea-42a4-a8c6-c0b1250db55c'] {{(pid=87272) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 10:57:59 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-9b169e5f-ccac-4144-94c5-7cf5fd7d6e6e tempest-VolumesMetadataTest-1691151577 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:57:59 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-9b169e5f-ccac-4144-94c5-7cf5fd7d6e6e tempest-VolumesMetadataTest-1691151577 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:57:59 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-9b169e5f-ccac-4144-94c5-7cf5fd7d6e6e tempest-VolumesMetadataTest-1691151577 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898': None} {{(pid=87272) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:57:59 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-9b169e5f-ccac-4144-94c5-7cf5fd7d6e6e tempest-VolumesMetadataTest-1691151577 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'] {{(pid=87272) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:57:59 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-9b169e5f-ccac-4144-94c5-7cf5fd7d6e6e tempest-VolumesMetadataTest-1691151577 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:57:59 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-9b169e5f-ccac-4144-94c5-7cf5fd7d6e6e tempest-VolumesMetadataTest-1691151577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:57:59 devstack sudo[97814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1 Nov 04 10:57:59 devstack sudo[97814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:57:59 devstack sudo[97814]: pam_unix(sudo:session): session closed for user root Nov 04 10:57:59 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-9b169e5f-ccac-4144-94c5-7cf5fd7d6e6e tempest-VolumesMetadataTest-1691151577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1" returned: 0 in 0.363s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:57:59 devstack cinder-volume[87272]: DEBUG cinder.manager [None req-9b169e5f-ccac-4144-94c5-7cf5fd7d6e6e tempest-VolumesMetadataTest-1691151577 None] Notifying Schedulers of capabilities ... {{(pid=87272) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 10:57:59 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-9b169e5f-ccac-4144-94c5-7cf5fd7d6e6e tempest-VolumesMetadataTest-1691151577 None] Deleted volume successfully. Nov 04 10:57:59 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-9b169e5f-ccac-4144-94c5-7cf5fd7d6e6e tempest-VolumesMetadataTest-1691151577 None] Lock "cinder-9fda3548-b621-4f04-b2e8-d4e1323f6466-delete_volume" released by "delete_volume" :: held 2.299s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:57:59 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [req-f8e96bfc-6429-434c-bda7-d12ec18882e2 req-224061ab-be98-43b5-8674-abdcda9b3752 tempest-VolumesSnapshotsTestJSON-935757216 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:57:59 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [req-f8e96bfc-6429-434c-bda7-d12ec18882e2 req-224061ab-be98-43b5-8674-abdcda9b3752 tempest-VolumesSnapshotsTestJSON-935757216 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:57:59 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.remotefs [req-f8e96bfc-6429-434c-bda7-d12ec18882e2 req-224061ab-be98-43b5-8674-abdcda9b3752 tempest-VolumesSnapshotsTestJSON-935757216 None] Creating offline snapshot f1a60095-5910-43d0-8a3f-aa9243a01c05 of volume b29532ee-0002-4ed5-8e3b-d3c404fa6321 {{(pid=87272) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 04 10:57:59 devstack cinder-volume[87272]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d32d4bf-3f32-48d7-9ca7-e84d609740df]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:57:59 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [req-f8e96bfc-6429-434c-bda7-d12ec18882e2 req-224061ab-be98-43b5-8674-abdcda9b3752 tempest-VolumesSnapshotsTestJSON-935757216 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-b29532ee-0002-4ed5-8e3b-d3c404fa6321 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:58:00 devstack sudo[97817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-b29532ee-0002-4ed5-8e3b-d3c404fa6321 Nov 04 10:58:00 devstack sudo[97817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:58:00 devstack sudo[97817]: pam_unix(sudo:session): session closed for user root Nov 04 10:58:00 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [req-f8e96bfc-6429-434c-bda7-d12ec18882e2 req-224061ab-be98-43b5-8674-abdcda9b3752 tempest-VolumesSnapshotsTestJSON-935757216 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-b29532ee-0002-4ed5-8e3b-d3c404fa6321" returned: 0 in 0.842s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:58:00 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [req-f8e96bfc-6429-434c-bda7-d12ec18882e2 req-224061ab-be98-43b5-8674-abdcda9b3752 tempest-VolumesSnapshotsTestJSON-935757216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-b29532ee-0002-4ed5-8e3b-d3c404fa6321,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-b29532ee-0002-4ed5-8e3b-d3c404fa6321.f1a60095-5910-43d0-8a3f-aa9243a01c05 1G {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:58:00 devstack sudo[97822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-b29532ee-0002-4ed5-8e3b-d3c404fa6321,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-b29532ee-0002-4ed5-8e3b-d3c404fa6321.f1a60095-5910-43d0-8a3f-aa9243a01c05 1G Nov 04 10:58:00 devstack sudo[97822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:58:01 devstack cinder-volume[87272]: DEBUG cinder.volume.flows.manager.create_volume [None req-13da831d-9e96-459e-a381-c22b1713610b tempest-VolumesSnapshotNegativeTestJSON-290076878 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87272) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 10:58:01 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-13da831d-9e96-459e-a381-c22b1713610b tempest-VolumesSnapshotNegativeTestJSON-290076878 None] Flow 'volume_create_manager' (39f6bd94-003e-4343-ad09-6e7c2a6a551f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:58:01 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-13da831d-9e96-459e-a381-c22b1713610b tempest-VolumesSnapshotNegativeTestJSON-290076878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (48907f55-5406-421f-a653-8e180f869dc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:58:01 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-13da831d-9e96-459e-a381-c22b1713610b tempest-VolumesSnapshotNegativeTestJSON-290076878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (48907f55-5406-421f-a653-8e180f869dc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T09:58:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1269298745',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=27990637-e1dd-45c7-b7ee-610535c5aa4c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='16ac7c5a818b4fb799eed95a638aab6d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T09:58:01Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T09:58:01Z,use_quota=True,user_id='0085d22fbdbb43d28c2425b0af8e8ea1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8989e4f-21e3-4f0a-9584-0d818784e883),volume_type_id=f8989e4f-21e3-4f0a-9584-0d818784e883)' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:58:01 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-13da831d-9e96-459e-a381-c22b1713610b tempest-VolumesSnapshotNegativeTestJSON-290076878 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cbc88e4b-cf59-4f56-be8b-6b784b673a14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:58:01 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-13da831d-9e96-459e-a381-c22b1713610b tempest-VolumesSnapshotNegativeTestJSON-290076878 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cbc88e4b-cf59-4f56-be8b-6b784b673a14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:58:01 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-13da831d-9e96-459e-a381-c22b1713610b tempest-VolumesSnapshotNegativeTestJSON-290076878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ee63168-11a1-4b41-bf7a-df49be2a770b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:58:01 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-13da831d-9e96-459e-a381-c22b1713610b tempest-VolumesSnapshotNegativeTestJSON-290076878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ee63168-11a1-4b41-bf7a-df49be2a770b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '27990637-e1dd-45c7-b7ee-610535c5aa4c', 'volume_name': 'volume-27990637-e1dd-45c7-b7ee-610535c5aa4c', 'volume_size': 2}' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:58:01 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-13da831d-9e96-459e-a381-c22b1713610b tempest-VolumesSnapshotNegativeTestJSON-290076878 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b823a439-1a79-4b2b-b3ca-55cb736c83a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:58:01 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-13da831d-9e96-459e-a381-c22b1713610b tempest-VolumesSnapshotNegativeTestJSON-290076878 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b823a439-1a79-4b2b-b3ca-55cb736c83a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:58:01 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-13da831d-9e96-459e-a381-c22b1713610b tempest-VolumesSnapshotNegativeTestJSON-290076878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b13ee5e3-4c7f-4d2f-8357-e8c3a3cdd13a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:58:01 devstack cinder-volume[87272]: INFO cinder.volume.flows.manager.create_volume [None req-13da831d-9e96-459e-a381-c22b1713610b tempest-VolumesSnapshotNegativeTestJSON-290076878 None] Volume 27990637-e1dd-45c7-b7ee-610535c5aa4c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-27990637-e1dd-45c7-b7ee-610535c5aa4c', 'volume_size': 2} Nov 04 10:58:01 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-13da831d-9e96-459e-a381-c22b1713610b tempest-VolumesSnapshotNegativeTestJSON-290076878 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:58:01 devstack sudo[97822]: pam_unix(sudo:session): session closed for user root Nov 04 10:58:01 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [req-f8e96bfc-6429-434c-bda7-d12ec18882e2 req-224061ab-be98-43b5-8674-abdcda9b3752 tempest-VolumesSnapshotsTestJSON-935757216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-b29532ee-0002-4ed5-8e3b-d3c404fa6321,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-b29532ee-0002-4ed5-8e3b-d3c404fa6321.f1a60095-5910-43d0-8a3f-aa9243a01c05 1G" returned: 0 in 0.905s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:58:01 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [req-f8e96bfc-6429-434c-bda7-d12ec18882e2 req-224061ab-be98-43b5-8674-abdcda9b3752 tempest-VolumesSnapshotsTestJSON-935757216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b29532ee-0002-4ed5-8e3b-d3c404fa6321 -F qcow2 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-b29532ee-0002-4ed5-8e3b-d3c404fa6321.f1a60095-5910-43d0-8a3f-aa9243a01c05 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:58:01 devstack sudo[97828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b29532ee-0002-4ed5-8e3b-d3c404fa6321 -F qcow2 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-b29532ee-0002-4ed5-8e3b-d3c404fa6321.f1a60095-5910-43d0-8a3f-aa9243a01c05 Nov 04 10:58:01 devstack sudo[97828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:58:01 devstack sudo[97828]: pam_unix(sudo:session): session closed for user root Nov 04 10:58:01 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [req-f8e96bfc-6429-434c-bda7-d12ec18882e2 req-224061ab-be98-43b5-8674-abdcda9b3752 tempest-VolumesSnapshotsTestJSON-935757216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b29532ee-0002-4ed5-8e3b-d3c404fa6321 -F qcow2 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-b29532ee-0002-4ed5-8e3b-d3c404fa6321.f1a60095-5910-43d0-8a3f-aa9243a01c05" returned: 0 in 0.353s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:58:01 devstack cinder-volume[87272]: WARNING cinder.volume.drivers.remotefs [req-f8e96bfc-6429-434c-bda7-d12ec18882e2 req-224061ab-be98-43b5-8674-abdcda9b3752 tempest-VolumesSnapshotsTestJSON-935757216 None] /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-b29532ee-0002-4ed5-8e3b-d3c404fa6321.f1a60095-5910-43d0-8a3f-aa9243a01c05 is being set with open permissions: ugo+rw Nov 04 10:58:01 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [req-f8e96bfc-6429-434c-bda7-d12ec18882e2 req-224061ab-be98-43b5-8674-abdcda9b3752 tempest-VolumesSnapshotsTestJSON-935757216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-b29532ee-0002-4ed5-8e3b-d3c404fa6321.f1a60095-5910-43d0-8a3f-aa9243a01c05 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:58:02 devstack sudo[97834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-b29532ee-0002-4ed5-8e3b-d3c404fa6321.f1a60095-5910-43d0-8a3f-aa9243a01c05 Nov 04 10:58:02 devstack sudo[97834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:58:02 devstack sudo[97834]: pam_unix(sudo:session): session closed for user root Nov 04 10:58:02 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [req-f8e96bfc-6429-434c-bda7-d12ec18882e2 req-224061ab-be98-43b5-8674-abdcda9b3752 tempest-VolumesSnapshotsTestJSON-935757216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-b29532ee-0002-4ed5-8e3b-d3c404fa6321.f1a60095-5910-43d0-8a3f-aa9243a01c05" returned: 0 in 0.405s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:58:02 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [req-f8e96bfc-6429-434c-bda7-d12ec18882e2 req-224061ab-be98-43b5-8674-abdcda9b3752 tempest-VolumesSnapshotsTestJSON-935757216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-b29532ee-0002-4ed5-8e3b-d3c404fa6321.info {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:58:02 devstack sudo[97840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-b29532ee-0002-4ed5-8e3b-d3c404fa6321.info Nov 04 10:58:02 devstack sudo[97840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:58:02 devstack sudo[97840]: pam_unix(sudo:session): session closed for user root Nov 04 10:58:02 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [req-f8e96bfc-6429-434c-bda7-d12ec18882e2 req-224061ab-be98-43b5-8674-abdcda9b3752 tempest-VolumesSnapshotsTestJSON-935757216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-b29532ee-0002-4ed5-8e3b-d3c404fa6321.info" returned: 0 in 0.347s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:58:02 devstack cinder-volume[87272]: WARNING cinder.volume.drivers.remotefs [req-f8e96bfc-6429-434c-bda7-d12ec18882e2 req-224061ab-be98-43b5-8674-abdcda9b3752 tempest-VolumesSnapshotsTestJSON-935757216 None] /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-b29532ee-0002-4ed5-8e3b-d3c404fa6321.info is being set with open permissions: ugo+rw Nov 04 10:58:02 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [req-f8e96bfc-6429-434c-bda7-d12ec18882e2 req-224061ab-be98-43b5-8674-abdcda9b3752 tempest-VolumesSnapshotsTestJSON-935757216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-b29532ee-0002-4ed5-8e3b-d3c404fa6321.info {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:58:02 devstack sudo[97843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-b29532ee-0002-4ed5-8e3b-d3c404fa6321.info Nov 04 10:58:02 devstack sudo[97843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:58:03 devstack sudo[97843]: pam_unix(sudo:session): session closed for user root Nov 04 10:58:03 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [req-f8e96bfc-6429-434c-bda7-d12ec18882e2 req-224061ab-be98-43b5-8674-abdcda9b3752 tempest-VolumesSnapshotsTestJSON-935757216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-b29532ee-0002-4ed5-8e3b-d3c404fa6321.info" returned: 0 in 0.375s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:58:03 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [req-f8e96bfc-6429-434c-bda7-d12ec18882e2 req-224061ab-be98-43b5-8674-abdcda9b3752 tempest-VolumesSnapshotsTestJSON-935757216 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.441s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:58:03 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-13da831d-9e96-459e-a381-c22b1713610b tempest-VolumesSnapshotNegativeTestJSON-290076878 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.005s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:58:03 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-13da831d-9e96-459e-a381-c22b1713610b tempest-VolumesSnapshotNegativeTestJSON-290076878 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T09:58:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1269298745',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=27990637-e1dd-45c7-b7ee-610535c5aa4c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='16ac7c5a818b4fb799eed95a638aab6d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T09:58:01Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T09:58:01Z,use_quota=True,user_id='0085d22fbdbb43d28c2425b0af8e8ea1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8989e4f-21e3-4f0a-9584-0d818784e883),volume_type_id=f8989e4f-21e3-4f0a-9584-0d818784e883)}" {{(pid=87272) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 04 10:58:03 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.remotefs [None req-13da831d-9e96-459e-a381-c22b1713610b tempest-VolumesSnapshotNegativeTestJSON-290076878 None] Creating volume 27990637-e1dd-45c7-b7ee-610535c5aa4c {{(pid=87272) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 10:58:03 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-13da831d-9e96-459e-a381-c22b1713610b tempest-VolumesSnapshotNegativeTestJSON-290076878 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:58:03 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-13da831d-9e96-459e-a381-c22b1713610b tempest-VolumesSnapshotNegativeTestJSON-290076878 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:58:03 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-13da831d-9e96-459e-a381-c22b1713610b tempest-VolumesSnapshotNegativeTestJSON-290076878 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898': None} {{(pid=87272) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:58:03 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-13da831d-9e96-459e-a381-c22b1713610b tempest-VolumesSnapshotNegativeTestJSON-290076878 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'] {{(pid=87272) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:58:03 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-13da831d-9e96-459e-a381-c22b1713610b tempest-VolumesSnapshotNegativeTestJSON-290076878 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:58:03 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-13da831d-9e96-459e-a381-c22b1713610b tempest-VolumesSnapshotNegativeTestJSON-290076878 None] Selected osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898 as target Quobyte volume. {{(pid=87272) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 10:58:03 devstack cinder-volume[87272]: INFO cinder.volume.drivers.remotefs [None req-13da831d-9e96-459e-a381-c22b1713610b tempest-VolumesSnapshotNegativeTestJSON-290076878 None] casted to osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898 Nov 04 10:58:03 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-13da831d-9e96-459e-a381-c22b1713610b tempest-VolumesSnapshotNegativeTestJSON-290076878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-27990637-e1dd-45c7-b7ee-610535c5aa4c 2147483648 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:58:03 devstack sudo[97846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-27990637-e1dd-45c7-b7ee-610535c5aa4c 2147483648 Nov 04 10:58:03 devstack sudo[97846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:58:03 devstack cinder-volume[87272]: INFO cinder.volume.manager [req-f8e96bfc-6429-434c-bda7-d12ec18882e2 req-224061ab-be98-43b5-8674-abdcda9b3752 tempest-VolumesSnapshotsTestJSON-935757216 None] Create snapshot completed successfully Nov 04 10:58:04 devstack sudo[97846]: pam_unix(sudo:session): session closed for user root Nov 04 10:58:04 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-13da831d-9e96-459e-a381-c22b1713610b tempest-VolumesSnapshotNegativeTestJSON-290076878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-27990637-e1dd-45c7-b7ee-610535c5aa4c 2147483648" returned: 0 in 0.899s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:58:04 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-13da831d-9e96-459e-a381-c22b1713610b tempest-VolumesSnapshotNegativeTestJSON-290076878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-27990637-e1dd-45c7-b7ee-610535c5aa4c {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:58:04 devstack sudo[97852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-27990637-e1dd-45c7-b7ee-610535c5aa4c Nov 04 10:58:04 devstack sudo[97852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:58:04 devstack cinder-volume[87272]: DEBUG cinder.coordination [req-25dadbad-f35b-44c5-b317-6a0e8b9f4c86 req-bb700264-698d-4143-a973-bc5d106fd863 tempest-VolumesSnapshotsTestJSON-935757216 None] Acquiring lock "cinder-f1a60095-5910-43d0-8a3f-aa9243a01c05-delete_snapshot" by "delete_snapshot" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:58:04 devstack cinder-volume[87272]: DEBUG cinder.coordination [req-25dadbad-f35b-44c5-b317-6a0e8b9f4c86 req-bb700264-698d-4143-a973-bc5d106fd863 tempest-VolumesSnapshotsTestJSON-935757216 None] Lock "cinder-f1a60095-5910-43d0-8a3f-aa9243a01c05-delete_snapshot" acquired by "delete_snapshot" :: waited 0.056s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:58:04 devstack cinder-volume[87272]: DEBUG cinder.coordination [req-25dadbad-f35b-44c5-b317-6a0e8b9f4c86 req-bb700264-698d-4143-a973-bc5d106fd863 tempest-VolumesSnapshotsTestJSON-935757216 None] Acquiring lock "cinder-quobyte-b29532ee-0002-4ed5-8e3b-d3c404fa6321" by "delete_snapshot" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:58:04 devstack cinder-volume[87272]: DEBUG cinder.coordination [req-25dadbad-f35b-44c5-b317-6a0e8b9f4c86 req-bb700264-698d-4143-a973-bc5d106fd863 tempest-VolumesSnapshotsTestJSON-935757216 None] Lock "cinder-quobyte-b29532ee-0002-4ed5-8e3b-d3c404fa6321" acquired by "delete_snapshot" :: waited 0.051s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:58:04 devstack cinder-volume[87272]: DEBUG cinder.coordination [req-25dadbad-f35b-44c5-b317-6a0e8b9f4c86 req-bb700264-698d-4143-a973-bc5d106fd863 tempest-VolumesSnapshotsTestJSON-935757216 None] Acquiring lock "cinder-quobyte-f1a60095-5910-43d0-8a3f-aa9243a01c05" by "_delete_snapshot" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:58:04 devstack cinder-volume[87272]: DEBUG cinder.coordination [req-25dadbad-f35b-44c5-b317-6a0e8b9f4c86 req-bb700264-698d-4143-a973-bc5d106fd863 tempest-VolumesSnapshotsTestJSON-935757216 None] Lock "cinder-quobyte-f1a60095-5910-43d0-8a3f-aa9243a01c05" acquired by "_delete_snapshot" :: waited 0.040s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:58:04 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.remotefs [req-25dadbad-f35b-44c5-b317-6a0e8b9f4c86 req-bb700264-698d-4143-a973-bc5d106fd863 tempest-VolumesSnapshotsTestJSON-935757216 None] Deleting offline snapshot f1a60095-5910-43d0-8a3f-aa9243a01c05 of volume b29532ee-0002-4ed5-8e3b-d3c404fa6321 {{(pid=87272) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 04 10:58:04 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.remotefs [req-25dadbad-f35b-44c5-b317-6a0e8b9f4c86 req-bb700264-698d-4143-a973-bc5d106fd863 tempest-VolumesSnapshotsTestJSON-935757216 None] snapshot_file for this snap is: volume-b29532ee-0002-4ed5-8e3b-d3c404fa6321.f1a60095-5910-43d0-8a3f-aa9243a01c05 {{(pid=87272) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 04 10:58:04 devstack cinder-volume[87272]: DEBUG oslo.privsep.daemon [-] privsep: reply[782cc459-59a8-495e-9b93-cc735ad94660]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:58:04 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [req-25dadbad-f35b-44c5-b317-6a0e8b9f4c86 req-bb700264-698d-4143-a973-bc5d106fd863 tempest-VolumesSnapshotsTestJSON-935757216 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-b29532ee-0002-4ed5-8e3b-d3c404fa6321.f1a60095-5910-43d0-8a3f-aa9243a01c05 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:58:04 devstack sudo[97852]: pam_unix(sudo:session): session closed for user root Nov 04 10:58:04 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-13da831d-9e96-459e-a381-c22b1713610b tempest-VolumesSnapshotNegativeTestJSON-290076878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-27990637-e1dd-45c7-b7ee-610535c5aa4c" returned: 0 in 0.701s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:58:04 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-13da831d-9e96-459e-a381-c22b1713610b tempest-VolumesSnapshotNegativeTestJSON-290076878 None] <== create_volume: return (1683ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'} {{(pid=87272) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 04 10:58:04 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-13da831d-9e96-459e-a381-c22b1713610b tempest-VolumesSnapshotNegativeTestJSON-290076878 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.688s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:58:04 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-13da831d-9e96-459e-a381-c22b1713610b tempest-VolumesSnapshotNegativeTestJSON-290076878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b13ee5e3-4c7f-4d2f-8357-e8c3a3cdd13a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-27990637-e1dd-45c7-b7ee-610535c5aa4c', 'volume_size': 2}' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:58:04 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-13da831d-9e96-459e-a381-c22b1713610b tempest-VolumesSnapshotNegativeTestJSON-290076878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (91c6b875-426f-4e67-8860-ee8c046335e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:58:05 devstack cinder-volume[87272]: INFO cinder.volume.flows.manager.create_volume [None req-13da831d-9e96-459e-a381-c22b1713610b tempest-VolumesSnapshotNegativeTestJSON-290076878 None] Volume volume-27990637-e1dd-45c7-b7ee-610535c5aa4c (27990637-e1dd-45c7-b7ee-610535c5aa4c): created successfully Nov 04 10:58:05 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-13da831d-9e96-459e-a381-c22b1713610b tempest-VolumesSnapshotNegativeTestJSON-290076878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (91c6b875-426f-4e67-8860-ee8c046335e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:58:05 devstack sudo[97859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-b29532ee-0002-4ed5-8e3b-d3c404fa6321.f1a60095-5910-43d0-8a3f-aa9243a01c05 Nov 04 10:58:05 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-13da831d-9e96-459e-a381-c22b1713610b tempest-VolumesSnapshotNegativeTestJSON-290076878 None] Flow 'volume_create_manager' (39f6bd94-003e-4343-ad09-6e7c2a6a551f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87272) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:58:05 devstack sudo[97859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:58:05 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-13da831d-9e96-459e-a381-c22b1713610b tempest-VolumesSnapshotNegativeTestJSON-290076878 None] Created volume successfully. Nov 04 10:58:05 devstack sudo[97859]: pam_unix(sudo:session): session closed for user root Nov 04 10:58:05 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [req-25dadbad-f35b-44c5-b317-6a0e8b9f4c86 req-bb700264-698d-4143-a973-bc5d106fd863 tempest-VolumesSnapshotsTestJSON-935757216 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-b29532ee-0002-4ed5-8e3b-d3c404fa6321.f1a60095-5910-43d0-8a3f-aa9243a01c05" returned: 0 in 1.002s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:58:05 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.remotefs [req-25dadbad-f35b-44c5-b317-6a0e8b9f4c86 req-bb700264-698d-4143-a973-bc5d106fd863 tempest-VolumesSnapshotsTestJSON-935757216 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b29532ee-0002-4ed5-8e3b-d3c404fa6321(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87272) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 10:58:05 devstack cinder-volume[87272]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf11f3d4-2d74-4fe7-8b98-0c9e7cf424ca]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:58:05 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [req-25dadbad-f35b-44c5-b317-6a0e8b9f4c86 req-bb700264-698d-4143-a973-bc5d106fd863 tempest-VolumesSnapshotsTestJSON-935757216 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-b29532ee-0002-4ed5-8e3b-d3c404fa6321 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:58:06 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-455ced2e-17b7-4297-b78a-3bb437b5bfb6 tempest-VolumesSnapshotNegativeTestJSON-290076878 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:58:06 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-455ced2e-17b7-4297-b78a-3bb437b5bfb6 tempest-VolumesSnapshotNegativeTestJSON-290076878 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.004s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:58:06 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.remotefs [None req-455ced2e-17b7-4297-b78a-3bb437b5bfb6 tempest-VolumesSnapshotNegativeTestJSON-290076878 None] Creating offline snapshot 340ba722-198b-413c-9e25-98bc0078a1bd of volume 27990637-e1dd-45c7-b7ee-610535c5aa4c {{(pid=87272) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 04 10:58:06 devstack cinder-volume[87272]: DEBUG oslo.privsep.daemon [-] privsep: reply[e73ee5c1-5152-44a3-b16f-aa835e196231]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:58:06 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-455ced2e-17b7-4297-b78a-3bb437b5bfb6 tempest-VolumesSnapshotNegativeTestJSON-290076878 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-27990637-e1dd-45c7-b7ee-610535c5aa4c {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:58:06 devstack sudo[97874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-b29532ee-0002-4ed5-8e3b-d3c404fa6321 Nov 04 10:58:06 devstack sudo[97874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:58:06 devstack sudo[97881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-27990637-e1dd-45c7-b7ee-610535c5aa4c Nov 04 10:58:06 devstack sudo[97881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:58:07 devstack sudo[97874]: pam_unix(sudo:session): session closed for user root Nov 04 10:58:07 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [req-25dadbad-f35b-44c5-b317-6a0e8b9f4c86 req-bb700264-698d-4143-a973-bc5d106fd863 tempest-VolumesSnapshotsTestJSON-935757216 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-b29532ee-0002-4ed5-8e3b-d3c404fa6321" returned: 0 in 1.168s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:58:07 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [req-25dadbad-f35b-44c5-b317-6a0e8b9f4c86 req-bb700264-698d-4143-a973-bc5d106fd863 tempest-VolumesSnapshotsTestJSON-935757216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-b29532ee-0002-4ed5-8e3b-d3c404fa6321.f1a60095-5910-43d0-8a3f-aa9243a01c05 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:58:07 devstack sudo[97889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-b29532ee-0002-4ed5-8e3b-d3c404fa6321.f1a60095-5910-43d0-8a3f-aa9243a01c05 Nov 04 10:58:07 devstack sudo[97889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:58:07 devstack sudo[97881]: pam_unix(sudo:session): session closed for user root Nov 04 10:58:07 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-455ced2e-17b7-4297-b78a-3bb437b5bfb6 tempest-VolumesSnapshotNegativeTestJSON-290076878 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-27990637-e1dd-45c7-b7ee-610535c5aa4c" returned: 0 in 0.931s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:58:07 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-455ced2e-17b7-4297-b78a-3bb437b5bfb6 tempest-VolumesSnapshotNegativeTestJSON-290076878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-27990637-e1dd-45c7-b7ee-610535c5aa4c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-27990637-e1dd-45c7-b7ee-610535c5aa4c.340ba722-198b-413c-9e25-98bc0078a1bd 2G {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:58:07 devstack sudo[97891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-27990637-e1dd-45c7-b7ee-610535c5aa4c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-27990637-e1dd-45c7-b7ee-610535c5aa4c.340ba722-198b-413c-9e25-98bc0078a1bd 2G Nov 04 10:58:07 devstack sudo[97891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:58:07 devstack sudo[97889]: pam_unix(sudo:session): session closed for user root Nov 04 10:58:07 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [req-25dadbad-f35b-44c5-b317-6a0e8b9f4c86 req-bb700264-698d-4143-a973-bc5d106fd863 tempest-VolumesSnapshotsTestJSON-935757216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-b29532ee-0002-4ed5-8e3b-d3c404fa6321.f1a60095-5910-43d0-8a3f-aa9243a01c05" returned: 0 in 0.527s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:58:07 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [req-25dadbad-f35b-44c5-b317-6a0e8b9f4c86 req-bb700264-698d-4143-a973-bc5d106fd863 tempest-VolumesSnapshotsTestJSON-935757216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-b29532ee-0002-4ed5-8e3b-d3c404fa6321.f1a60095-5910-43d0-8a3f-aa9243a01c05 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:58:07 devstack sudo[97899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-b29532ee-0002-4ed5-8e3b-d3c404fa6321.f1a60095-5910-43d0-8a3f-aa9243a01c05 Nov 04 10:58:07 devstack sudo[97899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:58:07 devstack sudo[97891]: pam_unix(sudo:session): session closed for user root Nov 04 10:58:07 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-455ced2e-17b7-4297-b78a-3bb437b5bfb6 tempest-VolumesSnapshotNegativeTestJSON-290076878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-27990637-e1dd-45c7-b7ee-610535c5aa4c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-27990637-e1dd-45c7-b7ee-610535c5aa4c.340ba722-198b-413c-9e25-98bc0078a1bd 2G" returned: 0 in 0.765s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:58:07 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-455ced2e-17b7-4297-b78a-3bb437b5bfb6 tempest-VolumesSnapshotNegativeTestJSON-290076878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-27990637-e1dd-45c7-b7ee-610535c5aa4c -F qcow2 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-27990637-e1dd-45c7-b7ee-610535c5aa4c.340ba722-198b-413c-9e25-98bc0078a1bd {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:58:08 devstack sudo[97905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-27990637-e1dd-45c7-b7ee-610535c5aa4c -F qcow2 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-27990637-e1dd-45c7-b7ee-610535c5aa4c.340ba722-198b-413c-9e25-98bc0078a1bd Nov 04 10:58:08 devstack sudo[97905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:58:08 devstack sudo[97899]: pam_unix(sudo:session): session closed for user root Nov 04 10:58:08 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [req-25dadbad-f35b-44c5-b317-6a0e8b9f4c86 req-bb700264-698d-4143-a973-bc5d106fd863 tempest-VolumesSnapshotsTestJSON-935757216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-b29532ee-0002-4ed5-8e3b-d3c404fa6321.f1a60095-5910-43d0-8a3f-aa9243a01c05" returned: 0 in 0.660s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:58:08 devstack cinder-volume[87272]: DEBUG cinder.coordination [req-25dadbad-f35b-44c5-b317-6a0e8b9f4c86 req-bb700264-698d-4143-a973-bc5d106fd863 tempest-VolumesSnapshotsTestJSON-935757216 None] Lock "cinder-quobyte-f1a60095-5910-43d0-8a3f-aa9243a01c05" released by "_delete_snapshot" :: held 3.586s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:58:08 devstack cinder-volume[87272]: DEBUG cinder.coordination [req-25dadbad-f35b-44c5-b317-6a0e8b9f4c86 req-bb700264-698d-4143-a973-bc5d106fd863 tempest-VolumesSnapshotsTestJSON-935757216 None] Lock "cinder-quobyte-b29532ee-0002-4ed5-8e3b-d3c404fa6321" released by "delete_snapshot" :: held 3.639s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:58:08 devstack cinder-volume[87272]: DEBUG cinder.quota [req-25dadbad-f35b-44c5-b317-6a0e8b9f4c86 req-bb700264-698d-4143-a973-bc5d106fd863 tempest-VolumesSnapshotsTestJSON-935757216 None] Created reservations ['367f01c5-6473-4a1a-b356-ece21068d9ef', '1c5706c1-fe1b-40a0-bf8f-49556d8a4b46', '07f7c6b5-9b5c-400a-85a2-a1f460b86636', '188eceb1-2fda-41ed-86b0-0adae2969699'] {{(pid=87272) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 10:58:08 devstack cinder-volume[87272]: INFO cinder.volume.manager [req-25dadbad-f35b-44c5-b317-6a0e8b9f4c86 req-bb700264-698d-4143-a973-bc5d106fd863 tempest-VolumesSnapshotsTestJSON-935757216 None] Delete snapshot completed successfully. Nov 04 10:58:08 devstack cinder-volume[87272]: DEBUG cinder.coordination [req-25dadbad-f35b-44c5-b317-6a0e8b9f4c86 req-bb700264-698d-4143-a973-bc5d106fd863 tempest-VolumesSnapshotsTestJSON-935757216 None] Lock "cinder-f1a60095-5910-43d0-8a3f-aa9243a01c05-delete_snapshot" released by "delete_snapshot" :: held 3.895s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:58:08 devstack sudo[97905]: pam_unix(sudo:session): session closed for user root Nov 04 10:58:08 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-455ced2e-17b7-4297-b78a-3bb437b5bfb6 tempest-VolumesSnapshotNegativeTestJSON-290076878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-27990637-e1dd-45c7-b7ee-610535c5aa4c -F qcow2 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-27990637-e1dd-45c7-b7ee-610535c5aa4c.340ba722-198b-413c-9e25-98bc0078a1bd" returned: 0 in 0.599s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:58:08 devstack cinder-volume[87272]: WARNING cinder.volume.drivers.remotefs [None req-455ced2e-17b7-4297-b78a-3bb437b5bfb6 tempest-VolumesSnapshotNegativeTestJSON-290076878 None] /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-27990637-e1dd-45c7-b7ee-610535c5aa4c.340ba722-198b-413c-9e25-98bc0078a1bd is being set with open permissions: ugo+rw Nov 04 10:58:08 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-455ced2e-17b7-4297-b78a-3bb437b5bfb6 tempest-VolumesSnapshotNegativeTestJSON-290076878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-27990637-e1dd-45c7-b7ee-610535c5aa4c.340ba722-198b-413c-9e25-98bc0078a1bd {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:58:08 devstack sudo[97911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-27990637-e1dd-45c7-b7ee-610535c5aa4c.340ba722-198b-413c-9e25-98bc0078a1bd Nov 04 10:58:08 devstack sudo[97911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:58:09 devstack sudo[97911]: pam_unix(sudo:session): session closed for user root Nov 04 10:58:09 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-455ced2e-17b7-4297-b78a-3bb437b5bfb6 tempest-VolumesSnapshotNegativeTestJSON-290076878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-27990637-e1dd-45c7-b7ee-610535c5aa4c.340ba722-198b-413c-9e25-98bc0078a1bd" returned: 0 in 0.546s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:58:09 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-455ced2e-17b7-4297-b78a-3bb437b5bfb6 tempest-VolumesSnapshotNegativeTestJSON-290076878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-27990637-e1dd-45c7-b7ee-610535c5aa4c.info {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:58:09 devstack sudo[97933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-27990637-e1dd-45c7-b7ee-610535c5aa4c.info Nov 04 10:58:09 devstack sudo[97933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:58:09 devstack cinder-volume[87272]: DEBUG cinder.coordination [req-2ddf1734-d741-4796-94b8-8a364a827254 req-e285593c-872c-4f2a-a399-de9c76002299 tempest-VolumesSnapshotsTestJSON-935757216 None] Acquiring lock "cinder-b29532ee-0002-4ed5-8e3b-d3c404fa6321-delete_volume" by "delete_volume" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:58:09 devstack cinder-volume[87272]: DEBUG cinder.coordination [req-2ddf1734-d741-4796-94b8-8a364a827254 req-e285593c-872c-4f2a-a399-de9c76002299 tempest-VolumesSnapshotsTestJSON-935757216 None] Lock "cinder-b29532ee-0002-4ed5-8e3b-d3c404fa6321-delete_volume" acquired by "delete_volume" :: waited 0.055s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:58:09 devstack cinder-volume[87272]: DEBUG cinder.coordination [req-2ddf1734-d741-4796-94b8-8a364a827254 req-e285593c-872c-4f2a-a399-de9c76002299 tempest-VolumesSnapshotsTestJSON-935757216 None] Acquiring lock "cinder-quobyte-b29532ee-0002-4ed5-8e3b-d3c404fa6321" by "delete_volume" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:58:09 devstack cinder-volume[87272]: DEBUG cinder.coordination [req-2ddf1734-d741-4796-94b8-8a364a827254 req-e285593c-872c-4f2a-a399-de9c76002299 tempest-VolumesSnapshotsTestJSON-935757216 None] Lock "cinder-quobyte-b29532ee-0002-4ed5-8e3b-d3c404fa6321" acquired by "delete_volume" :: waited 0.078s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:58:09 devstack cinder-volume[87272]: DEBUG oslo.privsep.daemon [-] privsep: reply[eaa71a10-35d3-42f0-82d9-966d83e9368b]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:58:09 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [req-2ddf1734-d741-4796-94b8-8a364a827254 req-e285593c-872c-4f2a-a399-de9c76002299 tempest-VolumesSnapshotsTestJSON-935757216 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-b29532ee-0002-4ed5-8e3b-d3c404fa6321 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:58:10 devstack sudo[97956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-b29532ee-0002-4ed5-8e3b-d3c404fa6321 Nov 04 10:58:10 devstack sudo[97956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:58:10 devstack cinder-volume[87272]: DEBUG cinder.volume.flows.manager.create_volume [None req-b6b0310d-6a00-49dc-b5c6-9117098c352f tempest-VolumesTransfersV355Test-1202785932 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87272) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 10:58:10 devstack sudo[97933]: pam_unix(sudo:session): session closed for user root Nov 04 10:58:10 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-b6b0310d-6a00-49dc-b5c6-9117098c352f tempest-VolumesTransfersV355Test-1202785932 None] Flow 'volume_create_manager' (fb1baf37-9c6e-4f19-b6e9-570f9db9ac46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:58:10 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-b6b0310d-6a00-49dc-b5c6-9117098c352f tempest-VolumesTransfersV355Test-1202785932 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d1be7eaf-c903-4ae4-b5fe-403098822057) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:58:10 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-455ced2e-17b7-4297-b78a-3bb437b5bfb6 tempest-VolumesSnapshotNegativeTestJSON-290076878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-27990637-e1dd-45c7-b7ee-610535c5aa4c.info" returned: 0 in 1.199s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:58:10 devstack cinder-volume[87272]: WARNING cinder.volume.drivers.remotefs [None req-455ced2e-17b7-4297-b78a-3bb437b5bfb6 tempest-VolumesSnapshotNegativeTestJSON-290076878 None] /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-27990637-e1dd-45c7-b7ee-610535c5aa4c.info is being set with open permissions: ugo+rw Nov 04 10:58:10 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-455ced2e-17b7-4297-b78a-3bb437b5bfb6 tempest-VolumesSnapshotNegativeTestJSON-290076878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-27990637-e1dd-45c7-b7ee-610535c5aa4c.info {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:58:10 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-b6b0310d-6a00-49dc-b5c6-9117098c352f tempest-VolumesTransfersV355Test-1202785932 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d1be7eaf-c903-4ae4-b5fe-403098822057) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T09:58:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1858773676',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e400e03-8544-4536-9f97-dd0e39c2cd7a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='28060fd89cb64e1f89ac53367553a310',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T09:58:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T09:58:10Z,use_quota=True,user_id='fdc202872c1d4218a78ab11d8dc8bd62',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8989e4f-21e3-4f0a-9584-0d818784e883),volume_type_id=f8989e4f-21e3-4f0a-9584-0d818784e883)' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:58:10 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-b6b0310d-6a00-49dc-b5c6-9117098c352f tempest-VolumesTransfersV355Test-1202785932 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (94920fa2-174b-4417-858f-3150d65b4d4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:58:10 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-b6b0310d-6a00-49dc-b5c6-9117098c352f tempest-VolumesTransfersV355Test-1202785932 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (94920fa2-174b-4417-858f-3150d65b4d4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:58:10 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-b6b0310d-6a00-49dc-b5c6-9117098c352f tempest-VolumesTransfersV355Test-1202785932 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6dd91acf-aa31-49ce-9265-e0e1b541de34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:58:10 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-b6b0310d-6a00-49dc-b5c6-9117098c352f tempest-VolumesTransfersV355Test-1202785932 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6dd91acf-aa31-49ce-9265-e0e1b541de34) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9e400e03-8544-4536-9f97-dd0e39c2cd7a', 'volume_name': 'volume-9e400e03-8544-4536-9f97-dd0e39c2cd7a', 'volume_size': 1}' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:58:10 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-b6b0310d-6a00-49dc-b5c6-9117098c352f tempest-VolumesTransfersV355Test-1202785932 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b323ce25-bbd5-45b2-b586-8e92344f9b13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:58:10 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-b6b0310d-6a00-49dc-b5c6-9117098c352f tempest-VolumesTransfersV355Test-1202785932 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b323ce25-bbd5-45b2-b586-8e92344f9b13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:58:10 devstack sudo[97959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-27990637-e1dd-45c7-b7ee-610535c5aa4c.info Nov 04 10:58:10 devstack sudo[97959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:58:10 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-b6b0310d-6a00-49dc-b5c6-9117098c352f tempest-VolumesTransfersV355Test-1202785932 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5538af21-2102-42dc-9b19-a43785233785) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:58:10 devstack cinder-volume[87272]: INFO cinder.volume.flows.manager.create_volume [None req-b6b0310d-6a00-49dc-b5c6-9117098c352f tempest-VolumesTransfersV355Test-1202785932 None] Volume 9e400e03-8544-4536-9f97-dd0e39c2cd7a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9e400e03-8544-4536-9f97-dd0e39c2cd7a', 'volume_size': 1} Nov 04 10:58:10 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-b6b0310d-6a00-49dc-b5c6-9117098c352f tempest-VolumesTransfersV355Test-1202785932 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:58:10 devstack sudo[97956]: pam_unix(sudo:session): session closed for user root Nov 04 10:58:10 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [req-2ddf1734-d741-4796-94b8-8a364a827254 req-e285593c-872c-4f2a-a399-de9c76002299 tempest-VolumesSnapshotsTestJSON-935757216 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-b29532ee-0002-4ed5-8e3b-d3c404fa6321" returned: 0 in 1.003s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:58:10 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [req-2ddf1734-d741-4796-94b8-8a364a827254 req-e285593c-872c-4f2a-a399-de9c76002299 tempest-VolumesSnapshotsTestJSON-935757216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-b29532ee-0002-4ed5-8e3b-d3c404fa6321 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:58:10 devstack sudo[97964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-b29532ee-0002-4ed5-8e3b-d3c404fa6321 Nov 04 10:58:10 devstack sudo[97964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:58:11 devstack sudo[97959]: pam_unix(sudo:session): session closed for user root Nov 04 10:58:11 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-455ced2e-17b7-4297-b78a-3bb437b5bfb6 tempest-VolumesSnapshotNegativeTestJSON-290076878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-27990637-e1dd-45c7-b7ee-610535c5aa4c.info" returned: 0 in 0.664s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:58:11 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-455ced2e-17b7-4297-b78a-3bb437b5bfb6 tempest-VolumesSnapshotNegativeTestJSON-290076878 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.925s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:58:11 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-b6b0310d-6a00-49dc-b5c6-9117098c352f tempest-VolumesTransfersV355Test-1202785932 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.610s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:58:11 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-b6b0310d-6a00-49dc-b5c6-9117098c352f tempest-VolumesTransfersV355Test-1202785932 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T09:58:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1858773676',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e400e03-8544-4536-9f97-dd0e39c2cd7a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='28060fd89cb64e1f89ac53367553a310',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T09:58:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T09:58:10Z,use_quota=True,user_id='fdc202872c1d4218a78ab11d8dc8bd62',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8989e4f-21e3-4f0a-9584-0d818784e883),volume_type_id=f8989e4f-21e3-4f0a-9584-0d818784e883)}" {{(pid=87272) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 04 10:58:11 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.remotefs [None req-b6b0310d-6a00-49dc-b5c6-9117098c352f tempest-VolumesTransfersV355Test-1202785932 None] Creating volume 9e400e03-8544-4536-9f97-dd0e39c2cd7a {{(pid=87272) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 10:58:11 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-b6b0310d-6a00-49dc-b5c6-9117098c352f tempest-VolumesTransfersV355Test-1202785932 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:58:11 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-b6b0310d-6a00-49dc-b5c6-9117098c352f tempest-VolumesTransfersV355Test-1202785932 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:58:11 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-b6b0310d-6a00-49dc-b5c6-9117098c352f tempest-VolumesTransfersV355Test-1202785932 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898': None} {{(pid=87272) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:58:11 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-b6b0310d-6a00-49dc-b5c6-9117098c352f tempest-VolumesTransfersV355Test-1202785932 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'] {{(pid=87272) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:58:11 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-b6b0310d-6a00-49dc-b5c6-9117098c352f tempest-VolumesTransfersV355Test-1202785932 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:58:11 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-b6b0310d-6a00-49dc-b5c6-9117098c352f tempest-VolumesTransfersV355Test-1202785932 None] Selected osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898 as target Quobyte volume. {{(pid=87272) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 10:58:11 devstack cinder-volume[87272]: INFO cinder.volume.drivers.remotefs [None req-b6b0310d-6a00-49dc-b5c6-9117098c352f tempest-VolumesTransfersV355Test-1202785932 None] casted to osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898 Nov 04 10:58:11 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-b6b0310d-6a00-49dc-b5c6-9117098c352f tempest-VolumesTransfersV355Test-1202785932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-9e400e03-8544-4536-9f97-dd0e39c2cd7a 1073741824 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:58:11 devstack sudo[97968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-9e400e03-8544-4536-9f97-dd0e39c2cd7a 1073741824 Nov 04 10:58:11 devstack sudo[97968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:58:11 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-455ced2e-17b7-4297-b78a-3bb437b5bfb6 tempest-VolumesSnapshotNegativeTestJSON-290076878 None] Create snapshot completed successfully Nov 04 10:58:11 devstack sudo[97964]: pam_unix(sudo:session): session closed for user root Nov 04 10:58:11 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [req-2ddf1734-d741-4796-94b8-8a364a827254 req-e285593c-872c-4f2a-a399-de9c76002299 tempest-VolumesSnapshotsTestJSON-935757216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-b29532ee-0002-4ed5-8e3b-d3c404fa6321" returned: 0 in 0.387s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:58:11 devstack cinder-volume[87272]: DEBUG cinder.coordination [req-2ddf1734-d741-4796-94b8-8a364a827254 req-e285593c-872c-4f2a-a399-de9c76002299 tempest-VolumesSnapshotsTestJSON-935757216 None] Lock "cinder-quobyte-b29532ee-0002-4ed5-8e3b-d3c404fa6321" released by "delete_volume" :: held 1.525s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:58:11 devstack cinder-volume[87272]: DEBUG cinder.quota [req-2ddf1734-d741-4796-94b8-8a364a827254 req-e285593c-872c-4f2a-a399-de9c76002299 tempest-VolumesSnapshotsTestJSON-935757216 None] Created reservations ['c13af5bc-6e44-4a76-b02c-ed1cb87e6730', '0f7bc835-e84a-4aa5-8de4-746033a76ba8', 'def56541-aff9-440d-832d-7b6cfbd0ea0f', 'a7d16a63-8690-45d9-b23e-7d5e9fb7def6'] {{(pid=87272) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 10:58:11 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [req-2ddf1734-d741-4796-94b8-8a364a827254 req-e285593c-872c-4f2a-a399-de9c76002299 tempest-VolumesSnapshotsTestJSON-935757216 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:58:11 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [req-2ddf1734-d741-4796-94b8-8a364a827254 req-e285593c-872c-4f2a-a399-de9c76002299 tempest-VolumesSnapshotsTestJSON-935757216 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:58:11 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [req-2ddf1734-d741-4796-94b8-8a364a827254 req-e285593c-872c-4f2a-a399-de9c76002299 tempest-VolumesSnapshotsTestJSON-935757216 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898': None} {{(pid=87272) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:58:11 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [req-2ddf1734-d741-4796-94b8-8a364a827254 req-e285593c-872c-4f2a-a399-de9c76002299 tempest-VolumesSnapshotsTestJSON-935757216 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'] {{(pid=87272) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:58:11 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [req-2ddf1734-d741-4796-94b8-8a364a827254 req-e285593c-872c-4f2a-a399-de9c76002299 tempest-VolumesSnapshotsTestJSON-935757216 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.046s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:58:11 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [req-2ddf1734-d741-4796-94b8-8a364a827254 req-e285593c-872c-4f2a-a399-de9c76002299 tempest-VolumesSnapshotsTestJSON-935757216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:58:11 devstack sudo[97992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1 Nov 04 10:58:11 devstack sudo[97992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:58:12 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-739df63f-afe0-40cf-b85f-282d3c4c80dc tempest-VolumesSnapshotNegativeTestJSON-290076878 None] Acquiring lock "cinder-340ba722-198b-413c-9e25-98bc0078a1bd-delete_snapshot" by "delete_snapshot" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:58:12 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-739df63f-afe0-40cf-b85f-282d3c4c80dc tempest-VolumesSnapshotNegativeTestJSON-290076878 None] Lock "cinder-340ba722-198b-413c-9e25-98bc0078a1bd-delete_snapshot" acquired by "delete_snapshot" :: waited 0.080s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:58:12 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-739df63f-afe0-40cf-b85f-282d3c4c80dc tempest-VolumesSnapshotNegativeTestJSON-290076878 None] Acquiring lock "cinder-quobyte-27990637-e1dd-45c7-b7ee-610535c5aa4c" by "delete_snapshot" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:58:12 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-739df63f-afe0-40cf-b85f-282d3c4c80dc tempest-VolumesSnapshotNegativeTestJSON-290076878 None] Lock "cinder-quobyte-27990637-e1dd-45c7-b7ee-610535c5aa4c" acquired by "delete_snapshot" :: waited 0.037s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:58:12 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-739df63f-afe0-40cf-b85f-282d3c4c80dc tempest-VolumesSnapshotNegativeTestJSON-290076878 None] Acquiring lock "cinder-quobyte-340ba722-198b-413c-9e25-98bc0078a1bd" by "_delete_snapshot" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:58:12 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-739df63f-afe0-40cf-b85f-282d3c4c80dc tempest-VolumesSnapshotNegativeTestJSON-290076878 None] Lock "cinder-quobyte-340ba722-198b-413c-9e25-98bc0078a1bd" acquired by "_delete_snapshot" :: waited 0.034s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:58:12 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.remotefs [None req-739df63f-afe0-40cf-b85f-282d3c4c80dc tempest-VolumesSnapshotNegativeTestJSON-290076878 None] Deleting offline snapshot 340ba722-198b-413c-9e25-98bc0078a1bd of volume 27990637-e1dd-45c7-b7ee-610535c5aa4c {{(pid=87272) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 04 10:58:12 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.remotefs [None req-739df63f-afe0-40cf-b85f-282d3c4c80dc tempest-VolumesSnapshotNegativeTestJSON-290076878 None] snapshot_file for this snap is: volume-27990637-e1dd-45c7-b7ee-610535c5aa4c.340ba722-198b-413c-9e25-98bc0078a1bd {{(pid=87272) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 04 10:58:12 devstack sudo[97992]: pam_unix(sudo:session): session closed for user root Nov 04 10:58:12 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [req-2ddf1734-d741-4796-94b8-8a364a827254 req-e285593c-872c-4f2a-a399-de9c76002299 tempest-VolumesSnapshotsTestJSON-935757216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1" returned: 0 in 0.636s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:58:12 devstack cinder-volume[87272]: DEBUG cinder.manager [req-2ddf1734-d741-4796-94b8-8a364a827254 req-e285593c-872c-4f2a-a399-de9c76002299 tempest-VolumesSnapshotsTestJSON-935757216 None] Notifying Schedulers of capabilities ... {{(pid=87272) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 10:58:12 devstack cinder-volume[87272]: DEBUG oslo.privsep.daemon [-] privsep: reply[44b5e621-2de6-4da4-9f79-85a368500abc]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:58:12 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-739df63f-afe0-40cf-b85f-282d3c4c80dc tempest-VolumesSnapshotNegativeTestJSON-290076878 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-27990637-e1dd-45c7-b7ee-610535c5aa4c.340ba722-198b-413c-9e25-98bc0078a1bd {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:58:12 devstack sudo[97968]: pam_unix(sudo:session): session closed for user root Nov 04 10:58:12 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-b6b0310d-6a00-49dc-b5c6-9117098c352f tempest-VolumesTransfersV355Test-1202785932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-9e400e03-8544-4536-9f97-dd0e39c2cd7a 1073741824" returned: 0 in 1.168s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:58:12 devstack cinder-volume[87272]: INFO cinder.volume.manager [req-2ddf1734-d741-4796-94b8-8a364a827254 req-e285593c-872c-4f2a-a399-de9c76002299 tempest-VolumesSnapshotsTestJSON-935757216 None] Deleted volume successfully. Nov 04 10:58:12 devstack cinder-volume[87272]: DEBUG cinder.coordination [req-2ddf1734-d741-4796-94b8-8a364a827254 req-e285593c-872c-4f2a-a399-de9c76002299 tempest-VolumesSnapshotsTestJSON-935757216 None] Lock "cinder-b29532ee-0002-4ed5-8e3b-d3c404fa6321-delete_volume" released by "delete_volume" :: held 2.903s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:58:12 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-b6b0310d-6a00-49dc-b5c6-9117098c352f tempest-VolumesTransfersV355Test-1202785932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-9e400e03-8544-4536-9f97-dd0e39c2cd7a {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:58:12 devstack sudo[97998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-9e400e03-8544-4536-9f97-dd0e39c2cd7a Nov 04 10:58:12 devstack sudo[97998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:58:12 devstack sudo[97997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-27990637-e1dd-45c7-b7ee-610535c5aa4c.340ba722-198b-413c-9e25-98bc0078a1bd Nov 04 10:58:12 devstack sudo[97997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:58:12 devstack sudo[97998]: pam_unix(sudo:session): session closed for user root Nov 04 10:58:12 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-b6b0310d-6a00-49dc-b5c6-9117098c352f tempest-VolumesTransfersV355Test-1202785932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-9e400e03-8544-4536-9f97-dd0e39c2cd7a" returned: 0 in 0.356s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:58:12 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-b6b0310d-6a00-49dc-b5c6-9117098c352f tempest-VolumesTransfersV355Test-1202785932 None] <== create_volume: return (1629ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'} {{(pid=87272) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 04 10:58:12 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-b6b0310d-6a00-49dc-b5c6-9117098c352f tempest-VolumesTransfersV355Test-1202785932 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.634s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:58:12 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-b6b0310d-6a00-49dc-b5c6-9117098c352f tempest-VolumesTransfersV355Test-1202785932 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5538af21-2102-42dc-9b19-a43785233785) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9e400e03-8544-4536-9f97-dd0e39c2cd7a', 'volume_size': 1}' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:58:12 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-b6b0310d-6a00-49dc-b5c6-9117098c352f tempest-VolumesTransfersV355Test-1202785932 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36880fc5-ce23-4fa4-b029-d26a237bbfed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:58:12 devstack cinder-volume[87272]: INFO cinder.volume.flows.manager.create_volume [None req-b6b0310d-6a00-49dc-b5c6-9117098c352f tempest-VolumesTransfersV355Test-1202785932 None] Volume volume-9e400e03-8544-4536-9f97-dd0e39c2cd7a (9e400e03-8544-4536-9f97-dd0e39c2cd7a): created successfully Nov 04 10:58:12 devstack sudo[97997]: pam_unix(sudo:session): session closed for user root Nov 04 10:58:12 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-b6b0310d-6a00-49dc-b5c6-9117098c352f tempest-VolumesTransfersV355Test-1202785932 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36880fc5-ce23-4fa4-b029-d26a237bbfed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:58:12 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-b6b0310d-6a00-49dc-b5c6-9117098c352f tempest-VolumesTransfersV355Test-1202785932 None] Flow 'volume_create_manager' (fb1baf37-9c6e-4f19-b6e9-570f9db9ac46) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87272) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:58:12 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-739df63f-afe0-40cf-b85f-282d3c4c80dc tempest-VolumesSnapshotNegativeTestJSON-290076878 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-27990637-e1dd-45c7-b7ee-610535c5aa4c.340ba722-198b-413c-9e25-98bc0078a1bd" returned: 0 in 0.556s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:58:12 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.remotefs [None req-739df63f-afe0-40cf-b85f-282d3c4c80dc tempest-VolumesSnapshotNegativeTestJSON-290076878 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-27990637-e1dd-45c7-b7ee-610535c5aa4c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87272) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 10:58:12 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-b6b0310d-6a00-49dc-b5c6-9117098c352f tempest-VolumesTransfersV355Test-1202785932 None] Created volume successfully. Nov 04 10:58:12 devstack cinder-volume[87272]: DEBUG oslo.privsep.daemon [-] privsep: reply[418d70c9-c320-4d86-90c7-ce397f7cbc56]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:58:12 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-739df63f-afe0-40cf-b85f-282d3c4c80dc tempest-VolumesSnapshotNegativeTestJSON-290076878 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-27990637-e1dd-45c7-b7ee-610535c5aa4c {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:58:13 devstack sudo[98005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-27990637-e1dd-45c7-b7ee-610535c5aa4c Nov 04 10:58:13 devstack sudo[98005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:58:13 devstack sudo[98005]: pam_unix(sudo:session): session closed for user root Nov 04 10:58:13 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-739df63f-afe0-40cf-b85f-282d3c4c80dc tempest-VolumesSnapshotNegativeTestJSON-290076878 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-27990637-e1dd-45c7-b7ee-610535c5aa4c" returned: 0 in 0.620s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:58:13 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-739df63f-afe0-40cf-b85f-282d3c4c80dc tempest-VolumesSnapshotNegativeTestJSON-290076878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-27990637-e1dd-45c7-b7ee-610535c5aa4c.340ba722-198b-413c-9e25-98bc0078a1bd {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:58:13 devstack sudo[98010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-27990637-e1dd-45c7-b7ee-610535c5aa4c.340ba722-198b-413c-9e25-98bc0078a1bd Nov 04 10:58:13 devstack sudo[98010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:58:14 devstack cinder-volume[87272]: DEBUG oslo_service.periodic_task [None req-236af0be-7f9d-4c80-b3d7-d645a9cd0dd1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87272) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 04 10:58:14 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-236af0be-7f9d-4c80-b3d7-d645a9cd0dd1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:58:14 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-236af0be-7f9d-4c80-b3d7-d645a9cd0dd1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:58:14 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-236af0be-7f9d-4c80-b3d7-d645a9cd0dd1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898': None} {{(pid=87272) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:58:14 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-236af0be-7f9d-4c80-b3d7-d645a9cd0dd1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'] {{(pid=87272) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:58:14 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-236af0be-7f9d-4c80-b3d7-d645a9cd0dd1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:58:14 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-236af0be-7f9d-4c80-b3d7-d645a9cd0dd1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:58:14 devstack sudo[98028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1 Nov 04 10:58:14 devstack sudo[98028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:58:14 devstack sudo[98010]: pam_unix(sudo:session): session closed for user root Nov 04 10:58:14 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-739df63f-afe0-40cf-b85f-282d3c4c80dc tempest-VolumesSnapshotNegativeTestJSON-290076878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-27990637-e1dd-45c7-b7ee-610535c5aa4c.340ba722-198b-413c-9e25-98bc0078a1bd" returned: 0 in 0.698s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:58:14 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-739df63f-afe0-40cf-b85f-282d3c4c80dc tempest-VolumesSnapshotNegativeTestJSON-290076878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-27990637-e1dd-45c7-b7ee-610535c5aa4c.340ba722-198b-413c-9e25-98bc0078a1bd {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:58:14 devstack sudo[98033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-27990637-e1dd-45c7-b7ee-610535c5aa4c.340ba722-198b-413c-9e25-98bc0078a1bd Nov 04 10:58:14 devstack sudo[98033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:58:14 devstack sudo[98033]: pam_unix(sudo:session): session closed for user root Nov 04 10:58:14 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-739df63f-afe0-40cf-b85f-282d3c4c80dc tempest-VolumesSnapshotNegativeTestJSON-290076878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-27990637-e1dd-45c7-b7ee-610535c5aa4c.340ba722-198b-413c-9e25-98bc0078a1bd" returned: 0 in 0.431s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:58:14 devstack sudo[98028]: pam_unix(sudo:session): session closed for user root Nov 04 10:58:14 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-739df63f-afe0-40cf-b85f-282d3c4c80dc tempest-VolumesSnapshotNegativeTestJSON-290076878 None] Lock "cinder-quobyte-340ba722-198b-413c-9e25-98bc0078a1bd" released by "_delete_snapshot" :: held 2.544s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:58:14 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-236af0be-7f9d-4c80-b3d7-d645a9cd0dd1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1" returned: 0 in 0.617s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:58:14 devstack cinder-volume[87272]: DEBUG cinder.manager [None req-236af0be-7f9d-4c80-b3d7-d645a9cd0dd1 None None] Notifying Schedulers of capabilities ... {{(pid=87272) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 10:58:14 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-739df63f-afe0-40cf-b85f-282d3c4c80dc tempest-VolumesSnapshotNegativeTestJSON-290076878 None] Lock "cinder-quobyte-27990637-e1dd-45c7-b7ee-610535c5aa4c" released by "delete_snapshot" :: held 2.589s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:58:14 devstack cinder-volume[87272]: DEBUG oslo_service.periodic_task [None req-236af0be-7f9d-4c80-b3d7-d645a9cd0dd1 None None] Running periodic task VolumeManager._thread_info {{(pid=87272) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 04 10:58:14 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-236af0be-7f9d-4c80-b3d7-d645a9cd0dd1 None None] thread count: 28 {{(pid=87272) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 04 10:58:14 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-236af0be-7f9d-4c80-b3d7-d645a9cd0dd1 None None] thread info: [<_MainThread(MainThread, started 127085713244288)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87272) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 04 10:58:14 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-16aca4f0-32e0-49e7-9c0c-cc0b350132a7 tempest-VolumesTransfersV355Test-303860919 None] Transfer volume completed successfully. Nov 04 10:58:14 devstack cinder-volume[87272]: DEBUG cinder.quota [None req-739df63f-afe0-40cf-b85f-282d3c4c80dc tempest-VolumesSnapshotNegativeTestJSON-290076878 None] Created reservations ['d957cb7c-a7c4-4c1b-863e-56b751a9d97a', '2f28e79c-7d87-49a0-8417-677bc02d3f2f', 'b560319f-c313-47ea-ab6b-5bd8d9d256f7', '1884823b-e3fd-4dcb-866d-f709fa086115'] {{(pid=87272) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 10:58:15 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-739df63f-afe0-40cf-b85f-282d3c4c80dc tempest-VolumesSnapshotNegativeTestJSON-290076878 None] Delete snapshot completed successfully. Nov 04 10:58:15 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-739df63f-afe0-40cf-b85f-282d3c4c80dc tempest-VolumesSnapshotNegativeTestJSON-290076878 None] Lock "cinder-340ba722-198b-413c-9e25-98bc0078a1bd-delete_snapshot" released by "delete_snapshot" :: held 2.902s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:58:15 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-c4ea26db-7517-46d6-bd90-5ac22e82e6eb tempest-VolumesSnapshotNegativeTestJSON-290076878 None] Acquiring lock "cinder-27990637-e1dd-45c7-b7ee-610535c5aa4c-delete_volume" by "delete_volume" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:58:15 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-c4ea26db-7517-46d6-bd90-5ac22e82e6eb tempest-VolumesSnapshotNegativeTestJSON-290076878 None] Lock "cinder-27990637-e1dd-45c7-b7ee-610535c5aa4c-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:58:15 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-c4ea26db-7517-46d6-bd90-5ac22e82e6eb tempest-VolumesSnapshotNegativeTestJSON-290076878 None] Acquiring lock "cinder-quobyte-27990637-e1dd-45c7-b7ee-610535c5aa4c" by "delete_volume" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:58:15 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-c4ea26db-7517-46d6-bd90-5ac22e82e6eb tempest-VolumesSnapshotNegativeTestJSON-290076878 None] Lock "cinder-quobyte-27990637-e1dd-45c7-b7ee-610535c5aa4c" acquired by "delete_volume" :: waited 0.038s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:58:15 devstack cinder-volume[87272]: DEBUG oslo.privsep.daemon [-] privsep: reply[74b32e14-93fc-418e-b360-7b7f32d5be40]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:58:15 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-c4ea26db-7517-46d6-bd90-5ac22e82e6eb tempest-VolumesSnapshotNegativeTestJSON-290076878 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-27990637-e1dd-45c7-b7ee-610535c5aa4c {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:58:15 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-bd749f18-682c-4969-afa9-1a5686928573 tempest-VolumesTransfersV355Test-2078413015 None] Acquiring lock "cinder-9e400e03-8544-4536-9f97-dd0e39c2cd7a-delete_volume" by "delete_volume" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:58:16 devstack sudo[98049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-27990637-e1dd-45c7-b7ee-610535c5aa4c Nov 04 10:58:16 devstack sudo[98049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:58:16 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-bd749f18-682c-4969-afa9-1a5686928573 tempest-VolumesTransfersV355Test-2078413015 None] Lock "cinder-9e400e03-8544-4536-9f97-dd0e39c2cd7a-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:58:16 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-bd749f18-682c-4969-afa9-1a5686928573 tempest-VolumesTransfersV355Test-2078413015 None] Acquiring lock "cinder-quobyte-9e400e03-8544-4536-9f97-dd0e39c2cd7a" by "delete_volume" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:58:16 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-bd749f18-682c-4969-afa9-1a5686928573 tempest-VolumesTransfersV355Test-2078413015 None] Lock "cinder-quobyte-9e400e03-8544-4536-9f97-dd0e39c2cd7a" acquired by "delete_volume" :: waited 0.024s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:58:16 devstack cinder-volume[87272]: DEBUG oslo.privsep.daemon [-] privsep: reply[f32d4725-3b2c-43a6-9552-3ad184a1894f]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:58:16 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-bd749f18-682c-4969-afa9-1a5686928573 tempest-VolumesTransfersV355Test-2078413015 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-9e400e03-8544-4536-9f97-dd0e39c2cd7a {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:58:16 devstack sudo[98052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-9e400e03-8544-4536-9f97-dd0e39c2cd7a Nov 04 10:58:16 devstack sudo[98052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:58:16 devstack sudo[98049]: pam_unix(sudo:session): session closed for user root Nov 04 10:58:16 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-c4ea26db-7517-46d6-bd90-5ac22e82e6eb tempest-VolumesSnapshotNegativeTestJSON-290076878 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-27990637-e1dd-45c7-b7ee-610535c5aa4c" returned: 0 in 0.513s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:58:16 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-c4ea26db-7517-46d6-bd90-5ac22e82e6eb tempest-VolumesSnapshotNegativeTestJSON-290076878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-27990637-e1dd-45c7-b7ee-610535c5aa4c {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:58:16 devstack sudo[98057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-27990637-e1dd-45c7-b7ee-610535c5aa4c Nov 04 10:58:16 devstack sudo[98057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:58:16 devstack sudo[98052]: pam_unix(sudo:session): session closed for user root Nov 04 10:58:16 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-bd749f18-682c-4969-afa9-1a5686928573 tempest-VolumesTransfersV355Test-2078413015 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-9e400e03-8544-4536-9f97-dd0e39c2cd7a" returned: 0 in 0.452s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:58:16 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-bd749f18-682c-4969-afa9-1a5686928573 tempest-VolumesTransfersV355Test-2078413015 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-9e400e03-8544-4536-9f97-dd0e39c2cd7a {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:58:16 devstack sudo[98062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-9e400e03-8544-4536-9f97-dd0e39c2cd7a Nov 04 10:58:16 devstack sudo[98062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:58:16 devstack sudo[98057]: pam_unix(sudo:session): session closed for user root Nov 04 10:58:16 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-c4ea26db-7517-46d6-bd90-5ac22e82e6eb tempest-VolumesSnapshotNegativeTestJSON-290076878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-27990637-e1dd-45c7-b7ee-610535c5aa4c" returned: 0 in 0.332s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:58:16 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-c4ea26db-7517-46d6-bd90-5ac22e82e6eb tempest-VolumesSnapshotNegativeTestJSON-290076878 None] Lock "cinder-quobyte-27990637-e1dd-45c7-b7ee-610535c5aa4c" released by "delete_volume" :: held 0.964s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:58:16 devstack cinder-volume[87272]: DEBUG cinder.quota [None req-c4ea26db-7517-46d6-bd90-5ac22e82e6eb tempest-VolumesSnapshotNegativeTestJSON-290076878 None] Created reservations ['020e89fc-1fbc-4455-bdd2-ee7fec169223', 'c34895d7-d861-4ae2-bb24-febfe8b33fbf', '5c704153-8db6-491b-ab08-b65178865e77', 'b0d36915-727f-4ae3-8d3d-521c15818c08'] {{(pid=87272) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 10:58:16 devstack sudo[98062]: pam_unix(sudo:session): session closed for user root Nov 04 10:58:16 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-bd749f18-682c-4969-afa9-1a5686928573 tempest-VolumesTransfersV355Test-2078413015 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-9e400e03-8544-4536-9f97-dd0e39c2cd7a" returned: 0 in 0.320s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:58:16 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-bd749f18-682c-4969-afa9-1a5686928573 tempest-VolumesTransfersV355Test-2078413015 None] Lock "cinder-quobyte-9e400e03-8544-4536-9f97-dd0e39c2cd7a" released by "delete_volume" :: held 0.841s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:58:16 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-c4ea26db-7517-46d6-bd90-5ac22e82e6eb tempest-VolumesSnapshotNegativeTestJSON-290076878 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:58:17 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-c4ea26db-7517-46d6-bd90-5ac22e82e6eb tempest-VolumesSnapshotNegativeTestJSON-290076878 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:58:17 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-c4ea26db-7517-46d6-bd90-5ac22e82e6eb tempest-VolumesSnapshotNegativeTestJSON-290076878 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898': None} {{(pid=87272) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:58:17 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-c4ea26db-7517-46d6-bd90-5ac22e82e6eb tempest-VolumesSnapshotNegativeTestJSON-290076878 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'] {{(pid=87272) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:58:17 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-c4ea26db-7517-46d6-bd90-5ac22e82e6eb tempest-VolumesSnapshotNegativeTestJSON-290076878 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:58:17 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-c4ea26db-7517-46d6-bd90-5ac22e82e6eb tempest-VolumesSnapshotNegativeTestJSON-290076878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:58:17 devstack sudo[98066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1 Nov 04 10:58:17 devstack sudo[98066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:58:17 devstack cinder-volume[87272]: DEBUG cinder.quota [None req-bd749f18-682c-4969-afa9-1a5686928573 tempest-VolumesTransfersV355Test-2078413015 None] Created reservations ['2f69e97e-b39b-433d-8efa-723e0c10f2ed', 'aeecd4be-4b71-4ee8-85f7-9e3277e32352', '8a7ce327-21c3-44d0-925e-faccbc18da8d', '1e0a2daa-ee04-469b-9a3c-b483903ee70f'] {{(pid=87272) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 10:58:17 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-bd749f18-682c-4969-afa9-1a5686928573 tempest-VolumesTransfersV355Test-2078413015 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:58:17 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-bd749f18-682c-4969-afa9-1a5686928573 tempest-VolumesTransfersV355Test-2078413015 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:58:17 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-bd749f18-682c-4969-afa9-1a5686928573 tempest-VolumesTransfersV355Test-2078413015 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898': None} {{(pid=87272) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:58:17 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-bd749f18-682c-4969-afa9-1a5686928573 tempest-VolumesTransfersV355Test-2078413015 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'] {{(pid=87272) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:58:17 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-bd749f18-682c-4969-afa9-1a5686928573 tempest-VolumesTransfersV355Test-2078413015 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:58:17 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-bd749f18-682c-4969-afa9-1a5686928573 tempest-VolumesTransfersV355Test-2078413015 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:58:17 devstack sudo[98068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1 Nov 04 10:58:17 devstack sudo[98068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:58:17 devstack sudo[98066]: pam_unix(sudo:session): session closed for user root Nov 04 10:58:17 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-c4ea26db-7517-46d6-bd90-5ac22e82e6eb tempest-VolumesSnapshotNegativeTestJSON-290076878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1" returned: 0 in 0.357s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:58:17 devstack cinder-volume[87272]: DEBUG cinder.manager [None req-c4ea26db-7517-46d6-bd90-5ac22e82e6eb tempest-VolumesSnapshotNegativeTestJSON-290076878 None] Notifying Schedulers of capabilities ... {{(pid=87272) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 10:58:17 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-c4ea26db-7517-46d6-bd90-5ac22e82e6eb tempest-VolumesSnapshotNegativeTestJSON-290076878 None] Deleted volume successfully. Nov 04 10:58:17 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-c4ea26db-7517-46d6-bd90-5ac22e82e6eb tempest-VolumesSnapshotNegativeTestJSON-290076878 None] Lock "cinder-27990637-e1dd-45c7-b7ee-610535c5aa4c-delete_volume" released by "delete_volume" :: held 1.759s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:58:17 devstack sudo[98068]: pam_unix(sudo:session): session closed for user root Nov 04 10:58:17 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-bd749f18-682c-4969-afa9-1a5686928573 tempest-VolumesTransfersV355Test-2078413015 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1" returned: 0 in 0.301s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:58:17 devstack cinder-volume[87272]: DEBUG cinder.manager [None req-bd749f18-682c-4969-afa9-1a5686928573 tempest-VolumesTransfersV355Test-2078413015 None] Notifying Schedulers of capabilities ... {{(pid=87272) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 10:58:17 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-bd749f18-682c-4969-afa9-1a5686928573 tempest-VolumesTransfersV355Test-2078413015 None] Deleted volume successfully. Nov 04 10:58:17 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-bd749f18-682c-4969-afa9-1a5686928573 tempest-VolumesTransfersV355Test-2078413015 None] Lock "cinder-9e400e03-8544-4536-9f97-dd0e39c2cd7a-delete_volume" released by "delete_volume" :: held 1.523s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:58:18 devstack cinder-volume[87272]: DEBUG cinder.volume.flows.manager.create_volume [None req-4038086d-6f91-468d-ba8b-e04f7242d972 tempest-ServersNegativeTestJSON-251354568 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87272) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 10:58:18 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-4038086d-6f91-468d-ba8b-e04f7242d972 tempest-ServersNegativeTestJSON-251354568 None] Flow 'volume_create_manager' (54197260-9950-4807-b1c8-9c9aa5983adf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:58:18 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-4038086d-6f91-468d-ba8b-e04f7242d972 tempest-ServersNegativeTestJSON-251354568 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4266cf50-5428-49f9-b70f-07919055a4b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:58:18 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-4038086d-6f91-468d-ba8b-e04f7242d972 tempest-ServersNegativeTestJSON-251354568 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4266cf50-5428-49f9-b70f-07919055a4b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T09:58:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1989614295',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da77fc8b-69ac-4e37-86cc-ea4f77f86a6b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='179004d11b4f44edaddb36a8427f1893',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T09:58:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T09:58:18Z,use_quota=True,user_id='f7b120e3b5e6492aa7b9ac6a9ac6331f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8989e4f-21e3-4f0a-9584-0d818784e883),volume_type_id=f8989e4f-21e3-4f0a-9584-0d818784e883)' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:58:18 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-4038086d-6f91-468d-ba8b-e04f7242d972 tempest-ServersNegativeTestJSON-251354568 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de47819c-d717-4cc8-8572-1c893c46c906) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:58:18 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-4038086d-6f91-468d-ba8b-e04f7242d972 tempest-ServersNegativeTestJSON-251354568 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de47819c-d717-4cc8-8572-1c893c46c906) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:58:18 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-4038086d-6f91-468d-ba8b-e04f7242d972 tempest-ServersNegativeTestJSON-251354568 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fed0b76b-b350-46fd-ac16-6d4883b214ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:58:18 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-4038086d-6f91-468d-ba8b-e04f7242d972 tempest-ServersNegativeTestJSON-251354568 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fed0b76b-b350-46fd-ac16-6d4883b214ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'da77fc8b-69ac-4e37-86cc-ea4f77f86a6b', 'volume_name': 'volume-da77fc8b-69ac-4e37-86cc-ea4f77f86a6b', 'volume_size': 1}' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:58:18 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-4038086d-6f91-468d-ba8b-e04f7242d972 tempest-ServersNegativeTestJSON-251354568 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (32aa777d-aa4a-4bdd-8bf0-644d9679abed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:58:18 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-4038086d-6f91-468d-ba8b-e04f7242d972 tempest-ServersNegativeTestJSON-251354568 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (32aa777d-aa4a-4bdd-8bf0-644d9679abed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:58:18 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-4038086d-6f91-468d-ba8b-e04f7242d972 tempest-ServersNegativeTestJSON-251354568 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (62976fe6-754d-47f3-b9bc-22fabce72571) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:58:18 devstack cinder-volume[87272]: INFO cinder.volume.flows.manager.create_volume [None req-4038086d-6f91-468d-ba8b-e04f7242d972 tempest-ServersNegativeTestJSON-251354568 None] Volume da77fc8b-69ac-4e37-86cc-ea4f77f86a6b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-da77fc8b-69ac-4e37-86cc-ea4f77f86a6b', 'volume_size': 1} Nov 04 10:58:18 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-4038086d-6f91-468d-ba8b-e04f7242d972 tempest-ServersNegativeTestJSON-251354568 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:58:18 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-4038086d-6f91-468d-ba8b-e04f7242d972 tempest-ServersNegativeTestJSON-251354568 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:58:18 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-4038086d-6f91-468d-ba8b-e04f7242d972 tempest-ServersNegativeTestJSON-251354568 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T09:58:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1989614295',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da77fc8b-69ac-4e37-86cc-ea4f77f86a6b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='179004d11b4f44edaddb36a8427f1893',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T09:58:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T09:58:18Z,use_quota=True,user_id='f7b120e3b5e6492aa7b9ac6a9ac6331f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8989e4f-21e3-4f0a-9584-0d818784e883),volume_type_id=f8989e4f-21e3-4f0a-9584-0d818784e883)}" {{(pid=87272) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 04 10:58:18 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.remotefs [None req-4038086d-6f91-468d-ba8b-e04f7242d972 tempest-ServersNegativeTestJSON-251354568 None] Creating volume da77fc8b-69ac-4e37-86cc-ea4f77f86a6b {{(pid=87272) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 10:58:18 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-4038086d-6f91-468d-ba8b-e04f7242d972 tempest-ServersNegativeTestJSON-251354568 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:58:18 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-4038086d-6f91-468d-ba8b-e04f7242d972 tempest-ServersNegativeTestJSON-251354568 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:58:18 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-4038086d-6f91-468d-ba8b-e04f7242d972 tempest-ServersNegativeTestJSON-251354568 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898': None} {{(pid=87272) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:58:18 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-4038086d-6f91-468d-ba8b-e04f7242d972 tempest-ServersNegativeTestJSON-251354568 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'] {{(pid=87272) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:58:18 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-4038086d-6f91-468d-ba8b-e04f7242d972 tempest-ServersNegativeTestJSON-251354568 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:58:18 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-4038086d-6f91-468d-ba8b-e04f7242d972 tempest-ServersNegativeTestJSON-251354568 None] Selected osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898 as target Quobyte volume. {{(pid=87272) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 10:58:18 devstack cinder-volume[87272]: INFO cinder.volume.drivers.remotefs [None req-4038086d-6f91-468d-ba8b-e04f7242d972 tempest-ServersNegativeTestJSON-251354568 None] casted to osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898 Nov 04 10:58:18 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-4038086d-6f91-468d-ba8b-e04f7242d972 tempest-ServersNegativeTestJSON-251354568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-da77fc8b-69ac-4e37-86cc-ea4f77f86a6b 1073741824 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:58:18 devstack sudo[98072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-da77fc8b-69ac-4e37-86cc-ea4f77f86a6b 1073741824 Nov 04 10:58:18 devstack sudo[98072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:58:18 devstack cinder-volume[87272]: DEBUG cinder.volume.flows.manager.create_volume [req-50fb630e-a5a5-4988-b675-fbfee4c86e8b req-9ab4a031-39ec-4197-be02-e34d274eddf2 tempest-VolumesGetTestJSON-1847012015 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87272) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 10:58:18 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [req-50fb630e-a5a5-4988-b675-fbfee4c86e8b req-9ab4a031-39ec-4197-be02-e34d274eddf2 tempest-VolumesGetTestJSON-1847012015 None] Flow 'volume_create_manager' (0a8074c0-27c9-4d04-83af-9cde656488fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:58:18 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [req-50fb630e-a5a5-4988-b675-fbfee4c86e8b req-9ab4a031-39ec-4197-be02-e34d274eddf2 tempest-VolumesGetTestJSON-1847012015 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d0062b0-d2ab-4c5c-81ea-b238ee5b7474) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:58:18 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [req-50fb630e-a5a5-4988-b675-fbfee4c86e8b req-9ab4a031-39ec-4197-be02-e34d274eddf2 tempest-VolumesGetTestJSON-1847012015 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d0062b0-d2ab-4c5c-81ea-b238ee5b7474) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T09:58:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1226848961',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=902e6afe-58cd-41b6-b724-0e100ed89c45,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='e99ac40750b9464d8577f1b0522fce82',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T09:58:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T09:58:18Z,use_quota=True,user_id='af72997e41e34a0c9a84b039d739a259',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8989e4f-21e3-4f0a-9584-0d818784e883),volume_type_id=f8989e4f-21e3-4f0a-9584-0d818784e883)' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:58:18 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [req-50fb630e-a5a5-4988-b675-fbfee4c86e8b req-9ab4a031-39ec-4197-be02-e34d274eddf2 tempest-VolumesGetTestJSON-1847012015 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf7a7b1f-c488-44f5-a0dc-b8abd4d46d19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:58:18 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [req-50fb630e-a5a5-4988-b675-fbfee4c86e8b req-9ab4a031-39ec-4197-be02-e34d274eddf2 tempest-VolumesGetTestJSON-1847012015 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf7a7b1f-c488-44f5-a0dc-b8abd4d46d19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:58:18 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [req-50fb630e-a5a5-4988-b675-fbfee4c86e8b req-9ab4a031-39ec-4197-be02-e34d274eddf2 tempest-VolumesGetTestJSON-1847012015 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e4072f7b-cffb-4c47-82b4-76a91f3cc3ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:58:18 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [req-50fb630e-a5a5-4988-b675-fbfee4c86e8b req-9ab4a031-39ec-4197-be02-e34d274eddf2 tempest-VolumesGetTestJSON-1847012015 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e4072f7b-cffb-4c47-82b4-76a91f3cc3ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '902e6afe-58cd-41b6-b724-0e100ed89c45', 'volume_name': 'volume-902e6afe-58cd-41b6-b724-0e100ed89c45', 'volume_size': 1}' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:58:18 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [req-50fb630e-a5a5-4988-b675-fbfee4c86e8b req-9ab4a031-39ec-4197-be02-e34d274eddf2 tempest-VolumesGetTestJSON-1847012015 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f71a9c4-d609-4312-9e6d-253fef381d41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:58:18 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [req-50fb630e-a5a5-4988-b675-fbfee4c86e8b req-9ab4a031-39ec-4197-be02-e34d274eddf2 tempest-VolumesGetTestJSON-1847012015 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f71a9c4-d609-4312-9e6d-253fef381d41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:58:18 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [req-50fb630e-a5a5-4988-b675-fbfee4c86e8b req-9ab4a031-39ec-4197-be02-e34d274eddf2 tempest-VolumesGetTestJSON-1847012015 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8386f72a-0b4c-49cb-a1fb-ca5cd0ce1373) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:58:18 devstack cinder-volume[87272]: INFO cinder.volume.flows.manager.create_volume [req-50fb630e-a5a5-4988-b675-fbfee4c86e8b req-9ab4a031-39ec-4197-be02-e34d274eddf2 tempest-VolumesGetTestJSON-1847012015 None] Volume 902e6afe-58cd-41b6-b724-0e100ed89c45: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-902e6afe-58cd-41b6-b724-0e100ed89c45', 'volume_size': 1} Nov 04 10:58:18 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [req-50fb630e-a5a5-4988-b675-fbfee4c86e8b req-9ab4a031-39ec-4197-be02-e34d274eddf2 tempest-VolumesGetTestJSON-1847012015 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:58:18 devstack sudo[98072]: pam_unix(sudo:session): session closed for user root Nov 04 10:58:18 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-4038086d-6f91-468d-ba8b-e04f7242d972 tempest-ServersNegativeTestJSON-251354568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-da77fc8b-69ac-4e37-86cc-ea4f77f86a6b 1073741824" returned: 0 in 0.689s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:58:18 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-4038086d-6f91-468d-ba8b-e04f7242d972 tempest-ServersNegativeTestJSON-251354568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-da77fc8b-69ac-4e37-86cc-ea4f77f86a6b {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:58:18 devstack sudo[98078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-da77fc8b-69ac-4e37-86cc-ea4f77f86a6b Nov 04 10:58:18 devstack sudo[98078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:58:19 devstack cinder-volume[87272]: DEBUG cinder.volume.flows.manager.create_volume [None req-54c92395-a67b-49a3-befa-d46f79838c21 tempest-VolumesTransfersV355Test-1202785932 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87272) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 10:58:19 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-54c92395-a67b-49a3-befa-d46f79838c21 tempest-VolumesTransfersV355Test-1202785932 None] Flow 'volume_create_manager' (a44a421c-ac39-4d61-82d8-cf955d59ebcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:58:19 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-54c92395-a67b-49a3-befa-d46f79838c21 tempest-VolumesTransfersV355Test-1202785932 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8486716-821f-4740-b620-4cacb2e0ac78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:58:19 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-54c92395-a67b-49a3-befa-d46f79838c21 tempest-VolumesTransfersV355Test-1202785932 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8486716-821f-4740-b620-4cacb2e0ac78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T09:58:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-260004221',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a2e1779a-0434-4a5a-8f29-3bd53f1c85c9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='28060fd89cb64e1f89ac53367553a310',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T09:58:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T09:58:19Z,use_quota=True,user_id='fdc202872c1d4218a78ab11d8dc8bd62',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8989e4f-21e3-4f0a-9584-0d818784e883),volume_type_id=f8989e4f-21e3-4f0a-9584-0d818784e883)' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:58:19 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-54c92395-a67b-49a3-befa-d46f79838c21 tempest-VolumesTransfersV355Test-1202785932 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc6a16a7-2f60-4c48-b996-1b57a3fd31f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:58:19 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-54c92395-a67b-49a3-befa-d46f79838c21 tempest-VolumesTransfersV355Test-1202785932 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc6a16a7-2f60-4c48-b996-1b57a3fd31f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:58:19 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-54c92395-a67b-49a3-befa-d46f79838c21 tempest-VolumesTransfersV355Test-1202785932 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b13b3a70-6016-4f79-9cef-31e4df0a02d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:58:19 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-54c92395-a67b-49a3-befa-d46f79838c21 tempest-VolumesTransfersV355Test-1202785932 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b13b3a70-6016-4f79-9cef-31e4df0a02d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a2e1779a-0434-4a5a-8f29-3bd53f1c85c9', 'volume_name': 'volume-a2e1779a-0434-4a5a-8f29-3bd53f1c85c9', 'volume_size': 1}' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:58:19 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-54c92395-a67b-49a3-befa-d46f79838c21 tempest-VolumesTransfersV355Test-1202785932 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a60020b1-a7aa-40e9-9f34-b526c15097f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:58:19 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-54c92395-a67b-49a3-befa-d46f79838c21 tempest-VolumesTransfersV355Test-1202785932 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a60020b1-a7aa-40e9-9f34-b526c15097f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:58:19 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-54c92395-a67b-49a3-befa-d46f79838c21 tempest-VolumesTransfersV355Test-1202785932 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ef2496f-0b83-4253-a109-c92fcf885041) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:58:19 devstack cinder-volume[87272]: INFO cinder.volume.flows.manager.create_volume [None req-54c92395-a67b-49a3-befa-d46f79838c21 tempest-VolumesTransfersV355Test-1202785932 None] Volume a2e1779a-0434-4a5a-8f29-3bd53f1c85c9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a2e1779a-0434-4a5a-8f29-3bd53f1c85c9', 'volume_size': 1} Nov 04 10:58:19 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-54c92395-a67b-49a3-befa-d46f79838c21 tempest-VolumesTransfersV355Test-1202785932 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:58:19 devstack sudo[98078]: pam_unix(sudo:session): session closed for user root Nov 04 10:58:19 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-4038086d-6f91-468d-ba8b-e04f7242d972 tempest-ServersNegativeTestJSON-251354568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-da77fc8b-69ac-4e37-86cc-ea4f77f86a6b" returned: 0 in 0.349s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:58:19 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-4038086d-6f91-468d-ba8b-e04f7242d972 tempest-ServersNegativeTestJSON-251354568 None] <== create_volume: return (1174ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'} {{(pid=87272) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 04 10:58:19 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-4038086d-6f91-468d-ba8b-e04f7242d972 tempest-ServersNegativeTestJSON-251354568 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.177s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:58:19 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [req-50fb630e-a5a5-4988-b675-fbfee4c86e8b req-9ab4a031-39ec-4197-be02-e34d274eddf2 tempest-VolumesGetTestJSON-1847012015 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.740s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:58:19 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [req-50fb630e-a5a5-4988-b675-fbfee4c86e8b req-9ab4a031-39ec-4197-be02-e34d274eddf2 tempest-VolumesGetTestJSON-1847012015 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T09:58:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1226848961',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=902e6afe-58cd-41b6-b724-0e100ed89c45,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='e99ac40750b9464d8577f1b0522fce82',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T09:58:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T09:58:18Z,use_quota=True,user_id='af72997e41e34a0c9a84b039d739a259',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8989e4f-21e3-4f0a-9584-0d818784e883),volume_type_id=f8989e4f-21e3-4f0a-9584-0d818784e883)}" {{(pid=87272) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 04 10:58:19 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.remotefs [req-50fb630e-a5a5-4988-b675-fbfee4c86e8b req-9ab4a031-39ec-4197-be02-e34d274eddf2 tempest-VolumesGetTestJSON-1847012015 None] Creating volume 902e6afe-58cd-41b6-b724-0e100ed89c45 {{(pid=87272) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 10:58:19 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [req-50fb630e-a5a5-4988-b675-fbfee4c86e8b req-9ab4a031-39ec-4197-be02-e34d274eddf2 tempest-VolumesGetTestJSON-1847012015 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:58:19 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [req-50fb630e-a5a5-4988-b675-fbfee4c86e8b req-9ab4a031-39ec-4197-be02-e34d274eddf2 tempest-VolumesGetTestJSON-1847012015 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:58:19 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [req-50fb630e-a5a5-4988-b675-fbfee4c86e8b req-9ab4a031-39ec-4197-be02-e34d274eddf2 tempest-VolumesGetTestJSON-1847012015 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898': None} {{(pid=87272) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:58:19 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [req-50fb630e-a5a5-4988-b675-fbfee4c86e8b req-9ab4a031-39ec-4197-be02-e34d274eddf2 tempest-VolumesGetTestJSON-1847012015 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'] {{(pid=87272) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:58:19 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [req-50fb630e-a5a5-4988-b675-fbfee4c86e8b req-9ab4a031-39ec-4197-be02-e34d274eddf2 tempest-VolumesGetTestJSON-1847012015 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:58:19 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [req-50fb630e-a5a5-4988-b675-fbfee4c86e8b req-9ab4a031-39ec-4197-be02-e34d274eddf2 tempest-VolumesGetTestJSON-1847012015 None] Selected osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898 as target Quobyte volume. {{(pid=87272) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 10:58:19 devstack cinder-volume[87272]: INFO cinder.volume.drivers.remotefs [req-50fb630e-a5a5-4988-b675-fbfee4c86e8b req-9ab4a031-39ec-4197-be02-e34d274eddf2 tempest-VolumesGetTestJSON-1847012015 None] casted to osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898 Nov 04 10:58:19 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [req-50fb630e-a5a5-4988-b675-fbfee4c86e8b req-9ab4a031-39ec-4197-be02-e34d274eddf2 tempest-VolumesGetTestJSON-1847012015 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-902e6afe-58cd-41b6-b724-0e100ed89c45 1073741824 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:58:19 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-4038086d-6f91-468d-ba8b-e04f7242d972 tempest-ServersNegativeTestJSON-251354568 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (62976fe6-754d-47f3-b9bc-22fabce72571) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-da77fc8b-69ac-4e37-86cc-ea4f77f86a6b', 'volume_size': 1}' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:58:19 devstack sudo[98081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-902e6afe-58cd-41b6-b724-0e100ed89c45 1073741824 Nov 04 10:58:19 devstack sudo[98081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:58:19 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-4038086d-6f91-468d-ba8b-e04f7242d972 tempest-ServersNegativeTestJSON-251354568 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6928dc25-3fd1-4c74-abf7-53fb2d1b7e9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:58:19 devstack cinder-volume[87272]: INFO cinder.volume.flows.manager.create_volume [None req-4038086d-6f91-468d-ba8b-e04f7242d972 tempest-ServersNegativeTestJSON-251354568 None] Volume volume-da77fc8b-69ac-4e37-86cc-ea4f77f86a6b (da77fc8b-69ac-4e37-86cc-ea4f77f86a6b): created successfully Nov 04 10:58:19 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-4038086d-6f91-468d-ba8b-e04f7242d972 tempest-ServersNegativeTestJSON-251354568 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6928dc25-3fd1-4c74-abf7-53fb2d1b7e9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:58:19 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-4038086d-6f91-468d-ba8b-e04f7242d972 tempest-ServersNegativeTestJSON-251354568 None] Flow 'volume_create_manager' (54197260-9950-4807-b1c8-9c9aa5983adf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87272) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:58:19 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-4038086d-6f91-468d-ba8b-e04f7242d972 tempest-ServersNegativeTestJSON-251354568 None] Created volume successfully. Nov 04 10:58:19 devstack sudo[98081]: pam_unix(sudo:session): session closed for user root Nov 04 10:58:19 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [req-50fb630e-a5a5-4988-b675-fbfee4c86e8b req-9ab4a031-39ec-4197-be02-e34d274eddf2 tempest-VolumesGetTestJSON-1847012015 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-902e6afe-58cd-41b6-b724-0e100ed89c45 1073741824" returned: 0 in 0.535s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:58:19 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [req-50fb630e-a5a5-4988-b675-fbfee4c86e8b req-9ab4a031-39ec-4197-be02-e34d274eddf2 tempest-VolumesGetTestJSON-1847012015 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-902e6afe-58cd-41b6-b724-0e100ed89c45 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:58:19 devstack sudo[98087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-902e6afe-58cd-41b6-b724-0e100ed89c45 Nov 04 10:58:19 devstack sudo[98087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:58:20 devstack sudo[98087]: pam_unix(sudo:session): session closed for user root Nov 04 10:58:20 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [req-50fb630e-a5a5-4988-b675-fbfee4c86e8b req-9ab4a031-39ec-4197-be02-e34d274eddf2 tempest-VolumesGetTestJSON-1847012015 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-902e6afe-58cd-41b6-b724-0e100ed89c45" returned: 0 in 0.376s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:58:20 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [req-50fb630e-a5a5-4988-b675-fbfee4c86e8b req-9ab4a031-39ec-4197-be02-e34d274eddf2 tempest-VolumesGetTestJSON-1847012015 None] <== create_volume: return (955ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'} {{(pid=87272) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 04 10:58:20 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [req-50fb630e-a5a5-4988-b675-fbfee4c86e8b req-9ab4a031-39ec-4197-be02-e34d274eddf2 tempest-VolumesGetTestJSON-1847012015 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.959s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:58:20 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-54c92395-a67b-49a3-befa-d46f79838c21 tempest-VolumesTransfersV355Test-1202785932 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.030s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:58:20 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-54c92395-a67b-49a3-befa-d46f79838c21 tempest-VolumesTransfersV355Test-1202785932 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T09:58:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-260004221',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a2e1779a-0434-4a5a-8f29-3bd53f1c85c9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='28060fd89cb64e1f89ac53367553a310',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T09:58:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T09:58:19Z,use_quota=True,user_id='fdc202872c1d4218a78ab11d8dc8bd62',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8989e4f-21e3-4f0a-9584-0d818784e883),volume_type_id=f8989e4f-21e3-4f0a-9584-0d818784e883)}" {{(pid=87272) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 04 10:58:20 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.remotefs [None req-54c92395-a67b-49a3-befa-d46f79838c21 tempest-VolumesTransfersV355Test-1202785932 None] Creating volume a2e1779a-0434-4a5a-8f29-3bd53f1c85c9 {{(pid=87272) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 10:58:20 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-54c92395-a67b-49a3-befa-d46f79838c21 tempest-VolumesTransfersV355Test-1202785932 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:58:20 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-54c92395-a67b-49a3-befa-d46f79838c21 tempest-VolumesTransfersV355Test-1202785932 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:58:20 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-54c92395-a67b-49a3-befa-d46f79838c21 tempest-VolumesTransfersV355Test-1202785932 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898': None} {{(pid=87272) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:58:20 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-54c92395-a67b-49a3-befa-d46f79838c21 tempest-VolumesTransfersV355Test-1202785932 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'] {{(pid=87272) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:58:20 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-54c92395-a67b-49a3-befa-d46f79838c21 tempest-VolumesTransfersV355Test-1202785932 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:58:20 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-54c92395-a67b-49a3-befa-d46f79838c21 tempest-VolumesTransfersV355Test-1202785932 None] Selected osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898 as target Quobyte volume. {{(pid=87272) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 10:58:20 devstack cinder-volume[87272]: INFO cinder.volume.drivers.remotefs [None req-54c92395-a67b-49a3-befa-d46f79838c21 tempest-VolumesTransfersV355Test-1202785932 None] casted to osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898 Nov 04 10:58:20 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-54c92395-a67b-49a3-befa-d46f79838c21 tempest-VolumesTransfersV355Test-1202785932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-a2e1779a-0434-4a5a-8f29-3bd53f1c85c9 1073741824 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:58:20 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [req-50fb630e-a5a5-4988-b675-fbfee4c86e8b req-9ab4a031-39ec-4197-be02-e34d274eddf2 tempest-VolumesGetTestJSON-1847012015 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8386f72a-0b4c-49cb-a1fb-ca5cd0ce1373) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-902e6afe-58cd-41b6-b724-0e100ed89c45', 'volume_size': 1}' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:58:20 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [req-50fb630e-a5a5-4988-b675-fbfee4c86e8b req-9ab4a031-39ec-4197-be02-e34d274eddf2 tempest-VolumesGetTestJSON-1847012015 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4444a597-04a4-43af-8c26-886464029ecf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:58:20 devstack sudo[98090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-a2e1779a-0434-4a5a-8f29-3bd53f1c85c9 1073741824 Nov 04 10:58:20 devstack sudo[98090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:58:20 devstack cinder-volume[87272]: INFO cinder.volume.flows.manager.create_volume [req-50fb630e-a5a5-4988-b675-fbfee4c86e8b req-9ab4a031-39ec-4197-be02-e34d274eddf2 tempest-VolumesGetTestJSON-1847012015 None] Volume volume-902e6afe-58cd-41b6-b724-0e100ed89c45 (902e6afe-58cd-41b6-b724-0e100ed89c45): created successfully Nov 04 10:58:20 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [req-50fb630e-a5a5-4988-b675-fbfee4c86e8b req-9ab4a031-39ec-4197-be02-e34d274eddf2 tempest-VolumesGetTestJSON-1847012015 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4444a597-04a4-43af-8c26-886464029ecf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:58:20 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [req-50fb630e-a5a5-4988-b675-fbfee4c86e8b req-9ab4a031-39ec-4197-be02-e34d274eddf2 tempest-VolumesGetTestJSON-1847012015 None] Flow 'volume_create_manager' (0a8074c0-27c9-4d04-83af-9cde656488fa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87272) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:58:20 devstack cinder-volume[87272]: INFO cinder.volume.manager [req-50fb630e-a5a5-4988-b675-fbfee4c86e8b req-9ab4a031-39ec-4197-be02-e34d274eddf2 tempest-VolumesGetTestJSON-1847012015 None] Created volume successfully. Nov 04 10:58:20 devstack sudo[98090]: pam_unix(sudo:session): session closed for user root Nov 04 10:58:20 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-54c92395-a67b-49a3-befa-d46f79838c21 tempest-VolumesTransfersV355Test-1202785932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-a2e1779a-0434-4a5a-8f29-3bd53f1c85c9 1073741824" returned: 0 in 0.694s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:58:21 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-54c92395-a67b-49a3-befa-d46f79838c21 tempest-VolumesTransfersV355Test-1202785932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-a2e1779a-0434-4a5a-8f29-3bd53f1c85c9 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:58:21 devstack sudo[98102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-a2e1779a-0434-4a5a-8f29-3bd53f1c85c9 Nov 04 10:58:21 devstack sudo[98102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:58:21 devstack cinder-volume[87272]: DEBUG cinder.coordination [req-9c529863-d0fc-49c1-9503-ec2650a7220a req-30d66f45-a30f-434b-9dfa-725db52082cd tempest-VolumesGetTestJSON-1847012015 None] Acquiring lock "cinder-902e6afe-58cd-41b6-b724-0e100ed89c45-delete_volume" by "delete_volume" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:58:21 devstack cinder-volume[87272]: DEBUG cinder.coordination [req-9c529863-d0fc-49c1-9503-ec2650a7220a req-30d66f45-a30f-434b-9dfa-725db52082cd tempest-VolumesGetTestJSON-1847012015 None] Lock "cinder-902e6afe-58cd-41b6-b724-0e100ed89c45-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:58:21 devstack cinder-volume[87272]: DEBUG cinder.coordination [req-9c529863-d0fc-49c1-9503-ec2650a7220a req-30d66f45-a30f-434b-9dfa-725db52082cd tempest-VolumesGetTestJSON-1847012015 None] Acquiring lock "cinder-quobyte-902e6afe-58cd-41b6-b724-0e100ed89c45" by "delete_volume" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:58:21 devstack cinder-volume[87272]: DEBUG cinder.coordination [req-9c529863-d0fc-49c1-9503-ec2650a7220a req-30d66f45-a30f-434b-9dfa-725db52082cd tempest-VolumesGetTestJSON-1847012015 None] Lock "cinder-quobyte-902e6afe-58cd-41b6-b724-0e100ed89c45" acquired by "delete_volume" :: waited 0.026s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:58:21 devstack sudo[98102]: pam_unix(sudo:session): session closed for user root Nov 04 10:58:21 devstack cinder-volume[87272]: DEBUG oslo.privsep.daemon [-] privsep: reply[2209bd5f-5713-4a97-a945-76aa9c8a76a6]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:58:21 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [req-9c529863-d0fc-49c1-9503-ec2650a7220a req-30d66f45-a30f-434b-9dfa-725db52082cd tempest-VolumesGetTestJSON-1847012015 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-902e6afe-58cd-41b6-b724-0e100ed89c45 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:58:21 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-54c92395-a67b-49a3-befa-d46f79838c21 tempest-VolumesTransfersV355Test-1202785932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-a2e1779a-0434-4a5a-8f29-3bd53f1c85c9" returned: 0 in 0.431s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:58:21 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-54c92395-a67b-49a3-befa-d46f79838c21 tempest-VolumesTransfersV355Test-1202785932 None] <== create_volume: return (1201ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'} {{(pid=87272) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 04 10:58:21 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-54c92395-a67b-49a3-befa-d46f79838c21 tempest-VolumesTransfersV355Test-1202785932 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.207s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:58:21 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-54c92395-a67b-49a3-befa-d46f79838c21 tempest-VolumesTransfersV355Test-1202785932 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ef2496f-0b83-4253-a109-c92fcf885041) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a2e1779a-0434-4a5a-8f29-3bd53f1c85c9', 'volume_size': 1}' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:58:21 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-54c92395-a67b-49a3-befa-d46f79838c21 tempest-VolumesTransfersV355Test-1202785932 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (96480d84-efed-45fa-9791-15ef605859a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:58:21 devstack cinder-volume[87272]: INFO cinder.volume.flows.manager.create_volume [None req-54c92395-a67b-49a3-befa-d46f79838c21 tempest-VolumesTransfersV355Test-1202785932 None] Volume volume-a2e1779a-0434-4a5a-8f29-3bd53f1c85c9 (a2e1779a-0434-4a5a-8f29-3bd53f1c85c9): created successfully Nov 04 10:58:21 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-54c92395-a67b-49a3-befa-d46f79838c21 tempest-VolumesTransfersV355Test-1202785932 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (96480d84-efed-45fa-9791-15ef605859a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:58:21 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-54c92395-a67b-49a3-befa-d46f79838c21 tempest-VolumesTransfersV355Test-1202785932 None] Flow 'volume_create_manager' (a44a421c-ac39-4d61-82d8-cf955d59ebcc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87272) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:58:21 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-54c92395-a67b-49a3-befa-d46f79838c21 tempest-VolumesTransfersV355Test-1202785932 None] Created volume successfully. Nov 04 10:58:21 devstack sudo[98105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-902e6afe-58cd-41b6-b724-0e100ed89c45 Nov 04 10:58:21 devstack sudo[98105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:58:21 devstack sudo[98105]: pam_unix(sudo:session): session closed for user root Nov 04 10:58:21 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [req-9c529863-d0fc-49c1-9503-ec2650a7220a req-30d66f45-a30f-434b-9dfa-725db52082cd tempest-VolumesGetTestJSON-1847012015 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-902e6afe-58cd-41b6-b724-0e100ed89c45" returned: 0 in 0.497s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:58:21 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [req-9c529863-d0fc-49c1-9503-ec2650a7220a req-30d66f45-a30f-434b-9dfa-725db52082cd tempest-VolumesGetTestJSON-1847012015 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-902e6afe-58cd-41b6-b724-0e100ed89c45 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:58:21 devstack sudo[98111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-902e6afe-58cd-41b6-b724-0e100ed89c45 Nov 04 10:58:21 devstack sudo[98111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:58:22 devstack cinder-volume[87272]: DEBUG cinder.volume.flows.manager.create_volume [None req-d43e565c-545f-4c0b-8db1-1800dfb4bfa3 tempest-ServersNegativeTestJSON-251354568 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87272) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 10:58:22 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-d43e565c-545f-4c0b-8db1-1800dfb4bfa3 tempest-ServersNegativeTestJSON-251354568 None] Flow 'volume_create_manager' (d1bf8832-c614-4a62-91db-b691e4689443) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:58:22 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-d43e565c-545f-4c0b-8db1-1800dfb4bfa3 tempest-ServersNegativeTestJSON-251354568 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e03aae5f-9e89-4360-a5c3-9378603c4a9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:58:22 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-d43e565c-545f-4c0b-8db1-1800dfb4bfa3 tempest-ServersNegativeTestJSON-251354568 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e03aae5f-9e89-4360-a5c3-9378603c4a9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T09:58:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1963253428',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=90fac968-50e1-4438-ae68-1e3edbf8af2b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='179004d11b4f44edaddb36a8427f1893',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T09:58:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T09:58:22Z,use_quota=True,user_id='f7b120e3b5e6492aa7b9ac6a9ac6331f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8989e4f-21e3-4f0a-9584-0d818784e883),volume_type_id=f8989e4f-21e3-4f0a-9584-0d818784e883)' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:58:22 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-d43e565c-545f-4c0b-8db1-1800dfb4bfa3 tempest-ServersNegativeTestJSON-251354568 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6fd482c8-668e-4433-949e-da2aebb8f52d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:58:22 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-d43e565c-545f-4c0b-8db1-1800dfb4bfa3 tempest-ServersNegativeTestJSON-251354568 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6fd482c8-668e-4433-949e-da2aebb8f52d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:58:22 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-d43e565c-545f-4c0b-8db1-1800dfb4bfa3 tempest-ServersNegativeTestJSON-251354568 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a36f4b3e-d18b-4721-bdf9-b36a8e3d5e3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:58:22 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-d43e565c-545f-4c0b-8db1-1800dfb4bfa3 tempest-ServersNegativeTestJSON-251354568 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a36f4b3e-d18b-4721-bdf9-b36a8e3d5e3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '90fac968-50e1-4438-ae68-1e3edbf8af2b', 'volume_name': 'volume-90fac968-50e1-4438-ae68-1e3edbf8af2b', 'volume_size': 1}' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:58:22 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-d43e565c-545f-4c0b-8db1-1800dfb4bfa3 tempest-ServersNegativeTestJSON-251354568 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec8e137c-106b-4770-bc9a-db70d0e5bdba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:58:22 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-d43e565c-545f-4c0b-8db1-1800dfb4bfa3 tempest-ServersNegativeTestJSON-251354568 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec8e137c-106b-4770-bc9a-db70d0e5bdba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:58:22 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-d43e565c-545f-4c0b-8db1-1800dfb4bfa3 tempest-ServersNegativeTestJSON-251354568 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e5e3531-8eac-4976-bd0c-8af12a6585d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:58:22 devstack cinder-volume[87272]: INFO cinder.volume.flows.manager.create_volume [None req-d43e565c-545f-4c0b-8db1-1800dfb4bfa3 tempest-ServersNegativeTestJSON-251354568 None] Volume 90fac968-50e1-4438-ae68-1e3edbf8af2b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-90fac968-50e1-4438-ae68-1e3edbf8af2b', 'volume_size': 1} Nov 04 10:58:22 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-d43e565c-545f-4c0b-8db1-1800dfb4bfa3 tempest-ServersNegativeTestJSON-251354568 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:58:22 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-d43e565c-545f-4c0b-8db1-1800dfb4bfa3 tempest-ServersNegativeTestJSON-251354568 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:58:22 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-d43e565c-545f-4c0b-8db1-1800dfb4bfa3 tempest-ServersNegativeTestJSON-251354568 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T09:58:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1963253428',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=90fac968-50e1-4438-ae68-1e3edbf8af2b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='179004d11b4f44edaddb36a8427f1893',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T09:58:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T09:58:22Z,use_quota=True,user_id='f7b120e3b5e6492aa7b9ac6a9ac6331f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8989e4f-21e3-4f0a-9584-0d818784e883),volume_type_id=f8989e4f-21e3-4f0a-9584-0d818784e883)}" {{(pid=87272) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 04 10:58:22 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.remotefs [None req-d43e565c-545f-4c0b-8db1-1800dfb4bfa3 tempest-ServersNegativeTestJSON-251354568 None] Creating volume 90fac968-50e1-4438-ae68-1e3edbf8af2b {{(pid=87272) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 10:58:22 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-d43e565c-545f-4c0b-8db1-1800dfb4bfa3 tempest-ServersNegativeTestJSON-251354568 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:58:22 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-d43e565c-545f-4c0b-8db1-1800dfb4bfa3 tempest-ServersNegativeTestJSON-251354568 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:58:22 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-d43e565c-545f-4c0b-8db1-1800dfb4bfa3 tempest-ServersNegativeTestJSON-251354568 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898': None} {{(pid=87272) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:58:22 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-d43e565c-545f-4c0b-8db1-1800dfb4bfa3 tempest-ServersNegativeTestJSON-251354568 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'] {{(pid=87272) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:58:22 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-d43e565c-545f-4c0b-8db1-1800dfb4bfa3 tempest-ServersNegativeTestJSON-251354568 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:58:22 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-d43e565c-545f-4c0b-8db1-1800dfb4bfa3 tempest-ServersNegativeTestJSON-251354568 None] Selected osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898 as target Quobyte volume. {{(pid=87272) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 10:58:22 devstack cinder-volume[87272]: INFO cinder.volume.drivers.remotefs [None req-d43e565c-545f-4c0b-8db1-1800dfb4bfa3 tempest-ServersNegativeTestJSON-251354568 None] casted to osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898 Nov 04 10:58:22 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-d43e565c-545f-4c0b-8db1-1800dfb4bfa3 tempest-ServersNegativeTestJSON-251354568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-90fac968-50e1-4438-ae68-1e3edbf8af2b 1073741824 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:58:22 devstack sudo[98111]: pam_unix(sudo:session): session closed for user root Nov 04 10:58:22 devstack sudo[98114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-90fac968-50e1-4438-ae68-1e3edbf8af2b 1073741824 Nov 04 10:58:22 devstack sudo[98114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:58:22 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [req-9c529863-d0fc-49c1-9503-ec2650a7220a req-30d66f45-a30f-434b-9dfa-725db52082cd tempest-VolumesGetTestJSON-1847012015 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-902e6afe-58cd-41b6-b724-0e100ed89c45" returned: 0 in 0.324s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:58:22 devstack cinder-volume[87272]: DEBUG cinder.coordination [req-9c529863-d0fc-49c1-9503-ec2650a7220a req-30d66f45-a30f-434b-9dfa-725db52082cd tempest-VolumesGetTestJSON-1847012015 None] Lock "cinder-quobyte-902e6afe-58cd-41b6-b724-0e100ed89c45" released by "delete_volume" :: held 0.898s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:58:22 devstack cinder-volume[87272]: DEBUG cinder.quota [req-9c529863-d0fc-49c1-9503-ec2650a7220a req-30d66f45-a30f-434b-9dfa-725db52082cd tempest-VolumesGetTestJSON-1847012015 None] Created reservations ['40ac1acb-defe-4035-ab35-b8026cf9a13e', 'c0af8eb6-356d-446c-a033-f566b953d427', '56f6324f-c38d-42ad-8855-42349936b2a9', '8de9d547-5dbb-470a-ad89-3e43865c127c'] {{(pid=87272) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 10:58:22 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [req-9c529863-d0fc-49c1-9503-ec2650a7220a req-30d66f45-a30f-434b-9dfa-725db52082cd tempest-VolumesGetTestJSON-1847012015 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:58:22 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [req-9c529863-d0fc-49c1-9503-ec2650a7220a req-30d66f45-a30f-434b-9dfa-725db52082cd tempest-VolumesGetTestJSON-1847012015 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:58:22 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [req-9c529863-d0fc-49c1-9503-ec2650a7220a req-30d66f45-a30f-434b-9dfa-725db52082cd tempest-VolumesGetTestJSON-1847012015 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898': None} {{(pid=87272) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:58:22 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [req-9c529863-d0fc-49c1-9503-ec2650a7220a req-30d66f45-a30f-434b-9dfa-725db52082cd tempest-VolumesGetTestJSON-1847012015 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'] {{(pid=87272) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:58:22 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [req-9c529863-d0fc-49c1-9503-ec2650a7220a req-30d66f45-a30f-434b-9dfa-725db52082cd tempest-VolumesGetTestJSON-1847012015 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:58:22 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [req-9c529863-d0fc-49c1-9503-ec2650a7220a req-30d66f45-a30f-434b-9dfa-725db52082cd tempest-VolumesGetTestJSON-1847012015 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:58:22 devstack sudo[98116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1 Nov 04 10:58:22 devstack sudo[98116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:58:22 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-4542d933-642a-46ba-9c96-be9d21d64fc0 tempest-VolumesTransfersV355Test-2078413015 None] Acquiring lock "cinder-a2e1779a-0434-4a5a-8f29-3bd53f1c85c9-delete_volume" by "delete_volume" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:58:22 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-4542d933-642a-46ba-9c96-be9d21d64fc0 tempest-VolumesTransfersV355Test-2078413015 None] Lock "cinder-a2e1779a-0434-4a5a-8f29-3bd53f1c85c9-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:58:22 devstack sudo[98114]: pam_unix(sudo:session): session closed for user root Nov 04 10:58:22 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-d43e565c-545f-4c0b-8db1-1800dfb4bfa3 tempest-ServersNegativeTestJSON-251354568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-90fac968-50e1-4438-ae68-1e3edbf8af2b 1073741824" returned: 0 in 0.685s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:58:22 devstack sudo[98116]: pam_unix(sudo:session): session closed for user root Nov 04 10:58:22 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [req-9c529863-d0fc-49c1-9503-ec2650a7220a req-30d66f45-a30f-434b-9dfa-725db52082cd tempest-VolumesGetTestJSON-1847012015 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1" returned: 0 in 0.472s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:58:22 devstack cinder-volume[87272]: DEBUG cinder.manager [req-9c529863-d0fc-49c1-9503-ec2650a7220a req-30d66f45-a30f-434b-9dfa-725db52082cd tempest-VolumesGetTestJSON-1847012015 None] Notifying Schedulers of capabilities ... {{(pid=87272) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 10:58:22 devstack cinder-volume[87272]: INFO cinder.volume.manager [req-9c529863-d0fc-49c1-9503-ec2650a7220a req-30d66f45-a30f-434b-9dfa-725db52082cd tempest-VolumesGetTestJSON-1847012015 None] Deleted volume successfully. Nov 04 10:58:22 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-4542d933-642a-46ba-9c96-be9d21d64fc0 tempest-VolumesTransfersV355Test-2078413015 None] Acquiring lock "cinder-quobyte-a2e1779a-0434-4a5a-8f29-3bd53f1c85c9" by "delete_volume" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:58:22 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-d43e565c-545f-4c0b-8db1-1800dfb4bfa3 tempest-ServersNegativeTestJSON-251354568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-90fac968-50e1-4438-ae68-1e3edbf8af2b {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:58:23 devstack cinder-volume[87272]: DEBUG cinder.coordination [req-9c529863-d0fc-49c1-9503-ec2650a7220a req-30d66f45-a30f-434b-9dfa-725db52082cd tempest-VolumesGetTestJSON-1847012015 None] Lock "cinder-902e6afe-58cd-41b6-b724-0e100ed89c45-delete_volume" released by "delete_volume" :: held 1.697s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:58:23 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-4542d933-642a-46ba-9c96-be9d21d64fc0 tempest-VolumesTransfersV355Test-2078413015 None] Lock "cinder-quobyte-a2e1779a-0434-4a5a-8f29-3bd53f1c85c9" acquired by "delete_volume" :: waited 0.035s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:58:23 devstack sudo[98124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-90fac968-50e1-4438-ae68-1e3edbf8af2b Nov 04 10:58:23 devstack sudo[98124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:58:23 devstack cinder-volume[87272]: DEBUG oslo.privsep.daemon [-] privsep: reply[b30e4693-bae0-41fc-a905-b2bf8ba018b5]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:58:23 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-4542d933-642a-46ba-9c96-be9d21d64fc0 tempest-VolumesTransfersV355Test-2078413015 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-a2e1779a-0434-4a5a-8f29-3bd53f1c85c9 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:58:23 devstack sudo[98126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-a2e1779a-0434-4a5a-8f29-3bd53f1c85c9 Nov 04 10:58:23 devstack sudo[98126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:58:23 devstack sudo[98124]: pam_unix(sudo:session): session closed for user root Nov 04 10:58:23 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-d43e565c-545f-4c0b-8db1-1800dfb4bfa3 tempest-ServersNegativeTestJSON-251354568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-90fac968-50e1-4438-ae68-1e3edbf8af2b" returned: 0 in 0.321s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:58:23 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-d43e565c-545f-4c0b-8db1-1800dfb4bfa3 tempest-ServersNegativeTestJSON-251354568 None] <== create_volume: return (1086ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'} {{(pid=87272) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 04 10:58:23 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-d43e565c-545f-4c0b-8db1-1800dfb4bfa3 tempest-ServersNegativeTestJSON-251354568 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.095s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:58:23 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-d43e565c-545f-4c0b-8db1-1800dfb4bfa3 tempest-ServersNegativeTestJSON-251354568 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e5e3531-8eac-4976-bd0c-8af12a6585d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-90fac968-50e1-4438-ae68-1e3edbf8af2b', 'volume_size': 1}' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:58:23 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-d43e565c-545f-4c0b-8db1-1800dfb4bfa3 tempest-ServersNegativeTestJSON-251354568 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eba4be13-0618-4439-a7bf-6a70cf2533a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:58:23 devstack cinder-volume[87272]: INFO cinder.volume.flows.manager.create_volume [None req-d43e565c-545f-4c0b-8db1-1800dfb4bfa3 tempest-ServersNegativeTestJSON-251354568 None] Volume volume-90fac968-50e1-4438-ae68-1e3edbf8af2b (90fac968-50e1-4438-ae68-1e3edbf8af2b): created successfully Nov 04 10:58:23 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-d43e565c-545f-4c0b-8db1-1800dfb4bfa3 tempest-ServersNegativeTestJSON-251354568 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eba4be13-0618-4439-a7bf-6a70cf2533a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:58:23 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-d43e565c-545f-4c0b-8db1-1800dfb4bfa3 tempest-ServersNegativeTestJSON-251354568 None] Flow 'volume_create_manager' (d1bf8832-c614-4a62-91db-b691e4689443) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87272) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:58:23 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-d43e565c-545f-4c0b-8db1-1800dfb4bfa3 tempest-ServersNegativeTestJSON-251354568 None] Created volume successfully. Nov 04 10:58:23 devstack sudo[98126]: pam_unix(sudo:session): session closed for user root Nov 04 10:58:23 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-4542d933-642a-46ba-9c96-be9d21d64fc0 tempest-VolumesTransfersV355Test-2078413015 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-a2e1779a-0434-4a5a-8f29-3bd53f1c85c9" returned: 0 in 0.514s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:58:23 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-4542d933-642a-46ba-9c96-be9d21d64fc0 tempest-VolumesTransfersV355Test-2078413015 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-a2e1779a-0434-4a5a-8f29-3bd53f1c85c9 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:58:23 devstack sudo[98132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-a2e1779a-0434-4a5a-8f29-3bd53f1c85c9 Nov 04 10:58:23 devstack sudo[98132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:58:23 devstack sudo[98132]: pam_unix(sudo:session): session closed for user root Nov 04 10:58:23 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-4542d933-642a-46ba-9c96-be9d21d64fc0 tempest-VolumesTransfersV355Test-2078413015 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-a2e1779a-0434-4a5a-8f29-3bd53f1c85c9" returned: 0 in 0.400s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:58:24 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-4542d933-642a-46ba-9c96-be9d21d64fc0 tempest-VolumesTransfersV355Test-2078413015 None] Lock "cinder-quobyte-a2e1779a-0434-4a5a-8f29-3bd53f1c85c9" released by "delete_volume" :: held 0.993s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:58:24 devstack cinder-volume[87272]: DEBUG cinder.quota [None req-4542d933-642a-46ba-9c96-be9d21d64fc0 tempest-VolumesTransfersV355Test-2078413015 None] Created reservations ['62d6ffab-9db0-4f9f-80cd-9eea3133e5ce', 'c1d25a7b-aa84-49df-84ec-7f2ab677dded', 'd3b125b4-cc59-40fc-a268-cbf6499f611d', '2cf43499-85ad-4b14-afef-5dcb7003cab7'] {{(pid=87272) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 10:58:24 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-4542d933-642a-46ba-9c96-be9d21d64fc0 tempest-VolumesTransfersV355Test-2078413015 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:58:24 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-4542d933-642a-46ba-9c96-be9d21d64fc0 tempest-VolumesTransfersV355Test-2078413015 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:58:24 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-4542d933-642a-46ba-9c96-be9d21d64fc0 tempest-VolumesTransfersV355Test-2078413015 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898': None} {{(pid=87272) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:58:24 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-4542d933-642a-46ba-9c96-be9d21d64fc0 tempest-VolumesTransfersV355Test-2078413015 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'] {{(pid=87272) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:58:24 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-4542d933-642a-46ba-9c96-be9d21d64fc0 tempest-VolumesTransfersV355Test-2078413015 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:58:24 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-4542d933-642a-46ba-9c96-be9d21d64fc0 tempest-VolumesTransfersV355Test-2078413015 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:58:24 devstack sudo[98135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1 Nov 04 10:58:24 devstack sudo[98135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:58:24 devstack sudo[98135]: pam_unix(sudo:session): session closed for user root Nov 04 10:58:24 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-4542d933-642a-46ba-9c96-be9d21d64fc0 tempest-VolumesTransfersV355Test-2078413015 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1" returned: 0 in 0.338s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:58:24 devstack cinder-volume[87272]: DEBUG cinder.manager [None req-4542d933-642a-46ba-9c96-be9d21d64fc0 tempest-VolumesTransfersV355Test-2078413015 None] Notifying Schedulers of capabilities ... {{(pid=87272) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 10:58:24 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-4542d933-642a-46ba-9c96-be9d21d64fc0 tempest-VolumesTransfersV355Test-2078413015 None] Deleted volume successfully. Nov 04 10:58:24 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-4542d933-642a-46ba-9c96-be9d21d64fc0 tempest-VolumesTransfersV355Test-2078413015 None] Lock "cinder-a2e1779a-0434-4a5a-8f29-3bd53f1c85c9-delete_volume" released by "delete_volume" :: held 1.719s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:58:25 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-8eb7475d-e5d2-4da6-9da7-85e4396b3375 tempest-ServersNegativeTestJSON-251354568 None] Acquiring lock "cinder-90fac968-50e1-4438-ae68-1e3edbf8af2b-delete_volume" by "delete_volume" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:58:25 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-8eb7475d-e5d2-4da6-9da7-85e4396b3375 tempest-ServersNegativeTestJSON-251354568 None] Lock "cinder-90fac968-50e1-4438-ae68-1e3edbf8af2b-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:58:25 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-8eb7475d-e5d2-4da6-9da7-85e4396b3375 tempest-ServersNegativeTestJSON-251354568 None] Acquiring lock "cinder-quobyte-90fac968-50e1-4438-ae68-1e3edbf8af2b" by "delete_volume" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:58:25 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-8eb7475d-e5d2-4da6-9da7-85e4396b3375 tempest-ServersNegativeTestJSON-251354568 None] Lock "cinder-quobyte-90fac968-50e1-4438-ae68-1e3edbf8af2b" acquired by "delete_volume" :: waited 0.020s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:58:25 devstack cinder-volume[87272]: DEBUG oslo.privsep.daemon [-] privsep: reply[0737413e-9141-43af-94b5-4c06176445ca]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:58:25 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-8eb7475d-e5d2-4da6-9da7-85e4396b3375 tempest-ServersNegativeTestJSON-251354568 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-90fac968-50e1-4438-ae68-1e3edbf8af2b {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:58:25 devstack sudo[98176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-90fac968-50e1-4438-ae68-1e3edbf8af2b Nov 04 10:58:25 devstack sudo[98176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:58:25 devstack sudo[98176]: pam_unix(sudo:session): session closed for user root Nov 04 10:58:25 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-8eb7475d-e5d2-4da6-9da7-85e4396b3375 tempest-ServersNegativeTestJSON-251354568 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-90fac968-50e1-4438-ae68-1e3edbf8af2b" returned: 0 in 0.592s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:58:25 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-8eb7475d-e5d2-4da6-9da7-85e4396b3375 tempest-ServersNegativeTestJSON-251354568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-90fac968-50e1-4438-ae68-1e3edbf8af2b {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:58:25 devstack sudo[98181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-90fac968-50e1-4438-ae68-1e3edbf8af2b Nov 04 10:58:25 devstack sudo[98181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:58:26 devstack sudo[98181]: pam_unix(sudo:session): session closed for user root Nov 04 10:58:26 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-8eb7475d-e5d2-4da6-9da7-85e4396b3375 tempest-ServersNegativeTestJSON-251354568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-90fac968-50e1-4438-ae68-1e3edbf8af2b" returned: 0 in 0.313s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:58:26 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-8eb7475d-e5d2-4da6-9da7-85e4396b3375 tempest-ServersNegativeTestJSON-251354568 None] Lock "cinder-quobyte-90fac968-50e1-4438-ae68-1e3edbf8af2b" released by "delete_volume" :: held 0.998s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:58:26 devstack cinder-volume[87272]: DEBUG cinder.quota [None req-8eb7475d-e5d2-4da6-9da7-85e4396b3375 tempest-ServersNegativeTestJSON-251354568 None] Created reservations ['b16cc1f2-3415-4880-a354-36b2bfcccd27', 'e1fe30c6-c6f2-46ee-b088-5996d198c39f', '8458eb07-7c09-499b-94e5-d99b621d2e8f', 'e419f342-4b2f-4866-b61c-a472ebe08f35'] {{(pid=87272) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 10:58:26 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-8eb7475d-e5d2-4da6-9da7-85e4396b3375 tempest-ServersNegativeTestJSON-251354568 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:58:26 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-8eb7475d-e5d2-4da6-9da7-85e4396b3375 tempest-ServersNegativeTestJSON-251354568 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:58:26 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-8eb7475d-e5d2-4da6-9da7-85e4396b3375 tempest-ServersNegativeTestJSON-251354568 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898': None} {{(pid=87272) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:58:26 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-8eb7475d-e5d2-4da6-9da7-85e4396b3375 tempest-ServersNegativeTestJSON-251354568 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'] {{(pid=87272) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:58:26 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-8eb7475d-e5d2-4da6-9da7-85e4396b3375 tempest-ServersNegativeTestJSON-251354568 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:58:26 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-8eb7475d-e5d2-4da6-9da7-85e4396b3375 tempest-ServersNegativeTestJSON-251354568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:58:26 devstack sudo[98185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1 Nov 04 10:58:26 devstack sudo[98185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:58:26 devstack sudo[98185]: pam_unix(sudo:session): session closed for user root Nov 04 10:58:26 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-8eb7475d-e5d2-4da6-9da7-85e4396b3375 tempest-ServersNegativeTestJSON-251354568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1" returned: 0 in 0.367s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:58:26 devstack cinder-volume[87272]: DEBUG cinder.manager [None req-8eb7475d-e5d2-4da6-9da7-85e4396b3375 tempest-ServersNegativeTestJSON-251354568 None] Notifying Schedulers of capabilities ... {{(pid=87272) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 10:58:26 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-8eb7475d-e5d2-4da6-9da7-85e4396b3375 tempest-ServersNegativeTestJSON-251354568 None] Deleted volume successfully. Nov 04 10:58:26 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-8eb7475d-e5d2-4da6-9da7-85e4396b3375 tempest-ServersNegativeTestJSON-251354568 None] Lock "cinder-90fac968-50e1-4438-ae68-1e3edbf8af2b-delete_volume" released by "delete_volume" :: held 1.714s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:58:27 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-b664a267-5773-4739-b1a8-3e07f89d1991 tempest-ServersNegativeTestJSON-251354568 None] Acquiring lock "cinder-da77fc8b-69ac-4e37-86cc-ea4f77f86a6b-delete_volume" by "delete_volume" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:58:27 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-b664a267-5773-4739-b1a8-3e07f89d1991 tempest-ServersNegativeTestJSON-251354568 None] Lock "cinder-da77fc8b-69ac-4e37-86cc-ea4f77f86a6b-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:58:27 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-b664a267-5773-4739-b1a8-3e07f89d1991 tempest-ServersNegativeTestJSON-251354568 None] Acquiring lock "cinder-quobyte-da77fc8b-69ac-4e37-86cc-ea4f77f86a6b" by "delete_volume" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:58:27 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-b664a267-5773-4739-b1a8-3e07f89d1991 tempest-ServersNegativeTestJSON-251354568 None] Lock "cinder-quobyte-da77fc8b-69ac-4e37-86cc-ea4f77f86a6b" acquired by "delete_volume" :: waited 0.024s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:58:27 devstack cinder-volume[87272]: DEBUG oslo.privsep.daemon [-] privsep: reply[477a8a45-30ff-4ff7-b83c-b134b773e12e]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:58:27 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-b664a267-5773-4739-b1a8-3e07f89d1991 tempest-ServersNegativeTestJSON-251354568 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-da77fc8b-69ac-4e37-86cc-ea4f77f86a6b {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:58:27 devstack sudo[98188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-da77fc8b-69ac-4e37-86cc-ea4f77f86a6b Nov 04 10:58:27 devstack sudo[98188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:58:28 devstack sudo[98188]: pam_unix(sudo:session): session closed for user root Nov 04 10:58:28 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-b664a267-5773-4739-b1a8-3e07f89d1991 tempest-ServersNegativeTestJSON-251354568 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-da77fc8b-69ac-4e37-86cc-ea4f77f86a6b" returned: 0 in 0.628s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:58:28 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-b664a267-5773-4739-b1a8-3e07f89d1991 tempest-ServersNegativeTestJSON-251354568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-da77fc8b-69ac-4e37-86cc-ea4f77f86a6b {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:58:28 devstack sudo[98193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-da77fc8b-69ac-4e37-86cc-ea4f77f86a6b Nov 04 10:58:28 devstack sudo[98193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:58:28 devstack sudo[98193]: pam_unix(sudo:session): session closed for user root Nov 04 10:58:28 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-b664a267-5773-4739-b1a8-3e07f89d1991 tempest-ServersNegativeTestJSON-251354568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-da77fc8b-69ac-4e37-86cc-ea4f77f86a6b" returned: 0 in 0.346s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:58:28 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-b664a267-5773-4739-b1a8-3e07f89d1991 tempest-ServersNegativeTestJSON-251354568 None] Lock "cinder-quobyte-da77fc8b-69ac-4e37-86cc-ea4f77f86a6b" released by "delete_volume" :: held 1.061s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:58:28 devstack cinder-volume[87272]: DEBUG cinder.quota [None req-b664a267-5773-4739-b1a8-3e07f89d1991 tempest-ServersNegativeTestJSON-251354568 None] Created reservations ['890f72be-b092-416f-8584-0a303b7673ec', 'eaa2d6d3-2af9-4a3f-9f0e-19a543db3305', 'f9451d27-5407-44d5-8695-c49cba283bea', 'e62a4708-103e-4f2e-b463-f98aa9afbd41'] {{(pid=87272) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 10:58:29 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-b664a267-5773-4739-b1a8-3e07f89d1991 tempest-ServersNegativeTestJSON-251354568 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:58:29 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-b664a267-5773-4739-b1a8-3e07f89d1991 tempest-ServersNegativeTestJSON-251354568 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:58:29 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-b664a267-5773-4739-b1a8-3e07f89d1991 tempest-ServersNegativeTestJSON-251354568 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898': None} {{(pid=87272) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:58:29 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-b664a267-5773-4739-b1a8-3e07f89d1991 tempest-ServersNegativeTestJSON-251354568 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'] {{(pid=87272) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:58:29 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-b664a267-5773-4739-b1a8-3e07f89d1991 tempest-ServersNegativeTestJSON-251354568 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:58:29 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-b664a267-5773-4739-b1a8-3e07f89d1991 tempest-ServersNegativeTestJSON-251354568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:58:29 devstack sudo[98196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1 Nov 04 10:58:29 devstack sudo[98196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:58:29 devstack sudo[98196]: pam_unix(sudo:session): session closed for user root Nov 04 10:58:29 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-b664a267-5773-4739-b1a8-3e07f89d1991 tempest-ServersNegativeTestJSON-251354568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1" returned: 0 in 0.460s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:58:29 devstack cinder-volume[87272]: DEBUG cinder.manager [None req-b664a267-5773-4739-b1a8-3e07f89d1991 tempest-ServersNegativeTestJSON-251354568 None] Notifying Schedulers of capabilities ... {{(pid=87272) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 10:58:29 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-b664a267-5773-4739-b1a8-3e07f89d1991 tempest-ServersNegativeTestJSON-251354568 None] Deleted volume successfully. Nov 04 10:58:29 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-b664a267-5773-4739-b1a8-3e07f89d1991 tempest-ServersNegativeTestJSON-251354568 None] Lock "cinder-da77fc8b-69ac-4e37-86cc-ea4f77f86a6b-delete_volume" released by "delete_volume" :: held 1.879s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:58:30 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-16670117-0772-4f0b-97ab-0cc2b6e5de11 tempest-GroupSnapshotsTest-534526937 None] Group tempest-GroupSnapshotsTest-Group-1807130537: creating Nov 04 10:58:30 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-16670117-0772-4f0b-97ab-0cc2b6e5de11 tempest-GroupSnapshotsTest-534526937 None] Group tempest-GroupSnapshotsTest-Group-1807130537: created successfully Nov 04 10:58:30 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-16670117-0772-4f0b-97ab-0cc2b6e5de11 tempest-GroupSnapshotsTest-534526937 None] Create group completed successfully. Nov 04 10:58:31 devstack cinder-volume[87272]: DEBUG dbcounter [-] [87272] Writing DB stats cinder:UPDATE=188,cinder:SELECT=129,cinder:INSERT=55,cinder:DELETE=15 {{(pid=87272) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 10:58:31 devstack cinder-volume[87272]: DEBUG cinder.volume.flows.manager.create_volume [None req-2dea808c-d53c-4e0a-a955-0a97e55abbb6 tempest-GroupSnapshotsTest-534526937 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87272) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 10:58:32 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-2dea808c-d53c-4e0a-a955-0a97e55abbb6 tempest-GroupSnapshotsTest-534526937 None] Flow 'volume_create_manager' (b0be8b97-f67e-4331-9650-934fda369f9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:58:32 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-2dea808c-d53c-4e0a-a955-0a97e55abbb6 tempest-GroupSnapshotsTest-534526937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (014c57e8-ac4b-41e5-8f3e-8e20f4933a47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:58:32 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-2dea808c-d53c-4e0a-a955-0a97e55abbb6 tempest-GroupSnapshotsTest-534526937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (014c57e8-ac4b-41e5-8f3e-8e20f4933a47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T09:58:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-114739656',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=9a80cf6b-de71-468c-a3a3-73e904bd6ed9,host='devstack@QuobyteHD#QuobyteHD',id=d797f36d-80b5-45cf-9896-2edbb0741f0d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d4fecca9e5c74435917afa362915006e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T09:58:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T09:58:32Z,use_quota=True,user_id='cd95811391ef4f95b79f4f5c5f6f23c1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1b3d5ad1-b532-456b-8792-e51e524745d1),volume_type_id=1b3d5ad1-b532-456b-8792-e51e524745d1)' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:58:32 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-2dea808c-d53c-4e0a-a955-0a97e55abbb6 tempest-GroupSnapshotsTest-534526937 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85631f04-0971-4107-aa3e-e1b38c2a4099) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:58:32 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-2dea808c-d53c-4e0a-a955-0a97e55abbb6 tempest-GroupSnapshotsTest-534526937 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85631f04-0971-4107-aa3e-e1b38c2a4099) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:58:32 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-2dea808c-d53c-4e0a-a955-0a97e55abbb6 tempest-GroupSnapshotsTest-534526937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca99831d-20ad-444a-b3e4-3686517de4b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:58:32 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-2dea808c-d53c-4e0a-a955-0a97e55abbb6 tempest-GroupSnapshotsTest-534526937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca99831d-20ad-444a-b3e4-3686517de4b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd797f36d-80b5-45cf-9896-2edbb0741f0d', 'volume_name': 'volume-d797f36d-80b5-45cf-9896-2edbb0741f0d', 'volume_size': 1}' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:58:32 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-2dea808c-d53c-4e0a-a955-0a97e55abbb6 tempest-GroupSnapshotsTest-534526937 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e56dceb-2955-4740-bdf8-267ab9f4227d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:58:32 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-2dea808c-d53c-4e0a-a955-0a97e55abbb6 tempest-GroupSnapshotsTest-534526937 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e56dceb-2955-4740-bdf8-267ab9f4227d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:58:32 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-2dea808c-d53c-4e0a-a955-0a97e55abbb6 tempest-GroupSnapshotsTest-534526937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (325429a2-aae0-4a52-bb17-2eace19da041) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:58:32 devstack cinder-volume[87272]: INFO cinder.volume.flows.manager.create_volume [None req-2dea808c-d53c-4e0a-a955-0a97e55abbb6 tempest-GroupSnapshotsTest-534526937 None] Volume d797f36d-80b5-45cf-9896-2edbb0741f0d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d797f36d-80b5-45cf-9896-2edbb0741f0d', 'volume_size': 1} Nov 04 10:58:32 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-2dea808c-d53c-4e0a-a955-0a97e55abbb6 tempest-GroupSnapshotsTest-534526937 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:58:32 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-2dea808c-d53c-4e0a-a955-0a97e55abbb6 tempest-GroupSnapshotsTest-534526937 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:58:32 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-2dea808c-d53c-4e0a-a955-0a97e55abbb6 tempest-GroupSnapshotsTest-534526937 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=9a80cf6b-de71-468c-a3a3-73e904bd6ed9,created_at=2026-11-04T09:58:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-114739656',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=9a80cf6b-de71-468c-a3a3-73e904bd6ed9,host='devstack@QuobyteHD#QuobyteHD',id=d797f36d-80b5-45cf-9896-2edbb0741f0d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d4fecca9e5c74435917afa362915006e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T09:58:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T09:58:32Z,use_quota=True,user_id='cd95811391ef4f95b79f4f5c5f6f23c1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1b3d5ad1-b532-456b-8792-e51e524745d1),volume_type_id=1b3d5ad1-b532-456b-8792-e51e524745d1)}" {{(pid=87272) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 04 10:58:32 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.remotefs [None req-2dea808c-d53c-4e0a-a955-0a97e55abbb6 tempest-GroupSnapshotsTest-534526937 None] Creating volume d797f36d-80b5-45cf-9896-2edbb0741f0d {{(pid=87272) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 10:58:32 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-2dea808c-d53c-4e0a-a955-0a97e55abbb6 tempest-GroupSnapshotsTest-534526937 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:58:32 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-2dea808c-d53c-4e0a-a955-0a97e55abbb6 tempest-GroupSnapshotsTest-534526937 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:58:32 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-2dea808c-d53c-4e0a-a955-0a97e55abbb6 tempest-GroupSnapshotsTest-534526937 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898': None} {{(pid=87272) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:58:32 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-2dea808c-d53c-4e0a-a955-0a97e55abbb6 tempest-GroupSnapshotsTest-534526937 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'] {{(pid=87272) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:58:32 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-2dea808c-d53c-4e0a-a955-0a97e55abbb6 tempest-GroupSnapshotsTest-534526937 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:58:32 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-2dea808c-d53c-4e0a-a955-0a97e55abbb6 tempest-GroupSnapshotsTest-534526937 None] Selected osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898 as target Quobyte volume. {{(pid=87272) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 10:58:32 devstack cinder-volume[87272]: INFO cinder.volume.drivers.remotefs [None req-2dea808c-d53c-4e0a-a955-0a97e55abbb6 tempest-GroupSnapshotsTest-534526937 None] casted to osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898 Nov 04 10:58:32 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-2dea808c-d53c-4e0a-a955-0a97e55abbb6 tempest-GroupSnapshotsTest-534526937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-d797f36d-80b5-45cf-9896-2edbb0741f0d 1073741824 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:58:32 devstack sudo[98220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-d797f36d-80b5-45cf-9896-2edbb0741f0d 1073741824 Nov 04 10:58:32 devstack sudo[98220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:58:32 devstack sudo[98220]: pam_unix(sudo:session): session closed for user root Nov 04 10:58:32 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-2dea808c-d53c-4e0a-a955-0a97e55abbb6 tempest-GroupSnapshotsTest-534526937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-d797f36d-80b5-45cf-9896-2edbb0741f0d 1073741824" returned: 0 in 0.564s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:58:32 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-2dea808c-d53c-4e0a-a955-0a97e55abbb6 tempest-GroupSnapshotsTest-534526937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-d797f36d-80b5-45cf-9896-2edbb0741f0d {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:58:32 devstack sudo[98227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-d797f36d-80b5-45cf-9896-2edbb0741f0d Nov 04 10:58:32 devstack sudo[98227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:58:33 devstack sudo[98227]: pam_unix(sudo:session): session closed for user root Nov 04 10:58:33 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-2dea808c-d53c-4e0a-a955-0a97e55abbb6 tempest-GroupSnapshotsTest-534526937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-d797f36d-80b5-45cf-9896-2edbb0741f0d" returned: 0 in 0.345s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:58:33 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-2dea808c-d53c-4e0a-a955-0a97e55abbb6 tempest-GroupSnapshotsTest-534526937 None] <== create_volume: return (964ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'} {{(pid=87272) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 04 10:58:33 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-2dea808c-d53c-4e0a-a955-0a97e55abbb6 tempest-GroupSnapshotsTest-534526937 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.974s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:58:33 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-2dea808c-d53c-4e0a-a955-0a97e55abbb6 tempest-GroupSnapshotsTest-534526937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (325429a2-aae0-4a52-bb17-2eace19da041) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d797f36d-80b5-45cf-9896-2edbb0741f0d', 'volume_size': 1}' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:58:33 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-2dea808c-d53c-4e0a-a955-0a97e55abbb6 tempest-GroupSnapshotsTest-534526937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c7ead3dd-d171-4b2d-996c-3c6bd577cacb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:58:33 devstack cinder-volume[87272]: INFO cinder.volume.flows.manager.create_volume [None req-2dea808c-d53c-4e0a-a955-0a97e55abbb6 tempest-GroupSnapshotsTest-534526937 None] Volume volume-d797f36d-80b5-45cf-9896-2edbb0741f0d (d797f36d-80b5-45cf-9896-2edbb0741f0d): created successfully Nov 04 10:58:33 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-2dea808c-d53c-4e0a-a955-0a97e55abbb6 tempest-GroupSnapshotsTest-534526937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c7ead3dd-d171-4b2d-996c-3c6bd577cacb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:58:33 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-2dea808c-d53c-4e0a-a955-0a97e55abbb6 tempest-GroupSnapshotsTest-534526937 None] Flow 'volume_create_manager' (b0be8b97-f67e-4331-9650-934fda369f9e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87272) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:58:33 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-2dea808c-d53c-4e0a-a955-0a97e55abbb6 tempest-GroupSnapshotsTest-534526937 None] Created volume successfully. Nov 04 10:58:33 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-566b60a4-4aab-4cb0-9933-2048795a6c0c tempest-GroupSnapshotsTest-534526937 None] GroupSnapshot 02e4ecad-fe16-46e5-a586-19a20f07c6c0: creating. Nov 04 10:58:33 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-566b60a4-4aab-4cb0-9933-2048795a6c0c tempest-GroupSnapshotsTest-534526937 None] Group snapshot 02e4ecad-fe16-46e5-a586-19a20f07c6c0: creating. {{(pid=87272) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Nov 04 10:58:33 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-566b60a4-4aab-4cb0-9933-2048795a6c0c tempest-GroupSnapshotsTest-534526937 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:58:33 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-566b60a4-4aab-4cb0-9933-2048795a6c0c tempest-GroupSnapshotsTest-534526937 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:58:33 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.remotefs [None req-566b60a4-4aab-4cb0-9933-2048795a6c0c tempest-GroupSnapshotsTest-534526937 None] Creating offline snapshot def650ed-13c3-4a0d-b83c-7b30f13bcb97 of volume d797f36d-80b5-45cf-9896-2edbb0741f0d {{(pid=87272) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 04 10:58:33 devstack cinder-volume[87272]: DEBUG oslo.privsep.daemon [-] privsep: reply[c313482a-ec47-4027-af60-1d1174dc3c23]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:58:33 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-566b60a4-4aab-4cb0-9933-2048795a6c0c tempest-GroupSnapshotsTest-534526937 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-d797f36d-80b5-45cf-9896-2edbb0741f0d {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:58:34 devstack sudo[98231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-d797f36d-80b5-45cf-9896-2edbb0741f0d Nov 04 10:58:34 devstack sudo[98231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:58:34 devstack sudo[98231]: pam_unix(sudo:session): session closed for user root Nov 04 10:58:34 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-566b60a4-4aab-4cb0-9933-2048795a6c0c tempest-GroupSnapshotsTest-534526937 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-d797f36d-80b5-45cf-9896-2edbb0741f0d" returned: 0 in 0.511s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:58:34 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-566b60a4-4aab-4cb0-9933-2048795a6c0c tempest-GroupSnapshotsTest-534526937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-d797f36d-80b5-45cf-9896-2edbb0741f0d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-d797f36d-80b5-45cf-9896-2edbb0741f0d.def650ed-13c3-4a0d-b83c-7b30f13bcb97 1G {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:58:34 devstack sudo[98236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-d797f36d-80b5-45cf-9896-2edbb0741f0d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-d797f36d-80b5-45cf-9896-2edbb0741f0d.def650ed-13c3-4a0d-b83c-7b30f13bcb97 1G Nov 04 10:58:34 devstack sudo[98236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:58:34 devstack sudo[98236]: pam_unix(sudo:session): session closed for user root Nov 04 10:58:34 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-566b60a4-4aab-4cb0-9933-2048795a6c0c tempest-GroupSnapshotsTest-534526937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-d797f36d-80b5-45cf-9896-2edbb0741f0d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-d797f36d-80b5-45cf-9896-2edbb0741f0d.def650ed-13c3-4a0d-b83c-7b30f13bcb97 1G" returned: 0 in 0.561s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:58:34 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-566b60a4-4aab-4cb0-9933-2048795a6c0c tempest-GroupSnapshotsTest-534526937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d797f36d-80b5-45cf-9896-2edbb0741f0d -F qcow2 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-d797f36d-80b5-45cf-9896-2edbb0741f0d.def650ed-13c3-4a0d-b83c-7b30f13bcb97 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:58:34 devstack sudo[98242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d797f36d-80b5-45cf-9896-2edbb0741f0d -F qcow2 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-d797f36d-80b5-45cf-9896-2edbb0741f0d.def650ed-13c3-4a0d-b83c-7b30f13bcb97 Nov 04 10:58:34 devstack sudo[98242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:58:35 devstack sudo[98242]: pam_unix(sudo:session): session closed for user root Nov 04 10:58:35 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-566b60a4-4aab-4cb0-9933-2048795a6c0c tempest-GroupSnapshotsTest-534526937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d797f36d-80b5-45cf-9896-2edbb0741f0d -F qcow2 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-d797f36d-80b5-45cf-9896-2edbb0741f0d.def650ed-13c3-4a0d-b83c-7b30f13bcb97" returned: 0 in 0.442s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:58:35 devstack cinder-volume[87272]: WARNING cinder.volume.drivers.remotefs [None req-566b60a4-4aab-4cb0-9933-2048795a6c0c tempest-GroupSnapshotsTest-534526937 None] /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-d797f36d-80b5-45cf-9896-2edbb0741f0d.def650ed-13c3-4a0d-b83c-7b30f13bcb97 is being set with open permissions: ugo+rw: NotImplementedError Nov 04 10:58:35 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-566b60a4-4aab-4cb0-9933-2048795a6c0c tempest-GroupSnapshotsTest-534526937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-d797f36d-80b5-45cf-9896-2edbb0741f0d.def650ed-13c3-4a0d-b83c-7b30f13bcb97 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:58:35 devstack sudo[98247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-d797f36d-80b5-45cf-9896-2edbb0741f0d.def650ed-13c3-4a0d-b83c-7b30f13bcb97 Nov 04 10:58:35 devstack sudo[98247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:58:35 devstack sudo[98247]: pam_unix(sudo:session): session closed for user root Nov 04 10:58:35 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-566b60a4-4aab-4cb0-9933-2048795a6c0c tempest-GroupSnapshotsTest-534526937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-d797f36d-80b5-45cf-9896-2edbb0741f0d.def650ed-13c3-4a0d-b83c-7b30f13bcb97" returned: 0 in 0.372s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:58:35 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-566b60a4-4aab-4cb0-9933-2048795a6c0c tempest-GroupSnapshotsTest-534526937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-d797f36d-80b5-45cf-9896-2edbb0741f0d.info {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:58:35 devstack sudo[98250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-d797f36d-80b5-45cf-9896-2edbb0741f0d.info Nov 04 10:58:35 devstack sudo[98250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:58:36 devstack sudo[98250]: pam_unix(sudo:session): session closed for user root Nov 04 10:58:36 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-566b60a4-4aab-4cb0-9933-2048795a6c0c tempest-GroupSnapshotsTest-534526937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-d797f36d-80b5-45cf-9896-2edbb0741f0d.info" returned: 0 in 0.441s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:58:36 devstack cinder-volume[87272]: WARNING cinder.volume.drivers.remotefs [None req-566b60a4-4aab-4cb0-9933-2048795a6c0c tempest-GroupSnapshotsTest-534526937 None] /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-d797f36d-80b5-45cf-9896-2edbb0741f0d.info is being set with open permissions: ugo+rw: NotImplementedError Nov 04 10:58:36 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-566b60a4-4aab-4cb0-9933-2048795a6c0c tempest-GroupSnapshotsTest-534526937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-d797f36d-80b5-45cf-9896-2edbb0741f0d.info {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:58:36 devstack sudo[98254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-d797f36d-80b5-45cf-9896-2edbb0741f0d.info Nov 04 10:58:36 devstack sudo[98254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:58:36 devstack sudo[98254]: pam_unix(sudo:session): session closed for user root Nov 04 10:58:36 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-566b60a4-4aab-4cb0-9933-2048795a6c0c tempest-GroupSnapshotsTest-534526937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-d797f36d-80b5-45cf-9896-2edbb0741f0d.info" returned: 0 in 0.333s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:58:36 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-566b60a4-4aab-4cb0-9933-2048795a6c0c tempest-GroupSnapshotsTest-534526937 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.828s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:58:36 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-566b60a4-4aab-4cb0-9933-2048795a6c0c tempest-GroupSnapshotsTest-534526937 None] group_snapshot 02e4ecad-fe16-46e5-a586-19a20f07c6c0: created successfully Nov 04 10:58:38 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-fce2505e-c6c2-4114-b1e7-6318c17b9d9a tempest-GroupSnapshotsTest-534526937 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:58:38 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-fce2505e-c6c2-4114-b1e7-6318c17b9d9a tempest-GroupSnapshotsTest-534526937 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:58:38 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-fce2505e-c6c2-4114-b1e7-6318c17b9d9a tempest-GroupSnapshotsTest-534526937 None] Acquiring lock "cinder-quobyte-def650ed-13c3-4a0d-b83c-7b30f13bcb97-7ff8c233-37c1-420b-9471-e762c8a39692" by "_create_volume_from_snapshot" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:58:38 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-fce2505e-c6c2-4114-b1e7-6318c17b9d9a tempest-GroupSnapshotsTest-534526937 None] Lock "cinder-quobyte-def650ed-13c3-4a0d-b83c-7b30f13bcb97-7ff8c233-37c1-420b-9471-e762c8a39692" acquired by "_create_volume_from_snapshot" :: waited 0.018s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:58:38 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-fce2505e-c6c2-4114-b1e7-6318c17b9d9a tempest-GroupSnapshotsTest-534526937 None] Creating volume 7ff8c233-37c1-420b-9471-e762c8a39692 from snapshot def650ed-13c3-4a0d-b83c-7b30f13bcb97 {{(pid=87272) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 04 10:58:38 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-fce2505e-c6c2-4114-b1e7-6318c17b9d9a tempest-GroupSnapshotsTest-534526937 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:58:38 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-fce2505e-c6c2-4114-b1e7-6318c17b9d9a tempest-GroupSnapshotsTest-534526937 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:58:38 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-fce2505e-c6c2-4114-b1e7-6318c17b9d9a tempest-GroupSnapshotsTest-534526937 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898': None} {{(pid=87272) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:58:38 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-fce2505e-c6c2-4114-b1e7-6318c17b9d9a tempest-GroupSnapshotsTest-534526937 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'] {{(pid=87272) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:58:38 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-fce2505e-c6c2-4114-b1e7-6318c17b9d9a tempest-GroupSnapshotsTest-534526937 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:58:38 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-fce2505e-c6c2-4114-b1e7-6318c17b9d9a tempest-GroupSnapshotsTest-534526937 None] Selected osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898 as target Quobyte volume. {{(pid=87272) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 10:58:38 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-fce2505e-c6c2-4114-b1e7-6318c17b9d9a tempest-GroupSnapshotsTest-534526937 None] Acquiring lock "cinder-quobyte-7ff8c233-37c1-420b-9471-e762c8a39692" by "_copy_volume_from_snapshot" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:58:38 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-fce2505e-c6c2-4114-b1e7-6318c17b9d9a tempest-GroupSnapshotsTest-534526937 None] Lock "cinder-quobyte-7ff8c233-37c1-420b-9471-e762c8a39692" acquired by "_copy_volume_from_snapshot" :: waited 0.024s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:58:38 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-fce2505e-c6c2-4114-b1e7-6318c17b9d9a tempest-GroupSnapshotsTest-534526937 None] snapshot: def650ed-13c3-4a0d-b83c-7b30f13bcb97, volume: 7ff8c233-37c1-420b-9471-e762c8a39692, {{(pid=87272) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 04 10:58:38 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-fce2505e-c6c2-4114-b1e7-6318c17b9d9a tempest-GroupSnapshotsTest-534526937 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:58:38 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-fce2505e-c6c2-4114-b1e7-6318c17b9d9a tempest-GroupSnapshotsTest-534526937 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:58:38 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-fce2505e-c6c2-4114-b1e7-6318c17b9d9a tempest-GroupSnapshotsTest-534526937 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898': None} {{(pid=87272) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:58:38 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-fce2505e-c6c2-4114-b1e7-6318c17b9d9a tempest-GroupSnapshotsTest-534526937 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'] {{(pid=87272) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:58:38 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-fce2505e-c6c2-4114-b1e7-6318c17b9d9a tempest-GroupSnapshotsTest-534526937 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:58:38 devstack cinder-volume[87272]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dea4647-698d-441b-b571-57f5a54ffa2d]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:58:38 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-fce2505e-c6c2-4114-b1e7-6318c17b9d9a tempest-GroupSnapshotsTest-534526937 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-d797f36d-80b5-45cf-9896-2edbb0741f0d.def650ed-13c3-4a0d-b83c-7b30f13bcb97 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:58:38 devstack sudo[98258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-d797f36d-80b5-45cf-9896-2edbb0741f0d.def650ed-13c3-4a0d-b83c-7b30f13bcb97 Nov 04 10:58:38 devstack sudo[98258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:58:39 devstack sudo[98258]: pam_unix(sudo:session): session closed for user root Nov 04 10:58:39 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-fce2505e-c6c2-4114-b1e7-6318c17b9d9a tempest-GroupSnapshotsTest-534526937 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-d797f36d-80b5-45cf-9896-2edbb0741f0d.def650ed-13c3-4a0d-b83c-7b30f13bcb97" returned: 0 in 0.637s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:58:39 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.remotefs [None req-fce2505e-c6c2-4114-b1e7-6318c17b9d9a tempest-GroupSnapshotsTest-534526937 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d797f36d-80b5-45cf-9896-2edbb0741f0d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87272) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 10:58:39 devstack cinder-volume[87272]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9b392e1-7dc7-47f9-818b-f10ab775c5ab]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:58:39 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-fce2505e-c6c2-4114-b1e7-6318c17b9d9a tempest-GroupSnapshotsTest-534526937 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-d797f36d-80b5-45cf-9896-2edbb0741f0d {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:58:39 devstack sudo[98263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-d797f36d-80b5-45cf-9896-2edbb0741f0d Nov 04 10:58:39 devstack sudo[98263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:58:39 devstack sudo[98263]: pam_unix(sudo:session): session closed for user root Nov 04 10:58:39 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-fce2505e-c6c2-4114-b1e7-6318c17b9d9a tempest-GroupSnapshotsTest-534526937 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-d797f36d-80b5-45cf-9896-2edbb0741f0d" returned: 0 in 0.456s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:58:39 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-fce2505e-c6c2-4114-b1e7-6318c17b9d9a tempest-GroupSnapshotsTest-534526937 None] will copy from snapshot at /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-d797f36d-80b5-45cf-9896-2edbb0741f0d {{(pid=87272) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 04 10:58:39 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-fce2505e-c6c2-4114-b1e7-6318c17b9d9a tempest-GroupSnapshotsTest-534526937 None] Creating direct copy from snapshot {{(pid=87272) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 04 10:58:39 devstack cinder-volume[87272]: DEBUG cinder.utils [None req-fce2505e-c6c2-4114-b1e7-6318c17b9d9a tempest-GroupSnapshotsTest-534526937 None] Path /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-7ff8c233-37c1-420b-9471-e762c8a39692 not found in is_blk_device check {{(pid=87272) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Nov 04 10:58:39 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-fce2505e-c6c2-4114-b1e7-6318c17b9d9a tempest-GroupSnapshotsTest-534526937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-d797f36d-80b5-45cf-9896-2edbb0741f0d /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-7ff8c233-37c1-420b-9471-e762c8a39692 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:58:39 devstack sudo[98268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-d797f36d-80b5-45cf-9896-2edbb0741f0d /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-7ff8c233-37c1-420b-9471-e762c8a39692 Nov 04 10:58:39 devstack sudo[98268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:58:40 devstack cinder-volume[87272]: DEBUG cinder.volume.flows.manager.create_volume [None req-9100fd15-5b25-4429-b298-d9738c06a966 tempest-VolumesTransfersV357Test-539385617 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87272) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 10:58:40 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-9100fd15-5b25-4429-b298-d9738c06a966 tempest-VolumesTransfersV357Test-539385617 None] Flow 'volume_create_manager' (fa88d145-b3b2-4440-ace9-21e222692bfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:58:40 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-9100fd15-5b25-4429-b298-d9738c06a966 tempest-VolumesTransfersV357Test-539385617 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bbaf58d4-25f6-482d-8362-c2065abd6b53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:58:40 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-9100fd15-5b25-4429-b298-d9738c06a966 tempest-VolumesTransfersV357Test-539385617 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bbaf58d4-25f6-482d-8362-c2065abd6b53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T09:58:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-2137553519',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=51e5700a-8225-4067-a23e-95b9b24cccf9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c2132d0645fb4147a17f0e04f4a7ef2e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T09:58:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T09:58:40Z,use_quota=True,user_id='d003243c40284ace8b5413f343306816',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8989e4f-21e3-4f0a-9584-0d818784e883),volume_type_id=f8989e4f-21e3-4f0a-9584-0d818784e883)' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:58:40 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-9100fd15-5b25-4429-b298-d9738c06a966 tempest-VolumesTransfersV357Test-539385617 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (33b66992-d883-494d-8d02-24208170327d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:58:40 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-9100fd15-5b25-4429-b298-d9738c06a966 tempest-VolumesTransfersV357Test-539385617 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (33b66992-d883-494d-8d02-24208170327d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:58:40 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-9100fd15-5b25-4429-b298-d9738c06a966 tempest-VolumesTransfersV357Test-539385617 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e508d16-dcbf-4652-b5bc-0f44a809c64b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:58:40 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-9100fd15-5b25-4429-b298-d9738c06a966 tempest-VolumesTransfersV357Test-539385617 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e508d16-dcbf-4652-b5bc-0f44a809c64b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '51e5700a-8225-4067-a23e-95b9b24cccf9', 'volume_name': 'volume-51e5700a-8225-4067-a23e-95b9b24cccf9', 'volume_size': 1}' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:58:40 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-9100fd15-5b25-4429-b298-d9738c06a966 tempest-VolumesTransfersV357Test-539385617 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76de6b21-8a61-49f0-9c2f-5bfed8bddd87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:58:40 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-9100fd15-5b25-4429-b298-d9738c06a966 tempest-VolumesTransfersV357Test-539385617 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76de6b21-8a61-49f0-9c2f-5bfed8bddd87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:58:40 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-9100fd15-5b25-4429-b298-d9738c06a966 tempest-VolumesTransfersV357Test-539385617 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb20a2e7-4ecd-46c4-abe5-ff2f048b96da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:58:40 devstack cinder-volume[87272]: INFO cinder.volume.flows.manager.create_volume [None req-9100fd15-5b25-4429-b298-d9738c06a966 tempest-VolumesTransfersV357Test-539385617 None] Volume 51e5700a-8225-4067-a23e-95b9b24cccf9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-51e5700a-8225-4067-a23e-95b9b24cccf9', 'volume_size': 1} Nov 04 10:58:40 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-9100fd15-5b25-4429-b298-d9738c06a966 tempest-VolumesTransfersV357Test-539385617 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:58:46 devstack cinder-volume[87272]: DEBUG dbcounter [-] [87272] Writing DB stats cinder:SELECT=111,cinder:UPDATE=137,cinder:INSERT=32,cinder:DELETE=11 {{(pid=87272) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 10:58:48 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-fce2505e-c6c2-4114-b1e7-6318c17b9d9a tempest-GroupSnapshotsTest-534526937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-d797f36d-80b5-45cf-9896-2edbb0741f0d /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-7ff8c233-37c1-420b-9471-e762c8a39692" returned: 0 in 8.906s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:58:48 devstack cinder-volume[87272]: DEBUG cinder.image.image_utils [None req-fce2505e-c6c2-4114-b1e7-6318c17b9d9a tempest-GroupSnapshotsTest-534526937 None] Image conversion details: src /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-d797f36d-80b5-45cf-9896-2edbb0741f0d, size 1024.00 MB, duration 8.91 sec, destination /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-7ff8c233-37c1-420b-9471-e762c8a39692 {{(pid=87272) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Nov 04 10:58:48 devstack cinder-volume[87272]: INFO cinder.image.image_utils [None req-fce2505e-c6c2-4114-b1e7-6318c17b9d9a tempest-GroupSnapshotsTest-534526937 None] Converted 1024.00 MB image at 114.97 MB/s Nov 04 10:58:48 devstack cinder-volume[87272]: WARNING cinder.volume.drivers.remotefs [None req-fce2505e-c6c2-4114-b1e7-6318c17b9d9a tempest-GroupSnapshotsTest-534526937 None] /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-7ff8c233-37c1-420b-9471-e762c8a39692 is being set with open permissions: ugo+rw: NotImplementedError Nov 04 10:58:48 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-fce2505e-c6c2-4114-b1e7-6318c17b9d9a tempest-GroupSnapshotsTest-534526937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-7ff8c233-37c1-420b-9471-e762c8a39692 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:58:48 devstack sudo[98282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-7ff8c233-37c1-420b-9471-e762c8a39692 Nov 04 10:58:48 devstack sudo[98282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:58:48 devstack sudo[98282]: pam_unix(sudo:session): session closed for user root Nov 04 10:58:48 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-fce2505e-c6c2-4114-b1e7-6318c17b9d9a tempest-GroupSnapshotsTest-534526937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-7ff8c233-37c1-420b-9471-e762c8a39692" returned: 0 in 0.313s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:58:48 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-fce2505e-c6c2-4114-b1e7-6318c17b9d9a tempest-GroupSnapshotsTest-534526937 None] Lock "cinder-quobyte-7ff8c233-37c1-420b-9471-e762c8a39692" released by "_copy_volume_from_snapshot" :: held 10.457s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:58:48 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-fce2505e-c6c2-4114-b1e7-6318c17b9d9a tempest-GroupSnapshotsTest-534526937 None] Lock "cinder-quobyte-def650ed-13c3-4a0d-b83c-7b30f13bcb97-7ff8c233-37c1-420b-9471-e762c8a39692" released by "_create_volume_from_snapshot" :: held 10.556s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:58:48 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-fce2505e-c6c2-4114-b1e7-6318c17b9d9a tempest-GroupSnapshotsTest-534526937 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.575s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:58:48 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-9100fd15-5b25-4429-b298-d9738c06a966 tempest-VolumesTransfersV357Test-539385617 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.603s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:58:48 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-9100fd15-5b25-4429-b298-d9738c06a966 tempest-VolumesTransfersV357Test-539385617 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T09:58:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-2137553519',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=51e5700a-8225-4067-a23e-95b9b24cccf9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c2132d0645fb4147a17f0e04f4a7ef2e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T09:58:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T09:58:40Z,use_quota=True,user_id='d003243c40284ace8b5413f343306816',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8989e4f-21e3-4f0a-9584-0d818784e883),volume_type_id=f8989e4f-21e3-4f0a-9584-0d818784e883)}" {{(pid=87272) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 04 10:58:48 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.remotefs [None req-9100fd15-5b25-4429-b298-d9738c06a966 tempest-VolumesTransfersV357Test-539385617 None] Creating volume 51e5700a-8225-4067-a23e-95b9b24cccf9 {{(pid=87272) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 10:58:48 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-9100fd15-5b25-4429-b298-d9738c06a966 tempest-VolumesTransfersV357Test-539385617 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:58:48 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-9100fd15-5b25-4429-b298-d9738c06a966 tempest-VolumesTransfersV357Test-539385617 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:58:48 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-9100fd15-5b25-4429-b298-d9738c06a966 tempest-VolumesTransfersV357Test-539385617 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898': None} {{(pid=87272) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:58:48 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-9100fd15-5b25-4429-b298-d9738c06a966 tempest-VolumesTransfersV357Test-539385617 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'] {{(pid=87272) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:58:48 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-9100fd15-5b25-4429-b298-d9738c06a966 tempest-VolumesTransfersV357Test-539385617 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:58:48 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-9100fd15-5b25-4429-b298-d9738c06a966 tempest-VolumesTransfersV357Test-539385617 None] Selected osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898 as target Quobyte volume. {{(pid=87272) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 10:58:48 devstack cinder-volume[87272]: INFO cinder.volume.drivers.remotefs [None req-9100fd15-5b25-4429-b298-d9738c06a966 tempest-VolumesTransfersV357Test-539385617 None] casted to osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898 Nov 04 10:58:48 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-9100fd15-5b25-4429-b298-d9738c06a966 tempest-VolumesTransfersV357Test-539385617 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-51e5700a-8225-4067-a23e-95b9b24cccf9 1073741824 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:58:49 devstack sudo[98285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-51e5700a-8225-4067-a23e-95b9b24cccf9 1073741824 Nov 04 10:58:49 devstack sudo[98285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:58:49 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-fce2505e-c6c2-4114-b1e7-6318c17b9d9a tempest-GroupSnapshotsTest-534526937 None] Create group from source-snapshot-02e4ecad-fe16-46e5-a586-19a20f07c6c0 completed successfully. Nov 04 10:58:49 devstack sudo[98285]: pam_unix(sudo:session): session closed for user root Nov 04 10:58:49 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-9100fd15-5b25-4429-b298-d9738c06a966 tempest-VolumesTransfersV357Test-539385617 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-51e5700a-8225-4067-a23e-95b9b24cccf9 1073741824" returned: 0 in 0.580s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:58:49 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-9100fd15-5b25-4429-b298-d9738c06a966 tempest-VolumesTransfersV357Test-539385617 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-51e5700a-8225-4067-a23e-95b9b24cccf9 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:58:49 devstack sudo[98291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-51e5700a-8225-4067-a23e-95b9b24cccf9 Nov 04 10:58:49 devstack sudo[98291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:58:50 devstack sudo[98291]: pam_unix(sudo:session): session closed for user root Nov 04 10:58:50 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-9100fd15-5b25-4429-b298-d9738c06a966 tempest-VolumesTransfersV357Test-539385617 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-51e5700a-8225-4067-a23e-95b9b24cccf9" returned: 0 in 0.420s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:58:50 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-9100fd15-5b25-4429-b298-d9738c06a966 tempest-VolumesTransfersV357Test-539385617 None] <== create_volume: return (1048ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'} {{(pid=87272) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 04 10:58:50 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-9100fd15-5b25-4429-b298-d9738c06a966 tempest-VolumesTransfersV357Test-539385617 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.051s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:58:50 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-9100fd15-5b25-4429-b298-d9738c06a966 tempest-VolumesTransfersV357Test-539385617 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb20a2e7-4ecd-46c4-abe5-ff2f048b96da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-51e5700a-8225-4067-a23e-95b9b24cccf9', 'volume_size': 1}' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:58:50 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-9100fd15-5b25-4429-b298-d9738c06a966 tempest-VolumesTransfersV357Test-539385617 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (007e251d-3acd-4e58-b47a-973fe593c478) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:58:50 devstack cinder-volume[87272]: INFO cinder.volume.flows.manager.create_volume [None req-9100fd15-5b25-4429-b298-d9738c06a966 tempest-VolumesTransfersV357Test-539385617 None] Volume volume-51e5700a-8225-4067-a23e-95b9b24cccf9 (51e5700a-8225-4067-a23e-95b9b24cccf9): created successfully Nov 04 10:58:50 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-9100fd15-5b25-4429-b298-d9738c06a966 tempest-VolumesTransfersV357Test-539385617 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (007e251d-3acd-4e58-b47a-973fe593c478) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:58:50 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-9100fd15-5b25-4429-b298-d9738c06a966 tempest-VolumesTransfersV357Test-539385617 None] Flow 'volume_create_manager' (fa88d145-b3b2-4440-ace9-21e222692bfe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87272) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:58:50 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-9100fd15-5b25-4429-b298-d9738c06a966 tempest-VolumesTransfersV357Test-539385617 None] Created volume successfully. Nov 04 10:58:50 devstack cinder-volume[87272]: DEBUG cinder.volume.flows.manager.create_volume [None req-e580126e-2db6-4134-8acb-6c8b232eb1de tempest-VolumesTestJSON-135941414 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87272) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 10:58:50 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-e580126e-2db6-4134-8acb-6c8b232eb1de tempest-VolumesTestJSON-135941414 None] Flow 'volume_create_manager' (932cb98a-5e84-44c6-9879-a3b65eb9c64f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:58:50 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-e580126e-2db6-4134-8acb-6c8b232eb1de tempest-VolumesTestJSON-135941414 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f88e7eb0-822d-4bb8-948f-4b3aa309ab4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:58:50 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-e580126e-2db6-4134-8acb-6c8b232eb1de tempest-VolumesTestJSON-135941414 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f88e7eb0-822d-4bb8-948f-4b3aa309ab4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T09:58:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-847564082',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e24b817-8c6b-45b6-9958-1d70c7eacf7b,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='75c6c047147047f98e183f059a8823e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T09:58:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T09:58:50Z,use_quota=True,user_id='b1c908c23315472d92c4202ad2718401',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8989e4f-21e3-4f0a-9584-0d818784e883),volume_type_id=f8989e4f-21e3-4f0a-9584-0d818784e883)' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:58:50 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-e580126e-2db6-4134-8acb-6c8b232eb1de tempest-VolumesTestJSON-135941414 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f40489c8-19f4-4ef3-8959-d0988765b58d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:58:50 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-e580126e-2db6-4134-8acb-6c8b232eb1de tempest-VolumesTestJSON-135941414 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f40489c8-19f4-4ef3-8959-d0988765b58d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:58:50 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-e580126e-2db6-4134-8acb-6c8b232eb1de tempest-VolumesTestJSON-135941414 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de7fa471-4715-4b95-8d6b-68d5f1eabf02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:58:50 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-e580126e-2db6-4134-8acb-6c8b232eb1de tempest-VolumesTestJSON-135941414 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de7fa471-4715-4b95-8d6b-68d5f1eabf02) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5e24b817-8c6b-45b6-9958-1d70c7eacf7b', 'volume_name': 'volume-5e24b817-8c6b-45b6-9958-1d70c7eacf7b', 'volume_size': 1}' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:58:50 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-e580126e-2db6-4134-8acb-6c8b232eb1de tempest-VolumesTestJSON-135941414 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1768047e-0963-4956-95e7-9c580fcf7ad8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:58:50 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-e580126e-2db6-4134-8acb-6c8b232eb1de tempest-VolumesTestJSON-135941414 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1768047e-0963-4956-95e7-9c580fcf7ad8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:58:50 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-e580126e-2db6-4134-8acb-6c8b232eb1de tempest-VolumesTestJSON-135941414 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59cebbf7-4ad8-4a65-b930-6740041c74b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:58:50 devstack cinder-volume[87272]: INFO cinder.volume.flows.manager.create_volume [None req-e580126e-2db6-4134-8acb-6c8b232eb1de tempest-VolumesTestJSON-135941414 None] Volume 5e24b817-8c6b-45b6-9958-1d70c7eacf7b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5e24b817-8c6b-45b6-9958-1d70c7eacf7b', 'volume_size': 1} Nov 04 10:58:50 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-e580126e-2db6-4134-8acb-6c8b232eb1de tempest-VolumesTestJSON-135941414 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:58:50 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-e580126e-2db6-4134-8acb-6c8b232eb1de tempest-VolumesTestJSON-135941414 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:58:50 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-e580126e-2db6-4134-8acb-6c8b232eb1de tempest-VolumesTestJSON-135941414 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T09:58:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-847564082',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e24b817-8c6b-45b6-9958-1d70c7eacf7b,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='75c6c047147047f98e183f059a8823e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T09:58:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T09:58:50Z,use_quota=True,user_id='b1c908c23315472d92c4202ad2718401',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8989e4f-21e3-4f0a-9584-0d818784e883),volume_type_id=f8989e4f-21e3-4f0a-9584-0d818784e883)}" {{(pid=87272) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 04 10:58:50 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.remotefs [None req-e580126e-2db6-4134-8acb-6c8b232eb1de tempest-VolumesTestJSON-135941414 None] Creating volume 5e24b817-8c6b-45b6-9958-1d70c7eacf7b {{(pid=87272) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 10:58:50 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-e580126e-2db6-4134-8acb-6c8b232eb1de tempest-VolumesTestJSON-135941414 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:58:50 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-e580126e-2db6-4134-8acb-6c8b232eb1de tempest-VolumesTestJSON-135941414 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:58:50 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-e580126e-2db6-4134-8acb-6c8b232eb1de tempest-VolumesTestJSON-135941414 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898': None} {{(pid=87272) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:58:50 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-e580126e-2db6-4134-8acb-6c8b232eb1de tempest-VolumesTestJSON-135941414 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'] {{(pid=87272) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:58:50 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-e580126e-2db6-4134-8acb-6c8b232eb1de tempest-VolumesTestJSON-135941414 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:58:50 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-e580126e-2db6-4134-8acb-6c8b232eb1de tempest-VolumesTestJSON-135941414 None] Selected osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898 as target Quobyte volume. {{(pid=87272) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 10:58:50 devstack cinder-volume[87272]: INFO cinder.volume.drivers.remotefs [None req-e580126e-2db6-4134-8acb-6c8b232eb1de tempest-VolumesTestJSON-135941414 None] casted to osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898 Nov 04 10:58:50 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-e580126e-2db6-4134-8acb-6c8b232eb1de tempest-VolumesTestJSON-135941414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-5e24b817-8c6b-45b6-9958-1d70c7eacf7b 1073741824 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:58:50 devstack sudo[98296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-5e24b817-8c6b-45b6-9958-1d70c7eacf7b 1073741824 Nov 04 10:58:50 devstack sudo[98296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:58:50 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-32b53377-ec3e-4976-8f4a-fdd08a0d9488 tempest-GroupSnapshotsTest-534526937 None] Acquiring lock "cinder-quobyte-7ff8c233-37c1-420b-9471-e762c8a39692" by "delete_volume" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:58:50 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-32b53377-ec3e-4976-8f4a-fdd08a0d9488 tempest-GroupSnapshotsTest-534526937 None] Lock "cinder-quobyte-7ff8c233-37c1-420b-9471-e762c8a39692" acquired by "delete_volume" :: waited 0.028s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:58:50 devstack cinder-volume[87272]: DEBUG oslo.privsep.daemon [-] privsep: reply[02c8e3fc-a19d-403a-aaef-1b840ce8a147]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:58:50 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-32b53377-ec3e-4976-8f4a-fdd08a0d9488 tempest-GroupSnapshotsTest-534526937 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-7ff8c233-37c1-420b-9471-e762c8a39692 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:58:51 devstack sudo[98301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-7ff8c233-37c1-420b-9471-e762c8a39692 Nov 04 10:58:51 devstack sudo[98301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:58:51 devstack sudo[98296]: pam_unix(sudo:session): session closed for user root Nov 04 10:58:51 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-e580126e-2db6-4134-8acb-6c8b232eb1de tempest-VolumesTestJSON-135941414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-5e24b817-8c6b-45b6-9958-1d70c7eacf7b 1073741824" returned: 0 in 0.807s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:58:51 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-e580126e-2db6-4134-8acb-6c8b232eb1de tempest-VolumesTestJSON-135941414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-5e24b817-8c6b-45b6-9958-1d70c7eacf7b {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:58:51 devstack sudo[98304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-5e24b817-8c6b-45b6-9958-1d70c7eacf7b Nov 04 10:58:51 devstack sudo[98304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:58:51 devstack sudo[98301]: pam_unix(sudo:session): session closed for user root Nov 04 10:58:51 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-32b53377-ec3e-4976-8f4a-fdd08a0d9488 tempest-GroupSnapshotsTest-534526937 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-7ff8c233-37c1-420b-9471-e762c8a39692" returned: 0 in 0.586s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:58:51 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-32b53377-ec3e-4976-8f4a-fdd08a0d9488 tempest-GroupSnapshotsTest-534526937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-7ff8c233-37c1-420b-9471-e762c8a39692 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:58:51 devstack sudo[98309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-7ff8c233-37c1-420b-9471-e762c8a39692 Nov 04 10:58:51 devstack sudo[98309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:58:51 devstack sudo[98304]: pam_unix(sudo:session): session closed for user root Nov 04 10:58:51 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-e580126e-2db6-4134-8acb-6c8b232eb1de tempest-VolumesTestJSON-135941414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-5e24b817-8c6b-45b6-9958-1d70c7eacf7b" returned: 0 in 0.410s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:58:51 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-e580126e-2db6-4134-8acb-6c8b232eb1de tempest-VolumesTestJSON-135941414 None] <== create_volume: return (1286ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'} {{(pid=87272) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 04 10:58:51 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-e580126e-2db6-4134-8acb-6c8b232eb1de tempest-VolumesTestJSON-135941414 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.293s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:58:51 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-e580126e-2db6-4134-8acb-6c8b232eb1de tempest-VolumesTestJSON-135941414 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59cebbf7-4ad8-4a65-b930-6740041c74b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5e24b817-8c6b-45b6-9958-1d70c7eacf7b', 'volume_size': 1}' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:58:51 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-e580126e-2db6-4134-8acb-6c8b232eb1de tempest-VolumesTestJSON-135941414 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a08e8646-b06d-4601-8410-925e234676ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:58:51 devstack cinder-volume[87272]: INFO cinder.volume.flows.manager.create_volume [None req-e580126e-2db6-4134-8acb-6c8b232eb1de tempest-VolumesTestJSON-135941414 None] Volume volume-5e24b817-8c6b-45b6-9958-1d70c7eacf7b (5e24b817-8c6b-45b6-9958-1d70c7eacf7b): created successfully Nov 04 10:58:51 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-e580126e-2db6-4134-8acb-6c8b232eb1de tempest-VolumesTestJSON-135941414 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a08e8646-b06d-4601-8410-925e234676ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:58:51 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-e580126e-2db6-4134-8acb-6c8b232eb1de tempest-VolumesTestJSON-135941414 None] Flow 'volume_create_manager' (932cb98a-5e84-44c6-9879-a3b65eb9c64f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87272) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:58:51 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-e580126e-2db6-4134-8acb-6c8b232eb1de tempest-VolumesTestJSON-135941414 None] Created volume successfully. Nov 04 10:58:51 devstack sudo[98309]: pam_unix(sudo:session): session closed for user root Nov 04 10:58:51 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-32b53377-ec3e-4976-8f4a-fdd08a0d9488 tempest-GroupSnapshotsTest-534526937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-7ff8c233-37c1-420b-9471-e762c8a39692" returned: 0 in 0.383s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:58:51 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-32b53377-ec3e-4976-8f4a-fdd08a0d9488 tempest-GroupSnapshotsTest-534526937 None] Lock "cinder-quobyte-7ff8c233-37c1-420b-9471-e762c8a39692" released by "delete_volume" :: held 1.060s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:58:51 devstack cinder-volume[87272]: DEBUG cinder.quota [None req-32b53377-ec3e-4976-8f4a-fdd08a0d9488 tempest-GroupSnapshotsTest-534526937 None] Created reservations ['b5a628e9-05da-441e-8161-97c2dbe1b248'] {{(pid=87272) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 10:58:51 devstack cinder-volume[87272]: WARNING cinder.quota [None req-32b53377-ec3e-4976-8f4a-fdd08a0d9488 tempest-GroupSnapshotsTest-534526937 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-118709704 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-118709704, it is now deprecated. Please use the default quota class for default quota. Nov 04 10:58:51 devstack cinder-volume[87272]: WARNING cinder.quota [None req-32b53377-ec3e-4976-8f4a-fdd08a0d9488 tempest-GroupSnapshotsTest-534526937 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-118709704 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-118709704, it is now deprecated. Please use the default quota class for default quota. Nov 04 10:58:51 devstack cinder-volume[87272]: DEBUG cinder.quota [None req-32b53377-ec3e-4976-8f4a-fdd08a0d9488 tempest-GroupSnapshotsTest-534526937 None] Created reservations ['c93d8f86-d978-4ba7-8a9b-fed71fcc03c9', '9fccf08c-dcde-49a0-91ed-a01c42235082', 'adfa65fe-494e-4933-b2ea-bb20d0fefca7', '99004d38-c438-4325-b185-6a63328509e9'] {{(pid=87272) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 10:58:52 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-897a98e6-971a-4169-94a3-27aad43a1458 tempest-VolumesTransfersV357Test-564374243 None] Transfer volume completed successfully. Nov 04 10:58:52 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-32b53377-ec3e-4976-8f4a-fdd08a0d9488 tempest-GroupSnapshotsTest-534526937 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:58:52 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-32b53377-ec3e-4976-8f4a-fdd08a0d9488 tempest-GroupSnapshotsTest-534526937 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:58:52 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-32b53377-ec3e-4976-8f4a-fdd08a0d9488 tempest-GroupSnapshotsTest-534526937 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898': None} {{(pid=87272) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:58:52 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-32b53377-ec3e-4976-8f4a-fdd08a0d9488 tempest-GroupSnapshotsTest-534526937 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'] {{(pid=87272) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:58:52 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-32b53377-ec3e-4976-8f4a-fdd08a0d9488 tempest-GroupSnapshotsTest-534526937 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:58:52 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-32b53377-ec3e-4976-8f4a-fdd08a0d9488 tempest-GroupSnapshotsTest-534526937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:58:52 devstack sudo[98313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1 Nov 04 10:58:52 devstack sudo[98313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:58:52 devstack sudo[98313]: pam_unix(sudo:session): session closed for user root Nov 04 10:58:52 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-32b53377-ec3e-4976-8f4a-fdd08a0d9488 tempest-GroupSnapshotsTest-534526937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1" returned: 0 in 0.350s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:58:52 devstack cinder-volume[87272]: DEBUG cinder.manager [None req-32b53377-ec3e-4976-8f4a-fdd08a0d9488 tempest-GroupSnapshotsTest-534526937 None] Notifying Schedulers of capabilities ... {{(pid=87272) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 10:58:52 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-32b53377-ec3e-4976-8f4a-fdd08a0d9488 tempest-GroupSnapshotsTest-534526937 None] Delete group completed successfully. Nov 04 10:58:52 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-6dbae7f8-5d17-4364-b146-77dfc4053083 tempest-VolumesTransfersV357Test-429907389 None] Acquiring lock "cinder-51e5700a-8225-4067-a23e-95b9b24cccf9-delete_volume" by "delete_volume" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:58:52 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-6dbae7f8-5d17-4364-b146-77dfc4053083 tempest-VolumesTransfersV357Test-429907389 None] Lock "cinder-51e5700a-8225-4067-a23e-95b9b24cccf9-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:58:52 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-6dbae7f8-5d17-4364-b146-77dfc4053083 tempest-VolumesTransfersV357Test-429907389 None] Acquiring lock "cinder-quobyte-51e5700a-8225-4067-a23e-95b9b24cccf9" by "delete_volume" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:58:52 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-6dbae7f8-5d17-4364-b146-77dfc4053083 tempest-VolumesTransfersV357Test-429907389 None] Lock "cinder-quobyte-51e5700a-8225-4067-a23e-95b9b24cccf9" acquired by "delete_volume" :: waited 0.022s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:58:52 devstack cinder-volume[87272]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f7c9407-891c-428f-86aa-bf7f1dbcef67]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:58:52 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-6dbae7f8-5d17-4364-b146-77dfc4053083 tempest-VolumesTransfersV357Test-429907389 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-51e5700a-8225-4067-a23e-95b9b24cccf9 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:58:53 devstack sudo[98316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-51e5700a-8225-4067-a23e-95b9b24cccf9 Nov 04 10:58:53 devstack sudo[98316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:58:53 devstack cinder-volume[87272]: DEBUG cinder.volume.flows.manager.create_volume [None req-a7f17641-edfe-40a6-994d-9e860e82fd0c tempest-VolumesTestJSON-135941414 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87272) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 10:58:53 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-a7f17641-edfe-40a6-994d-9e860e82fd0c tempest-VolumesTestJSON-135941414 None] Flow 'volume_create_manager' (3a232bb9-f3f3-403d-9a52-8a548c38164d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:58:53 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-a7f17641-edfe-40a6-994d-9e860e82fd0c tempest-VolumesTestJSON-135941414 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a0bf814-0298-404a-9359-546240162554) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:58:53 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-a7f17641-edfe-40a6-994d-9e860e82fd0c tempest-VolumesTestJSON-135941414 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a0bf814-0298-404a-9359-546240162554) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T09:58:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-400359543',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7913a8eb-e8ab-4075-95cd-20c37d6567e2,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='75c6c047147047f98e183f059a8823e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T09:58:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T09:58:53Z,use_quota=True,user_id='b1c908c23315472d92c4202ad2718401',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8989e4f-21e3-4f0a-9584-0d818784e883),volume_type_id=f8989e4f-21e3-4f0a-9584-0d818784e883)' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:58:53 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-a7f17641-edfe-40a6-994d-9e860e82fd0c tempest-VolumesTestJSON-135941414 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef2bc1e9-a474-47da-87c0-ca3edd41911d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:58:53 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-a7f17641-edfe-40a6-994d-9e860e82fd0c tempest-VolumesTestJSON-135941414 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef2bc1e9-a474-47da-87c0-ca3edd41911d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:58:53 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-a7f17641-edfe-40a6-994d-9e860e82fd0c tempest-VolumesTestJSON-135941414 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c1d5d4e6-0c7a-4877-964b-2ae02d60c913) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:58:53 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-a7f17641-edfe-40a6-994d-9e860e82fd0c tempest-VolumesTestJSON-135941414 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c1d5d4e6-0c7a-4877-964b-2ae02d60c913) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7913a8eb-e8ab-4075-95cd-20c37d6567e2', 'volume_name': 'volume-7913a8eb-e8ab-4075-95cd-20c37d6567e2', 'volume_size': 1}' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:58:53 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-a7f17641-edfe-40a6-994d-9e860e82fd0c tempest-VolumesTestJSON-135941414 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (38e462ee-4c8c-4e73-af2e-514a71d09b2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:58:53 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-a7f17641-edfe-40a6-994d-9e860e82fd0c tempest-VolumesTestJSON-135941414 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (38e462ee-4c8c-4e73-af2e-514a71d09b2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:58:53 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-a7f17641-edfe-40a6-994d-9e860e82fd0c tempest-VolumesTestJSON-135941414 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a514d641-ce39-4344-acc4-eab007c7966f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:58:53 devstack cinder-volume[87272]: INFO cinder.volume.flows.manager.create_volume [None req-a7f17641-edfe-40a6-994d-9e860e82fd0c tempest-VolumesTestJSON-135941414 None] Volume 7913a8eb-e8ab-4075-95cd-20c37d6567e2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7913a8eb-e8ab-4075-95cd-20c37d6567e2', 'volume_size': 1} Nov 04 10:58:53 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-a7f17641-edfe-40a6-994d-9e860e82fd0c tempest-VolumesTestJSON-135941414 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:58:53 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-a7f17641-edfe-40a6-994d-9e860e82fd0c tempest-VolumesTestJSON-135941414 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:58:53 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-a7f17641-edfe-40a6-994d-9e860e82fd0c tempest-VolumesTestJSON-135941414 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T09:58:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-400359543',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7913a8eb-e8ab-4075-95cd-20c37d6567e2,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='75c6c047147047f98e183f059a8823e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T09:58:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T09:58:53Z,use_quota=True,user_id='b1c908c23315472d92c4202ad2718401',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8989e4f-21e3-4f0a-9584-0d818784e883),volume_type_id=f8989e4f-21e3-4f0a-9584-0d818784e883)}" {{(pid=87272) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 04 10:58:53 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.remotefs [None req-a7f17641-edfe-40a6-994d-9e860e82fd0c tempest-VolumesTestJSON-135941414 None] Creating volume 7913a8eb-e8ab-4075-95cd-20c37d6567e2 {{(pid=87272) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 10:58:53 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-a7f17641-edfe-40a6-994d-9e860e82fd0c tempest-VolumesTestJSON-135941414 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:58:53 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-a7f17641-edfe-40a6-994d-9e860e82fd0c tempest-VolumesTestJSON-135941414 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:58:53 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-a7f17641-edfe-40a6-994d-9e860e82fd0c tempest-VolumesTestJSON-135941414 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898': None} {{(pid=87272) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:58:53 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-a7f17641-edfe-40a6-994d-9e860e82fd0c tempest-VolumesTestJSON-135941414 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'] {{(pid=87272) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:58:53 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-a7f17641-edfe-40a6-994d-9e860e82fd0c tempest-VolumesTestJSON-135941414 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:58:53 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-a7f17641-edfe-40a6-994d-9e860e82fd0c tempest-VolumesTestJSON-135941414 None] Selected osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898 as target Quobyte volume. {{(pid=87272) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 10:58:53 devstack cinder-volume[87272]: INFO cinder.volume.drivers.remotefs [None req-a7f17641-edfe-40a6-994d-9e860e82fd0c tempest-VolumesTestJSON-135941414 None] casted to osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898 Nov 04 10:58:53 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-a7f17641-edfe-40a6-994d-9e860e82fd0c tempest-VolumesTestJSON-135941414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-7913a8eb-e8ab-4075-95cd-20c37d6567e2 1073741824 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:58:53 devstack sudo[98318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-7913a8eb-e8ab-4075-95cd-20c37d6567e2 1073741824 Nov 04 10:58:53 devstack sudo[98318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:58:53 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-01c7e07d-1e0f-46de-a7f7-4efdfc0ff4ff tempest-GroupSnapshotsTest-534526937 None] group_snapshot 02e4ecad-fe16-46e5-a586-19a20f07c6c0: deleting Nov 04 10:58:53 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-01c7e07d-1e0f-46de-a7f7-4efdfc0ff4ff tempest-GroupSnapshotsTest-534526937 None] group_snapshot 02e4ecad-fe16-46e5-a586-19a20f07c6c0: deleting {{(pid=87272) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Nov 04 10:58:53 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-01c7e07d-1e0f-46de-a7f7-4efdfc0ff4ff tempest-GroupSnapshotsTest-534526937 None] Acquiring lock "cinder-quobyte-d797f36d-80b5-45cf-9896-2edbb0741f0d" by "delete_snapshot" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:58:53 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-01c7e07d-1e0f-46de-a7f7-4efdfc0ff4ff tempest-GroupSnapshotsTest-534526937 None] Lock "cinder-quobyte-d797f36d-80b5-45cf-9896-2edbb0741f0d" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:58:53 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-01c7e07d-1e0f-46de-a7f7-4efdfc0ff4ff tempest-GroupSnapshotsTest-534526937 None] Acquiring lock "cinder-quobyte-def650ed-13c3-4a0d-b83c-7b30f13bcb97" by "_delete_snapshot" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:58:53 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-01c7e07d-1e0f-46de-a7f7-4efdfc0ff4ff tempest-GroupSnapshotsTest-534526937 None] Lock "cinder-quobyte-def650ed-13c3-4a0d-b83c-7b30f13bcb97" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:58:53 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.remotefs [None req-01c7e07d-1e0f-46de-a7f7-4efdfc0ff4ff tempest-GroupSnapshotsTest-534526937 None] Deleting offline snapshot def650ed-13c3-4a0d-b83c-7b30f13bcb97 of volume d797f36d-80b5-45cf-9896-2edbb0741f0d {{(pid=87272) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 04 10:58:53 devstack sudo[98316]: pam_unix(sudo:session): session closed for user root Nov 04 10:58:53 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.remotefs [None req-01c7e07d-1e0f-46de-a7f7-4efdfc0ff4ff tempest-GroupSnapshotsTest-534526937 None] snapshot_file for this snap is: volume-d797f36d-80b5-45cf-9896-2edbb0741f0d.def650ed-13c3-4a0d-b83c-7b30f13bcb97 {{(pid=87272) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 04 10:58:53 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-6dbae7f8-5d17-4364-b146-77dfc4053083 tempest-VolumesTransfersV357Test-429907389 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-51e5700a-8225-4067-a23e-95b9b24cccf9" returned: 0 in 0.556s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:58:53 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-6dbae7f8-5d17-4364-b146-77dfc4053083 tempest-VolumesTransfersV357Test-429907389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-51e5700a-8225-4067-a23e-95b9b24cccf9 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:58:53 devstack cinder-volume[87272]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c228cff-2142-47da-a776-821132fcbd4e]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:58:53 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-01c7e07d-1e0f-46de-a7f7-4efdfc0ff4ff tempest-GroupSnapshotsTest-534526937 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-d797f36d-80b5-45cf-9896-2edbb0741f0d.def650ed-13c3-4a0d-b83c-7b30f13bcb97 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:58:53 devstack sudo[98323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-51e5700a-8225-4067-a23e-95b9b24cccf9 Nov 04 10:58:53 devstack sudo[98323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:58:53 devstack sudo[98326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-d797f36d-80b5-45cf-9896-2edbb0741f0d.def650ed-13c3-4a0d-b83c-7b30f13bcb97 Nov 04 10:58:53 devstack sudo[98326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:58:53 devstack sudo[98318]: pam_unix(sudo:session): session closed for user root Nov 04 10:58:53 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-a7f17641-edfe-40a6-994d-9e860e82fd0c tempest-VolumesTestJSON-135941414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-7913a8eb-e8ab-4075-95cd-20c37d6567e2 1073741824" returned: 0 in 0.590s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:58:53 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-a7f17641-edfe-40a6-994d-9e860e82fd0c tempest-VolumesTestJSON-135941414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-7913a8eb-e8ab-4075-95cd-20c37d6567e2 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:58:53 devstack sudo[98323]: pam_unix(sudo:session): session closed for user root Nov 04 10:58:53 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-6dbae7f8-5d17-4364-b146-77dfc4053083 tempest-VolumesTransfersV357Test-429907389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-51e5700a-8225-4067-a23e-95b9b24cccf9" returned: 0 in 0.428s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:58:53 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-6dbae7f8-5d17-4364-b146-77dfc4053083 tempest-VolumesTransfersV357Test-429907389 None] Lock "cinder-quobyte-51e5700a-8225-4067-a23e-95b9b24cccf9" released by "delete_volume" :: held 1.066s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:58:54 devstack sudo[98332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-7913a8eb-e8ab-4075-95cd-20c37d6567e2 Nov 04 10:58:54 devstack sudo[98332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:58:54 devstack sudo[98326]: pam_unix(sudo:session): session closed for user root Nov 04 10:58:54 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-01c7e07d-1e0f-46de-a7f7-4efdfc0ff4ff tempest-GroupSnapshotsTest-534526937 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-d797f36d-80b5-45cf-9896-2edbb0741f0d.def650ed-13c3-4a0d-b83c-7b30f13bcb97" returned: 0 in 0.520s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:58:54 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.remotefs [None req-01c7e07d-1e0f-46de-a7f7-4efdfc0ff4ff tempest-GroupSnapshotsTest-534526937 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d797f36d-80b5-45cf-9896-2edbb0741f0d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87272) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 10:58:54 devstack cinder-volume[87272]: DEBUG oslo.privsep.daemon [-] privsep: reply[088bbb89-4a07-4f61-b4ff-7907240fb07f]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:58:54 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-01c7e07d-1e0f-46de-a7f7-4efdfc0ff4ff tempest-GroupSnapshotsTest-534526937 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-d797f36d-80b5-45cf-9896-2edbb0741f0d {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:58:54 devstack cinder-volume[87272]: DEBUG cinder.quota [None req-6dbae7f8-5d17-4364-b146-77dfc4053083 tempest-VolumesTransfersV357Test-429907389 None] Created reservations ['8ae8093d-2c73-420c-a357-ccb5e1843882', '99c3f6c1-cd05-479a-ae93-c1cc6307616e', '46106f39-954f-42af-9977-1c8ca72d652f', '1c157231-7a85-492c-b7ca-efe708b09c1a'] {{(pid=87272) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 10:58:54 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-6dbae7f8-5d17-4364-b146-77dfc4053083 tempest-VolumesTransfersV357Test-429907389 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:58:54 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-6dbae7f8-5d17-4364-b146-77dfc4053083 tempest-VolumesTransfersV357Test-429907389 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:58:54 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-6dbae7f8-5d17-4364-b146-77dfc4053083 tempest-VolumesTransfersV357Test-429907389 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898': None} {{(pid=87272) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:58:54 devstack sudo[98337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-d797f36d-80b5-45cf-9896-2edbb0741f0d Nov 04 10:58:54 devstack sudo[98337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:58:54 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-6dbae7f8-5d17-4364-b146-77dfc4053083 tempest-VolumesTransfersV357Test-429907389 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'] {{(pid=87272) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:58:54 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-6dbae7f8-5d17-4364-b146-77dfc4053083 tempest-VolumesTransfersV357Test-429907389 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:58:54 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-6dbae7f8-5d17-4364-b146-77dfc4053083 tempest-VolumesTransfersV357Test-429907389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:58:54 devstack sudo[98332]: pam_unix(sudo:session): session closed for user root Nov 04 10:58:54 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-a7f17641-edfe-40a6-994d-9e860e82fd0c tempest-VolumesTestJSON-135941414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-7913a8eb-e8ab-4075-95cd-20c37d6567e2" returned: 0 in 0.369s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:58:54 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-a7f17641-edfe-40a6-994d-9e860e82fd0c tempest-VolumesTestJSON-135941414 None] <== create_volume: return (1035ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'} {{(pid=87272) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 04 10:58:54 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-a7f17641-edfe-40a6-994d-9e860e82fd0c tempest-VolumesTestJSON-135941414 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.038s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:58:54 devstack sudo[98340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1 Nov 04 10:58:54 devstack sudo[98340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:58:54 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-a7f17641-edfe-40a6-994d-9e860e82fd0c tempest-VolumesTestJSON-135941414 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a514d641-ce39-4344-acc4-eab007c7966f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7913a8eb-e8ab-4075-95cd-20c37d6567e2', 'volume_size': 1}' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:58:54 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-a7f17641-edfe-40a6-994d-9e860e82fd0c tempest-VolumesTestJSON-135941414 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc5dd56b-e1f2-4b02-9d31-a328b22046d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:58:54 devstack cinder-volume[87272]: INFO cinder.volume.flows.manager.create_volume [None req-a7f17641-edfe-40a6-994d-9e860e82fd0c tempest-VolumesTestJSON-135941414 None] Volume volume-7913a8eb-e8ab-4075-95cd-20c37d6567e2 (7913a8eb-e8ab-4075-95cd-20c37d6567e2): created successfully Nov 04 10:58:54 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-a7f17641-edfe-40a6-994d-9e860e82fd0c tempest-VolumesTestJSON-135941414 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc5dd56b-e1f2-4b02-9d31-a328b22046d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:58:54 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-a7f17641-edfe-40a6-994d-9e860e82fd0c tempest-VolumesTestJSON-135941414 None] Flow 'volume_create_manager' (3a232bb9-f3f3-403d-9a52-8a548c38164d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87272) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:58:54 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-a7f17641-edfe-40a6-994d-9e860e82fd0c tempest-VolumesTestJSON-135941414 None] Created volume successfully. Nov 04 10:58:54 devstack sudo[98340]: pam_unix(sudo:session): session closed for user root Nov 04 10:58:54 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-6dbae7f8-5d17-4364-b146-77dfc4053083 tempest-VolumesTransfersV357Test-429907389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1" returned: 0 in 0.341s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:58:54 devstack cinder-volume[87272]: DEBUG cinder.manager [None req-6dbae7f8-5d17-4364-b146-77dfc4053083 tempest-VolumesTransfersV357Test-429907389 None] Notifying Schedulers of capabilities ... {{(pid=87272) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 10:58:54 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-6dbae7f8-5d17-4364-b146-77dfc4053083 tempest-VolumesTransfersV357Test-429907389 None] Deleted volume successfully. Nov 04 10:58:54 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-6dbae7f8-5d17-4364-b146-77dfc4053083 tempest-VolumesTransfersV357Test-429907389 None] Lock "cinder-51e5700a-8225-4067-a23e-95b9b24cccf9-delete_volume" released by "delete_volume" :: held 1.823s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:58:54 devstack sudo[98337]: pam_unix(sudo:session): session closed for user root Nov 04 10:58:54 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-01c7e07d-1e0f-46de-a7f7-4efdfc0ff4ff tempest-GroupSnapshotsTest-534526937 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-d797f36d-80b5-45cf-9896-2edbb0741f0d" returned: 0 in 0.817s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:58:54 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-01c7e07d-1e0f-46de-a7f7-4efdfc0ff4ff tempest-GroupSnapshotsTest-534526937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-d797f36d-80b5-45cf-9896-2edbb0741f0d.def650ed-13c3-4a0d-b83c-7b30f13bcb97 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:58:54 devstack sudo[98346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-d797f36d-80b5-45cf-9896-2edbb0741f0d.def650ed-13c3-4a0d-b83c-7b30f13bcb97 Nov 04 10:58:54 devstack sudo[98346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:58:55 devstack sudo[98346]: pam_unix(sudo:session): session closed for user root Nov 04 10:58:55 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-01c7e07d-1e0f-46de-a7f7-4efdfc0ff4ff tempest-GroupSnapshotsTest-534526937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-d797f36d-80b5-45cf-9896-2edbb0741f0d.def650ed-13c3-4a0d-b83c-7b30f13bcb97" returned: 0 in 0.443s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:58:55 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-01c7e07d-1e0f-46de-a7f7-4efdfc0ff4ff tempest-GroupSnapshotsTest-534526937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-d797f36d-80b5-45cf-9896-2edbb0741f0d.def650ed-13c3-4a0d-b83c-7b30f13bcb97 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:58:55 devstack sudo[98353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-d797f36d-80b5-45cf-9896-2edbb0741f0d.def650ed-13c3-4a0d-b83c-7b30f13bcb97 Nov 04 10:58:55 devstack sudo[98353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:58:55 devstack sudo[98353]: pam_unix(sudo:session): session closed for user root Nov 04 10:58:55 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-01c7e07d-1e0f-46de-a7f7-4efdfc0ff4ff tempest-GroupSnapshotsTest-534526937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-d797f36d-80b5-45cf-9896-2edbb0741f0d.def650ed-13c3-4a0d-b83c-7b30f13bcb97" returned: 0 in 0.377s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:58:55 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-01c7e07d-1e0f-46de-a7f7-4efdfc0ff4ff tempest-GroupSnapshotsTest-534526937 None] Lock "cinder-quobyte-def650ed-13c3-4a0d-b83c-7b30f13bcb97" released by "_delete_snapshot" :: held 2.321s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:58:55 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-01c7e07d-1e0f-46de-a7f7-4efdfc0ff4ff tempest-GroupSnapshotsTest-534526937 None] Lock "cinder-quobyte-d797f36d-80b5-45cf-9896-2edbb0741f0d" released by "delete_snapshot" :: held 2.362s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:58:55 devstack cinder-volume[87272]: DEBUG cinder.volume.flows.manager.create_volume [None req-85a19867-92d1-4598-9ff0-62fa5ddea988 tempest-VolumesTransfersV357Test-539385617 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87272) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 10:58:55 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-85a19867-92d1-4598-9ff0-62fa5ddea988 tempest-VolumesTransfersV357Test-539385617 None] Flow 'volume_create_manager' (4202cc6f-6f01-4845-8ed7-40881a7f7369) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:58:55 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-85a19867-92d1-4598-9ff0-62fa5ddea988 tempest-VolumesTransfersV357Test-539385617 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cda8b342-adf7-41ad-84cd-c721dfbfd8d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:58:55 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-85a19867-92d1-4598-9ff0-62fa5ddea988 tempest-VolumesTransfersV357Test-539385617 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cda8b342-adf7-41ad-84cd-c721dfbfd8d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T09:58:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1522941543',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=76404812-a7de-4a25-ae85-50bab1946d31,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c2132d0645fb4147a17f0e04f4a7ef2e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T09:58:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T09:58:56Z,use_quota=True,user_id='d003243c40284ace8b5413f343306816',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8989e4f-21e3-4f0a-9584-0d818784e883),volume_type_id=f8989e4f-21e3-4f0a-9584-0d818784e883)' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:58:55 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-85a19867-92d1-4598-9ff0-62fa5ddea988 tempest-VolumesTransfersV357Test-539385617 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (90e5cf95-e544-4eb1-9efe-bc4a5aa54394) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:58:55 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-85a19867-92d1-4598-9ff0-62fa5ddea988 tempest-VolumesTransfersV357Test-539385617 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (90e5cf95-e544-4eb1-9efe-bc4a5aa54394) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:58:55 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-85a19867-92d1-4598-9ff0-62fa5ddea988 tempest-VolumesTransfersV357Test-539385617 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d248355-8033-483e-ab5a-dee0270f11c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:58:55 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-85a19867-92d1-4598-9ff0-62fa5ddea988 tempest-VolumesTransfersV357Test-539385617 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d248355-8033-483e-ab5a-dee0270f11c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '76404812-a7de-4a25-ae85-50bab1946d31', 'volume_name': 'volume-76404812-a7de-4a25-ae85-50bab1946d31', 'volume_size': 1}' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:58:55 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-85a19867-92d1-4598-9ff0-62fa5ddea988 tempest-VolumesTransfersV357Test-539385617 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0cfe01f7-1d9a-457e-9d2e-9d2efa2a3dbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:58:55 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-85a19867-92d1-4598-9ff0-62fa5ddea988 tempest-VolumesTransfersV357Test-539385617 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0cfe01f7-1d9a-457e-9d2e-9d2efa2a3dbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:58:55 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-85a19867-92d1-4598-9ff0-62fa5ddea988 tempest-VolumesTransfersV357Test-539385617 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25e993e4-5f09-4918-9188-e2501d1f08f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:58:55 devstack cinder-volume[87272]: INFO cinder.volume.flows.manager.create_volume [None req-85a19867-92d1-4598-9ff0-62fa5ddea988 tempest-VolumesTransfersV357Test-539385617 None] Volume 76404812-a7de-4a25-ae85-50bab1946d31: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-76404812-a7de-4a25-ae85-50bab1946d31', 'volume_size': 1} Nov 04 10:58:55 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-85a19867-92d1-4598-9ff0-62fa5ddea988 tempest-VolumesTransfersV357Test-539385617 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:58:55 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-85a19867-92d1-4598-9ff0-62fa5ddea988 tempest-VolumesTransfersV357Test-539385617 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:58:55 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-85a19867-92d1-4598-9ff0-62fa5ddea988 tempest-VolumesTransfersV357Test-539385617 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T09:58:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1522941543',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=76404812-a7de-4a25-ae85-50bab1946d31,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c2132d0645fb4147a17f0e04f4a7ef2e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T09:58:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T09:58:56Z,use_quota=True,user_id='d003243c40284ace8b5413f343306816',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8989e4f-21e3-4f0a-9584-0d818784e883),volume_type_id=f8989e4f-21e3-4f0a-9584-0d818784e883)}" {{(pid=87272) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 04 10:58:55 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.remotefs [None req-85a19867-92d1-4598-9ff0-62fa5ddea988 tempest-VolumesTransfersV357Test-539385617 None] Creating volume 76404812-a7de-4a25-ae85-50bab1946d31 {{(pid=87272) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 10:58:55 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-85a19867-92d1-4598-9ff0-62fa5ddea988 tempest-VolumesTransfersV357Test-539385617 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:58:55 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-85a19867-92d1-4598-9ff0-62fa5ddea988 tempest-VolumesTransfersV357Test-539385617 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:58:55 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-85a19867-92d1-4598-9ff0-62fa5ddea988 tempest-VolumesTransfersV357Test-539385617 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898': None} {{(pid=87272) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:58:55 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-85a19867-92d1-4598-9ff0-62fa5ddea988 tempest-VolumesTransfersV357Test-539385617 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'] {{(pid=87272) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:58:55 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-85a19867-92d1-4598-9ff0-62fa5ddea988 tempest-VolumesTransfersV357Test-539385617 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:58:55 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-85a19867-92d1-4598-9ff0-62fa5ddea988 tempest-VolumesTransfersV357Test-539385617 None] Selected osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898 as target Quobyte volume. {{(pid=87272) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 10:58:55 devstack cinder-volume[87272]: INFO cinder.volume.drivers.remotefs [None req-85a19867-92d1-4598-9ff0-62fa5ddea988 tempest-VolumesTransfersV357Test-539385617 None] casted to osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898 Nov 04 10:58:55 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-85a19867-92d1-4598-9ff0-62fa5ddea988 tempest-VolumesTransfersV357Test-539385617 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-76404812-a7de-4a25-ae85-50bab1946d31 1073741824 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:58:56 devstack sudo[98356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-76404812-a7de-4a25-ae85-50bab1946d31 1073741824 Nov 04 10:58:56 devstack sudo[98356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:58:56 devstack cinder-volume[87272]: DEBUG cinder.volume.flows.manager.create_volume [None req-550af076-389d-4873-808e-9f7af2839542 tempest-VolumesTestJSON-135941414 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87272) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 10:58:56 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-550af076-389d-4873-808e-9f7af2839542 tempest-VolumesTestJSON-135941414 None] Flow 'volume_create_manager' (a66379f8-121f-4526-bb05-38dc50491a70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:58:56 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-550af076-389d-4873-808e-9f7af2839542 tempest-VolumesTestJSON-135941414 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1515db12-7feb-4e0f-a8b0-131a8cba94b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:58:56 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-550af076-389d-4873-808e-9f7af2839542 tempest-VolumesTestJSON-135941414 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1515db12-7feb-4e0f-a8b0-131a8cba94b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T09:58:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1692236497',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5ce6b790-59f1-45e3-b23a-e696e290f714,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='75c6c047147047f98e183f059a8823e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T09:58:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T09:58:56Z,use_quota=True,user_id='b1c908c23315472d92c4202ad2718401',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8989e4f-21e3-4f0a-9584-0d818784e883),volume_type_id=f8989e4f-21e3-4f0a-9584-0d818784e883)' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:58:56 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-550af076-389d-4873-808e-9f7af2839542 tempest-VolumesTestJSON-135941414 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57323b3c-5783-4f59-a03f-00e598d61a97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:58:56 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-550af076-389d-4873-808e-9f7af2839542 tempest-VolumesTestJSON-135941414 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57323b3c-5783-4f59-a03f-00e598d61a97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:58:56 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-550af076-389d-4873-808e-9f7af2839542 tempest-VolumesTestJSON-135941414 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (318bd995-65bd-4150-b15f-c79be447310b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:58:56 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-550af076-389d-4873-808e-9f7af2839542 tempest-VolumesTestJSON-135941414 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (318bd995-65bd-4150-b15f-c79be447310b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5ce6b790-59f1-45e3-b23a-e696e290f714', 'volume_name': 'volume-5ce6b790-59f1-45e3-b23a-e696e290f714', 'volume_size': 1}' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:58:56 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-550af076-389d-4873-808e-9f7af2839542 tempest-VolumesTestJSON-135941414 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bba9f201-2b61-4e24-bdf9-d061ae549e7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:58:56 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-550af076-389d-4873-808e-9f7af2839542 tempest-VolumesTestJSON-135941414 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bba9f201-2b61-4e24-bdf9-d061ae549e7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:58:56 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-550af076-389d-4873-808e-9f7af2839542 tempest-VolumesTestJSON-135941414 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5bf93469-72d4-4674-9948-23dfbbadd409) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:58:56 devstack cinder-volume[87272]: INFO cinder.volume.flows.manager.create_volume [None req-550af076-389d-4873-808e-9f7af2839542 tempest-VolumesTestJSON-135941414 None] Volume 5ce6b790-59f1-45e3-b23a-e696e290f714: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5ce6b790-59f1-45e3-b23a-e696e290f714', 'volume_size': 1} Nov 04 10:58:56 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-550af076-389d-4873-808e-9f7af2839542 tempest-VolumesTestJSON-135941414 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:58:56 devstack cinder-volume[87272]: WARNING cinder.quota [None req-01c7e07d-1e0f-46de-a7f7-4efdfc0ff4ff tempest-GroupSnapshotsTest-534526937 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-118709704 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-118709704, it is now deprecated. Please use the default quota class for default quota. Nov 04 10:58:56 devstack cinder-volume[87272]: DEBUG cinder.quota [None req-01c7e07d-1e0f-46de-a7f7-4efdfc0ff4ff tempest-GroupSnapshotsTest-534526937 None] Created reservations ['39989dfc-f83b-4cb4-901e-903d4af6f486', '99345f71-7242-40a5-9c0e-d4c671a80556', '57262c3a-8ec9-440c-af62-2932c3c30bd5', 'bf6560ee-bace-45b4-9872-f296607b40e5'] {{(pid=87272) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 10:58:56 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-01c7e07d-1e0f-46de-a7f7-4efdfc0ff4ff tempest-GroupSnapshotsTest-534526937 None] group_snapshot 02e4ecad-fe16-46e5-a586-19a20f07c6c0: deleted successfully Nov 04 10:58:56 devstack sudo[98356]: pam_unix(sudo:session): session closed for user root Nov 04 10:58:56 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-85a19867-92d1-4598-9ff0-62fa5ddea988 tempest-VolumesTransfersV357Test-539385617 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-76404812-a7de-4a25-ae85-50bab1946d31 1073741824" returned: 0 in 0.463s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:58:56 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-85a19867-92d1-4598-9ff0-62fa5ddea988 tempest-VolumesTransfersV357Test-539385617 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-76404812-a7de-4a25-ae85-50bab1946d31 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:58:56 devstack sudo[98363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-76404812-a7de-4a25-ae85-50bab1946d31 Nov 04 10:58:56 devstack sudo[98363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:58:56 devstack sudo[98363]: pam_unix(sudo:session): session closed for user root Nov 04 10:58:56 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-85a19867-92d1-4598-9ff0-62fa5ddea988 tempest-VolumesTransfersV357Test-539385617 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-76404812-a7de-4a25-ae85-50bab1946d31" returned: 0 in 0.257s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:58:56 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-85a19867-92d1-4598-9ff0-62fa5ddea988 tempest-VolumesTransfersV357Test-539385617 None] <== create_volume: return (770ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'} {{(pid=87272) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 04 10:58:56 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-85a19867-92d1-4598-9ff0-62fa5ddea988 tempest-VolumesTransfersV357Test-539385617 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.773s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:58:56 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-550af076-389d-4873-808e-9f7af2839542 tempest-VolumesTestJSON-135941414 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.617s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:58:56 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-550af076-389d-4873-808e-9f7af2839542 tempest-VolumesTestJSON-135941414 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T09:58:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1692236497',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5ce6b790-59f1-45e3-b23a-e696e290f714,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='75c6c047147047f98e183f059a8823e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T09:58:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T09:58:56Z,use_quota=True,user_id='b1c908c23315472d92c4202ad2718401',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8989e4f-21e3-4f0a-9584-0d818784e883),volume_type_id=f8989e4f-21e3-4f0a-9584-0d818784e883)}" {{(pid=87272) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 04 10:58:56 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.remotefs [None req-550af076-389d-4873-808e-9f7af2839542 tempest-VolumesTestJSON-135941414 None] Creating volume 5ce6b790-59f1-45e3-b23a-e696e290f714 {{(pid=87272) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 10:58:56 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-550af076-389d-4873-808e-9f7af2839542 tempest-VolumesTestJSON-135941414 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:58:56 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-550af076-389d-4873-808e-9f7af2839542 tempest-VolumesTestJSON-135941414 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:58:56 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-550af076-389d-4873-808e-9f7af2839542 tempest-VolumesTestJSON-135941414 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898': None} {{(pid=87272) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:58:56 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-550af076-389d-4873-808e-9f7af2839542 tempest-VolumesTestJSON-135941414 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'] {{(pid=87272) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:58:56 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-550af076-389d-4873-808e-9f7af2839542 tempest-VolumesTestJSON-135941414 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:58:56 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-550af076-389d-4873-808e-9f7af2839542 tempest-VolumesTestJSON-135941414 None] Selected osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898 as target Quobyte volume. {{(pid=87272) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 10:58:56 devstack cinder-volume[87272]: INFO cinder.volume.drivers.remotefs [None req-550af076-389d-4873-808e-9f7af2839542 tempest-VolumesTestJSON-135941414 None] casted to osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898 Nov 04 10:58:56 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-550af076-389d-4873-808e-9f7af2839542 tempest-VolumesTestJSON-135941414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-5ce6b790-59f1-45e3-b23a-e696e290f714 1073741824 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:58:56 devstack sudo[98366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-5ce6b790-59f1-45e3-b23a-e696e290f714 1073741824 Nov 04 10:58:56 devstack sudo[98366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:58:56 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-85a19867-92d1-4598-9ff0-62fa5ddea988 tempest-VolumesTransfersV357Test-539385617 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25e993e4-5f09-4918-9188-e2501d1f08f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-76404812-a7de-4a25-ae85-50bab1946d31', 'volume_size': 1}' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:58:56 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-85a19867-92d1-4598-9ff0-62fa5ddea988 tempest-VolumesTransfersV357Test-539385617 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7fc3d0f6-617e-4911-8ed8-b118a51a27d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:58:56 devstack cinder-volume[87272]: INFO cinder.volume.flows.manager.create_volume [None req-85a19867-92d1-4598-9ff0-62fa5ddea988 tempest-VolumesTransfersV357Test-539385617 None] Volume volume-76404812-a7de-4a25-ae85-50bab1946d31 (76404812-a7de-4a25-ae85-50bab1946d31): created successfully Nov 04 10:58:56 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-85a19867-92d1-4598-9ff0-62fa5ddea988 tempest-VolumesTransfersV357Test-539385617 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7fc3d0f6-617e-4911-8ed8-b118a51a27d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:58:56 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-85a19867-92d1-4598-9ff0-62fa5ddea988 tempest-VolumesTransfersV357Test-539385617 None] Flow 'volume_create_manager' (4202cc6f-6f01-4845-8ed7-40881a7f7369) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87272) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:58:56 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-85a19867-92d1-4598-9ff0-62fa5ddea988 tempest-VolumesTransfersV357Test-539385617 None] Created volume successfully. Nov 04 10:58:57 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-fb576938-904a-4eac-9036-e6482ae1e8b8 tempest-GroupSnapshotsTest-534526937 None] Acquiring lock "cinder-quobyte-d797f36d-80b5-45cf-9896-2edbb0741f0d" by "delete_volume" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:58:57 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-fb576938-904a-4eac-9036-e6482ae1e8b8 tempest-GroupSnapshotsTest-534526937 None] Lock "cinder-quobyte-d797f36d-80b5-45cf-9896-2edbb0741f0d" acquired by "delete_volume" :: waited 0.016s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:58:57 devstack cinder-volume[87272]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb3de2f3-8bc3-4092-82e8-e17b2d34901c]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:58:57 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-fb576938-904a-4eac-9036-e6482ae1e8b8 tempest-GroupSnapshotsTest-534526937 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-d797f36d-80b5-45cf-9896-2edbb0741f0d {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:58:57 devstack sudo[98366]: pam_unix(sudo:session): session closed for user root Nov 04 10:58:57 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-550af076-389d-4873-808e-9f7af2839542 tempest-VolumesTestJSON-135941414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-5ce6b790-59f1-45e3-b23a-e696e290f714 1073741824" returned: 0 in 0.550s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:58:57 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-550af076-389d-4873-808e-9f7af2839542 tempest-VolumesTestJSON-135941414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-5ce6b790-59f1-45e3-b23a-e696e290f714 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:58:57 devstack sudo[98373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-5ce6b790-59f1-45e3-b23a-e696e290f714 Nov 04 10:58:57 devstack sudo[98373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:58:57 devstack sudo[98372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-d797f36d-80b5-45cf-9896-2edbb0741f0d Nov 04 10:58:57 devstack sudo[98372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:58:57 devstack sudo[98373]: pam_unix(sudo:session): session closed for user root Nov 04 10:58:57 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-550af076-389d-4873-808e-9f7af2839542 tempest-VolumesTestJSON-135941414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-5ce6b790-59f1-45e3-b23a-e696e290f714" returned: 0 in 0.257s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:58:57 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-550af076-389d-4873-808e-9f7af2839542 tempest-VolumesTestJSON-135941414 None] <== create_volume: return (862ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'} {{(pid=87272) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 04 10:58:57 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-550af076-389d-4873-808e-9f7af2839542 tempest-VolumesTestJSON-135941414 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.865s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:58:57 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-550af076-389d-4873-808e-9f7af2839542 tempest-VolumesTestJSON-135941414 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5bf93469-72d4-4674-9948-23dfbbadd409) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5ce6b790-59f1-45e3-b23a-e696e290f714', 'volume_size': 1}' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:58:57 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-550af076-389d-4873-808e-9f7af2839542 tempest-VolumesTestJSON-135941414 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (19085145-cf97-447d-a5b2-f96e6c726e00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:58:57 devstack cinder-volume[87272]: INFO cinder.volume.flows.manager.create_volume [None req-550af076-389d-4873-808e-9f7af2839542 tempest-VolumesTestJSON-135941414 None] Volume volume-5ce6b790-59f1-45e3-b23a-e696e290f714 (5ce6b790-59f1-45e3-b23a-e696e290f714): created successfully Nov 04 10:58:57 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-550af076-389d-4873-808e-9f7af2839542 tempest-VolumesTestJSON-135941414 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (19085145-cf97-447d-a5b2-f96e6c726e00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:58:57 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-550af076-389d-4873-808e-9f7af2839542 tempest-VolumesTestJSON-135941414 None] Flow 'volume_create_manager' (a66379f8-121f-4526-bb05-38dc50491a70) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87272) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:58:57 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-550af076-389d-4873-808e-9f7af2839542 tempest-VolumesTestJSON-135941414 None] Created volume successfully. Nov 04 10:58:57 devstack sudo[98372]: pam_unix(sudo:session): session closed for user root Nov 04 10:58:57 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-fb576938-904a-4eac-9036-e6482ae1e8b8 tempest-GroupSnapshotsTest-534526937 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-d797f36d-80b5-45cf-9896-2edbb0741f0d" returned: 0 in 0.422s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:58:57 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-fb576938-904a-4eac-9036-e6482ae1e8b8 tempest-GroupSnapshotsTest-534526937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-d797f36d-80b5-45cf-9896-2edbb0741f0d {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:58:57 devstack sudo[98380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-d797f36d-80b5-45cf-9896-2edbb0741f0d Nov 04 10:58:57 devstack sudo[98380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:58:57 devstack sudo[98380]: pam_unix(sudo:session): session closed for user root Nov 04 10:58:57 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-fb576938-904a-4eac-9036-e6482ae1e8b8 tempest-GroupSnapshotsTest-534526937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-d797f36d-80b5-45cf-9896-2edbb0741f0d" returned: 0 in 0.290s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:58:58 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-fb576938-904a-4eac-9036-e6482ae1e8b8 tempest-GroupSnapshotsTest-534526937 None] Lock "cinder-quobyte-d797f36d-80b5-45cf-9896-2edbb0741f0d" released by "delete_volume" :: held 0.808s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:58:58 devstack cinder-volume[87272]: DEBUG cinder.quota [None req-fb576938-904a-4eac-9036-e6482ae1e8b8 tempest-GroupSnapshotsTest-534526937 None] Created reservations ['f242f59f-2104-4ed3-a4ea-7a6536b88be7'] {{(pid=87272) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 10:58:58 devstack cinder-volume[87272]: WARNING cinder.db.api [None req-fb576938-904a-4eac-9036-e6482ae1e8b8 tempest-GroupSnapshotsTest-534526937 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-118709704'] Nov 04 10:58:58 devstack cinder-volume[87272]: DEBUG cinder.quota [None req-fb576938-904a-4eac-9036-e6482ae1e8b8 tempest-GroupSnapshotsTest-534526937 None] Created reservations ['07e64d1c-a008-4c54-b169-6c5c84dce8a4', '818cef4d-8d1f-49c8-97eb-9d70c7740dd4', 'ad6c36a1-6894-4864-92a0-c67248b32a56', '239291f9-1fd9-4b7d-9b81-8f5a19472bd8'] {{(pid=87272) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 10:58:58 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-43be9696-a75b-4309-86f2-2f9cb6b54406 tempest-VolumesTransfersV357Test-429907389 None] Acquiring lock "cinder-76404812-a7de-4a25-ae85-50bab1946d31-delete_volume" by "delete_volume" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:58:58 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-43be9696-a75b-4309-86f2-2f9cb6b54406 tempest-VolumesTransfersV357Test-429907389 None] Lock "cinder-76404812-a7de-4a25-ae85-50bab1946d31-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:58:58 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-43be9696-a75b-4309-86f2-2f9cb6b54406 tempest-VolumesTransfersV357Test-429907389 None] Acquiring lock "cinder-quobyte-76404812-a7de-4a25-ae85-50bab1946d31" by "delete_volume" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:58:58 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-fb576938-904a-4eac-9036-e6482ae1e8b8 tempest-GroupSnapshotsTest-534526937 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:58:58 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-fb576938-904a-4eac-9036-e6482ae1e8b8 tempest-GroupSnapshotsTest-534526937 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:58:58 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-fb576938-904a-4eac-9036-e6482ae1e8b8 tempest-GroupSnapshotsTest-534526937 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898': None} {{(pid=87272) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:58:58 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-fb576938-904a-4eac-9036-e6482ae1e8b8 tempest-GroupSnapshotsTest-534526937 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'] {{(pid=87272) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:58:58 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-fb576938-904a-4eac-9036-e6482ae1e8b8 tempest-GroupSnapshotsTest-534526937 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:58:58 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-fb576938-904a-4eac-9036-e6482ae1e8b8 tempest-GroupSnapshotsTest-534526937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:58:58 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-43be9696-a75b-4309-86f2-2f9cb6b54406 tempest-VolumesTransfersV357Test-429907389 None] Lock "cinder-quobyte-76404812-a7de-4a25-ae85-50bab1946d31" acquired by "delete_volume" :: waited 0.042s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:58:58 devstack sudo[98383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1 Nov 04 10:58:58 devstack sudo[98383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:58:58 devstack cinder-volume[87272]: DEBUG oslo.privsep.daemon [-] privsep: reply[3864f3e9-51f4-4f4e-b54c-8d7800ece9de]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:58:58 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-43be9696-a75b-4309-86f2-2f9cb6b54406 tempest-VolumesTransfersV357Test-429907389 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-76404812-a7de-4a25-ae85-50bab1946d31 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:58:58 devstack sudo[98385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-76404812-a7de-4a25-ae85-50bab1946d31 Nov 04 10:58:58 devstack sudo[98385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:58:58 devstack sudo[98383]: pam_unix(sudo:session): session closed for user root Nov 04 10:58:58 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-fb576938-904a-4eac-9036-e6482ae1e8b8 tempest-GroupSnapshotsTest-534526937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1" returned: 0 in 0.361s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:58:58 devstack cinder-volume[87272]: DEBUG cinder.manager [None req-fb576938-904a-4eac-9036-e6482ae1e8b8 tempest-GroupSnapshotsTest-534526937 None] Notifying Schedulers of capabilities ... {{(pid=87272) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 10:58:58 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-fb576938-904a-4eac-9036-e6482ae1e8b8 tempest-GroupSnapshotsTest-534526937 None] Delete group completed successfully. Nov 04 10:58:58 devstack sudo[98385]: pam_unix(sudo:session): session closed for user root Nov 04 10:58:58 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-43be9696-a75b-4309-86f2-2f9cb6b54406 tempest-VolumesTransfersV357Test-429907389 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-76404812-a7de-4a25-ae85-50bab1946d31" returned: 0 in 0.499s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:58:58 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-43be9696-a75b-4309-86f2-2f9cb6b54406 tempest-VolumesTransfersV357Test-429907389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-76404812-a7de-4a25-ae85-50bab1946d31 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:58:59 devstack sudo[98391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-76404812-a7de-4a25-ae85-50bab1946d31 Nov 04 10:58:59 devstack sudo[98391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:58:59 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-9dad801a-1ec7-47f4-8ab7-1d593fc7aa47 tempest-GroupSnapshotsTest-534526937 None] Group tempest-GroupSnapshotsTest-Group-2113988141: creating Nov 04 10:58:59 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-9dad801a-1ec7-47f4-8ab7-1d593fc7aa47 tempest-GroupSnapshotsTest-534526937 None] Group tempest-GroupSnapshotsTest-Group-2113988141: created successfully Nov 04 10:58:59 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-9dad801a-1ec7-47f4-8ab7-1d593fc7aa47 tempest-GroupSnapshotsTest-534526937 None] Create group completed successfully. Nov 04 10:58:59 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-42b47376-8a70-4cbf-9c01-ba4dd9e39595 tempest-VolumesTestJSON-135941414 None] Acquiring lock "cinder-5ce6b790-59f1-45e3-b23a-e696e290f714-delete_volume" by "delete_volume" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:58:59 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-42b47376-8a70-4cbf-9c01-ba4dd9e39595 tempest-VolumesTestJSON-135941414 None] Lock "cinder-5ce6b790-59f1-45e3-b23a-e696e290f714-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:58:59 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-42b47376-8a70-4cbf-9c01-ba4dd9e39595 tempest-VolumesTestJSON-135941414 None] Acquiring lock "cinder-quobyte-5ce6b790-59f1-45e3-b23a-e696e290f714" by "delete_volume" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:58:59 devstack sudo[98391]: pam_unix(sudo:session): session closed for user root Nov 04 10:58:59 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-43be9696-a75b-4309-86f2-2f9cb6b54406 tempest-VolumesTransfersV357Test-429907389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-76404812-a7de-4a25-ae85-50bab1946d31" returned: 0 in 0.343s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:58:59 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-42b47376-8a70-4cbf-9c01-ba4dd9e39595 tempest-VolumesTestJSON-135941414 None] Lock "cinder-quobyte-5ce6b790-59f1-45e3-b23a-e696e290f714" acquired by "delete_volume" :: waited 0.024s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:58:59 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-43be9696-a75b-4309-86f2-2f9cb6b54406 tempest-VolumesTransfersV357Test-429907389 None] Lock "cinder-quobyte-76404812-a7de-4a25-ae85-50bab1946d31" released by "delete_volume" :: held 0.922s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:58:59 devstack cinder-volume[87272]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1a3bb7a-6b06-42ae-820d-67d64fb368e6]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:58:59 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-42b47376-8a70-4cbf-9c01-ba4dd9e39595 tempest-VolumesTestJSON-135941414 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-5ce6b790-59f1-45e3-b23a-e696e290f714 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:58:59 devstack cinder-volume[87272]: DEBUG cinder.quota [None req-43be9696-a75b-4309-86f2-2f9cb6b54406 tempest-VolumesTransfersV357Test-429907389 None] Created reservations ['d5a59685-6eb7-4d0d-a759-44c6d2039a54', '7a31d26d-22ab-462f-a152-5182d739211d', 'c75b989e-b4b3-40d0-9c3e-0d8407abc359', '6b3db61d-e826-4308-9158-e3f93aad29cd'] {{(pid=87272) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 10:58:59 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-43be9696-a75b-4309-86f2-2f9cb6b54406 tempest-VolumesTransfersV357Test-429907389 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:58:59 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-43be9696-a75b-4309-86f2-2f9cb6b54406 tempest-VolumesTransfersV357Test-429907389 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:58:59 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-43be9696-a75b-4309-86f2-2f9cb6b54406 tempest-VolumesTransfersV357Test-429907389 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898': None} {{(pid=87272) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:58:59 devstack sudo[98394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-5ce6b790-59f1-45e3-b23a-e696e290f714 Nov 04 10:58:59 devstack sudo[98394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:58:59 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-43be9696-a75b-4309-86f2-2f9cb6b54406 tempest-VolumesTransfersV357Test-429907389 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'] {{(pid=87272) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:58:59 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-43be9696-a75b-4309-86f2-2f9cb6b54406 tempest-VolumesTransfersV357Test-429907389 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:58:59 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-43be9696-a75b-4309-86f2-2f9cb6b54406 tempest-VolumesTransfersV357Test-429907389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:58:59 devstack sudo[98396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1 Nov 04 10:58:59 devstack sudo[98396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:58:59 devstack sudo[98396]: pam_unix(sudo:session): session closed for user root Nov 04 10:58:59 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-43be9696-a75b-4309-86f2-2f9cb6b54406 tempest-VolumesTransfersV357Test-429907389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1" returned: 0 in 0.266s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:58:59 devstack cinder-volume[87272]: DEBUG cinder.manager [None req-43be9696-a75b-4309-86f2-2f9cb6b54406 tempest-VolumesTransfersV357Test-429907389 None] Notifying Schedulers of capabilities ... {{(pid=87272) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 10:58:59 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-43be9696-a75b-4309-86f2-2f9cb6b54406 tempest-VolumesTransfersV357Test-429907389 None] Deleted volume successfully. Nov 04 10:58:59 devstack sudo[98394]: pam_unix(sudo:session): session closed for user root Nov 04 10:58:59 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-43be9696-a75b-4309-86f2-2f9cb6b54406 tempest-VolumesTransfersV357Test-429907389 None] Lock "cinder-76404812-a7de-4a25-ae85-50bab1946d31-delete_volume" released by "delete_volume" :: held 1.483s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:58:59 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-42b47376-8a70-4cbf-9c01-ba4dd9e39595 tempest-VolumesTestJSON-135941414 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-5ce6b790-59f1-45e3-b23a-e696e290f714" returned: 0 in 0.447s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:58:59 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-42b47376-8a70-4cbf-9c01-ba4dd9e39595 tempest-VolumesTestJSON-135941414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-5ce6b790-59f1-45e3-b23a-e696e290f714 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:58:59 devstack sudo[98405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-5ce6b790-59f1-45e3-b23a-e696e290f714 Nov 04 10:58:59 devstack sudo[98405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:59:00 devstack sudo[98405]: pam_unix(sudo:session): session closed for user root Nov 04 10:59:00 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-42b47376-8a70-4cbf-9c01-ba4dd9e39595 tempest-VolumesTestJSON-135941414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-5ce6b790-59f1-45e3-b23a-e696e290f714" returned: 0 in 0.264s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:59:00 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-42b47376-8a70-4cbf-9c01-ba4dd9e39595 tempest-VolumesTestJSON-135941414 None] Lock "cinder-quobyte-5ce6b790-59f1-45e3-b23a-e696e290f714" released by "delete_volume" :: held 0.766s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:59:00 devstack cinder-volume[87272]: DEBUG cinder.quota [None req-42b47376-8a70-4cbf-9c01-ba4dd9e39595 tempest-VolumesTestJSON-135941414 None] Created reservations ['ca9f5f7e-1cc2-4556-86ef-4afafb652b95', '679acd44-70b9-475b-9873-62ce69410886', '1566deb6-249f-4cbe-9f36-48a338fdc37f', 'e49f160b-a1e2-4adb-863b-8db8ccf1be6a'] {{(pid=87272) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 10:59:00 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-42b47376-8a70-4cbf-9c01-ba4dd9e39595 tempest-VolumesTestJSON-135941414 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:59:00 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-42b47376-8a70-4cbf-9c01-ba4dd9e39595 tempest-VolumesTestJSON-135941414 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:59:00 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-42b47376-8a70-4cbf-9c01-ba4dd9e39595 tempest-VolumesTestJSON-135941414 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898': None} {{(pid=87272) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:59:00 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-42b47376-8a70-4cbf-9c01-ba4dd9e39595 tempest-VolumesTestJSON-135941414 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'] {{(pid=87272) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:59:00 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-42b47376-8a70-4cbf-9c01-ba4dd9e39595 tempest-VolumesTestJSON-135941414 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:59:00 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-42b47376-8a70-4cbf-9c01-ba4dd9e39595 tempest-VolumesTestJSON-135941414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:59:00 devstack sudo[98408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1 Nov 04 10:59:00 devstack sudo[98408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:59:00 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-54e976c9-580a-460d-8845-12d3e2d4f8e7 tempest-VolumesTestJSON-135941414 None] Acquiring lock "cinder-7913a8eb-e8ab-4075-95cd-20c37d6567e2-delete_volume" by "delete_volume" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:59:00 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-54e976c9-580a-460d-8845-12d3e2d4f8e7 tempest-VolumesTestJSON-135941414 None] Lock "cinder-7913a8eb-e8ab-4075-95cd-20c37d6567e2-delete_volume" acquired by "delete_volume" :: waited 0.059s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:59:00 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-42b47376-8a70-4cbf-9c01-ba4dd9e39595 tempest-VolumesTestJSON-135941414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1" returned: 0 in 0.331s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:59:00 devstack cinder-volume[87272]: DEBUG cinder.manager [None req-42b47376-8a70-4cbf-9c01-ba4dd9e39595 tempest-VolumesTestJSON-135941414 None] Notifying Schedulers of capabilities ... {{(pid=87272) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 10:59:00 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-54e976c9-580a-460d-8845-12d3e2d4f8e7 tempest-VolumesTestJSON-135941414 None] Acquiring lock "cinder-quobyte-7913a8eb-e8ab-4075-95cd-20c37d6567e2" by "delete_volume" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:59:00 devstack sudo[98408]: pam_unix(sudo:session): session closed for user root Nov 04 10:59:00 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-42b47376-8a70-4cbf-9c01-ba4dd9e39595 tempest-VolumesTestJSON-135941414 None] Deleted volume successfully. Nov 04 10:59:00 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-42b47376-8a70-4cbf-9c01-ba4dd9e39595 tempest-VolumesTestJSON-135941414 None] Lock "cinder-5ce6b790-59f1-45e3-b23a-e696e290f714-delete_volume" released by "delete_volume" :: held 1.364s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:59:00 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-54e976c9-580a-460d-8845-12d3e2d4f8e7 tempest-VolumesTestJSON-135941414 None] Lock "cinder-quobyte-7913a8eb-e8ab-4075-95cd-20c37d6567e2" acquired by "delete_volume" :: waited 0.048s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:59:00 devstack cinder-volume[87272]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a849093-d963-4f29-907c-ae80bdea50af]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:59:00 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-54e976c9-580a-460d-8845-12d3e2d4f8e7 tempest-VolumesTestJSON-135941414 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-7913a8eb-e8ab-4075-95cd-20c37d6567e2 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:59:00 devstack cinder-volume[87272]: DEBUG cinder.volume.flows.manager.create_volume [None req-c4062422-6182-47a8-9ca2-c49190e2b8e4 tempest-GroupSnapshotsTest-534526937 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87272) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 10:59:00 devstack sudo[98411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-7913a8eb-e8ab-4075-95cd-20c37d6567e2 Nov 04 10:59:00 devstack sudo[98411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:59:00 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-c4062422-6182-47a8-9ca2-c49190e2b8e4 tempest-GroupSnapshotsTest-534526937 None] Flow 'volume_create_manager' (92985f12-cffd-45dc-ac76-96310c8bea15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:59:00 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-c4062422-6182-47a8-9ca2-c49190e2b8e4 tempest-GroupSnapshotsTest-534526937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed5893b3-3147-4aca-a234-1ec1256eb4c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:59:00 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-c4062422-6182-47a8-9ca2-c49190e2b8e4 tempest-GroupSnapshotsTest-534526937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed5893b3-3147-4aca-a234-1ec1256eb4c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T09:59:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-561252012',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=e2cf3ac6-29b5-4b43-ba07-c7ca92268cf7,host='devstack@QuobyteHD#QuobyteHD',id=36ef6ce6-5b38-449d-84e6-34165c6eb7a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d4fecca9e5c74435917afa362915006e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T09:59:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T09:59:01Z,use_quota=True,user_id='cd95811391ef4f95b79f4f5c5f6f23c1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59d5590f-b108-431d-aa6d-2afdbaaff627),volume_type_id=59d5590f-b108-431d-aa6d-2afdbaaff627)' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:59:00 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-c4062422-6182-47a8-9ca2-c49190e2b8e4 tempest-GroupSnapshotsTest-534526937 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f9ef540b-4d10-465d-a5eb-9eccbce122e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:59:00 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-c4062422-6182-47a8-9ca2-c49190e2b8e4 tempest-GroupSnapshotsTest-534526937 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f9ef540b-4d10-465d-a5eb-9eccbce122e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:59:00 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-c4062422-6182-47a8-9ca2-c49190e2b8e4 tempest-GroupSnapshotsTest-534526937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a74f81c2-0279-4584-8e42-4672c6dac30e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:59:00 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-c4062422-6182-47a8-9ca2-c49190e2b8e4 tempest-GroupSnapshotsTest-534526937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a74f81c2-0279-4584-8e42-4672c6dac30e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '36ef6ce6-5b38-449d-84e6-34165c6eb7a1', 'volume_name': 'volume-36ef6ce6-5b38-449d-84e6-34165c6eb7a1', 'volume_size': 1}' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:59:00 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-c4062422-6182-47a8-9ca2-c49190e2b8e4 tempest-GroupSnapshotsTest-534526937 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf6932b2-89d7-4334-bee4-137c3384f1ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:59:00 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-c4062422-6182-47a8-9ca2-c49190e2b8e4 tempest-GroupSnapshotsTest-534526937 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf6932b2-89d7-4334-bee4-137c3384f1ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:59:00 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-c4062422-6182-47a8-9ca2-c49190e2b8e4 tempest-GroupSnapshotsTest-534526937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a532d6e6-16fa-4279-916a-8326d84d147d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:59:00 devstack cinder-volume[87272]: INFO cinder.volume.flows.manager.create_volume [None req-c4062422-6182-47a8-9ca2-c49190e2b8e4 tempest-GroupSnapshotsTest-534526937 None] Volume 36ef6ce6-5b38-449d-84e6-34165c6eb7a1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-36ef6ce6-5b38-449d-84e6-34165c6eb7a1', 'volume_size': 1} Nov 04 10:59:00 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-c4062422-6182-47a8-9ca2-c49190e2b8e4 tempest-GroupSnapshotsTest-534526937 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:59:00 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-c4062422-6182-47a8-9ca2-c49190e2b8e4 tempest-GroupSnapshotsTest-534526937 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:59:00 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-c4062422-6182-47a8-9ca2-c49190e2b8e4 tempest-GroupSnapshotsTest-534526937 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=e2cf3ac6-29b5-4b43-ba07-c7ca92268cf7,created_at=2026-11-04T09:59:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-561252012',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=e2cf3ac6-29b5-4b43-ba07-c7ca92268cf7,host='devstack@QuobyteHD#QuobyteHD',id=36ef6ce6-5b38-449d-84e6-34165c6eb7a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d4fecca9e5c74435917afa362915006e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T09:59:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T09:59:01Z,use_quota=True,user_id='cd95811391ef4f95b79f4f5c5f6f23c1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59d5590f-b108-431d-aa6d-2afdbaaff627),volume_type_id=59d5590f-b108-431d-aa6d-2afdbaaff627)}" {{(pid=87272) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 04 10:59:00 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.remotefs [None req-c4062422-6182-47a8-9ca2-c49190e2b8e4 tempest-GroupSnapshotsTest-534526937 None] Creating volume 36ef6ce6-5b38-449d-84e6-34165c6eb7a1 {{(pid=87272) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 10:59:00 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-c4062422-6182-47a8-9ca2-c49190e2b8e4 tempest-GroupSnapshotsTest-534526937 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:59:00 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-c4062422-6182-47a8-9ca2-c49190e2b8e4 tempest-GroupSnapshotsTest-534526937 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:59:00 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-c4062422-6182-47a8-9ca2-c49190e2b8e4 tempest-GroupSnapshotsTest-534526937 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898': None} {{(pid=87272) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:59:00 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-c4062422-6182-47a8-9ca2-c49190e2b8e4 tempest-GroupSnapshotsTest-534526937 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'] {{(pid=87272) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:59:00 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-c4062422-6182-47a8-9ca2-c49190e2b8e4 tempest-GroupSnapshotsTest-534526937 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:59:00 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-c4062422-6182-47a8-9ca2-c49190e2b8e4 tempest-GroupSnapshotsTest-534526937 None] Selected osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898 as target Quobyte volume. {{(pid=87272) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 10:59:00 devstack cinder-volume[87272]: INFO cinder.volume.drivers.remotefs [None req-c4062422-6182-47a8-9ca2-c49190e2b8e4 tempest-GroupSnapshotsTest-534526937 None] casted to osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898 Nov 04 10:59:00 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-c4062422-6182-47a8-9ca2-c49190e2b8e4 tempest-GroupSnapshotsTest-534526937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-36ef6ce6-5b38-449d-84e6-34165c6eb7a1 1073741824 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:59:01 devstack sudo[98413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-36ef6ce6-5b38-449d-84e6-34165c6eb7a1 1073741824 Nov 04 10:59:01 devstack sudo[98413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:59:01 devstack sudo[98411]: pam_unix(sudo:session): session closed for user root Nov 04 10:59:01 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-54e976c9-580a-460d-8845-12d3e2d4f8e7 tempest-VolumesTestJSON-135941414 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-7913a8eb-e8ab-4075-95cd-20c37d6567e2" returned: 0 in 0.591s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:59:01 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-54e976c9-580a-460d-8845-12d3e2d4f8e7 tempest-VolumesTestJSON-135941414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-7913a8eb-e8ab-4075-95cd-20c37d6567e2 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:59:01 devstack sudo[98418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-7913a8eb-e8ab-4075-95cd-20c37d6567e2 Nov 04 10:59:01 devstack sudo[98418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:59:01 devstack sudo[98413]: pam_unix(sudo:session): session closed for user root Nov 04 10:59:01 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-c4062422-6182-47a8-9ca2-c49190e2b8e4 tempest-GroupSnapshotsTest-534526937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-36ef6ce6-5b38-449d-84e6-34165c6eb7a1 1073741824" returned: 0 in 0.653s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:59:01 devstack sudo[98418]: pam_unix(sudo:session): session closed for user root Nov 04 10:59:01 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-54e976c9-580a-460d-8845-12d3e2d4f8e7 tempest-VolumesTestJSON-135941414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-7913a8eb-e8ab-4075-95cd-20c37d6567e2" returned: 0 in 0.409s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:59:01 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-54e976c9-580a-460d-8845-12d3e2d4f8e7 tempest-VolumesTestJSON-135941414 None] Lock "cinder-quobyte-7913a8eb-e8ab-4075-95cd-20c37d6567e2" released by "delete_volume" :: held 1.100s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:59:01 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-c4062422-6182-47a8-9ca2-c49190e2b8e4 tempest-GroupSnapshotsTest-534526937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-36ef6ce6-5b38-449d-84e6-34165c6eb7a1 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:59:01 devstack sudo[98425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-36ef6ce6-5b38-449d-84e6-34165c6eb7a1 Nov 04 10:59:01 devstack sudo[98425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:59:01 devstack cinder-volume[87272]: DEBUG cinder.quota [None req-54e976c9-580a-460d-8845-12d3e2d4f8e7 tempest-VolumesTestJSON-135941414 None] Created reservations ['4b91a501-84e8-4a3e-be6f-7e48ad6d0dfe', 'c8208faf-eed1-4032-9e92-a3600da85058', '4a5e232c-a8c7-44de-b309-bf60ad60ecb0', '6643f990-17de-402d-8937-d99967b50d58'] {{(pid=87272) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 10:59:02 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-54e976c9-580a-460d-8845-12d3e2d4f8e7 tempest-VolumesTestJSON-135941414 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:59:02 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-54e976c9-580a-460d-8845-12d3e2d4f8e7 tempest-VolumesTestJSON-135941414 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:59:02 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-54e976c9-580a-460d-8845-12d3e2d4f8e7 tempest-VolumesTestJSON-135941414 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898': None} {{(pid=87272) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:59:02 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-54e976c9-580a-460d-8845-12d3e2d4f8e7 tempest-VolumesTestJSON-135941414 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'] {{(pid=87272) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:59:02 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-54e976c9-580a-460d-8845-12d3e2d4f8e7 tempest-VolumesTestJSON-135941414 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:59:02 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-54e976c9-580a-460d-8845-12d3e2d4f8e7 tempest-VolumesTestJSON-135941414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:59:02 devstack sudo[98427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1 Nov 04 10:59:02 devstack sudo[98427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:59:02 devstack sudo[98425]: pam_unix(sudo:session): session closed for user root Nov 04 10:59:02 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-c4062422-6182-47a8-9ca2-c49190e2b8e4 tempest-GroupSnapshotsTest-534526937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-36ef6ce6-5b38-449d-84e6-34165c6eb7a1" returned: 0 in 0.561s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:59:02 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-c4062422-6182-47a8-9ca2-c49190e2b8e4 tempest-GroupSnapshotsTest-534526937 None] <== create_volume: return (1417ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'} {{(pid=87272) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 04 10:59:02 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-c4062422-6182-47a8-9ca2-c49190e2b8e4 tempest-GroupSnapshotsTest-534526937 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.421s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:59:02 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-c4062422-6182-47a8-9ca2-c49190e2b8e4 tempest-GroupSnapshotsTest-534526937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a532d6e6-16fa-4279-916a-8326d84d147d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-36ef6ce6-5b38-449d-84e6-34165c6eb7a1', 'volume_size': 1}' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:59:02 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-c4062422-6182-47a8-9ca2-c49190e2b8e4 tempest-GroupSnapshotsTest-534526937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a4e5b1a7-8af0-4ce0-b5fa-03d43693c013) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:59:02 devstack cinder-volume[87272]: INFO cinder.volume.flows.manager.create_volume [None req-c4062422-6182-47a8-9ca2-c49190e2b8e4 tempest-GroupSnapshotsTest-534526937 None] Volume volume-36ef6ce6-5b38-449d-84e6-34165c6eb7a1 (36ef6ce6-5b38-449d-84e6-34165c6eb7a1): created successfully Nov 04 10:59:02 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-c4062422-6182-47a8-9ca2-c49190e2b8e4 tempest-GroupSnapshotsTest-534526937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a4e5b1a7-8af0-4ce0-b5fa-03d43693c013) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:59:02 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-c4062422-6182-47a8-9ca2-c49190e2b8e4 tempest-GroupSnapshotsTest-534526937 None] Flow 'volume_create_manager' (92985f12-cffd-45dc-ac76-96310c8bea15) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87272) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:59:02 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-c4062422-6182-47a8-9ca2-c49190e2b8e4 tempest-GroupSnapshotsTest-534526937 None] Created volume successfully. Nov 04 10:59:02 devstack sudo[98427]: pam_unix(sudo:session): session closed for user root Nov 04 10:59:02 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-54e976c9-580a-460d-8845-12d3e2d4f8e7 tempest-VolumesTestJSON-135941414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1" returned: 0 in 0.510s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:59:02 devstack cinder-volume[87272]: DEBUG cinder.manager [None req-54e976c9-580a-460d-8845-12d3e2d4f8e7 tempest-VolumesTestJSON-135941414 None] Notifying Schedulers of capabilities ... {{(pid=87272) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 10:59:02 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-54e976c9-580a-460d-8845-12d3e2d4f8e7 tempest-VolumesTestJSON-135941414 None] Deleted volume successfully. Nov 04 10:59:02 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-54e976c9-580a-460d-8845-12d3e2d4f8e7 tempest-VolumesTestJSON-135941414 None] Lock "cinder-7913a8eb-e8ab-4075-95cd-20c37d6567e2-delete_volume" released by "delete_volume" :: held 2.323s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:59:02 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-a2d52ddd-dd38-41dc-adb9-13ba4f4b61ef tempest-VolumesTestJSON-135941414 None] Acquiring lock "cinder-5e24b817-8c6b-45b6-9958-1d70c7eacf7b-delete_volume" by "delete_volume" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:59:02 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-a2d52ddd-dd38-41dc-adb9-13ba4f4b61ef tempest-VolumesTestJSON-135941414 None] Lock "cinder-5e24b817-8c6b-45b6-9958-1d70c7eacf7b-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:59:03 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-a2d52ddd-dd38-41dc-adb9-13ba4f4b61ef tempest-VolumesTestJSON-135941414 None] Acquiring lock "cinder-quobyte-5e24b817-8c6b-45b6-9958-1d70c7eacf7b" by "delete_volume" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:59:03 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-a2d52ddd-dd38-41dc-adb9-13ba4f4b61ef tempest-VolumesTestJSON-135941414 None] Lock "cinder-quobyte-5e24b817-8c6b-45b6-9958-1d70c7eacf7b" acquired by "delete_volume" :: waited 0.035s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:59:03 devstack cinder-volume[87272]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e1b55e7-0979-45e3-9c19-268076a2e1a8]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:59:03 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-a2d52ddd-dd38-41dc-adb9-13ba4f4b61ef tempest-VolumesTestJSON-135941414 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-5e24b817-8c6b-45b6-9958-1d70c7eacf7b {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:59:03 devstack sudo[98441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-5e24b817-8c6b-45b6-9958-1d70c7eacf7b Nov 04 10:59:03 devstack sudo[98441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:59:03 devstack sudo[98441]: pam_unix(sudo:session): session closed for user root Nov 04 10:59:03 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-a2d52ddd-dd38-41dc-adb9-13ba4f4b61ef tempest-VolumesTestJSON-135941414 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-5e24b817-8c6b-45b6-9958-1d70c7eacf7b" returned: 0 in 0.539s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:59:03 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-a2d52ddd-dd38-41dc-adb9-13ba4f4b61ef tempest-VolumesTestJSON-135941414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-5e24b817-8c6b-45b6-9958-1d70c7eacf7b {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:59:03 devstack sudo[98450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-5e24b817-8c6b-45b6-9958-1d70c7eacf7b Nov 04 10:59:03 devstack sudo[98450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:59:04 devstack sudo[98450]: pam_unix(sudo:session): session closed for user root Nov 04 10:59:04 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-a2d52ddd-dd38-41dc-adb9-13ba4f4b61ef tempest-VolumesTestJSON-135941414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-5e24b817-8c6b-45b6-9958-1d70c7eacf7b" returned: 0 in 0.398s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:59:04 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-a2d52ddd-dd38-41dc-adb9-13ba4f4b61ef tempest-VolumesTestJSON-135941414 None] Lock "cinder-quobyte-5e24b817-8c6b-45b6-9958-1d70c7eacf7b" released by "delete_volume" :: held 1.007s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:59:04 devstack cinder-volume[87272]: DEBUG cinder.quota [None req-a2d52ddd-dd38-41dc-adb9-13ba4f4b61ef tempest-VolumesTestJSON-135941414 None] Created reservations ['bbd77af9-842e-4589-9547-38354bd405d9', '2e6db5aa-5ab8-4d39-8a99-973a75f7ed81', '2de21c20-001c-4179-bea9-8fbb1e891bf5', 'e717bda5-542b-4db4-9314-b79ed7daf270'] {{(pid=87272) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 10:59:04 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-a2d52ddd-dd38-41dc-adb9-13ba4f4b61ef tempest-VolumesTestJSON-135941414 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:59:04 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-a2d52ddd-dd38-41dc-adb9-13ba4f4b61ef tempest-VolumesTestJSON-135941414 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:59:04 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-a2d52ddd-dd38-41dc-adb9-13ba4f4b61ef tempest-VolumesTestJSON-135941414 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898': None} {{(pid=87272) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:59:04 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-a2d52ddd-dd38-41dc-adb9-13ba4f4b61ef tempest-VolumesTestJSON-135941414 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'] {{(pid=87272) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:59:04 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-a2d52ddd-dd38-41dc-adb9-13ba4f4b61ef tempest-VolumesTestJSON-135941414 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:59:04 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-a2d52ddd-dd38-41dc-adb9-13ba4f4b61ef tempest-VolumesTestJSON-135941414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:59:04 devstack sudo[98466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1 Nov 04 10:59:04 devstack sudo[98466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:59:04 devstack cinder-volume[87272]: DEBUG cinder.volume.flows.manager.create_volume [None req-904d305c-9e76-4f8d-b296-9df1efd7620a tempest-GroupSnapshotsTest-534526937 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87272) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 10:59:04 devstack sudo[98466]: pam_unix(sudo:session): session closed for user root Nov 04 10:59:04 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-904d305c-9e76-4f8d-b296-9df1efd7620a tempest-GroupSnapshotsTest-534526937 None] Flow 'volume_create_manager' (20f3ed2e-109a-40b9-9b4e-a30a907b1d37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:59:04 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-904d305c-9e76-4f8d-b296-9df1efd7620a tempest-GroupSnapshotsTest-534526937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ccebfde2-81da-4b31-adf7-2bfe23c0762d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:59:04 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-a2d52ddd-dd38-41dc-adb9-13ba4f4b61ef tempest-VolumesTestJSON-135941414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1" returned: 0 in 0.492s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:59:04 devstack cinder-volume[87272]: DEBUG cinder.manager [None req-a2d52ddd-dd38-41dc-adb9-13ba4f4b61ef tempest-VolumesTestJSON-135941414 None] Notifying Schedulers of capabilities ... {{(pid=87272) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 10:59:04 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-904d305c-9e76-4f8d-b296-9df1efd7620a tempest-GroupSnapshotsTest-534526937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ccebfde2-81da-4b31-adf7-2bfe23c0762d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T09:59:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-390082002',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=e2cf3ac6-29b5-4b43-ba07-c7ca92268cf7,host='devstack@QuobyteHD#QuobyteHD',id=17f5eabe-9ee6-4da5-92be-62bb4b546b66,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d4fecca9e5c74435917afa362915006e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T09:59:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T09:59:05Z,use_quota=True,user_id='cd95811391ef4f95b79f4f5c5f6f23c1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59d5590f-b108-431d-aa6d-2afdbaaff627),volume_type_id=59d5590f-b108-431d-aa6d-2afdbaaff627)' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:59:04 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-904d305c-9e76-4f8d-b296-9df1efd7620a tempest-GroupSnapshotsTest-534526937 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (04d8b4a4-3641-4d80-b772-870598ab9e8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:59:04 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-904d305c-9e76-4f8d-b296-9df1efd7620a tempest-GroupSnapshotsTest-534526937 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (04d8b4a4-3641-4d80-b772-870598ab9e8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:59:04 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-904d305c-9e76-4f8d-b296-9df1efd7620a tempest-GroupSnapshotsTest-534526937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (56232bb1-4973-4f01-8a2c-a0e4f15f7ed0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:59:04 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-904d305c-9e76-4f8d-b296-9df1efd7620a tempest-GroupSnapshotsTest-534526937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (56232bb1-4973-4f01-8a2c-a0e4f15f7ed0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '17f5eabe-9ee6-4da5-92be-62bb4b546b66', 'volume_name': 'volume-17f5eabe-9ee6-4da5-92be-62bb4b546b66', 'volume_size': 1}' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:59:04 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-904d305c-9e76-4f8d-b296-9df1efd7620a tempest-GroupSnapshotsTest-534526937 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f9cbeba7-60aa-41f9-99f6-bdcffe2c79b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:59:04 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-904d305c-9e76-4f8d-b296-9df1efd7620a tempest-GroupSnapshotsTest-534526937 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f9cbeba7-60aa-41f9-99f6-bdcffe2c79b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:59:04 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-904d305c-9e76-4f8d-b296-9df1efd7620a tempest-GroupSnapshotsTest-534526937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07449143-9ebf-40b1-959e-54fa9f52f92e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:59:04 devstack cinder-volume[87272]: INFO cinder.volume.flows.manager.create_volume [None req-904d305c-9e76-4f8d-b296-9df1efd7620a tempest-GroupSnapshotsTest-534526937 None] Volume 17f5eabe-9ee6-4da5-92be-62bb4b546b66: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-17f5eabe-9ee6-4da5-92be-62bb4b546b66', 'volume_size': 1} Nov 04 10:59:04 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-904d305c-9e76-4f8d-b296-9df1efd7620a tempest-GroupSnapshotsTest-534526937 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:59:04 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-904d305c-9e76-4f8d-b296-9df1efd7620a tempest-GroupSnapshotsTest-534526937 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:59:04 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-904d305c-9e76-4f8d-b296-9df1efd7620a tempest-GroupSnapshotsTest-534526937 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=e2cf3ac6-29b5-4b43-ba07-c7ca92268cf7,created_at=2026-11-04T09:59:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-390082002',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=e2cf3ac6-29b5-4b43-ba07-c7ca92268cf7,host='devstack@QuobyteHD#QuobyteHD',id=17f5eabe-9ee6-4da5-92be-62bb4b546b66,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d4fecca9e5c74435917afa362915006e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T09:59:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T09:59:05Z,use_quota=True,user_id='cd95811391ef4f95b79f4f5c5f6f23c1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59d5590f-b108-431d-aa6d-2afdbaaff627),volume_type_id=59d5590f-b108-431d-aa6d-2afdbaaff627)}" {{(pid=87272) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 04 10:59:04 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.remotefs [None req-904d305c-9e76-4f8d-b296-9df1efd7620a tempest-GroupSnapshotsTest-534526937 None] Creating volume 17f5eabe-9ee6-4da5-92be-62bb4b546b66 {{(pid=87272) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 10:59:04 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-904d305c-9e76-4f8d-b296-9df1efd7620a tempest-GroupSnapshotsTest-534526937 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:59:04 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-904d305c-9e76-4f8d-b296-9df1efd7620a tempest-GroupSnapshotsTest-534526937 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:59:04 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-904d305c-9e76-4f8d-b296-9df1efd7620a tempest-GroupSnapshotsTest-534526937 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898': None} {{(pid=87272) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:59:04 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-904d305c-9e76-4f8d-b296-9df1efd7620a tempest-GroupSnapshotsTest-534526937 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'] {{(pid=87272) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:59:04 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-904d305c-9e76-4f8d-b296-9df1efd7620a tempest-GroupSnapshotsTest-534526937 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:59:04 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-904d305c-9e76-4f8d-b296-9df1efd7620a tempest-GroupSnapshotsTest-534526937 None] Selected osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898 as target Quobyte volume. {{(pid=87272) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 10:59:04 devstack cinder-volume[87272]: INFO cinder.volume.drivers.remotefs [None req-904d305c-9e76-4f8d-b296-9df1efd7620a tempest-GroupSnapshotsTest-534526937 None] casted to osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898 Nov 04 10:59:04 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-904d305c-9e76-4f8d-b296-9df1efd7620a tempest-GroupSnapshotsTest-534526937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-17f5eabe-9ee6-4da5-92be-62bb4b546b66 1073741824 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:59:04 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-a2d52ddd-dd38-41dc-adb9-13ba4f4b61ef tempest-VolumesTestJSON-135941414 None] Deleted volume successfully. Nov 04 10:59:04 devstack sudo[98473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-17f5eabe-9ee6-4da5-92be-62bb4b546b66 1073741824 Nov 04 10:59:04 devstack sudo[98473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:59:04 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-a2d52ddd-dd38-41dc-adb9-13ba4f4b61ef tempest-VolumesTestJSON-135941414 None] Lock "cinder-5e24b817-8c6b-45b6-9958-1d70c7eacf7b-delete_volume" released by "delete_volume" :: held 1.986s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:59:05 devstack sudo[98473]: pam_unix(sudo:session): session closed for user root Nov 04 10:59:05 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-904d305c-9e76-4f8d-b296-9df1efd7620a tempest-GroupSnapshotsTest-534526937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-17f5eabe-9ee6-4da5-92be-62bb4b546b66 1073741824" returned: 0 in 0.776s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:59:05 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-904d305c-9e76-4f8d-b296-9df1efd7620a tempest-GroupSnapshotsTest-534526937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-17f5eabe-9ee6-4da5-92be-62bb4b546b66 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:59:05 devstack sudo[98494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-17f5eabe-9ee6-4da5-92be-62bb4b546b66 Nov 04 10:59:05 devstack sudo[98494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:59:06 devstack sudo[98494]: pam_unix(sudo:session): session closed for user root Nov 04 10:59:06 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-904d305c-9e76-4f8d-b296-9df1efd7620a tempest-GroupSnapshotsTest-534526937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-17f5eabe-9ee6-4da5-92be-62bb4b546b66" returned: 0 in 0.617s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:59:06 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-904d305c-9e76-4f8d-b296-9df1efd7620a tempest-GroupSnapshotsTest-534526937 None] <== create_volume: return (1481ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'} {{(pid=87272) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 04 10:59:06 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-904d305c-9e76-4f8d-b296-9df1efd7620a tempest-GroupSnapshotsTest-534526937 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.484s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:59:06 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-904d305c-9e76-4f8d-b296-9df1efd7620a tempest-GroupSnapshotsTest-534526937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07449143-9ebf-40b1-959e-54fa9f52f92e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-17f5eabe-9ee6-4da5-92be-62bb4b546b66', 'volume_size': 1}' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:59:06 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-904d305c-9e76-4f8d-b296-9df1efd7620a tempest-GroupSnapshotsTest-534526937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (23ad549b-4680-47db-92bb-363567c79884) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:59:06 devstack cinder-volume[87272]: INFO cinder.volume.flows.manager.create_volume [None req-904d305c-9e76-4f8d-b296-9df1efd7620a tempest-GroupSnapshotsTest-534526937 None] Volume volume-17f5eabe-9ee6-4da5-92be-62bb4b546b66 (17f5eabe-9ee6-4da5-92be-62bb4b546b66): created successfully Nov 04 10:59:06 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-904d305c-9e76-4f8d-b296-9df1efd7620a tempest-GroupSnapshotsTest-534526937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (23ad549b-4680-47db-92bb-363567c79884) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:59:06 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-904d305c-9e76-4f8d-b296-9df1efd7620a tempest-GroupSnapshotsTest-534526937 None] Flow 'volume_create_manager' (20f3ed2e-109a-40b9-9b4e-a30a907b1d37) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87272) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:59:06 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-904d305c-9e76-4f8d-b296-9df1efd7620a tempest-GroupSnapshotsTest-534526937 None] Created volume successfully. Nov 04 10:59:07 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-67fc7c0e-3f40-4ae4-bf4c-e69eb3b0b054 tempest-GroupSnapshotsTest-534526937 None] Update group completed successfully. Nov 04 10:59:08 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-24a6f5b2-6e1e-4b4b-88fe-09696605a2fe tempest-GroupSnapshotsTest-534526937 None] Update group completed successfully. Nov 04 10:59:10 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-8e63cb97-e5ab-4469-8bc7-57338ec46a8b tempest-GroupSnapshotsTest-534526937 None] Update group completed successfully. Nov 04 10:59:11 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-0d259b45-1b1b-47d3-97c6-5951f5174175 tempest-GroupSnapshotsTest-534526937 None] Update group completed successfully. Nov 04 10:59:11 devstack cinder-volume[87272]: DEBUG cinder.volume.flows.manager.create_volume [None req-12d98c32-5b25-4652-99d4-767155b6f69f tempest-VolumesCloneNegativeTest-1665880561 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87272) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 10:59:11 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-12d98c32-5b25-4652-99d4-767155b6f69f tempest-VolumesCloneNegativeTest-1665880561 None] Flow 'volume_create_manager' (83bf8ccd-98cb-4cc8-8f63-ea8de2cbf52d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:59:11 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-12d98c32-5b25-4652-99d4-767155b6f69f tempest-VolumesCloneNegativeTest-1665880561 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01f4a0e6-5654-4871-86b1-ca5e6a1d289d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:59:11 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-12d98c32-5b25-4652-99d4-767155b6f69f tempest-VolumesCloneNegativeTest-1665880561 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01f4a0e6-5654-4871-86b1-ca5e6a1d289d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T09:59:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-665557091',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dbd1f79f-dae3-4d27-ae6c-1f434322514e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea24e489a6a540afa006fb8af78ae355',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T09:59:12Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T09:59:12Z,use_quota=True,user_id='47c02daeef9a4413ae4900a7e2942779',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8989e4f-21e3-4f0a-9584-0d818784e883),volume_type_id=f8989e4f-21e3-4f0a-9584-0d818784e883)' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:59:11 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-12d98c32-5b25-4652-99d4-767155b6f69f tempest-VolumesCloneNegativeTest-1665880561 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1eb9231d-18b7-44bd-94da-5c46089ffee9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:59:11 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-12d98c32-5b25-4652-99d4-767155b6f69f tempest-VolumesCloneNegativeTest-1665880561 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1eb9231d-18b7-44bd-94da-5c46089ffee9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:59:11 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-12d98c32-5b25-4652-99d4-767155b6f69f tempest-VolumesCloneNegativeTest-1665880561 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b9f2410-5ac3-4c77-9d9d-bfb2f7e24703) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:59:11 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-12d98c32-5b25-4652-99d4-767155b6f69f tempest-VolumesCloneNegativeTest-1665880561 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b9f2410-5ac3-4c77-9d9d-bfb2f7e24703) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dbd1f79f-dae3-4d27-ae6c-1f434322514e', 'volume_name': 'volume-dbd1f79f-dae3-4d27-ae6c-1f434322514e', 'volume_size': 2}' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:59:11 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-12d98c32-5b25-4652-99d4-767155b6f69f tempest-VolumesCloneNegativeTest-1665880561 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed9022b2-61ec-4766-8127-7b80d6ced378) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:59:11 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-12d98c32-5b25-4652-99d4-767155b6f69f tempest-VolumesCloneNegativeTest-1665880561 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed9022b2-61ec-4766-8127-7b80d6ced378) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:59:11 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-12d98c32-5b25-4652-99d4-767155b6f69f tempest-VolumesCloneNegativeTest-1665880561 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (94047f54-8981-4cd6-b743-6602ad9a3ee0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:59:11 devstack cinder-volume[87272]: INFO cinder.volume.flows.manager.create_volume [None req-12d98c32-5b25-4652-99d4-767155b6f69f tempest-VolumesCloneNegativeTest-1665880561 None] Volume dbd1f79f-dae3-4d27-ae6c-1f434322514e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dbd1f79f-dae3-4d27-ae6c-1f434322514e', 'volume_size': 2} Nov 04 10:59:11 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-12d98c32-5b25-4652-99d4-767155b6f69f tempest-VolumesCloneNegativeTest-1665880561 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:59:11 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-12d98c32-5b25-4652-99d4-767155b6f69f tempest-VolumesCloneNegativeTest-1665880561 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:59:11 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-12d98c32-5b25-4652-99d4-767155b6f69f tempest-VolumesCloneNegativeTest-1665880561 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T09:59:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-665557091',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dbd1f79f-dae3-4d27-ae6c-1f434322514e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea24e489a6a540afa006fb8af78ae355',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T09:59:12Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T09:59:12Z,use_quota=True,user_id='47c02daeef9a4413ae4900a7e2942779',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8989e4f-21e3-4f0a-9584-0d818784e883),volume_type_id=f8989e4f-21e3-4f0a-9584-0d818784e883)}" {{(pid=87272) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 04 10:59:11 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.remotefs [None req-12d98c32-5b25-4652-99d4-767155b6f69f tempest-VolumesCloneNegativeTest-1665880561 None] Creating volume dbd1f79f-dae3-4d27-ae6c-1f434322514e {{(pid=87272) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 10:59:11 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-12d98c32-5b25-4652-99d4-767155b6f69f tempest-VolumesCloneNegativeTest-1665880561 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:59:11 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-12d98c32-5b25-4652-99d4-767155b6f69f tempest-VolumesCloneNegativeTest-1665880561 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:59:11 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-12d98c32-5b25-4652-99d4-767155b6f69f tempest-VolumesCloneNegativeTest-1665880561 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898': None} {{(pid=87272) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:59:11 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-12d98c32-5b25-4652-99d4-767155b6f69f tempest-VolumesCloneNegativeTest-1665880561 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'] {{(pid=87272) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:59:11 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-12d98c32-5b25-4652-99d4-767155b6f69f tempest-VolumesCloneNegativeTest-1665880561 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:59:11 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-12d98c32-5b25-4652-99d4-767155b6f69f tempest-VolumesCloneNegativeTest-1665880561 None] Selected osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898 as target Quobyte volume. {{(pid=87272) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 10:59:11 devstack cinder-volume[87272]: INFO cinder.volume.drivers.remotefs [None req-12d98c32-5b25-4652-99d4-767155b6f69f tempest-VolumesCloneNegativeTest-1665880561 None] casted to osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898 Nov 04 10:59:11 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-12d98c32-5b25-4652-99d4-767155b6f69f tempest-VolumesCloneNegativeTest-1665880561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-dbd1f79f-dae3-4d27-ae6c-1f434322514e 2147483648 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:59:11 devstack cinder-volume[87272]: DEBUG cinder.volume.flows.manager.create_volume [None req-a23aeca6-b8f5-4fdd-ac15-b223bae1578a tempest-TestMinimumBasicScenario-423304152 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87272) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 10:59:11 devstack sudo[98555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-dbd1f79f-dae3-4d27-ae6c-1f434322514e 2147483648 Nov 04 10:59:11 devstack sudo[98555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:59:11 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-a23aeca6-b8f5-4fdd-ac15-b223bae1578a tempest-TestMinimumBasicScenario-423304152 None] Flow 'volume_create_manager' (e6a4cc8a-27b3-4aeb-9b79-24651276a641) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:59:11 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-a23aeca6-b8f5-4fdd-ac15-b223bae1578a tempest-TestMinimumBasicScenario-423304152 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f8882926-63aa-4c5c-835e-1a69751931c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:59:11 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-a23aeca6-b8f5-4fdd-ac15-b223bae1578a tempest-TestMinimumBasicScenario-423304152 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f8882926-63aa-4c5c-835e-1a69751931c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T09:59:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-581328503',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a2187971-7944-4eb9-a57d-41ad89a3a539,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0ae565dd6bf544cba3c6f60930458506',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T09:59:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T09:59:12Z,use_quota=True,user_id='dc0bf92f920f4a4ca5921c43fdf8d8a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8989e4f-21e3-4f0a-9584-0d818784e883),volume_type_id=f8989e4f-21e3-4f0a-9584-0d818784e883)' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:59:11 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-a23aeca6-b8f5-4fdd-ac15-b223bae1578a tempest-TestMinimumBasicScenario-423304152 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78953fee-455a-4cb6-9a9b-b87cebe510f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:59:11 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-a23aeca6-b8f5-4fdd-ac15-b223bae1578a tempest-TestMinimumBasicScenario-423304152 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78953fee-455a-4cb6-9a9b-b87cebe510f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:59:11 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-a23aeca6-b8f5-4fdd-ac15-b223bae1578a tempest-TestMinimumBasicScenario-423304152 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c618b1f-2287-4282-9ccd-4853401f26d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:59:11 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-a23aeca6-b8f5-4fdd-ac15-b223bae1578a tempest-TestMinimumBasicScenario-423304152 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c618b1f-2287-4282-9ccd-4853401f26d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a2187971-7944-4eb9-a57d-41ad89a3a539', 'volume_name': 'volume-a2187971-7944-4eb9-a57d-41ad89a3a539', 'volume_size': 1}' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:59:11 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-a23aeca6-b8f5-4fdd-ac15-b223bae1578a tempest-TestMinimumBasicScenario-423304152 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a67802d-5590-4813-8ab7-e99ec6c43a7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:59:11 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-a23aeca6-b8f5-4fdd-ac15-b223bae1578a tempest-TestMinimumBasicScenario-423304152 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a67802d-5590-4813-8ab7-e99ec6c43a7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:59:11 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-a23aeca6-b8f5-4fdd-ac15-b223bae1578a tempest-TestMinimumBasicScenario-423304152 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e69a3f6-0a2c-4cdd-bfb1-380693bd89e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:59:11 devstack cinder-volume[87272]: INFO cinder.volume.flows.manager.create_volume [None req-a23aeca6-b8f5-4fdd-ac15-b223bae1578a tempest-TestMinimumBasicScenario-423304152 None] Volume a2187971-7944-4eb9-a57d-41ad89a3a539: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a2187971-7944-4eb9-a57d-41ad89a3a539', 'volume_size': 1} Nov 04 10:59:11 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-a23aeca6-b8f5-4fdd-ac15-b223bae1578a tempest-TestMinimumBasicScenario-423304152 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:59:12 devstack sudo[98555]: pam_unix(sudo:session): session closed for user root Nov 04 10:59:12 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-12d98c32-5b25-4652-99d4-767155b6f69f tempest-VolumesCloneNegativeTest-1665880561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-dbd1f79f-dae3-4d27-ae6c-1f434322514e 2147483648" returned: 0 in 0.591s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:59:12 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-12d98c32-5b25-4652-99d4-767155b6f69f tempest-VolumesCloneNegativeTest-1665880561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-dbd1f79f-dae3-4d27-ae6c-1f434322514e {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:59:12 devstack sudo[98561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-dbd1f79f-dae3-4d27-ae6c-1f434322514e Nov 04 10:59:12 devstack sudo[98561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:59:12 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-039a5bf2-74e8-4c45-9f4a-b4c159eafe41 tempest-GroupsV314Test-1517989196 None] Group tempest-GroupsV314Test-Group-1767225396: creating Nov 04 10:59:12 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-039a5bf2-74e8-4c45-9f4a-b4c159eafe41 tempest-GroupsV314Test-1517989196 None] Group tempest-GroupsV314Test-Group-1767225396: created successfully Nov 04 10:59:12 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-039a5bf2-74e8-4c45-9f4a-b4c159eafe41 tempest-GroupsV314Test-1517989196 None] Create group completed successfully. Nov 04 10:59:12 devstack sudo[98561]: pam_unix(sudo:session): session closed for user root Nov 04 10:59:12 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-12d98c32-5b25-4652-99d4-767155b6f69f tempest-VolumesCloneNegativeTest-1665880561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-dbd1f79f-dae3-4d27-ae6c-1f434322514e" returned: 0 in 0.434s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:59:12 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-12d98c32-5b25-4652-99d4-767155b6f69f tempest-VolumesCloneNegativeTest-1665880561 None] <== create_volume: return (1087ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'} {{(pid=87272) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 04 10:59:12 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-12d98c32-5b25-4652-99d4-767155b6f69f tempest-VolumesCloneNegativeTest-1665880561 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.090s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:59:12 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-a23aeca6-b8f5-4fdd-ac15-b223bae1578a tempest-TestMinimumBasicScenario-423304152 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.950s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:59:12 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-a23aeca6-b8f5-4fdd-ac15-b223bae1578a tempest-TestMinimumBasicScenario-423304152 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T09:59:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-581328503',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a2187971-7944-4eb9-a57d-41ad89a3a539,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0ae565dd6bf544cba3c6f60930458506',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T09:59:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T09:59:12Z,use_quota=True,user_id='dc0bf92f920f4a4ca5921c43fdf8d8a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8989e4f-21e3-4f0a-9584-0d818784e883),volume_type_id=f8989e4f-21e3-4f0a-9584-0d818784e883)}" {{(pid=87272) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 04 10:59:12 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.remotefs [None req-a23aeca6-b8f5-4fdd-ac15-b223bae1578a tempest-TestMinimumBasicScenario-423304152 None] Creating volume a2187971-7944-4eb9-a57d-41ad89a3a539 {{(pid=87272) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 10:59:12 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-a23aeca6-b8f5-4fdd-ac15-b223bae1578a tempest-TestMinimumBasicScenario-423304152 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:59:12 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-a23aeca6-b8f5-4fdd-ac15-b223bae1578a tempest-TestMinimumBasicScenario-423304152 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:59:12 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-a23aeca6-b8f5-4fdd-ac15-b223bae1578a tempest-TestMinimumBasicScenario-423304152 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898': None} {{(pid=87272) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:59:12 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-a23aeca6-b8f5-4fdd-ac15-b223bae1578a tempest-TestMinimumBasicScenario-423304152 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'] {{(pid=87272) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:59:12 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-a23aeca6-b8f5-4fdd-ac15-b223bae1578a tempest-TestMinimumBasicScenario-423304152 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:59:12 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-a23aeca6-b8f5-4fdd-ac15-b223bae1578a tempest-TestMinimumBasicScenario-423304152 None] Selected osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898 as target Quobyte volume. {{(pid=87272) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 10:59:12 devstack cinder-volume[87272]: INFO cinder.volume.drivers.remotefs [None req-a23aeca6-b8f5-4fdd-ac15-b223bae1578a tempest-TestMinimumBasicScenario-423304152 None] casted to osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898 Nov 04 10:59:12 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-a23aeca6-b8f5-4fdd-ac15-b223bae1578a tempest-TestMinimumBasicScenario-423304152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-a2187971-7944-4eb9-a57d-41ad89a3a539 1073741824 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:59:12 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-12d98c32-5b25-4652-99d4-767155b6f69f tempest-VolumesCloneNegativeTest-1665880561 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (94047f54-8981-4cd6-b743-6602ad9a3ee0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dbd1f79f-dae3-4d27-ae6c-1f434322514e', 'volume_size': 2}' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:59:12 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-12d98c32-5b25-4652-99d4-767155b6f69f tempest-VolumesCloneNegativeTest-1665880561 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed943dd1-9c99-468c-8930-3ed2b2621c8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:59:12 devstack sudo[98564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-a2187971-7944-4eb9-a57d-41ad89a3a539 1073741824 Nov 04 10:59:12 devstack sudo[98564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:59:12 devstack cinder-volume[87272]: INFO cinder.volume.flows.manager.create_volume [None req-12d98c32-5b25-4652-99d4-767155b6f69f tempest-VolumesCloneNegativeTest-1665880561 None] Volume volume-dbd1f79f-dae3-4d27-ae6c-1f434322514e (dbd1f79f-dae3-4d27-ae6c-1f434322514e): created successfully Nov 04 10:59:12 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-12d98c32-5b25-4652-99d4-767155b6f69f tempest-VolumesCloneNegativeTest-1665880561 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed943dd1-9c99-468c-8930-3ed2b2621c8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:59:12 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-12d98c32-5b25-4652-99d4-767155b6f69f tempest-VolumesCloneNegativeTest-1665880561 None] Flow 'volume_create_manager' (83bf8ccd-98cb-4cc8-8f63-ea8de2cbf52d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87272) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:59:12 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-12d98c32-5b25-4652-99d4-767155b6f69f tempest-VolumesCloneNegativeTest-1665880561 None] Created volume successfully. Nov 04 10:59:13 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-7111c9c0-719c-4ae7-9e96-8e5c8816e42b tempest-GroupSnapshotsTest-534526937 None] GroupSnapshot 80dbd989-5900-4bf3-a24d-371c11167cfe: creating. Nov 04 10:59:13 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-7111c9c0-719c-4ae7-9e96-8e5c8816e42b tempest-GroupSnapshotsTest-534526937 None] Group snapshot 80dbd989-5900-4bf3-a24d-371c11167cfe: creating. {{(pid=87272) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Nov 04 10:59:13 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-7111c9c0-719c-4ae7-9e96-8e5c8816e42b tempest-GroupSnapshotsTest-534526937 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:59:13 devstack sudo[98564]: pam_unix(sudo:session): session closed for user root Nov 04 10:59:13 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-a23aeca6-b8f5-4fdd-ac15-b223bae1578a tempest-TestMinimumBasicScenario-423304152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-a2187971-7944-4eb9-a57d-41ad89a3a539 1073741824" returned: 0 in 0.458s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:59:13 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-a23aeca6-b8f5-4fdd-ac15-b223bae1578a tempest-TestMinimumBasicScenario-423304152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-a2187971-7944-4eb9-a57d-41ad89a3a539 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:59:13 devstack sudo[98569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-a2187971-7944-4eb9-a57d-41ad89a3a539 Nov 04 10:59:13 devstack sudo[98569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:59:13 devstack sudo[98569]: pam_unix(sudo:session): session closed for user root Nov 04 10:59:13 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-0f100ca2-187d-4b30-aaf5-eba9772e13d5 tempest-VolumesCloneNegativeTest-1665880561 None] Acquiring lock "cinder-dbd1f79f-dae3-4d27-ae6c-1f434322514e-delete_volume" by "delete_volume" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:59:13 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-a23aeca6-b8f5-4fdd-ac15-b223bae1578a tempest-TestMinimumBasicScenario-423304152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-a2187971-7944-4eb9-a57d-41ad89a3a539" returned: 0 in 0.288s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:59:13 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-a23aeca6-b8f5-4fdd-ac15-b223bae1578a tempest-TestMinimumBasicScenario-423304152 None] <== create_volume: return (793ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'} {{(pid=87272) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 04 10:59:13 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-a23aeca6-b8f5-4fdd-ac15-b223bae1578a tempest-TestMinimumBasicScenario-423304152 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.800s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:59:13 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-7111c9c0-719c-4ae7-9e96-8e5c8816e42b tempest-GroupSnapshotsTest-534526937 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.485s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:59:13 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-0f100ca2-187d-4b30-aaf5-eba9772e13d5 tempest-VolumesCloneNegativeTest-1665880561 None] Lock "cinder-dbd1f79f-dae3-4d27-ae6c-1f434322514e-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:59:13 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-a23aeca6-b8f5-4fdd-ac15-b223bae1578a tempest-TestMinimumBasicScenario-423304152 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e69a3f6-0a2c-4cdd-bfb1-380693bd89e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a2187971-7944-4eb9-a57d-41ad89a3a539', 'volume_size': 1}' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:59:13 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-a23aeca6-b8f5-4fdd-ac15-b223bae1578a tempest-TestMinimumBasicScenario-423304152 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a641cc55-2753-4a81-9755-6a8af885f558) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:59:13 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.remotefs [None req-7111c9c0-719c-4ae7-9e96-8e5c8816e42b tempest-GroupSnapshotsTest-534526937 None] Creating offline snapshot 4263ce94-b62e-4778-8159-f8f470b0dbcd of volume 36ef6ce6-5b38-449d-84e6-34165c6eb7a1 {{(pid=87272) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 04 10:59:13 devstack cinder-volume[87272]: INFO cinder.volume.flows.manager.create_volume [None req-a23aeca6-b8f5-4fdd-ac15-b223bae1578a tempest-TestMinimumBasicScenario-423304152 None] Volume volume-a2187971-7944-4eb9-a57d-41ad89a3a539 (a2187971-7944-4eb9-a57d-41ad89a3a539): created successfully Nov 04 10:59:13 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-a23aeca6-b8f5-4fdd-ac15-b223bae1578a tempest-TestMinimumBasicScenario-423304152 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a641cc55-2753-4a81-9755-6a8af885f558) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:59:13 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-a23aeca6-b8f5-4fdd-ac15-b223bae1578a tempest-TestMinimumBasicScenario-423304152 None] Flow 'volume_create_manager' (e6a4cc8a-27b3-4aeb-9b79-24651276a641) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87272) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:59:13 devstack cinder-volume[87272]: DEBUG oslo.privsep.daemon [-] privsep: reply[a36f19eb-2a27-4bbd-b1fc-6ff8a232797e]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:59:13 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-7111c9c0-719c-4ae7-9e96-8e5c8816e42b tempest-GroupSnapshotsTest-534526937 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-36ef6ce6-5b38-449d-84e6-34165c6eb7a1 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:59:13 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-a23aeca6-b8f5-4fdd-ac15-b223bae1578a tempest-TestMinimumBasicScenario-423304152 None] Created volume successfully. Nov 04 10:59:13 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-0f100ca2-187d-4b30-aaf5-eba9772e13d5 tempest-VolumesCloneNegativeTest-1665880561 None] Acquiring lock "cinder-quobyte-dbd1f79f-dae3-4d27-ae6c-1f434322514e" by "delete_volume" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:59:13 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-0f100ca2-187d-4b30-aaf5-eba9772e13d5 tempest-VolumesCloneNegativeTest-1665880561 None] Lock "cinder-quobyte-dbd1f79f-dae3-4d27-ae6c-1f434322514e" acquired by "delete_volume" :: waited 0.023s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:59:13 devstack cinder-volume[87272]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae93e0de-55d5-4f84-b0e6-595f8c92f0b6]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:59:13 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-0f100ca2-187d-4b30-aaf5-eba9772e13d5 tempest-VolumesCloneNegativeTest-1665880561 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-dbd1f79f-dae3-4d27-ae6c-1f434322514e {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:59:13 devstack sudo[98572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-36ef6ce6-5b38-449d-84e6-34165c6eb7a1 Nov 04 10:59:13 devstack sudo[98572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:59:14 devstack sudo[98573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-dbd1f79f-dae3-4d27-ae6c-1f434322514e Nov 04 10:59:14 devstack sudo[98573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:59:14 devstack cinder-volume[87272]: DEBUG oslo_service.periodic_task [None req-236af0be-7f9d-4c80-b3d7-d645a9cd0dd1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87272) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 04 10:59:14 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-236af0be-7f9d-4c80-b3d7-d645a9cd0dd1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:59:14 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-236af0be-7f9d-4c80-b3d7-d645a9cd0dd1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:59:14 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-236af0be-7f9d-4c80-b3d7-d645a9cd0dd1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898': None} {{(pid=87272) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:59:14 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-236af0be-7f9d-4c80-b3d7-d645a9cd0dd1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'] {{(pid=87272) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:59:14 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-236af0be-7f9d-4c80-b3d7-d645a9cd0dd1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:59:14 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-236af0be-7f9d-4c80-b3d7-d645a9cd0dd1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:59:14 devstack sudo[98576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1 Nov 04 10:59:14 devstack sudo[98576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:59:14 devstack sudo[98572]: pam_unix(sudo:session): session closed for user root Nov 04 10:59:14 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-7111c9c0-719c-4ae7-9e96-8e5c8816e42b tempest-GroupSnapshotsTest-534526937 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-36ef6ce6-5b38-449d-84e6-34165c6eb7a1" returned: 0 in 0.612s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:59:14 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-7111c9c0-719c-4ae7-9e96-8e5c8816e42b tempest-GroupSnapshotsTest-534526937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-36ef6ce6-5b38-449d-84e6-34165c6eb7a1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-36ef6ce6-5b38-449d-84e6-34165c6eb7a1.4263ce94-b62e-4778-8159-f8f470b0dbcd 1G {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:59:14 devstack sudo[98581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-36ef6ce6-5b38-449d-84e6-34165c6eb7a1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-36ef6ce6-5b38-449d-84e6-34165c6eb7a1.4263ce94-b62e-4778-8159-f8f470b0dbcd 1G Nov 04 10:59:14 devstack sudo[98581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:59:14 devstack sudo[98576]: pam_unix(sudo:session): session closed for user root Nov 04 10:59:14 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-236af0be-7f9d-4c80-b3d7-d645a9cd0dd1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1" returned: 0 in 0.386s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:59:14 devstack cinder-volume[87272]: DEBUG cinder.manager [None req-236af0be-7f9d-4c80-b3d7-d645a9cd0dd1 None None] Notifying Schedulers of capabilities ... {{(pid=87272) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 10:59:14 devstack cinder-volume[87272]: DEBUG oslo_service.periodic_task [None req-236af0be-7f9d-4c80-b3d7-d645a9cd0dd1 None None] Running periodic task VolumeManager._thread_info {{(pid=87272) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 04 10:59:14 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-236af0be-7f9d-4c80-b3d7-d645a9cd0dd1 None None] thread count: 28 {{(pid=87272) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 04 10:59:14 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-236af0be-7f9d-4c80-b3d7-d645a9cd0dd1 None None] thread info: [<_MainThread(MainThread, started 127085713244288)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87272) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 04 10:59:14 devstack sudo[98573]: pam_unix(sudo:session): session closed for user root Nov 04 10:59:14 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-0f100ca2-187d-4b30-aaf5-eba9772e13d5 tempest-VolumesCloneNegativeTest-1665880561 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-dbd1f79f-dae3-4d27-ae6c-1f434322514e" returned: 0 in 0.749s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:59:14 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-0f100ca2-187d-4b30-aaf5-eba9772e13d5 tempest-VolumesCloneNegativeTest-1665880561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-dbd1f79f-dae3-4d27-ae6c-1f434322514e {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:59:14 devstack sudo[98587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-dbd1f79f-dae3-4d27-ae6c-1f434322514e Nov 04 10:59:14 devstack sudo[98587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:59:14 devstack cinder-volume[87272]: DEBUG cinder.volume.flows.manager.create_volume [None req-96215ac5-f5c4-477d-afb7-448cd68e7774 tempest-GroupsV314Test-1517989196 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87272) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 10:59:14 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-96215ac5-f5c4-477d-afb7-448cd68e7774 tempest-GroupsV314Test-1517989196 None] Flow 'volume_create_manager' (206d0ab6-7797-42fa-b183-b13600854a35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:59:14 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-96215ac5-f5c4-477d-afb7-448cd68e7774 tempest-GroupsV314Test-1517989196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d865378-9fbc-4053-9486-751ab2dc3235) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:59:14 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-96215ac5-f5c4-477d-afb7-448cd68e7774 tempest-GroupsV314Test-1517989196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d865378-9fbc-4053-9486-751ab2dc3235) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T09:59:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1833948289',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=093028c5-5134-4299-9b96-39cbf694a894,host='devstack@QuobyteHD#QuobyteHD',id=c67a032e-a321-4ffa-9f76-48e8ffaac0d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a97fc738a464fbfb544f3645a900049',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T09:59:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T09:59:15Z,use_quota=True,user_id='9942404166d0443281d08a30255a7be5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f263f8ec-1910-454a-a52b-eadc17f9cd10),volume_type_id=f263f8ec-1910-454a-a52b-eadc17f9cd10)' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:59:14 devstack sudo[98587]: pam_unix(sudo:session): session closed for user root Nov 04 10:59:15 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-96215ac5-f5c4-477d-afb7-448cd68e7774 tempest-GroupsV314Test-1517989196 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a1ce2f7-8717-493a-8a2d-ead81449bdeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:59:15 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-96215ac5-f5c4-477d-afb7-448cd68e7774 tempest-GroupsV314Test-1517989196 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a1ce2f7-8717-493a-8a2d-ead81449bdeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:59:15 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-96215ac5-f5c4-477d-afb7-448cd68e7774 tempest-GroupsV314Test-1517989196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (deabce76-c3f8-4441-a601-80905c6ef3b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:59:15 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-96215ac5-f5c4-477d-afb7-448cd68e7774 tempest-GroupsV314Test-1517989196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (deabce76-c3f8-4441-a601-80905c6ef3b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c67a032e-a321-4ffa-9f76-48e8ffaac0d4', 'volume_name': 'volume-c67a032e-a321-4ffa-9f76-48e8ffaac0d4', 'volume_size': 1}' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:59:15 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-96215ac5-f5c4-477d-afb7-448cd68e7774 tempest-GroupsV314Test-1517989196 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3479da3-ca6c-43c2-a59c-22d2b237ba1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:59:15 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-96215ac5-f5c4-477d-afb7-448cd68e7774 tempest-GroupsV314Test-1517989196 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3479da3-ca6c-43c2-a59c-22d2b237ba1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:59:15 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-96215ac5-f5c4-477d-afb7-448cd68e7774 tempest-GroupsV314Test-1517989196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (42c83f65-c1bc-4da2-89c2-3e4782228841) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:59:15 devstack cinder-volume[87272]: INFO cinder.volume.flows.manager.create_volume [None req-96215ac5-f5c4-477d-afb7-448cd68e7774 tempest-GroupsV314Test-1517989196 None] Volume c67a032e-a321-4ffa-9f76-48e8ffaac0d4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c67a032e-a321-4ffa-9f76-48e8ffaac0d4', 'volume_size': 1} Nov 04 10:59:15 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-96215ac5-f5c4-477d-afb7-448cd68e7774 tempest-GroupsV314Test-1517989196 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:59:15 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-0f100ca2-187d-4b30-aaf5-eba9772e13d5 tempest-VolumesCloneNegativeTest-1665880561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-dbd1f79f-dae3-4d27-ae6c-1f434322514e" returned: 0 in 0.424s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:59:15 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-0f100ca2-187d-4b30-aaf5-eba9772e13d5 tempest-VolumesCloneNegativeTest-1665880561 None] Lock "cinder-quobyte-dbd1f79f-dae3-4d27-ae6c-1f434322514e" released by "delete_volume" :: held 1.235s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:59:15 devstack sudo[98581]: pam_unix(sudo:session): session closed for user root Nov 04 10:59:15 devstack cinder-volume[87272]: DEBUG cinder.quota [None req-0f100ca2-187d-4b30-aaf5-eba9772e13d5 tempest-VolumesCloneNegativeTest-1665880561 None] Created reservations ['fa392233-8f7f-4577-a09b-5ae750945906', '21c6f030-d50f-43b3-aea5-f649e10a4035', '4a259312-b5d1-4a54-85c8-9427d5832e48', '3517c8e6-f497-4540-bcb4-852a51567cac'] {{(pid=87272) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 10:59:15 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-7111c9c0-719c-4ae7-9e96-8e5c8816e42b tempest-GroupSnapshotsTest-534526937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-36ef6ce6-5b38-449d-84e6-34165c6eb7a1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-36ef6ce6-5b38-449d-84e6-34165c6eb7a1.4263ce94-b62e-4778-8159-f8f470b0dbcd 1G" returned: 0 in 0.748s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:59:15 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-7111c9c0-719c-4ae7-9e96-8e5c8816e42b tempest-GroupSnapshotsTest-534526937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-36ef6ce6-5b38-449d-84e6-34165c6eb7a1 -F qcow2 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-36ef6ce6-5b38-449d-84e6-34165c6eb7a1.4263ce94-b62e-4778-8159-f8f470b0dbcd {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:59:15 devstack sudo[98597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-36ef6ce6-5b38-449d-84e6-34165c6eb7a1 -F qcow2 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-36ef6ce6-5b38-449d-84e6-34165c6eb7a1.4263ce94-b62e-4778-8159-f8f470b0dbcd Nov 04 10:59:15 devstack sudo[98597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:59:15 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-0f100ca2-187d-4b30-aaf5-eba9772e13d5 tempest-VolumesCloneNegativeTest-1665880561 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:59:15 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-0f100ca2-187d-4b30-aaf5-eba9772e13d5 tempest-VolumesCloneNegativeTest-1665880561 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:59:15 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-0f100ca2-187d-4b30-aaf5-eba9772e13d5 tempest-VolumesCloneNegativeTest-1665880561 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898': None} {{(pid=87272) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:59:15 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-0f100ca2-187d-4b30-aaf5-eba9772e13d5 tempest-VolumesCloneNegativeTest-1665880561 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'] {{(pid=87272) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:59:15 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-0f100ca2-187d-4b30-aaf5-eba9772e13d5 tempest-VolumesCloneNegativeTest-1665880561 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:59:15 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-0f100ca2-187d-4b30-aaf5-eba9772e13d5 tempest-VolumesCloneNegativeTest-1665880561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:59:15 devstack sudo[98599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1 Nov 04 10:59:15 devstack sudo[98599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:59:15 devstack sudo[98597]: pam_unix(sudo:session): session closed for user root Nov 04 10:59:15 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-7111c9c0-719c-4ae7-9e96-8e5c8816e42b tempest-GroupSnapshotsTest-534526937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-36ef6ce6-5b38-449d-84e6-34165c6eb7a1 -F qcow2 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-36ef6ce6-5b38-449d-84e6-34165c6eb7a1.4263ce94-b62e-4778-8159-f8f470b0dbcd" returned: 0 in 0.410s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:59:15 devstack cinder-volume[87272]: WARNING cinder.volume.drivers.remotefs [None req-7111c9c0-719c-4ae7-9e96-8e5c8816e42b tempest-GroupSnapshotsTest-534526937 None] /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-36ef6ce6-5b38-449d-84e6-34165c6eb7a1.4263ce94-b62e-4778-8159-f8f470b0dbcd is being set with open permissions: ugo+rw: NotImplementedError Nov 04 10:59:15 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-7111c9c0-719c-4ae7-9e96-8e5c8816e42b tempest-GroupSnapshotsTest-534526937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-36ef6ce6-5b38-449d-84e6-34165c6eb7a1.4263ce94-b62e-4778-8159-f8f470b0dbcd {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:59:15 devstack sudo[98610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-36ef6ce6-5b38-449d-84e6-34165c6eb7a1.4263ce94-b62e-4778-8159-f8f470b0dbcd Nov 04 10:59:15 devstack sudo[98610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:59:15 devstack sudo[98599]: pam_unix(sudo:session): session closed for user root Nov 04 10:59:15 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-0f100ca2-187d-4b30-aaf5-eba9772e13d5 tempest-VolumesCloneNegativeTest-1665880561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1" returned: 0 in 0.381s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:59:15 devstack cinder-volume[87272]: DEBUG cinder.manager [None req-0f100ca2-187d-4b30-aaf5-eba9772e13d5 tempest-VolumesCloneNegativeTest-1665880561 None] Notifying Schedulers of capabilities ... {{(pid=87272) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 10:59:15 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-0f100ca2-187d-4b30-aaf5-eba9772e13d5 tempest-VolumesCloneNegativeTest-1665880561 None] Deleted volume successfully. Nov 04 10:59:15 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-0f100ca2-187d-4b30-aaf5-eba9772e13d5 tempest-VolumesCloneNegativeTest-1665880561 None] Lock "cinder-dbd1f79f-dae3-4d27-ae6c-1f434322514e-delete_volume" released by "delete_volume" :: held 1.995s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:59:15 devstack sudo[98610]: pam_unix(sudo:session): session closed for user root Nov 04 10:59:15 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-7111c9c0-719c-4ae7-9e96-8e5c8816e42b tempest-GroupSnapshotsTest-534526937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-36ef6ce6-5b38-449d-84e6-34165c6eb7a1.4263ce94-b62e-4778-8159-f8f470b0dbcd" returned: 0 in 0.371s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:59:15 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-7111c9c0-719c-4ae7-9e96-8e5c8816e42b tempest-GroupSnapshotsTest-534526937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-36ef6ce6-5b38-449d-84e6-34165c6eb7a1.info {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:59:15 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [req-2f9ac66b-6f6c-4215-bf5d-2ef56fcdd2fa req-e0ac3b52-a85e-43f7-9cc7-caa80d6beb11 tempest-TestMinimumBasicScenario-423304152 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:59:15 devstack sudo[98622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-36ef6ce6-5b38-449d-84e6-34165c6eb7a1.info Nov 04 10:59:15 devstack sudo[98622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:59:16 devstack sudo[98622]: pam_unix(sudo:session): session closed for user root Nov 04 10:59:16 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-7111c9c0-719c-4ae7-9e96-8e5c8816e42b tempest-GroupSnapshotsTest-534526937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-36ef6ce6-5b38-449d-84e6-34165c6eb7a1.info" returned: 0 in 0.267s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:59:16 devstack cinder-volume[87272]: WARNING cinder.volume.drivers.remotefs [None req-7111c9c0-719c-4ae7-9e96-8e5c8816e42b tempest-GroupSnapshotsTest-534526937 None] /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-36ef6ce6-5b38-449d-84e6-34165c6eb7a1.info is being set with open permissions: ugo+rw: NotImplementedError Nov 04 10:59:16 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-7111c9c0-719c-4ae7-9e96-8e5c8816e42b tempest-GroupSnapshotsTest-534526937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-36ef6ce6-5b38-449d-84e6-34165c6eb7a1.info {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:59:16 devstack sudo[98626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-36ef6ce6-5b38-449d-84e6-34165c6eb7a1.info Nov 04 10:59:16 devstack sudo[98626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:59:16 devstack sudo[98626]: pam_unix(sudo:session): session closed for user root Nov 04 10:59:16 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-7111c9c0-719c-4ae7-9e96-8e5c8816e42b tempest-GroupSnapshotsTest-534526937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-36ef6ce6-5b38-449d-84e6-34165c6eb7a1.info" returned: 0 in 0.265s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:59:16 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-7111c9c0-719c-4ae7-9e96-8e5c8816e42b tempest-GroupSnapshotsTest-534526937 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.835s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:59:16 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-7111c9c0-719c-4ae7-9e96-8e5c8816e42b tempest-GroupSnapshotsTest-534526937 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:59:16 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-7111c9c0-719c-4ae7-9e96-8e5c8816e42b tempest-GroupSnapshotsTest-534526937 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:59:16 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.remotefs [None req-7111c9c0-719c-4ae7-9e96-8e5c8816e42b tempest-GroupSnapshotsTest-534526937 None] Creating offline snapshot af1148b8-1d97-455f-b211-d49ab7d13c38 of volume 17f5eabe-9ee6-4da5-92be-62bb4b546b66 {{(pid=87272) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 04 10:59:16 devstack cinder-volume[87272]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dc003fc-9217-49ae-9710-e2bd43727724]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:59:16 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-7111c9c0-719c-4ae7-9e96-8e5c8816e42b tempest-GroupSnapshotsTest-534526937 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-17f5eabe-9ee6-4da5-92be-62bb4b546b66 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:59:16 devstack sudo[98629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-17f5eabe-9ee6-4da5-92be-62bb4b546b66 Nov 04 10:59:16 devstack sudo[98629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:59:16 devstack sudo[98629]: pam_unix(sudo:session): session closed for user root Nov 04 10:59:16 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-7111c9c0-719c-4ae7-9e96-8e5c8816e42b tempest-GroupSnapshotsTest-534526937 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-17f5eabe-9ee6-4da5-92be-62bb4b546b66" returned: 0 in 0.379s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:59:16 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-7111c9c0-719c-4ae7-9e96-8e5c8816e42b tempest-GroupSnapshotsTest-534526937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-17f5eabe-9ee6-4da5-92be-62bb4b546b66,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-17f5eabe-9ee6-4da5-92be-62bb4b546b66.af1148b8-1d97-455f-b211-d49ab7d13c38 1G {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:59:16 devstack sudo[98634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-17f5eabe-9ee6-4da5-92be-62bb4b546b66,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-17f5eabe-9ee6-4da5-92be-62bb4b546b66.af1148b8-1d97-455f-b211-d49ab7d13c38 1G Nov 04 10:59:16 devstack sudo[98634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:59:17 devstack sudo[98634]: pam_unix(sudo:session): session closed for user root Nov 04 10:59:17 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-7111c9c0-719c-4ae7-9e96-8e5c8816e42b tempest-GroupSnapshotsTest-534526937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-17f5eabe-9ee6-4da5-92be-62bb4b546b66,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-17f5eabe-9ee6-4da5-92be-62bb4b546b66.af1148b8-1d97-455f-b211-d49ab7d13c38 1G" returned: 0 in 0.533s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:59:17 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-7111c9c0-719c-4ae7-9e96-8e5c8816e42b tempest-GroupSnapshotsTest-534526937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-17f5eabe-9ee6-4da5-92be-62bb4b546b66 -F qcow2 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-17f5eabe-9ee6-4da5-92be-62bb4b546b66.af1148b8-1d97-455f-b211-d49ab7d13c38 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:59:17 devstack sudo[98641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-17f5eabe-9ee6-4da5-92be-62bb4b546b66 -F qcow2 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-17f5eabe-9ee6-4da5-92be-62bb4b546b66.af1148b8-1d97-455f-b211-d49ab7d13c38 Nov 04 10:59:17 devstack sudo[98641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:59:17 devstack sudo[98641]: pam_unix(sudo:session): session closed for user root Nov 04 10:59:17 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-7111c9c0-719c-4ae7-9e96-8e5c8816e42b tempest-GroupSnapshotsTest-534526937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-17f5eabe-9ee6-4da5-92be-62bb4b546b66 -F qcow2 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-17f5eabe-9ee6-4da5-92be-62bb4b546b66.af1148b8-1d97-455f-b211-d49ab7d13c38" returned: 0 in 0.382s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:59:17 devstack cinder-volume[87272]: WARNING cinder.volume.drivers.remotefs [None req-7111c9c0-719c-4ae7-9e96-8e5c8816e42b tempest-GroupSnapshotsTest-534526937 None] /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-17f5eabe-9ee6-4da5-92be-62bb4b546b66.af1148b8-1d97-455f-b211-d49ab7d13c38 is being set with open permissions: ugo+rw: NotImplementedError Nov 04 10:59:17 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-7111c9c0-719c-4ae7-9e96-8e5c8816e42b tempest-GroupSnapshotsTest-534526937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-17f5eabe-9ee6-4da5-92be-62bb4b546b66.af1148b8-1d97-455f-b211-d49ab7d13c38 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:59:17 devstack sudo[98647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-17f5eabe-9ee6-4da5-92be-62bb4b546b66.af1148b8-1d97-455f-b211-d49ab7d13c38 Nov 04 10:59:17 devstack sudo[98647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:59:18 devstack sudo[98647]: pam_unix(sudo:session): session closed for user root Nov 04 10:59:18 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-7111c9c0-719c-4ae7-9e96-8e5c8816e42b tempest-GroupSnapshotsTest-534526937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-17f5eabe-9ee6-4da5-92be-62bb4b546b66.af1148b8-1d97-455f-b211-d49ab7d13c38" returned: 0 in 0.269s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:59:18 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-7111c9c0-719c-4ae7-9e96-8e5c8816e42b tempest-GroupSnapshotsTest-534526937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-17f5eabe-9ee6-4da5-92be-62bb4b546b66.info {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:59:18 devstack sudo[98650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-17f5eabe-9ee6-4da5-92be-62bb4b546b66.info Nov 04 10:59:18 devstack sudo[98650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:59:18 devstack sudo[98650]: pam_unix(sudo:session): session closed for user root Nov 04 10:59:18 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-7111c9c0-719c-4ae7-9e96-8e5c8816e42b tempest-GroupSnapshotsTest-534526937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-17f5eabe-9ee6-4da5-92be-62bb4b546b66.info" returned: 0 in 0.339s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:59:18 devstack cinder-volume[87272]: WARNING cinder.volume.drivers.remotefs [None req-7111c9c0-719c-4ae7-9e96-8e5c8816e42b tempest-GroupSnapshotsTest-534526937 None] /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-17f5eabe-9ee6-4da5-92be-62bb4b546b66.info is being set with open permissions: ugo+rw: NotImplementedError Nov 04 10:59:18 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-7111c9c0-719c-4ae7-9e96-8e5c8816e42b tempest-GroupSnapshotsTest-534526937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-17f5eabe-9ee6-4da5-92be-62bb4b546b66.info {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:59:18 devstack sudo[98653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-17f5eabe-9ee6-4da5-92be-62bb4b546b66.info Nov 04 10:59:18 devstack sudo[98653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:59:18 devstack sudo[98653]: pam_unix(sudo:session): session closed for user root Nov 04 10:59:18 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-7111c9c0-719c-4ae7-9e96-8e5c8816e42b tempest-GroupSnapshotsTest-534526937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-17f5eabe-9ee6-4da5-92be-62bb4b546b66.info" returned: 0 in 0.267s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:59:18 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-7111c9c0-719c-4ae7-9e96-8e5c8816e42b tempest-GroupSnapshotsTest-534526937 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.282s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:59:18 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [req-2f9ac66b-6f6c-4215-bf5d-2ef56fcdd2fa req-e0ac3b52-a85e-43f7-9cc7-caa80d6beb11 tempest-TestMinimumBasicScenario-423304152 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 2.830s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:59:18 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [req-2f9ac66b-6f6c-4215-bf5d-2ef56fcdd2fa req-e0ac3b52-a85e-43f7-9cc7-caa80d6beb11 tempest-TestMinimumBasicScenario-423304152 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.036s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:59:18 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-96215ac5-f5c4-477d-afb7-448cd68e7774 tempest-GroupsV314Test-1517989196 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.790s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:59:18 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-96215ac5-f5c4-477d-afb7-448cd68e7774 tempest-GroupsV314Test-1517989196 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=093028c5-5134-4299-9b96-39cbf694a894,created_at=2026-11-04T09:59:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1833948289',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=093028c5-5134-4299-9b96-39cbf694a894,host='devstack@QuobyteHD#QuobyteHD',id=c67a032e-a321-4ffa-9f76-48e8ffaac0d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a97fc738a464fbfb544f3645a900049',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T09:59:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T09:59:15Z,use_quota=True,user_id='9942404166d0443281d08a30255a7be5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f263f8ec-1910-454a-a52b-eadc17f9cd10),volume_type_id=f263f8ec-1910-454a-a52b-eadc17f9cd10)}" {{(pid=87272) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 04 10:59:18 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.remotefs [None req-96215ac5-f5c4-477d-afb7-448cd68e7774 tempest-GroupsV314Test-1517989196 None] Creating volume c67a032e-a321-4ffa-9f76-48e8ffaac0d4 {{(pid=87272) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 10:59:18 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-96215ac5-f5c4-477d-afb7-448cd68e7774 tempest-GroupsV314Test-1517989196 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:59:18 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-96215ac5-f5c4-477d-afb7-448cd68e7774 tempest-GroupsV314Test-1517989196 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:59:18 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-96215ac5-f5c4-477d-afb7-448cd68e7774 tempest-GroupsV314Test-1517989196 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898': None} {{(pid=87272) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:59:18 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-96215ac5-f5c4-477d-afb7-448cd68e7774 tempest-GroupsV314Test-1517989196 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'] {{(pid=87272) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:59:18 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-96215ac5-f5c4-477d-afb7-448cd68e7774 tempest-GroupsV314Test-1517989196 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:59:18 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-96215ac5-f5c4-477d-afb7-448cd68e7774 tempest-GroupsV314Test-1517989196 None] Selected osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898 as target Quobyte volume. {{(pid=87272) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 10:59:18 devstack cinder-volume[87272]: INFO cinder.volume.drivers.remotefs [None req-96215ac5-f5c4-477d-afb7-448cd68e7774 tempest-GroupsV314Test-1517989196 None] casted to osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898 Nov 04 10:59:18 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-96215ac5-f5c4-477d-afb7-448cd68e7774 tempest-GroupsV314Test-1517989196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-c67a032e-a321-4ffa-9f76-48e8ffaac0d4 1073741824 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:59:18 devstack sudo[98656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-c67a032e-a321-4ffa-9f76-48e8ffaac0d4 1073741824 Nov 04 10:59:18 devstack sudo[98656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:59:18 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [req-2f9ac66b-6f6c-4215-bf5d-2ef56fcdd2fa req-e0ac3b52-a85e-43f7-9cc7-caa80d6beb11 tempest-TestMinimumBasicScenario-423304152 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898', 'name': 'volume-a2187971-7944-4eb9-a57d-41ad89a3a539', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '0e6a4df3-87a8-4718-bde3-8ce23cdf9a44', 'enforce_multipath': True} {{(pid=87272) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 04 10:59:19 devstack cinder-volume[87272]: INFO cinder.volume.manager [req-2f9ac66b-6f6c-4215-bf5d-2ef56fcdd2fa req-e0ac3b52-a85e-43f7-9cc7-caa80d6beb11 tempest-TestMinimumBasicScenario-423304152 None] attachment_update completed successfully. Nov 04 10:59:19 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-7111c9c0-719c-4ae7-9e96-8e5c8816e42b tempest-GroupSnapshotsTest-534526937 None] group_snapshot 80dbd989-5900-4bf3-a24d-371c11167cfe: created successfully Nov 04 10:59:19 devstack sudo[98656]: pam_unix(sudo:session): session closed for user root Nov 04 10:59:19 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-96215ac5-f5c4-477d-afb7-448cd68e7774 tempest-GroupsV314Test-1517989196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-c67a032e-a321-4ffa-9f76-48e8ffaac0d4 1073741824" returned: 0 in 0.611s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:59:19 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-96215ac5-f5c4-477d-afb7-448cd68e7774 tempest-GroupsV314Test-1517989196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-c67a032e-a321-4ffa-9f76-48e8ffaac0d4 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:59:19 devstack sudo[99075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-c67a032e-a321-4ffa-9f76-48e8ffaac0d4 Nov 04 10:59:19 devstack sudo[99075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:59:19 devstack sudo[99075]: pam_unix(sudo:session): session closed for user root Nov 04 10:59:19 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-96215ac5-f5c4-477d-afb7-448cd68e7774 tempest-GroupsV314Test-1517989196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-c67a032e-a321-4ffa-9f76-48e8ffaac0d4" returned: 0 in 0.379s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:59:19 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-96215ac5-f5c4-477d-afb7-448cd68e7774 tempest-GroupsV314Test-1517989196 None] <== create_volume: return (1076ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'} {{(pid=87272) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 04 10:59:19 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-96215ac5-f5c4-477d-afb7-448cd68e7774 tempest-GroupsV314Test-1517989196 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.083s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:59:19 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-96215ac5-f5c4-477d-afb7-448cd68e7774 tempest-GroupsV314Test-1517989196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (42c83f65-c1bc-4da2-89c2-3e4782228841) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c67a032e-a321-4ffa-9f76-48e8ffaac0d4', 'volume_size': 1}' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:59:19 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-96215ac5-f5c4-477d-afb7-448cd68e7774 tempest-GroupsV314Test-1517989196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1268783e-5e45-4579-92eb-deaccd945e79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:59:19 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-e469e24b-8dcd-4c30-9274-36995a813f5f tempest-GroupSnapshotsTest-534526937 None] group_snapshot 80dbd989-5900-4bf3-a24d-371c11167cfe: deleting Nov 04 10:59:20 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-e469e24b-8dcd-4c30-9274-36995a813f5f tempest-GroupSnapshotsTest-534526937 None] group_snapshot 80dbd989-5900-4bf3-a24d-371c11167cfe: deleting {{(pid=87272) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Nov 04 10:59:20 devstack cinder-volume[87272]: INFO cinder.volume.flows.manager.create_volume [None req-96215ac5-f5c4-477d-afb7-448cd68e7774 tempest-GroupsV314Test-1517989196 None] Volume volume-c67a032e-a321-4ffa-9f76-48e8ffaac0d4 (c67a032e-a321-4ffa-9f76-48e8ffaac0d4): created successfully Nov 04 10:59:20 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-96215ac5-f5c4-477d-afb7-448cd68e7774 tempest-GroupsV314Test-1517989196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1268783e-5e45-4579-92eb-deaccd945e79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:59:20 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-96215ac5-f5c4-477d-afb7-448cd68e7774 tempest-GroupsV314Test-1517989196 None] Flow 'volume_create_manager' (206d0ab6-7797-42fa-b183-b13600854a35) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87272) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:59:20 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-96215ac5-f5c4-477d-afb7-448cd68e7774 tempest-GroupsV314Test-1517989196 None] Created volume successfully. Nov 04 10:59:20 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-e469e24b-8dcd-4c30-9274-36995a813f5f tempest-GroupSnapshotsTest-534526937 None] Acquiring lock "cinder-quobyte-36ef6ce6-5b38-449d-84e6-34165c6eb7a1" by "delete_snapshot" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:59:20 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-e469e24b-8dcd-4c30-9274-36995a813f5f tempest-GroupSnapshotsTest-534526937 None] Lock "cinder-quobyte-36ef6ce6-5b38-449d-84e6-34165c6eb7a1" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:59:20 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-e469e24b-8dcd-4c30-9274-36995a813f5f tempest-GroupSnapshotsTest-534526937 None] Acquiring lock "cinder-quobyte-4263ce94-b62e-4778-8159-f8f470b0dbcd" by "_delete_snapshot" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:59:20 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-e469e24b-8dcd-4c30-9274-36995a813f5f tempest-GroupSnapshotsTest-534526937 None] Lock "cinder-quobyte-4263ce94-b62e-4778-8159-f8f470b0dbcd" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:59:20 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.remotefs [None req-e469e24b-8dcd-4c30-9274-36995a813f5f tempest-GroupSnapshotsTest-534526937 None] Deleting offline snapshot 4263ce94-b62e-4778-8159-f8f470b0dbcd of volume 36ef6ce6-5b38-449d-84e6-34165c6eb7a1 {{(pid=87272) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 04 10:59:20 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.remotefs [None req-e469e24b-8dcd-4c30-9274-36995a813f5f tempest-GroupSnapshotsTest-534526937 None] snapshot_file for this snap is: volume-36ef6ce6-5b38-449d-84e6-34165c6eb7a1.4263ce94-b62e-4778-8159-f8f470b0dbcd {{(pid=87272) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 04 10:59:20 devstack cinder-volume[87272]: DEBUG oslo.privsep.daemon [-] privsep: reply[f60186dd-6872-4636-9d10-8a9ed967cb37]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:59:20 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-e469e24b-8dcd-4c30-9274-36995a813f5f tempest-GroupSnapshotsTest-534526937 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-36ef6ce6-5b38-449d-84e6-34165c6eb7a1.4263ce94-b62e-4778-8159-f8f470b0dbcd {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:59:20 devstack sudo[99086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-36ef6ce6-5b38-449d-84e6-34165c6eb7a1.4263ce94-b62e-4778-8159-f8f470b0dbcd Nov 04 10:59:20 devstack sudo[99086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:59:20 devstack sudo[99086]: pam_unix(sudo:session): session closed for user root Nov 04 10:59:20 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-e469e24b-8dcd-4c30-9274-36995a813f5f tempest-GroupSnapshotsTest-534526937 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-36ef6ce6-5b38-449d-84e6-34165c6eb7a1.4263ce94-b62e-4778-8159-f8f470b0dbcd" returned: 0 in 0.646s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:59:20 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.remotefs [None req-e469e24b-8dcd-4c30-9274-36995a813f5f tempest-GroupSnapshotsTest-534526937 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-36ef6ce6-5b38-449d-84e6-34165c6eb7a1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87272) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 10:59:20 devstack cinder-volume[87272]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b11b5ef-2ee1-4102-815e-a136e42e4c33]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:59:20 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-e469e24b-8dcd-4c30-9274-36995a813f5f tempest-GroupSnapshotsTest-534526937 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-36ef6ce6-5b38-449d-84e6-34165c6eb7a1 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:59:21 devstack sudo[99119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-36ef6ce6-5b38-449d-84e6-34165c6eb7a1 Nov 04 10:59:21 devstack sudo[99119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:59:21 devstack sudo[99119]: pam_unix(sudo:session): session closed for user root Nov 04 10:59:21 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-e469e24b-8dcd-4c30-9274-36995a813f5f tempest-GroupSnapshotsTest-534526937 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-36ef6ce6-5b38-449d-84e6-34165c6eb7a1" returned: 0 in 0.576s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:59:21 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-e469e24b-8dcd-4c30-9274-36995a813f5f tempest-GroupSnapshotsTest-534526937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-36ef6ce6-5b38-449d-84e6-34165c6eb7a1.4263ce94-b62e-4778-8159-f8f470b0dbcd {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:59:21 devstack sudo[99124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-36ef6ce6-5b38-449d-84e6-34165c6eb7a1.4263ce94-b62e-4778-8159-f8f470b0dbcd Nov 04 10:59:21 devstack sudo[99124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:59:21 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-6c6fd187-dbec-4935-b5a8-d00734d8192c tempest-GroupsV314Test-1517989196 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:59:21 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-6c6fd187-dbec-4935-b5a8-d00734d8192c tempest-GroupsV314Test-1517989196 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:59:21 devstack cinder-volume[87272]: INFO cinder.volume.drivers.remotefs [None req-6c6fd187-dbec-4935-b5a8-d00734d8192c tempest-GroupsV314Test-1517989196 None] Cloning volume c67a032e-a321-4ffa-9f76-48e8ffaac0d4 to volume 5e44a03b-145b-4a96-a10f-83712c83a979 Nov 04 10:59:21 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.remotefs [None req-6c6fd187-dbec-4935-b5a8-d00734d8192c tempest-GroupsV314Test-1517989196 None] Creating offline snapshot 5aab8b2d-c984-49f4-bf13-43954d5bfd80 of volume c67a032e-a321-4ffa-9f76-48e8ffaac0d4 {{(pid=87272) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 04 10:59:21 devstack cinder-volume[87272]: DEBUG oslo.privsep.daemon [-] privsep: reply[a882bd19-a88b-4651-b40f-9da14c2abcaa]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:59:21 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-6c6fd187-dbec-4935-b5a8-d00734d8192c tempest-GroupsV314Test-1517989196 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-c67a032e-a321-4ffa-9f76-48e8ffaac0d4 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:59:22 devstack sudo[99128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-c67a032e-a321-4ffa-9f76-48e8ffaac0d4 Nov 04 10:59:22 devstack sudo[99128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:59:22 devstack sudo[99124]: pam_unix(sudo:session): session closed for user root Nov 04 10:59:22 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-e469e24b-8dcd-4c30-9274-36995a813f5f tempest-GroupSnapshotsTest-534526937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-36ef6ce6-5b38-449d-84e6-34165c6eb7a1.4263ce94-b62e-4778-8159-f8f470b0dbcd" returned: 0 in 0.538s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:59:22 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-e469e24b-8dcd-4c30-9274-36995a813f5f tempest-GroupSnapshotsTest-534526937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-36ef6ce6-5b38-449d-84e6-34165c6eb7a1.4263ce94-b62e-4778-8159-f8f470b0dbcd {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:59:22 devstack sudo[99131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-36ef6ce6-5b38-449d-84e6-34165c6eb7a1.4263ce94-b62e-4778-8159-f8f470b0dbcd Nov 04 10:59:22 devstack sudo[99131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:59:22 devstack sudo[99131]: pam_unix(sudo:session): session closed for user root Nov 04 10:59:22 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-e469e24b-8dcd-4c30-9274-36995a813f5f tempest-GroupSnapshotsTest-534526937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-36ef6ce6-5b38-449d-84e6-34165c6eb7a1.4263ce94-b62e-4778-8159-f8f470b0dbcd" returned: 0 in 0.315s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:59:22 devstack sudo[99128]: pam_unix(sudo:session): session closed for user root Nov 04 10:59:22 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-6c6fd187-dbec-4935-b5a8-d00734d8192c tempest-GroupsV314Test-1517989196 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-c67a032e-a321-4ffa-9f76-48e8ffaac0d4" returned: 0 in 0.575s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:59:22 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-6c6fd187-dbec-4935-b5a8-d00734d8192c tempest-GroupsV314Test-1517989196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-c67a032e-a321-4ffa-9f76-48e8ffaac0d4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-c67a032e-a321-4ffa-9f76-48e8ffaac0d4.5aab8b2d-c984-49f4-bf13-43954d5bfd80 1G {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:59:22 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-e469e24b-8dcd-4c30-9274-36995a813f5f tempest-GroupSnapshotsTest-534526937 None] Lock "cinder-quobyte-4263ce94-b62e-4778-8159-f8f470b0dbcd" released by "_delete_snapshot" :: held 2.234s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:59:22 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-e469e24b-8dcd-4c30-9274-36995a813f5f tempest-GroupSnapshotsTest-534526937 None] Lock "cinder-quobyte-36ef6ce6-5b38-449d-84e6-34165c6eb7a1" released by "delete_snapshot" :: held 2.271s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:59:22 devstack sudo[99137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-c67a032e-a321-4ffa-9f76-48e8ffaac0d4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-c67a032e-a321-4ffa-9f76-48e8ffaac0d4.5aab8b2d-c984-49f4-bf13-43954d5bfd80 1G Nov 04 10:59:22 devstack sudo[99137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:59:22 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-e469e24b-8dcd-4c30-9274-36995a813f5f tempest-GroupSnapshotsTest-534526937 None] Acquiring lock "cinder-quobyte-17f5eabe-9ee6-4da5-92be-62bb4b546b66" by "delete_snapshot" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:59:22 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-e469e24b-8dcd-4c30-9274-36995a813f5f tempest-GroupSnapshotsTest-534526937 None] Lock "cinder-quobyte-17f5eabe-9ee6-4da5-92be-62bb4b546b66" acquired by "delete_snapshot" :: waited 0.031s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:59:22 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-e469e24b-8dcd-4c30-9274-36995a813f5f tempest-GroupSnapshotsTest-534526937 None] Acquiring lock "cinder-quobyte-af1148b8-1d97-455f-b211-d49ab7d13c38" by "_delete_snapshot" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:59:22 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-e469e24b-8dcd-4c30-9274-36995a813f5f tempest-GroupSnapshotsTest-534526937 None] Lock "cinder-quobyte-af1148b8-1d97-455f-b211-d49ab7d13c38" acquired by "_delete_snapshot" :: waited 0.033s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:59:22 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.remotefs [None req-e469e24b-8dcd-4c30-9274-36995a813f5f tempest-GroupSnapshotsTest-534526937 None] Deleting offline snapshot af1148b8-1d97-455f-b211-d49ab7d13c38 of volume 17f5eabe-9ee6-4da5-92be-62bb4b546b66 {{(pid=87272) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 04 10:59:22 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.remotefs [None req-e469e24b-8dcd-4c30-9274-36995a813f5f tempest-GroupSnapshotsTest-534526937 None] snapshot_file for this snap is: volume-17f5eabe-9ee6-4da5-92be-62bb4b546b66.af1148b8-1d97-455f-b211-d49ab7d13c38 {{(pid=87272) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 04 10:59:22 devstack cinder-volume[87272]: DEBUG oslo.privsep.daemon [-] privsep: reply[25a801b5-c979-4491-9913-471ec1f646b5]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:59:22 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-e469e24b-8dcd-4c30-9274-36995a813f5f tempest-GroupSnapshotsTest-534526937 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-17f5eabe-9ee6-4da5-92be-62bb4b546b66.af1148b8-1d97-455f-b211-d49ab7d13c38 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:59:22 devstack sudo[99139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-17f5eabe-9ee6-4da5-92be-62bb4b546b66.af1148b8-1d97-455f-b211-d49ab7d13c38 Nov 04 10:59:22 devstack sudo[99139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:59:23 devstack sudo[99137]: pam_unix(sudo:session): session closed for user root Nov 04 10:59:23 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-6c6fd187-dbec-4935-b5a8-d00734d8192c tempest-GroupsV314Test-1517989196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-c67a032e-a321-4ffa-9f76-48e8ffaac0d4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-c67a032e-a321-4ffa-9f76-48e8ffaac0d4.5aab8b2d-c984-49f4-bf13-43954d5bfd80 1G" returned: 0 in 0.620s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:59:23 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-6c6fd187-dbec-4935-b5a8-d00734d8192c tempest-GroupsV314Test-1517989196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c67a032e-a321-4ffa-9f76-48e8ffaac0d4 -F qcow2 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-c67a032e-a321-4ffa-9f76-48e8ffaac0d4.5aab8b2d-c984-49f4-bf13-43954d5bfd80 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:59:23 devstack sudo[99151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c67a032e-a321-4ffa-9f76-48e8ffaac0d4 -F qcow2 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-c67a032e-a321-4ffa-9f76-48e8ffaac0d4.5aab8b2d-c984-49f4-bf13-43954d5bfd80 Nov 04 10:59:23 devstack sudo[99151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:59:23 devstack sudo[99139]: pam_unix(sudo:session): session closed for user root Nov 04 10:59:23 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-e469e24b-8dcd-4c30-9274-36995a813f5f tempest-GroupSnapshotsTest-534526937 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-17f5eabe-9ee6-4da5-92be-62bb4b546b66.af1148b8-1d97-455f-b211-d49ab7d13c38" returned: 0 in 0.530s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:59:23 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.remotefs [None req-e469e24b-8dcd-4c30-9274-36995a813f5f tempest-GroupSnapshotsTest-534526937 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-17f5eabe-9ee6-4da5-92be-62bb4b546b66(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87272) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 10:59:23 devstack cinder-volume[87272]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ee9c87d-ff63-43b8-9180-0d984edd5929]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:59:23 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-e469e24b-8dcd-4c30-9274-36995a813f5f tempest-GroupSnapshotsTest-534526937 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-17f5eabe-9ee6-4da5-92be-62bb4b546b66 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:59:23 devstack sudo[99154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-17f5eabe-9ee6-4da5-92be-62bb4b546b66 Nov 04 10:59:23 devstack sudo[99154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:59:23 devstack sudo[99151]: pam_unix(sudo:session): session closed for user root Nov 04 10:59:23 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-6c6fd187-dbec-4935-b5a8-d00734d8192c tempest-GroupsV314Test-1517989196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c67a032e-a321-4ffa-9f76-48e8ffaac0d4 -F qcow2 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-c67a032e-a321-4ffa-9f76-48e8ffaac0d4.5aab8b2d-c984-49f4-bf13-43954d5bfd80" returned: 0 in 0.353s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:59:23 devstack cinder-volume[87272]: WARNING cinder.volume.drivers.remotefs [None req-6c6fd187-dbec-4935-b5a8-d00734d8192c tempest-GroupsV314Test-1517989196 None] /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-c67a032e-a321-4ffa-9f76-48e8ffaac0d4.5aab8b2d-c984-49f4-bf13-43954d5bfd80 is being set with open permissions: ugo+rw: NotImplementedError Nov 04 10:59:23 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-6c6fd187-dbec-4935-b5a8-d00734d8192c tempest-GroupsV314Test-1517989196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-c67a032e-a321-4ffa-9f76-48e8ffaac0d4.5aab8b2d-c984-49f4-bf13-43954d5bfd80 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:59:23 devstack sudo[99160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-c67a032e-a321-4ffa-9f76-48e8ffaac0d4.5aab8b2d-c984-49f4-bf13-43954d5bfd80 Nov 04 10:59:23 devstack sudo[99160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:59:23 devstack sudo[99154]: pam_unix(sudo:session): session closed for user root Nov 04 10:59:23 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-e469e24b-8dcd-4c30-9274-36995a813f5f tempest-GroupSnapshotsTest-534526937 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-17f5eabe-9ee6-4da5-92be-62bb4b546b66" returned: 0 in 0.455s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:59:23 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-e469e24b-8dcd-4c30-9274-36995a813f5f tempest-GroupSnapshotsTest-534526937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-17f5eabe-9ee6-4da5-92be-62bb4b546b66.af1148b8-1d97-455f-b211-d49ab7d13c38 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:59:23 devstack sudo[99166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-17f5eabe-9ee6-4da5-92be-62bb4b546b66.af1148b8-1d97-455f-b211-d49ab7d13c38 Nov 04 10:59:23 devstack sudo[99166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:59:23 devstack sudo[99160]: pam_unix(sudo:session): session closed for user root Nov 04 10:59:23 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-6c6fd187-dbec-4935-b5a8-d00734d8192c tempest-GroupsV314Test-1517989196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-c67a032e-a321-4ffa-9f76-48e8ffaac0d4.5aab8b2d-c984-49f4-bf13-43954d5bfd80" returned: 0 in 0.347s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:59:23 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-6c6fd187-dbec-4935-b5a8-d00734d8192c tempest-GroupsV314Test-1517989196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-c67a032e-a321-4ffa-9f76-48e8ffaac0d4.info {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:59:23 devstack sudo[99169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-c67a032e-a321-4ffa-9f76-48e8ffaac0d4.info Nov 04 10:59:23 devstack sudo[99169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:59:24 devstack sudo[99166]: pam_unix(sudo:session): session closed for user root Nov 04 10:59:24 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-e469e24b-8dcd-4c30-9274-36995a813f5f tempest-GroupSnapshotsTest-534526937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-17f5eabe-9ee6-4da5-92be-62bb4b546b66.af1148b8-1d97-455f-b211-d49ab7d13c38" returned: 0 in 0.489s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:59:24 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-e469e24b-8dcd-4c30-9274-36995a813f5f tempest-GroupSnapshotsTest-534526937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-17f5eabe-9ee6-4da5-92be-62bb4b546b66.af1148b8-1d97-455f-b211-d49ab7d13c38 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:59:24 devstack sudo[99169]: pam_unix(sudo:session): session closed for user root Nov 04 10:59:24 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-6c6fd187-dbec-4935-b5a8-d00734d8192c tempest-GroupsV314Test-1517989196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-c67a032e-a321-4ffa-9f76-48e8ffaac0d4.info" returned: 0 in 0.368s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:59:24 devstack cinder-volume[87272]: WARNING cinder.volume.drivers.remotefs [None req-6c6fd187-dbec-4935-b5a8-d00734d8192c tempest-GroupsV314Test-1517989196 None] /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-c67a032e-a321-4ffa-9f76-48e8ffaac0d4.info is being set with open permissions: ugo+rw: NotImplementedError Nov 04 10:59:24 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-6c6fd187-dbec-4935-b5a8-d00734d8192c tempest-GroupsV314Test-1517989196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-c67a032e-a321-4ffa-9f76-48e8ffaac0d4.info {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:59:24 devstack sudo[99175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-17f5eabe-9ee6-4da5-92be-62bb4b546b66.af1148b8-1d97-455f-b211-d49ab7d13c38 Nov 04 10:59:24 devstack sudo[99175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:59:24 devstack sudo[99177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-c67a032e-a321-4ffa-9f76-48e8ffaac0d4.info Nov 04 10:59:24 devstack sudo[99177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:59:24 devstack sudo[99175]: pam_unix(sudo:session): session closed for user root Nov 04 10:59:24 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-e469e24b-8dcd-4c30-9274-36995a813f5f tempest-GroupSnapshotsTest-534526937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-17f5eabe-9ee6-4da5-92be-62bb4b546b66.af1148b8-1d97-455f-b211-d49ab7d13c38" returned: 0 in 0.335s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:59:24 devstack sudo[99177]: pam_unix(sudo:session): session closed for user root Nov 04 10:59:24 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-6c6fd187-dbec-4935-b5a8-d00734d8192c tempest-GroupsV314Test-1517989196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-c67a032e-a321-4ffa-9f76-48e8ffaac0d4.info" returned: 0 in 0.357s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:59:24 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-6c6fd187-dbec-4935-b5a8-d00734d8192c tempest-GroupsV314Test-1517989196 None] Acquiring lock "cinder-quobyte-5e44a03b-145b-4a96-a10f-83712c83a979" by "_copy_volume_from_snapshot" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:59:24 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-e469e24b-8dcd-4c30-9274-36995a813f5f tempest-GroupSnapshotsTest-534526937 None] Lock "cinder-quobyte-af1148b8-1d97-455f-b211-d49ab7d13c38" released by "_delete_snapshot" :: held 2.030s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:59:24 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-e469e24b-8dcd-4c30-9274-36995a813f5f tempest-GroupSnapshotsTest-534526937 None] Lock "cinder-quobyte-17f5eabe-9ee6-4da5-92be-62bb4b546b66" released by "delete_snapshot" :: held 2.075s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:59:24 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-6c6fd187-dbec-4935-b5a8-d00734d8192c tempest-GroupsV314Test-1517989196 None] Lock "cinder-quobyte-5e44a03b-145b-4a96-a10f-83712c83a979" acquired by "_copy_volume_from_snapshot" :: waited 0.035s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:59:24 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-6c6fd187-dbec-4935-b5a8-d00734d8192c tempest-GroupsV314Test-1517989196 None] snapshot: 5aab8b2d-c984-49f4-bf13-43954d5bfd80, volume: 5e44a03b-145b-4a96-a10f-83712c83a979, {{(pid=87272) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 04 10:59:24 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-6c6fd187-dbec-4935-b5a8-d00734d8192c tempest-GroupsV314Test-1517989196 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:59:24 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-6c6fd187-dbec-4935-b5a8-d00734d8192c tempest-GroupsV314Test-1517989196 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:59:24 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-6c6fd187-dbec-4935-b5a8-d00734d8192c tempest-GroupsV314Test-1517989196 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898': None} {{(pid=87272) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:59:24 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-6c6fd187-dbec-4935-b5a8-d00734d8192c tempest-GroupsV314Test-1517989196 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'] {{(pid=87272) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:59:24 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-6c6fd187-dbec-4935-b5a8-d00734d8192c tempest-GroupsV314Test-1517989196 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:59:24 devstack cinder-volume[87272]: DEBUG oslo.privsep.daemon [-] privsep: reply[62edc05f-cf88-4020-888e-07bc7efe1f80]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:59:24 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-6c6fd187-dbec-4935-b5a8-d00734d8192c tempest-GroupsV314Test-1517989196 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-c67a032e-a321-4ffa-9f76-48e8ffaac0d4.5aab8b2d-c984-49f4-bf13-43954d5bfd80 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:59:24 devstack cinder-volume[87272]: WARNING cinder.quota [None req-e469e24b-8dcd-4c30-9274-36995a813f5f tempest-GroupSnapshotsTest-534526937 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-954695369 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-954695369, it is now deprecated. Please use the default quota class for default quota. Nov 04 10:59:24 devstack cinder-volume[87272]: WARNING cinder.quota [None req-e469e24b-8dcd-4c30-9274-36995a813f5f tempest-GroupSnapshotsTest-534526937 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-954695369 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-954695369, it is now deprecated. Please use the default quota class for default quota. Nov 04 10:59:24 devstack cinder-volume[87272]: DEBUG cinder.quota [None req-e469e24b-8dcd-4c30-9274-36995a813f5f tempest-GroupSnapshotsTest-534526937 None] Created reservations ['4917f4d3-2e4f-4156-9052-e7b17a2cc9bb', '93339cd0-f979-4c8e-ace3-670f4c57957c', 'fc2ac8a0-1054-476e-9997-7b83a9211ffa', '3ec57e7c-fcbc-4805-9f30-c95d69b15261'] {{(pid=87272) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 10:59:24 devstack sudo[99182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-c67a032e-a321-4ffa-9f76-48e8ffaac0d4.5aab8b2d-c984-49f4-bf13-43954d5bfd80 Nov 04 10:59:24 devstack sudo[99182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:59:25 devstack cinder-volume[87272]: DEBUG cinder.quota [None req-e469e24b-8dcd-4c30-9274-36995a813f5f tempest-GroupSnapshotsTest-534526937 None] Created reservations ['5c0bca38-11e4-4f12-9098-3b3850c37656', '0955423d-2f98-4a8d-8a6b-cd3bda1a8973', 'ace8efeb-e124-4e71-899c-bf1ead3b8cd4', '42d66d64-c501-48f1-a3a0-5905973c78ac'] {{(pid=87272) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 10:59:25 devstack sudo[99182]: pam_unix(sudo:session): session closed for user root Nov 04 10:59:25 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-e469e24b-8dcd-4c30-9274-36995a813f5f tempest-GroupSnapshotsTest-534526937 None] group_snapshot 80dbd989-5900-4bf3-a24d-371c11167cfe: deleted successfully Nov 04 10:59:25 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-6c6fd187-dbec-4935-b5a8-d00734d8192c tempest-GroupsV314Test-1517989196 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-c67a032e-a321-4ffa-9f76-48e8ffaac0d4.5aab8b2d-c984-49f4-bf13-43954d5bfd80" returned: 0 in 0.512s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:59:25 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.remotefs [None req-6c6fd187-dbec-4935-b5a8-d00734d8192c tempest-GroupsV314Test-1517989196 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c67a032e-a321-4ffa-9f76-48e8ffaac0d4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87272) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 10:59:25 devstack cinder-volume[87272]: DEBUG oslo.privsep.daemon [-] privsep: reply[55d96263-4f3f-4b97-9e49-bd83309456ea]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:59:25 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-6c6fd187-dbec-4935-b5a8-d00734d8192c tempest-GroupsV314Test-1517989196 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-c67a032e-a321-4ffa-9f76-48e8ffaac0d4 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:59:25 devstack sudo[99189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-c67a032e-a321-4ffa-9f76-48e8ffaac0d4 Nov 04 10:59:25 devstack sudo[99189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:59:25 devstack sudo[99189]: pam_unix(sudo:session): session closed for user root Nov 04 10:59:25 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-6c6fd187-dbec-4935-b5a8-d00734d8192c tempest-GroupsV314Test-1517989196 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-c67a032e-a321-4ffa-9f76-48e8ffaac0d4" returned: 0 in 0.532s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:59:25 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-6c6fd187-dbec-4935-b5a8-d00734d8192c tempest-GroupsV314Test-1517989196 None] will copy from snapshot at /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-c67a032e-a321-4ffa-9f76-48e8ffaac0d4 {{(pid=87272) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 04 10:59:25 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-6c6fd187-dbec-4935-b5a8-d00734d8192c tempest-GroupsV314Test-1517989196 None] Creating direct copy from snapshot {{(pid=87272) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 04 10:59:25 devstack cinder-volume[87272]: DEBUG cinder.utils [None req-6c6fd187-dbec-4935-b5a8-d00734d8192c tempest-GroupsV314Test-1517989196 None] Path /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-5e44a03b-145b-4a96-a10f-83712c83a979 not found in is_blk_device check {{(pid=87272) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Nov 04 10:59:25 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-6c6fd187-dbec-4935-b5a8-d00734d8192c tempest-GroupsV314Test-1517989196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-c67a032e-a321-4ffa-9f76-48e8ffaac0d4 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-5e44a03b-145b-4a96-a10f-83712c83a979 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:59:25 devstack sudo[99230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-c67a032e-a321-4ffa-9f76-48e8ffaac0d4 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-5e44a03b-145b-4a96-a10f-83712c83a979 Nov 04 10:59:25 devstack sudo[99230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:59:26 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-ed7665e5-b3e0-4b56-8465-2205396328b5 tempest-GroupSnapshotsTest-534526937 None] Acquiring lock "cinder-quobyte-17f5eabe-9ee6-4da5-92be-62bb4b546b66" by "delete_volume" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:59:26 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-ed7665e5-b3e0-4b56-8465-2205396328b5 tempest-GroupSnapshotsTest-534526937 None] Lock "cinder-quobyte-17f5eabe-9ee6-4da5-92be-62bb4b546b66" acquired by "delete_volume" :: waited 0.043s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:59:27 devstack cinder-volume[87272]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e2fe525-90cd-4eed-99cf-e29ac4622f52]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:59:27 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-ed7665e5-b3e0-4b56-8465-2205396328b5 tempest-GroupSnapshotsTest-534526937 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-17f5eabe-9ee6-4da5-92be-62bb4b546b66 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:59:27 devstack sudo[99245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-17f5eabe-9ee6-4da5-92be-62bb4b546b66 Nov 04 10:59:27 devstack sudo[99245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:59:27 devstack sudo[99245]: pam_unix(sudo:session): session closed for user root Nov 04 10:59:27 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-ed7665e5-b3e0-4b56-8465-2205396328b5 tempest-GroupSnapshotsTest-534526937 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-17f5eabe-9ee6-4da5-92be-62bb4b546b66" returned: 0 in 0.707s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:59:27 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-ed7665e5-b3e0-4b56-8465-2205396328b5 tempest-GroupSnapshotsTest-534526937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-17f5eabe-9ee6-4da5-92be-62bb4b546b66 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:59:27 devstack sudo[99250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-17f5eabe-9ee6-4da5-92be-62bb4b546b66 Nov 04 10:59:27 devstack sudo[99250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:59:28 devstack sudo[99250]: pam_unix(sudo:session): session closed for user root Nov 04 10:59:28 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-ed7665e5-b3e0-4b56-8465-2205396328b5 tempest-GroupSnapshotsTest-534526937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-17f5eabe-9ee6-4da5-92be-62bb4b546b66" returned: 0 in 0.647s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:59:28 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-ed7665e5-b3e0-4b56-8465-2205396328b5 tempest-GroupSnapshotsTest-534526937 None] Lock "cinder-quobyte-17f5eabe-9ee6-4da5-92be-62bb4b546b66" released by "delete_volume" :: held 1.543s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:59:28 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-ed7665e5-b3e0-4b56-8465-2205396328b5 tempest-GroupSnapshotsTest-534526937 None] Acquiring lock "cinder-quobyte-36ef6ce6-5b38-449d-84e6-34165c6eb7a1" by "delete_volume" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:59:28 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-ed7665e5-b3e0-4b56-8465-2205396328b5 tempest-GroupSnapshotsTest-534526937 None] Lock "cinder-quobyte-36ef6ce6-5b38-449d-84e6-34165c6eb7a1" acquired by "delete_volume" :: waited 0.026s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:59:28 devstack cinder-volume[87272]: DEBUG oslo.privsep.daemon [-] privsep: reply[32276553-e8f0-492f-bc96-49cb43a873b2]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:59:28 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-ed7665e5-b3e0-4b56-8465-2205396328b5 tempest-GroupSnapshotsTest-534526937 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-36ef6ce6-5b38-449d-84e6-34165c6eb7a1 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:59:28 devstack sudo[99253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-36ef6ce6-5b38-449d-84e6-34165c6eb7a1 Nov 04 10:59:28 devstack sudo[99253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:59:29 devstack sudo[99253]: pam_unix(sudo:session): session closed for user root Nov 04 10:59:29 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-ed7665e5-b3e0-4b56-8465-2205396328b5 tempest-GroupSnapshotsTest-534526937 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-36ef6ce6-5b38-449d-84e6-34165c6eb7a1" returned: 0 in 0.938s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:59:29 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-ed7665e5-b3e0-4b56-8465-2205396328b5 tempest-GroupSnapshotsTest-534526937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-36ef6ce6-5b38-449d-84e6-34165c6eb7a1 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:59:29 devstack sudo[99258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-36ef6ce6-5b38-449d-84e6-34165c6eb7a1 Nov 04 10:59:29 devstack sudo[99258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:59:30 devstack sudo[99258]: pam_unix(sudo:session): session closed for user root Nov 04 10:59:30 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-ed7665e5-b3e0-4b56-8465-2205396328b5 tempest-GroupSnapshotsTest-534526937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-36ef6ce6-5b38-449d-84e6-34165c6eb7a1" returned: 0 in 0.617s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:59:30 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-ed7665e5-b3e0-4b56-8465-2205396328b5 tempest-GroupSnapshotsTest-534526937 None] Lock "cinder-quobyte-36ef6ce6-5b38-449d-84e6-34165c6eb7a1" released by "delete_volume" :: held 1.721s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:59:30 devstack cinder-volume[87272]: DEBUG cinder.quota [None req-ed7665e5-b3e0-4b56-8465-2205396328b5 tempest-GroupSnapshotsTest-534526937 None] Created reservations ['88de82d5-5dc0-44b9-b14b-391f5ace3131'] {{(pid=87272) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 10:59:30 devstack cinder-volume[87272]: WARNING cinder.quota [None req-ed7665e5-b3e0-4b56-8465-2205396328b5 tempest-GroupSnapshotsTest-534526937 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-954695369 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-954695369, it is now deprecated. Please use the default quota class for default quota. Nov 04 10:59:30 devstack cinder-volume[87272]: DEBUG cinder.quota [None req-ed7665e5-b3e0-4b56-8465-2205396328b5 tempest-GroupSnapshotsTest-534526937 None] Created reservations ['b7be06ff-8dfd-475c-ad17-266fd3038bb3', 'b7391d51-2986-4790-bd53-81f093ef61f5', 'f9509a26-4ed1-435f-a247-e713e2c3da8e', '1d234e94-ba13-4aa3-bdf9-74d607f6afc5'] {{(pid=87272) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 10:59:30 devstack cinder-volume[87272]: DEBUG cinder.quota [None req-ed7665e5-b3e0-4b56-8465-2205396328b5 tempest-GroupSnapshotsTest-534526937 None] Created reservations ['1761e06d-6d96-45b6-9d34-5089c8f8e4f1', '310e71b4-8b67-460c-81af-f4be6f8e583b', 'c1ba6bd2-6c34-4d5e-ba20-a40bdd3b69c4', '44241f35-fb3e-4bc4-9b65-8e22e5cc7147'] {{(pid=87272) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 10:59:31 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-ed7665e5-b3e0-4b56-8465-2205396328b5 tempest-GroupSnapshotsTest-534526937 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:59:31 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-ed7665e5-b3e0-4b56-8465-2205396328b5 tempest-GroupSnapshotsTest-534526937 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:59:31 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-ed7665e5-b3e0-4b56-8465-2205396328b5 tempest-GroupSnapshotsTest-534526937 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898': None} {{(pid=87272) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:59:31 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-ed7665e5-b3e0-4b56-8465-2205396328b5 tempest-GroupSnapshotsTest-534526937 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'] {{(pid=87272) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:59:31 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-ed7665e5-b3e0-4b56-8465-2205396328b5 tempest-GroupSnapshotsTest-534526937 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:59:31 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-ed7665e5-b3e0-4b56-8465-2205396328b5 tempest-GroupSnapshotsTest-534526937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:59:31 devstack sudo[99262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1 Nov 04 10:59:31 devstack sudo[99262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:59:32 devstack sudo[99262]: pam_unix(sudo:session): session closed for user root Nov 04 10:59:32 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-ed7665e5-b3e0-4b56-8465-2205396328b5 tempest-GroupSnapshotsTest-534526937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1" returned: 0 in 0.851s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:59:32 devstack cinder-volume[87272]: DEBUG cinder.manager [None req-ed7665e5-b3e0-4b56-8465-2205396328b5 tempest-GroupSnapshotsTest-534526937 None] Notifying Schedulers of capabilities ... {{(pid=87272) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 10:59:32 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-ed7665e5-b3e0-4b56-8465-2205396328b5 tempest-GroupSnapshotsTest-534526937 None] Delete group completed successfully. Nov 04 10:59:33 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-a861a4f3-be9f-4fdc-af0d-47ae99f756ac tempest-GroupSnapshotsTest-534526937 None] Group tempest-GroupSnapshotsTest-Group-771133230: creating Nov 04 10:59:33 devstack cinder-volume[87272]: DEBUG dbcounter [-] [87272] Writing DB stats cinder:SELECT=155,cinder:UPDATE=158,cinder:INSERT=32,cinder:DELETE=7 {{(pid=87272) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 10:59:33 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-a861a4f3-be9f-4fdc-af0d-47ae99f756ac tempest-GroupSnapshotsTest-534526937 None] Group tempest-GroupSnapshotsTest-Group-771133230: created successfully Nov 04 10:59:33 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-a861a4f3-be9f-4fdc-af0d-47ae99f756ac tempest-GroupSnapshotsTest-534526937 None] Create group completed successfully. Nov 04 10:59:35 devstack sudo[99230]: pam_unix(sudo:session): session closed for user root Nov 04 10:59:35 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-6c6fd187-dbec-4935-b5a8-d00734d8192c tempest-GroupsV314Test-1517989196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-c67a032e-a321-4ffa-9f76-48e8ffaac0d4 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-5e44a03b-145b-4a96-a10f-83712c83a979" returned: 0 in 10.072s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:59:35 devstack cinder-volume[87272]: DEBUG cinder.image.image_utils [None req-6c6fd187-dbec-4935-b5a8-d00734d8192c tempest-GroupsV314Test-1517989196 None] Image conversion details: src /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-c67a032e-a321-4ffa-9f76-48e8ffaac0d4, size 1024.00 MB, duration 10.07 sec, destination /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-5e44a03b-145b-4a96-a10f-83712c83a979 {{(pid=87272) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Nov 04 10:59:35 devstack cinder-volume[87272]: INFO cinder.image.image_utils [None req-6c6fd187-dbec-4935-b5a8-d00734d8192c tempest-GroupsV314Test-1517989196 None] Converted 1024.00 MB image at 101.66 MB/s Nov 04 10:59:35 devstack cinder-volume[87272]: WARNING cinder.volume.drivers.remotefs [None req-6c6fd187-dbec-4935-b5a8-d00734d8192c tempest-GroupsV314Test-1517989196 None] /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-5e44a03b-145b-4a96-a10f-83712c83a979 is being set with open permissions: ugo+rw: NotImplementedError Nov 04 10:59:35 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-6c6fd187-dbec-4935-b5a8-d00734d8192c tempest-GroupsV314Test-1517989196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-5e44a03b-145b-4a96-a10f-83712c83a979 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:59:35 devstack sudo[99268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-5e44a03b-145b-4a96-a10f-83712c83a979 Nov 04 10:59:35 devstack sudo[99268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:59:35 devstack cinder-volume[87272]: DEBUG cinder.volume.flows.manager.create_volume [None req-12e7cb26-7571-46c9-9ec8-7a790603e119 tempest-GroupSnapshotsTest-534526937 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87272) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 10:59:36 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-12e7cb26-7571-46c9-9ec8-7a790603e119 tempest-GroupSnapshotsTest-534526937 None] Flow 'volume_create_manager' (43276557-0c53-4c6a-9617-538940705144) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:59:36 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-12e7cb26-7571-46c9-9ec8-7a790603e119 tempest-GroupSnapshotsTest-534526937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1ef08e9-9bad-479e-9251-e7facfe51f06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:59:36 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-12e7cb26-7571-46c9-9ec8-7a790603e119 tempest-GroupSnapshotsTest-534526937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1ef08e9-9bad-479e-9251-e7facfe51f06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T09:59:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1128954622',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=61541754-cae6-423e-8705-8c60a8d092e3,host='devstack@QuobyteHD#QuobyteHD',id=aec93e76-d799-4152-9049-592862d9094a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d4fecca9e5c74435917afa362915006e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T09:59:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T09:59:36Z,use_quota=True,user_id='cd95811391ef4f95b79f4f5c5f6f23c1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f2c454e0-3da9-4814-87a2-1be5af6cf0b7),volume_type_id=f2c454e0-3da9-4814-87a2-1be5af6cf0b7)' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:59:36 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-12e7cb26-7571-46c9-9ec8-7a790603e119 tempest-GroupSnapshotsTest-534526937 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a60a02f8-87e9-4c46-bdb6-0c20141978a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:59:36 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-12e7cb26-7571-46c9-9ec8-7a790603e119 tempest-GroupSnapshotsTest-534526937 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a60a02f8-87e9-4c46-bdb6-0c20141978a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:59:36 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-12e7cb26-7571-46c9-9ec8-7a790603e119 tempest-GroupSnapshotsTest-534526937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c7453352-5917-4e3e-8b68-0c8714b83cfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:59:36 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-12e7cb26-7571-46c9-9ec8-7a790603e119 tempest-GroupSnapshotsTest-534526937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c7453352-5917-4e3e-8b68-0c8714b83cfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aec93e76-d799-4152-9049-592862d9094a', 'volume_name': 'volume-aec93e76-d799-4152-9049-592862d9094a', 'volume_size': 1}' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:59:36 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-12e7cb26-7571-46c9-9ec8-7a790603e119 tempest-GroupSnapshotsTest-534526937 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d30f420b-7bbe-4694-98a5-ba91d83fd96c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:59:36 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-12e7cb26-7571-46c9-9ec8-7a790603e119 tempest-GroupSnapshotsTest-534526937 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d30f420b-7bbe-4694-98a5-ba91d83fd96c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:59:36 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-12e7cb26-7571-46c9-9ec8-7a790603e119 tempest-GroupSnapshotsTest-534526937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c8e952d-fbf2-4bb9-99ac-f805ad2f917f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:59:36 devstack cinder-volume[87272]: INFO cinder.volume.flows.manager.create_volume [None req-12e7cb26-7571-46c9-9ec8-7a790603e119 tempest-GroupSnapshotsTest-534526937 None] Volume aec93e76-d799-4152-9049-592862d9094a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aec93e76-d799-4152-9049-592862d9094a', 'volume_size': 1} Nov 04 10:59:36 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-12e7cb26-7571-46c9-9ec8-7a790603e119 tempest-GroupSnapshotsTest-534526937 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:59:36 devstack sudo[99268]: pam_unix(sudo:session): session closed for user root Nov 04 10:59:36 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-6c6fd187-dbec-4935-b5a8-d00734d8192c tempest-GroupsV314Test-1517989196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-5e44a03b-145b-4a96-a10f-83712c83a979" returned: 0 in 0.452s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:59:36 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-6c6fd187-dbec-4935-b5a8-d00734d8192c tempest-GroupsV314Test-1517989196 None] Lock "cinder-quobyte-5e44a03b-145b-4a96-a10f-83712c83a979" released by "_copy_volume_from_snapshot" :: held 11.676s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:59:36 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-6c6fd187-dbec-4935-b5a8-d00734d8192c tempest-GroupsV314Test-1517989196 None] Acquiring lock "cinder-quobyte-5aab8b2d-c984-49f4-bf13-43954d5bfd80" by "_delete_snapshot" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:59:36 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-6c6fd187-dbec-4935-b5a8-d00734d8192c tempest-GroupsV314Test-1517989196 None] Lock "cinder-quobyte-5aab8b2d-c984-49f4-bf13-43954d5bfd80" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:59:36 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.remotefs [None req-6c6fd187-dbec-4935-b5a8-d00734d8192c tempest-GroupsV314Test-1517989196 None] Deleting offline snapshot 5aab8b2d-c984-49f4-bf13-43954d5bfd80 of volume c67a032e-a321-4ffa-9f76-48e8ffaac0d4 {{(pid=87272) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 04 10:59:36 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.remotefs [None req-6c6fd187-dbec-4935-b5a8-d00734d8192c tempest-GroupsV314Test-1517989196 None] snapshot_file for this snap is: volume-c67a032e-a321-4ffa-9f76-48e8ffaac0d4.5aab8b2d-c984-49f4-bf13-43954d5bfd80 {{(pid=87272) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 04 10:59:36 devstack cinder-volume[87272]: DEBUG oslo.privsep.daemon [-] privsep: reply[db26c9ce-63f5-47a9-a065-696e11fd4adf]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:59:36 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-6c6fd187-dbec-4935-b5a8-d00734d8192c tempest-GroupsV314Test-1517989196 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-c67a032e-a321-4ffa-9f76-48e8ffaac0d4.5aab8b2d-c984-49f4-bf13-43954d5bfd80 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:59:36 devstack sudo[99272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-c67a032e-a321-4ffa-9f76-48e8ffaac0d4.5aab8b2d-c984-49f4-bf13-43954d5bfd80 Nov 04 10:59:36 devstack sudo[99272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:59:36 devstack sudo[99272]: pam_unix(sudo:session): session closed for user root Nov 04 10:59:36 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-6c6fd187-dbec-4935-b5a8-d00734d8192c tempest-GroupsV314Test-1517989196 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-c67a032e-a321-4ffa-9f76-48e8ffaac0d4.5aab8b2d-c984-49f4-bf13-43954d5bfd80" returned: 0 in 0.533s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:59:36 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.remotefs [None req-6c6fd187-dbec-4935-b5a8-d00734d8192c tempest-GroupsV314Test-1517989196 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c67a032e-a321-4ffa-9f76-48e8ffaac0d4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87272) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 10:59:36 devstack cinder-volume[87272]: DEBUG oslo.privsep.daemon [-] privsep: reply[108293cb-64f3-43ad-8b48-daeaec691d3f]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:59:36 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-6c6fd187-dbec-4935-b5a8-d00734d8192c tempest-GroupsV314Test-1517989196 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-c67a032e-a321-4ffa-9f76-48e8ffaac0d4 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:59:37 devstack sudo[99277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-c67a032e-a321-4ffa-9f76-48e8ffaac0d4 Nov 04 10:59:37 devstack sudo[99277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:59:37 devstack sudo[99277]: pam_unix(sudo:session): session closed for user root Nov 04 10:59:37 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-6c6fd187-dbec-4935-b5a8-d00734d8192c tempest-GroupsV314Test-1517989196 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-c67a032e-a321-4ffa-9f76-48e8ffaac0d4" returned: 0 in 0.638s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:59:37 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-6c6fd187-dbec-4935-b5a8-d00734d8192c tempest-GroupsV314Test-1517989196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-c67a032e-a321-4ffa-9f76-48e8ffaac0d4.5aab8b2d-c984-49f4-bf13-43954d5bfd80 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:59:37 devstack sudo[99282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-c67a032e-a321-4ffa-9f76-48e8ffaac0d4.5aab8b2d-c984-49f4-bf13-43954d5bfd80 Nov 04 10:59:37 devstack sudo[99282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:59:38 devstack sudo[99282]: pam_unix(sudo:session): session closed for user root Nov 04 10:59:38 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-6c6fd187-dbec-4935-b5a8-d00734d8192c tempest-GroupsV314Test-1517989196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-c67a032e-a321-4ffa-9f76-48e8ffaac0d4.5aab8b2d-c984-49f4-bf13-43954d5bfd80" returned: 0 in 0.442s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:59:38 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-6c6fd187-dbec-4935-b5a8-d00734d8192c tempest-GroupsV314Test-1517989196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-c67a032e-a321-4ffa-9f76-48e8ffaac0d4.5aab8b2d-c984-49f4-bf13-43954d5bfd80 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:59:38 devstack sudo[99287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-c67a032e-a321-4ffa-9f76-48e8ffaac0d4.5aab8b2d-c984-49f4-bf13-43954d5bfd80 Nov 04 10:59:38 devstack sudo[99287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:59:38 devstack sudo[99287]: pam_unix(sudo:session): session closed for user root Nov 04 10:59:38 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-6c6fd187-dbec-4935-b5a8-d00734d8192c tempest-GroupsV314Test-1517989196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-c67a032e-a321-4ffa-9f76-48e8ffaac0d4.5aab8b2d-c984-49f4-bf13-43954d5bfd80" returned: 0 in 0.344s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:59:38 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-6c6fd187-dbec-4935-b5a8-d00734d8192c tempest-GroupsV314Test-1517989196 None] Lock "cinder-quobyte-5aab8b2d-c984-49f4-bf13-43954d5bfd80" released by "_delete_snapshot" :: held 2.100s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:59:38 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-6c6fd187-dbec-4935-b5a8-d00734d8192c tempest-GroupsV314Test-1517989196 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 16.735s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:59:38 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-12e7cb26-7571-46c9-9ec8-7a790603e119 tempest-GroupSnapshotsTest-534526937 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.339s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:59:38 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-12e7cb26-7571-46c9-9ec8-7a790603e119 tempest-GroupSnapshotsTest-534526937 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=61541754-cae6-423e-8705-8c60a8d092e3,created_at=2026-11-04T09:59:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1128954622',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=61541754-cae6-423e-8705-8c60a8d092e3,host='devstack@QuobyteHD#QuobyteHD',id=aec93e76-d799-4152-9049-592862d9094a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d4fecca9e5c74435917afa362915006e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T09:59:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T09:59:36Z,use_quota=True,user_id='cd95811391ef4f95b79f4f5c5f6f23c1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f2c454e0-3da9-4814-87a2-1be5af6cf0b7),volume_type_id=f2c454e0-3da9-4814-87a2-1be5af6cf0b7)}" {{(pid=87272) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 04 10:59:38 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.remotefs [None req-12e7cb26-7571-46c9-9ec8-7a790603e119 tempest-GroupSnapshotsTest-534526937 None] Creating volume aec93e76-d799-4152-9049-592862d9094a {{(pid=87272) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 10:59:38 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-12e7cb26-7571-46c9-9ec8-7a790603e119 tempest-GroupSnapshotsTest-534526937 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:59:38 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-12e7cb26-7571-46c9-9ec8-7a790603e119 tempest-GroupSnapshotsTest-534526937 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:59:38 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-12e7cb26-7571-46c9-9ec8-7a790603e119 tempest-GroupSnapshotsTest-534526937 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898': None} {{(pid=87272) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:59:38 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-12e7cb26-7571-46c9-9ec8-7a790603e119 tempest-GroupSnapshotsTest-534526937 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'] {{(pid=87272) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:59:38 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-12e7cb26-7571-46c9-9ec8-7a790603e119 tempest-GroupSnapshotsTest-534526937 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:59:38 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-12e7cb26-7571-46c9-9ec8-7a790603e119 tempest-GroupSnapshotsTest-534526937 None] Selected osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898 as target Quobyte volume. {{(pid=87272) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 10:59:38 devstack cinder-volume[87272]: INFO cinder.volume.drivers.remotefs [None req-12e7cb26-7571-46c9-9ec8-7a790603e119 tempest-GroupSnapshotsTest-534526937 None] casted to osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898 Nov 04 10:59:38 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-12e7cb26-7571-46c9-9ec8-7a790603e119 tempest-GroupSnapshotsTest-534526937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-aec93e76-d799-4152-9049-592862d9094a 1073741824 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:59:38 devstack sudo[99290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-aec93e76-d799-4152-9049-592862d9094a 1073741824 Nov 04 10:59:38 devstack sudo[99290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:59:38 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-6c6fd187-dbec-4935-b5a8-d00734d8192c tempest-GroupsV314Test-1517989196 None] Create group from source-group-093028c5-5134-4299-9b96-39cbf694a894 completed successfully. Nov 04 10:59:39 devstack sudo[99290]: pam_unix(sudo:session): session closed for user root Nov 04 10:59:39 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-12e7cb26-7571-46c9-9ec8-7a790603e119 tempest-GroupSnapshotsTest-534526937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-aec93e76-d799-4152-9049-592862d9094a 1073741824" returned: 0 in 0.694s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:59:39 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-12e7cb26-7571-46c9-9ec8-7a790603e119 tempest-GroupSnapshotsTest-534526937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-aec93e76-d799-4152-9049-592862d9094a {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:59:39 devstack sudo[99296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-aec93e76-d799-4152-9049-592862d9094a Nov 04 10:59:39 devstack sudo[99296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:59:39 devstack sudo[99296]: pam_unix(sudo:session): session closed for user root Nov 04 10:59:39 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-12e7cb26-7571-46c9-9ec8-7a790603e119 tempest-GroupSnapshotsTest-534526937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-aec93e76-d799-4152-9049-592862d9094a" returned: 0 in 0.364s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:59:39 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-12e7cb26-7571-46c9-9ec8-7a790603e119 tempest-GroupSnapshotsTest-534526937 None] <== create_volume: return (1137ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'} {{(pid=87272) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 04 10:59:39 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-12e7cb26-7571-46c9-9ec8-7a790603e119 tempest-GroupSnapshotsTest-534526937 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.140s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:59:39 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-12e7cb26-7571-46c9-9ec8-7a790603e119 tempest-GroupSnapshotsTest-534526937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c8e952d-fbf2-4bb9-99ac-f805ad2f917f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aec93e76-d799-4152-9049-592862d9094a', 'volume_size': 1}' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:59:39 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-12e7cb26-7571-46c9-9ec8-7a790603e119 tempest-GroupSnapshotsTest-534526937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b8f4a87-44a6-4dcb-96f6-385eaf8a76a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:59:39 devstack cinder-volume[87272]: INFO cinder.volume.flows.manager.create_volume [None req-12e7cb26-7571-46c9-9ec8-7a790603e119 tempest-GroupSnapshotsTest-534526937 None] Volume volume-aec93e76-d799-4152-9049-592862d9094a (aec93e76-d799-4152-9049-592862d9094a): created successfully Nov 04 10:59:39 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-12e7cb26-7571-46c9-9ec8-7a790603e119 tempest-GroupSnapshotsTest-534526937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b8f4a87-44a6-4dcb-96f6-385eaf8a76a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:59:39 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-12e7cb26-7571-46c9-9ec8-7a790603e119 tempest-GroupSnapshotsTest-534526937 None] Flow 'volume_create_manager' (43276557-0c53-4c6a-9617-538940705144) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87272) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:59:39 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-7a0809bb-1d96-47c3-a3df-7d22b3576f33 tempest-GroupsV314Test-1517989196 None] Acquiring lock "cinder-quobyte-5e44a03b-145b-4a96-a10f-83712c83a979" by "delete_volume" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:59:39 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-12e7cb26-7571-46c9-9ec8-7a790603e119 tempest-GroupSnapshotsTest-534526937 None] Created volume successfully. Nov 04 10:59:39 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-7a0809bb-1d96-47c3-a3df-7d22b3576f33 tempest-GroupsV314Test-1517989196 None] Lock "cinder-quobyte-5e44a03b-145b-4a96-a10f-83712c83a979" acquired by "delete_volume" :: waited 0.033s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:59:39 devstack cinder-volume[87272]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ee107f6-3962-45e1-bdb2-0971e80be5bc]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:59:39 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-7a0809bb-1d96-47c3-a3df-7d22b3576f33 tempest-GroupsV314Test-1517989196 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-5e44a03b-145b-4a96-a10f-83712c83a979 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:59:39 devstack sudo[99329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-5e44a03b-145b-4a96-a10f-83712c83a979 Nov 04 10:59:39 devstack sudo[99329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:59:40 devstack sudo[99329]: pam_unix(sudo:session): session closed for user root Nov 04 10:59:40 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-7a0809bb-1d96-47c3-a3df-7d22b3576f33 tempest-GroupsV314Test-1517989196 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-5e44a03b-145b-4a96-a10f-83712c83a979" returned: 0 in 0.522s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:59:40 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-7a0809bb-1d96-47c3-a3df-7d22b3576f33 tempest-GroupsV314Test-1517989196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-5e44a03b-145b-4a96-a10f-83712c83a979 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:59:40 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-612d85ab-c362-4739-a7b3-eb407a623504 tempest-GroupSnapshotsTest-534526937 None] GroupSnapshot 0d6e7f33-0a71-4218-ae85-7738cbfbe40b: creating. Nov 04 10:59:40 devstack sudo[99334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-5e44a03b-145b-4a96-a10f-83712c83a979 Nov 04 10:59:40 devstack sudo[99334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:59:40 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-612d85ab-c362-4739-a7b3-eb407a623504 tempest-GroupSnapshotsTest-534526937 None] Group snapshot 0d6e7f33-0a71-4218-ae85-7738cbfbe40b: creating. {{(pid=87272) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Nov 04 10:59:40 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-612d85ab-c362-4739-a7b3-eb407a623504 tempest-GroupSnapshotsTest-534526937 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:59:40 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-612d85ab-c362-4739-a7b3-eb407a623504 tempest-GroupSnapshotsTest-534526937 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:59:40 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.remotefs [None req-612d85ab-c362-4739-a7b3-eb407a623504 tempest-GroupSnapshotsTest-534526937 None] Creating offline snapshot a2b6a287-3d6b-4910-85b6-ad805e2cdf97 of volume aec93e76-d799-4152-9049-592862d9094a {{(pid=87272) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 04 10:59:40 devstack cinder-volume[87272]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd7e4759-a9a3-4a49-842f-3a7089e1eca7]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:59:40 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-612d85ab-c362-4739-a7b3-eb407a623504 tempest-GroupSnapshotsTest-534526937 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-aec93e76-d799-4152-9049-592862d9094a {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:59:40 devstack sudo[99346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-aec93e76-d799-4152-9049-592862d9094a Nov 04 10:59:40 devstack sudo[99346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:59:40 devstack sudo[99334]: pam_unix(sudo:session): session closed for user root Nov 04 10:59:40 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-7a0809bb-1d96-47c3-a3df-7d22b3576f33 tempest-GroupsV314Test-1517989196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-5e44a03b-145b-4a96-a10f-83712c83a979" returned: 0 in 0.443s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:59:40 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-7a0809bb-1d96-47c3-a3df-7d22b3576f33 tempest-GroupsV314Test-1517989196 None] Lock "cinder-quobyte-5e44a03b-145b-4a96-a10f-83712c83a979" released by "delete_volume" :: held 1.057s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:59:40 devstack cinder-volume[87272]: DEBUG cinder.quota [None req-7a0809bb-1d96-47c3-a3df-7d22b3576f33 tempest-GroupsV314Test-1517989196 None] Created reservations ['bbeabd49-3664-4958-9199-26ae2b1bd40e'] {{(pid=87272) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 10:59:41 devstack cinder-volume[87272]: WARNING cinder.quota [None req-7a0809bb-1d96-47c3-a3df-7d22b3576f33 tempest-GroupsV314Test-1517989196 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-1555519315 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-1555519315, it is now deprecated. Please use the default quota class for default quota. Nov 04 10:59:41 devstack cinder-volume[87272]: WARNING cinder.quota [None req-7a0809bb-1d96-47c3-a3df-7d22b3576f33 tempest-GroupsV314Test-1517989196 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-1555519315 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-1555519315, it is now deprecated. Please use the default quota class for default quota. Nov 04 10:59:41 devstack cinder-volume[87272]: DEBUG cinder.quota [None req-7a0809bb-1d96-47c3-a3df-7d22b3576f33 tempest-GroupsV314Test-1517989196 None] Created reservations ['a2fe69ae-48b0-4b49-b97a-df62b53a2491', '8899c64a-ae61-4e31-89c8-1dda13b32a1c', '4eab0ad7-4772-4ad2-ada6-788897208e99', '6d73ed0e-3fcb-4a37-84fe-85f8043e9bb1'] {{(pid=87272) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 10:59:41 devstack sudo[99346]: pam_unix(sudo:session): session closed for user root Nov 04 10:59:41 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-612d85ab-c362-4739-a7b3-eb407a623504 tempest-GroupSnapshotsTest-534526937 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-aec93e76-d799-4152-9049-592862d9094a" returned: 0 in 0.800s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:59:41 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-612d85ab-c362-4739-a7b3-eb407a623504 tempest-GroupSnapshotsTest-534526937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-aec93e76-d799-4152-9049-592862d9094a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-aec93e76-d799-4152-9049-592862d9094a.a2b6a287-3d6b-4910-85b6-ad805e2cdf97 1G {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:59:41 devstack sudo[99363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-aec93e76-d799-4152-9049-592862d9094a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-aec93e76-d799-4152-9049-592862d9094a.a2b6a287-3d6b-4910-85b6-ad805e2cdf97 1G Nov 04 10:59:41 devstack sudo[99363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:59:41 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-7a0809bb-1d96-47c3-a3df-7d22b3576f33 tempest-GroupsV314Test-1517989196 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:59:41 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-7a0809bb-1d96-47c3-a3df-7d22b3576f33 tempest-GroupsV314Test-1517989196 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:59:41 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-7a0809bb-1d96-47c3-a3df-7d22b3576f33 tempest-GroupsV314Test-1517989196 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898': None} {{(pid=87272) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:59:41 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-7a0809bb-1d96-47c3-a3df-7d22b3576f33 tempest-GroupsV314Test-1517989196 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'] {{(pid=87272) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:59:41 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-7a0809bb-1d96-47c3-a3df-7d22b3576f33 tempest-GroupsV314Test-1517989196 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:59:41 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-7a0809bb-1d96-47c3-a3df-7d22b3576f33 tempest-GroupsV314Test-1517989196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:59:41 devstack sudo[99365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1 Nov 04 10:59:41 devstack sudo[99365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:59:41 devstack sudo[99365]: pam_unix(sudo:session): session closed for user root Nov 04 10:59:41 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-7a0809bb-1d96-47c3-a3df-7d22b3576f33 tempest-GroupsV314Test-1517989196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1" returned: 0 in 0.445s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:59:41 devstack cinder-volume[87272]: DEBUG cinder.manager [None req-7a0809bb-1d96-47c3-a3df-7d22b3576f33 tempest-GroupsV314Test-1517989196 None] Notifying Schedulers of capabilities ... {{(pid=87272) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 10:59:41 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-7a0809bb-1d96-47c3-a3df-7d22b3576f33 tempest-GroupsV314Test-1517989196 None] Delete group completed successfully. Nov 04 10:59:42 devstack sudo[99363]: pam_unix(sudo:session): session closed for user root Nov 04 10:59:42 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-612d85ab-c362-4739-a7b3-eb407a623504 tempest-GroupSnapshotsTest-534526937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-aec93e76-d799-4152-9049-592862d9094a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-aec93e76-d799-4152-9049-592862d9094a.a2b6a287-3d6b-4910-85b6-ad805e2cdf97 1G" returned: 0 in 0.738s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:59:42 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-612d85ab-c362-4739-a7b3-eb407a623504 tempest-GroupSnapshotsTest-534526937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aec93e76-d799-4152-9049-592862d9094a -F qcow2 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-aec93e76-d799-4152-9049-592862d9094a.a2b6a287-3d6b-4910-85b6-ad805e2cdf97 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:59:42 devstack sudo[99373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aec93e76-d799-4152-9049-592862d9094a -F qcow2 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-aec93e76-d799-4152-9049-592862d9094a.a2b6a287-3d6b-4910-85b6-ad805e2cdf97 Nov 04 10:59:42 devstack sudo[99373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:59:42 devstack sudo[99373]: pam_unix(sudo:session): session closed for user root Nov 04 10:59:42 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-612d85ab-c362-4739-a7b3-eb407a623504 tempest-GroupSnapshotsTest-534526937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aec93e76-d799-4152-9049-592862d9094a -F qcow2 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-aec93e76-d799-4152-9049-592862d9094a.a2b6a287-3d6b-4910-85b6-ad805e2cdf97" returned: 0 in 0.788s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:59:42 devstack cinder-volume[87272]: WARNING cinder.volume.drivers.remotefs [None req-612d85ab-c362-4739-a7b3-eb407a623504 tempest-GroupSnapshotsTest-534526937 None] /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-aec93e76-d799-4152-9049-592862d9094a.a2b6a287-3d6b-4910-85b6-ad805e2cdf97 is being set with open permissions: ugo+rw: NotImplementedError Nov 04 10:59:42 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-612d85ab-c362-4739-a7b3-eb407a623504 tempest-GroupSnapshotsTest-534526937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-aec93e76-d799-4152-9049-592862d9094a.a2b6a287-3d6b-4910-85b6-ad805e2cdf97 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:59:42 devstack sudo[99379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-aec93e76-d799-4152-9049-592862d9094a.a2b6a287-3d6b-4910-85b6-ad805e2cdf97 Nov 04 10:59:42 devstack sudo[99379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:59:42 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-ab388dfb-670c-4bf2-9440-db56b21a7a04 tempest-GroupsV314Test-1517989196 None] Acquiring lock "cinder-quobyte-c67a032e-a321-4ffa-9f76-48e8ffaac0d4" by "delete_volume" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:59:42 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-ab388dfb-670c-4bf2-9440-db56b21a7a04 tempest-GroupsV314Test-1517989196 None] Lock "cinder-quobyte-c67a032e-a321-4ffa-9f76-48e8ffaac0d4" acquired by "delete_volume" :: waited 0.033s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:59:43 devstack cinder-volume[87272]: DEBUG oslo.privsep.daemon [-] privsep: reply[3429178a-8a7e-4096-9559-aa7a7bf55f8d]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:59:43 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-ab388dfb-670c-4bf2-9440-db56b21a7a04 tempest-GroupsV314Test-1517989196 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-c67a032e-a321-4ffa-9f76-48e8ffaac0d4 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:59:43 devstack sudo[99379]: pam_unix(sudo:session): session closed for user root Nov 04 10:59:43 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-612d85ab-c362-4739-a7b3-eb407a623504 tempest-GroupSnapshotsTest-534526937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-aec93e76-d799-4152-9049-592862d9094a.a2b6a287-3d6b-4910-85b6-ad805e2cdf97" returned: 0 in 0.511s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:59:43 devstack sudo[99381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-c67a032e-a321-4ffa-9f76-48e8ffaac0d4 Nov 04 10:59:43 devstack sudo[99381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:59:43 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-612d85ab-c362-4739-a7b3-eb407a623504 tempest-GroupSnapshotsTest-534526937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-aec93e76-d799-4152-9049-592862d9094a.info {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:59:43 devstack sudo[99384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-aec93e76-d799-4152-9049-592862d9094a.info Nov 04 10:59:43 devstack sudo[99384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:59:43 devstack sudo[99381]: pam_unix(sudo:session): session closed for user root Nov 04 10:59:43 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-ab388dfb-670c-4bf2-9440-db56b21a7a04 tempest-GroupsV314Test-1517989196 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-c67a032e-a321-4ffa-9f76-48e8ffaac0d4" returned: 0 in 0.792s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:59:43 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-ab388dfb-670c-4bf2-9440-db56b21a7a04 tempest-GroupsV314Test-1517989196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-c67a032e-a321-4ffa-9f76-48e8ffaac0d4 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:59:43 devstack sudo[99391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-c67a032e-a321-4ffa-9f76-48e8ffaac0d4 Nov 04 10:59:43 devstack sudo[99391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:59:43 devstack sudo[99384]: pam_unix(sudo:session): session closed for user root Nov 04 10:59:43 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-612d85ab-c362-4739-a7b3-eb407a623504 tempest-GroupSnapshotsTest-534526937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-aec93e76-d799-4152-9049-592862d9094a.info" returned: 0 in 0.490s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:59:43 devstack cinder-volume[87272]: WARNING cinder.volume.drivers.remotefs [None req-612d85ab-c362-4739-a7b3-eb407a623504 tempest-GroupSnapshotsTest-534526937 None] /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-aec93e76-d799-4152-9049-592862d9094a.info is being set with open permissions: ugo+rw: NotImplementedError Nov 04 10:59:43 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-612d85ab-c362-4739-a7b3-eb407a623504 tempest-GroupSnapshotsTest-534526937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-aec93e76-d799-4152-9049-592862d9094a.info {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:59:43 devstack sudo[99393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-aec93e76-d799-4152-9049-592862d9094a.info Nov 04 10:59:43 devstack sudo[99393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:59:44 devstack sudo[99391]: pam_unix(sudo:session): session closed for user root Nov 04 10:59:44 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-ab388dfb-670c-4bf2-9440-db56b21a7a04 tempest-GroupsV314Test-1517989196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-c67a032e-a321-4ffa-9f76-48e8ffaac0d4" returned: 0 in 0.345s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:59:44 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-ab388dfb-670c-4bf2-9440-db56b21a7a04 tempest-GroupsV314Test-1517989196 None] Lock "cinder-quobyte-c67a032e-a321-4ffa-9f76-48e8ffaac0d4" released by "delete_volume" :: held 1.249s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:59:44 devstack sudo[99393]: pam_unix(sudo:session): session closed for user root Nov 04 10:59:44 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-612d85ab-c362-4739-a7b3-eb407a623504 tempest-GroupSnapshotsTest-534526937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-aec93e76-d799-4152-9049-592862d9094a.info" returned: 0 in 0.361s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:59:44 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-612d85ab-c362-4739-a7b3-eb407a623504 tempest-GroupSnapshotsTest-534526937 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.871s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:59:44 devstack cinder-volume[87272]: DEBUG cinder.quota [None req-ab388dfb-670c-4bf2-9440-db56b21a7a04 tempest-GroupsV314Test-1517989196 None] Created reservations ['586ac78a-78e4-4792-b76a-8da93c502cbe'] {{(pid=87272) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 10:59:44 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-612d85ab-c362-4739-a7b3-eb407a623504 tempest-GroupSnapshotsTest-534526937 None] group_snapshot 0d6e7f33-0a71-4218-ae85-7738cbfbe40b: created successfully Nov 04 10:59:44 devstack cinder-volume[87272]: DEBUG cinder.quota [None req-ab388dfb-670c-4bf2-9440-db56b21a7a04 tempest-GroupsV314Test-1517989196 None] Created reservations ['4a7be5d6-66d1-4a12-8061-b65031fc8220', 'f2c15a46-3218-42d5-9ef1-c5810642e92a', '0c1e3dd4-ec6e-43c5-9201-fc0a82ebcef2', '3472a496-36c0-48f0-9613-85a3a3724541'] {{(pid=87272) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 10:59:44 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-ab388dfb-670c-4bf2-9440-db56b21a7a04 tempest-GroupsV314Test-1517989196 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:59:44 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-ab388dfb-670c-4bf2-9440-db56b21a7a04 tempest-GroupsV314Test-1517989196 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:59:44 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-ab388dfb-670c-4bf2-9440-db56b21a7a04 tempest-GroupsV314Test-1517989196 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898': None} {{(pid=87272) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:59:44 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-ab388dfb-670c-4bf2-9440-db56b21a7a04 tempest-GroupsV314Test-1517989196 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'] {{(pid=87272) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:59:44 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-ab388dfb-670c-4bf2-9440-db56b21a7a04 tempest-GroupsV314Test-1517989196 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:59:44 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-ab388dfb-670c-4bf2-9440-db56b21a7a04 tempest-GroupsV314Test-1517989196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:59:44 devstack sudo[99397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1 Nov 04 10:59:44 devstack sudo[99397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:59:45 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-3cdf7239-43fb-4113-b728-ba1b3861facc tempest-GroupSnapshotsTest-534526937 None] group_snapshot 0d6e7f33-0a71-4218-ae85-7738cbfbe40b: deleting Nov 04 10:59:45 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-3cdf7239-43fb-4113-b728-ba1b3861facc tempest-GroupSnapshotsTest-534526937 None] group_snapshot 0d6e7f33-0a71-4218-ae85-7738cbfbe40b: deleting {{(pid=87272) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Nov 04 10:59:45 devstack sudo[99397]: pam_unix(sudo:session): session closed for user root Nov 04 10:59:45 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-ab388dfb-670c-4bf2-9440-db56b21a7a04 tempest-GroupsV314Test-1517989196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1" returned: 0 in 0.414s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:59:45 devstack cinder-volume[87272]: DEBUG cinder.manager [None req-ab388dfb-670c-4bf2-9440-db56b21a7a04 tempest-GroupsV314Test-1517989196 None] Notifying Schedulers of capabilities ... {{(pid=87272) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 10:59:45 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-3cdf7239-43fb-4113-b728-ba1b3861facc tempest-GroupSnapshotsTest-534526937 None] Acquiring lock "cinder-quobyte-aec93e76-d799-4152-9049-592862d9094a" by "delete_snapshot" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:59:45 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-ab388dfb-670c-4bf2-9440-db56b21a7a04 tempest-GroupsV314Test-1517989196 None] Delete group completed successfully. Nov 04 10:59:45 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-3cdf7239-43fb-4113-b728-ba1b3861facc tempest-GroupSnapshotsTest-534526937 None] Lock "cinder-quobyte-aec93e76-d799-4152-9049-592862d9094a" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:59:45 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-3cdf7239-43fb-4113-b728-ba1b3861facc tempest-GroupSnapshotsTest-534526937 None] Acquiring lock "cinder-quobyte-a2b6a287-3d6b-4910-85b6-ad805e2cdf97" by "_delete_snapshot" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:59:45 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-3cdf7239-43fb-4113-b728-ba1b3861facc tempest-GroupSnapshotsTest-534526937 None] Lock "cinder-quobyte-a2b6a287-3d6b-4910-85b6-ad805e2cdf97" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:59:45 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.remotefs [None req-3cdf7239-43fb-4113-b728-ba1b3861facc tempest-GroupSnapshotsTest-534526937 None] Deleting offline snapshot a2b6a287-3d6b-4910-85b6-ad805e2cdf97 of volume aec93e76-d799-4152-9049-592862d9094a {{(pid=87272) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 04 10:59:45 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.remotefs [None req-3cdf7239-43fb-4113-b728-ba1b3861facc tempest-GroupSnapshotsTest-534526937 None] snapshot_file for this snap is: volume-aec93e76-d799-4152-9049-592862d9094a.a2b6a287-3d6b-4910-85b6-ad805e2cdf97 {{(pid=87272) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 04 10:59:45 devstack cinder-volume[87272]: DEBUG oslo.privsep.daemon [-] privsep: reply[54fe9709-cd0b-478a-b891-b79fab9e00d9]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:59:45 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-3cdf7239-43fb-4113-b728-ba1b3861facc tempest-GroupSnapshotsTest-534526937 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-aec93e76-d799-4152-9049-592862d9094a.a2b6a287-3d6b-4910-85b6-ad805e2cdf97 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:59:45 devstack sudo[99400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-aec93e76-d799-4152-9049-592862d9094a.a2b6a287-3d6b-4910-85b6-ad805e2cdf97 Nov 04 10:59:45 devstack sudo[99400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:59:45 devstack sudo[99400]: pam_unix(sudo:session): session closed for user root Nov 04 10:59:45 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-3cdf7239-43fb-4113-b728-ba1b3861facc tempest-GroupSnapshotsTest-534526937 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-aec93e76-d799-4152-9049-592862d9094a.a2b6a287-3d6b-4910-85b6-ad805e2cdf97" returned: 0 in 0.461s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:59:45 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.remotefs [None req-3cdf7239-43fb-4113-b728-ba1b3861facc tempest-GroupSnapshotsTest-534526937 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-aec93e76-d799-4152-9049-592862d9094a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87272) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 10:59:45 devstack cinder-volume[87272]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b4782f4-57a7-4af5-93f5-6e51d3ba70a6]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:59:45 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-3cdf7239-43fb-4113-b728-ba1b3861facc tempest-GroupSnapshotsTest-534526937 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-aec93e76-d799-4152-9049-592862d9094a {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:59:45 devstack sudo[99405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-aec93e76-d799-4152-9049-592862d9094a Nov 04 10:59:45 devstack sudo[99405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:59:46 devstack sudo[99405]: pam_unix(sudo:session): session closed for user root Nov 04 10:59:46 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-3cdf7239-43fb-4113-b728-ba1b3861facc tempest-GroupSnapshotsTest-534526937 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-aec93e76-d799-4152-9049-592862d9094a" returned: 0 in 0.464s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:59:46 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-3cdf7239-43fb-4113-b728-ba1b3861facc tempest-GroupSnapshotsTest-534526937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-aec93e76-d799-4152-9049-592862d9094a.a2b6a287-3d6b-4910-85b6-ad805e2cdf97 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:59:46 devstack sudo[99411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-aec93e76-d799-4152-9049-592862d9094a.a2b6a287-3d6b-4910-85b6-ad805e2cdf97 Nov 04 10:59:46 devstack sudo[99411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:59:46 devstack sudo[99411]: pam_unix(sudo:session): session closed for user root Nov 04 10:59:46 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-3cdf7239-43fb-4113-b728-ba1b3861facc tempest-GroupSnapshotsTest-534526937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-aec93e76-d799-4152-9049-592862d9094a.a2b6a287-3d6b-4910-85b6-ad805e2cdf97" returned: 0 in 0.518s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:59:46 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-3cdf7239-43fb-4113-b728-ba1b3861facc tempest-GroupSnapshotsTest-534526937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-aec93e76-d799-4152-9049-592862d9094a.a2b6a287-3d6b-4910-85b6-ad805e2cdf97 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:59:46 devstack sudo[99417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-aec93e76-d799-4152-9049-592862d9094a.a2b6a287-3d6b-4910-85b6-ad805e2cdf97 Nov 04 10:59:46 devstack sudo[99417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:59:47 devstack sudo[99417]: pam_unix(sudo:session): session closed for user root Nov 04 10:59:47 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-3cdf7239-43fb-4113-b728-ba1b3861facc tempest-GroupSnapshotsTest-534526937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-aec93e76-d799-4152-9049-592862d9094a.a2b6a287-3d6b-4910-85b6-ad805e2cdf97" returned: 0 in 0.380s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:59:47 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-3cdf7239-43fb-4113-b728-ba1b3861facc tempest-GroupSnapshotsTest-534526937 None] Lock "cinder-quobyte-a2b6a287-3d6b-4910-85b6-ad805e2cdf97" released by "_delete_snapshot" :: held 1.971s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:59:47 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-3cdf7239-43fb-4113-b728-ba1b3861facc tempest-GroupSnapshotsTest-534526937 None] Lock "cinder-quobyte-aec93e76-d799-4152-9049-592862d9094a" released by "delete_snapshot" :: held 2.019s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:59:47 devstack cinder-volume[87272]: DEBUG dbcounter [-] [87272] Writing DB stats cinder:SELECT=152,cinder:INSERT=48,cinder:UPDATE=178,cinder:DELETE=9 {{(pid=87272) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 10:59:47 devstack cinder-volume[87272]: WARNING cinder.quota [None req-3cdf7239-43fb-4113-b728-ba1b3861facc tempest-GroupSnapshotsTest-534526937 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-78084588 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-78084588, it is now deprecated. Please use the default quota class for default quota. Nov 04 10:59:47 devstack cinder-volume[87272]: WARNING cinder.quota [None req-3cdf7239-43fb-4113-b728-ba1b3861facc tempest-GroupSnapshotsTest-534526937 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-78084588 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-78084588, it is now deprecated. Please use the default quota class for default quota. Nov 04 10:59:47 devstack cinder-volume[87272]: DEBUG cinder.quota [None req-3cdf7239-43fb-4113-b728-ba1b3861facc tempest-GroupSnapshotsTest-534526937 None] Created reservations ['638569f9-cefa-45bc-adcb-81ed9893110e', '2cf5963b-9fe1-4ae0-a27b-325aa4167dce', '94b9f4d8-769f-4715-bff8-c6a055b6c13c', '2f7961f6-0a67-4ee9-aece-ad94b7b14dd1'] {{(pid=87272) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 10:59:47 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-3cdf7239-43fb-4113-b728-ba1b3861facc tempest-GroupSnapshotsTest-534526937 None] group_snapshot 0d6e7f33-0a71-4218-ae85-7738cbfbe40b: deleted successfully Nov 04 10:59:49 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-1bdc0220-ac2d-46ff-8afa-835f6ed315eb tempest-GroupSnapshotsTest-534526937 None] Acquiring lock "cinder-quobyte-aec93e76-d799-4152-9049-592862d9094a" by "delete_volume" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 10:59:49 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-1bdc0220-ac2d-46ff-8afa-835f6ed315eb tempest-GroupSnapshotsTest-534526937 None] Lock "cinder-quobyte-aec93e76-d799-4152-9049-592862d9094a" acquired by "delete_volume" :: waited 0.044s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 10:59:49 devstack cinder-volume[87272]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1d6ad14-e234-407e-8011-b3b99a51dbb1]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:59:49 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-1bdc0220-ac2d-46ff-8afa-835f6ed315eb tempest-GroupSnapshotsTest-534526937 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-aec93e76-d799-4152-9049-592862d9094a {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:59:49 devstack sudo[99420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-aec93e76-d799-4152-9049-592862d9094a Nov 04 10:59:49 devstack sudo[99420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:59:49 devstack sudo[99420]: pam_unix(sudo:session): session closed for user root Nov 04 10:59:49 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-1bdc0220-ac2d-46ff-8afa-835f6ed315eb tempest-GroupSnapshotsTest-534526937 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-aec93e76-d799-4152-9049-592862d9094a" returned: 0 in 0.630s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:59:49 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-1bdc0220-ac2d-46ff-8afa-835f6ed315eb tempest-GroupSnapshotsTest-534526937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-aec93e76-d799-4152-9049-592862d9094a {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:59:49 devstack sudo[99425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-aec93e76-d799-4152-9049-592862d9094a Nov 04 10:59:49 devstack sudo[99425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:59:50 devstack sudo[99425]: pam_unix(sudo:session): session closed for user root Nov 04 10:59:50 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-1bdc0220-ac2d-46ff-8afa-835f6ed315eb tempest-GroupSnapshotsTest-534526937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-aec93e76-d799-4152-9049-592862d9094a" returned: 0 in 0.781s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:59:50 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-1bdc0220-ac2d-46ff-8afa-835f6ed315eb tempest-GroupSnapshotsTest-534526937 None] Lock "cinder-quobyte-aec93e76-d799-4152-9049-592862d9094a" released by "delete_volume" :: held 1.556s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 10:59:50 devstack cinder-volume[87272]: DEBUG cinder.quota [None req-1bdc0220-ac2d-46ff-8afa-835f6ed315eb tempest-GroupSnapshotsTest-534526937 None] Created reservations ['7e7c832b-0696-4b6a-a76c-9e41fd318d53'] {{(pid=87272) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 10:59:50 devstack cinder-volume[87272]: WARNING cinder.quota [None req-1bdc0220-ac2d-46ff-8afa-835f6ed315eb tempest-GroupSnapshotsTest-534526937 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-78084588 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-78084588, it is now deprecated. Please use the default quota class for default quota. Nov 04 10:59:50 devstack cinder-volume[87272]: DEBUG cinder.quota [None req-1bdc0220-ac2d-46ff-8afa-835f6ed315eb tempest-GroupSnapshotsTest-534526937 None] Created reservations ['d2baaf5d-9f8d-4ac4-a7f8-55ad14013799', 'fd46b243-f39a-4cfd-a18d-f3d3b0c490fc', 'd19fa4fc-e5dd-4cce-b6fa-929a6a760541', '4b7ffe73-e9bc-4f4c-bb09-bedee5db8539'] {{(pid=87272) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 10:59:51 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-1bdc0220-ac2d-46ff-8afa-835f6ed315eb tempest-GroupSnapshotsTest-534526937 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:59:51 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-1bdc0220-ac2d-46ff-8afa-835f6ed315eb tempest-GroupSnapshotsTest-534526937 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:59:51 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-1bdc0220-ac2d-46ff-8afa-835f6ed315eb tempest-GroupSnapshotsTest-534526937 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898': None} {{(pid=87272) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:59:51 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-1bdc0220-ac2d-46ff-8afa-835f6ed315eb tempest-GroupSnapshotsTest-534526937 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'] {{(pid=87272) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:59:51 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-1bdc0220-ac2d-46ff-8afa-835f6ed315eb tempest-GroupSnapshotsTest-534526937 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:59:51 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-1bdc0220-ac2d-46ff-8afa-835f6ed315eb tempest-GroupSnapshotsTest-534526937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:59:51 devstack sudo[99437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1 Nov 04 10:59:51 devstack sudo[99437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:59:51 devstack sudo[99437]: pam_unix(sudo:session): session closed for user root Nov 04 10:59:51 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-1bdc0220-ac2d-46ff-8afa-835f6ed315eb tempest-GroupSnapshotsTest-534526937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1" returned: 0 in 0.502s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:59:51 devstack cinder-volume[87272]: DEBUG cinder.manager [None req-1bdc0220-ac2d-46ff-8afa-835f6ed315eb tempest-GroupSnapshotsTest-534526937 None] Notifying Schedulers of capabilities ... {{(pid=87272) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 10:59:51 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-1bdc0220-ac2d-46ff-8afa-835f6ed315eb tempest-GroupSnapshotsTest-534526937 None] Delete group completed successfully. Nov 04 10:59:56 devstack cinder-volume[87272]: DEBUG cinder.volume.flows.manager.create_volume [None req-4f5e2b69-d057-4898-a236-d24e1f578453 tempest-SnapshotsActionsTest-1929562032 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87272) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 10:59:56 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-4f5e2b69-d057-4898-a236-d24e1f578453 tempest-SnapshotsActionsTest-1929562032 None] Flow 'volume_create_manager' (c3ab86c1-1b25-4336-a8e5-087bc51a6bed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:59:56 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-4f5e2b69-d057-4898-a236-d24e1f578453 tempest-SnapshotsActionsTest-1929562032 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8517666d-eed6-44aa-838e-124655534c04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:59:56 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-4f5e2b69-d057-4898-a236-d24e1f578453 tempest-SnapshotsActionsTest-1929562032 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8517666d-eed6-44aa-838e-124655534c04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T09:59:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1983445670',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=46336612-417e-4879-916a-0b4221935d7f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='676661234bad411c9124dabdd0a325eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T09:59:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T09:59:56Z,use_quota=True,user_id='35f30894039047ebbf9d9a4b48f87954',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8989e4f-21e3-4f0a-9584-0d818784e883),volume_type_id=f8989e4f-21e3-4f0a-9584-0d818784e883)' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:59:56 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-4f5e2b69-d057-4898-a236-d24e1f578453 tempest-SnapshotsActionsTest-1929562032 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (322903ea-abba-46b5-8430-efcabceb7b92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:59:56 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-4f5e2b69-d057-4898-a236-d24e1f578453 tempest-SnapshotsActionsTest-1929562032 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (322903ea-abba-46b5-8430-efcabceb7b92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:59:56 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-4f5e2b69-d057-4898-a236-d24e1f578453 tempest-SnapshotsActionsTest-1929562032 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff76432c-bb40-4a6a-b2c4-5b4c4ac5cb0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:59:56 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-4f5e2b69-d057-4898-a236-d24e1f578453 tempest-SnapshotsActionsTest-1929562032 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff76432c-bb40-4a6a-b2c4-5b4c4ac5cb0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '46336612-417e-4879-916a-0b4221935d7f', 'volume_name': 'volume-46336612-417e-4879-916a-0b4221935d7f', 'volume_size': 1}' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:59:56 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-4f5e2b69-d057-4898-a236-d24e1f578453 tempest-SnapshotsActionsTest-1929562032 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (825151e3-4b19-4740-8a6f-02b47597cb75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:59:56 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-4f5e2b69-d057-4898-a236-d24e1f578453 tempest-SnapshotsActionsTest-1929562032 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (825151e3-4b19-4740-8a6f-02b47597cb75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:59:56 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-4f5e2b69-d057-4898-a236-d24e1f578453 tempest-SnapshotsActionsTest-1929562032 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (090c3c61-9aff-43e1-9b96-1f69ffacc217) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:59:56 devstack cinder-volume[87272]: INFO cinder.volume.flows.manager.create_volume [None req-4f5e2b69-d057-4898-a236-d24e1f578453 tempest-SnapshotsActionsTest-1929562032 None] Volume 46336612-417e-4879-916a-0b4221935d7f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-46336612-417e-4879-916a-0b4221935d7f', 'volume_size': 1} Nov 04 10:59:56 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-4f5e2b69-d057-4898-a236-d24e1f578453 tempest-SnapshotsActionsTest-1929562032 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:59:56 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-4f5e2b69-d057-4898-a236-d24e1f578453 tempest-SnapshotsActionsTest-1929562032 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:59:56 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-4f5e2b69-d057-4898-a236-d24e1f578453 tempest-SnapshotsActionsTest-1929562032 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T09:59:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1983445670',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=46336612-417e-4879-916a-0b4221935d7f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='676661234bad411c9124dabdd0a325eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T09:59:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T09:59:56Z,use_quota=True,user_id='35f30894039047ebbf9d9a4b48f87954',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8989e4f-21e3-4f0a-9584-0d818784e883),volume_type_id=f8989e4f-21e3-4f0a-9584-0d818784e883)}" {{(pid=87272) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 04 10:59:56 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.remotefs [None req-4f5e2b69-d057-4898-a236-d24e1f578453 tempest-SnapshotsActionsTest-1929562032 None] Creating volume 46336612-417e-4879-916a-0b4221935d7f {{(pid=87272) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 10:59:56 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-4f5e2b69-d057-4898-a236-d24e1f578453 tempest-SnapshotsActionsTest-1929562032 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:59:56 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-4f5e2b69-d057-4898-a236-d24e1f578453 tempest-SnapshotsActionsTest-1929562032 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:59:56 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-4f5e2b69-d057-4898-a236-d24e1f578453 tempest-SnapshotsActionsTest-1929562032 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898': None} {{(pid=87272) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 10:59:56 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-4f5e2b69-d057-4898-a236-d24e1f578453 tempest-SnapshotsActionsTest-1929562032 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'] {{(pid=87272) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 10:59:56 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-4f5e2b69-d057-4898-a236-d24e1f578453 tempest-SnapshotsActionsTest-1929562032 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:59:56 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-4f5e2b69-d057-4898-a236-d24e1f578453 tempest-SnapshotsActionsTest-1929562032 None] Selected osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898 as target Quobyte volume. {{(pid=87272) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 10:59:56 devstack cinder-volume[87272]: INFO cinder.volume.drivers.remotefs [None req-4f5e2b69-d057-4898-a236-d24e1f578453 tempest-SnapshotsActionsTest-1929562032 None] casted to osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898 Nov 04 10:59:56 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-4f5e2b69-d057-4898-a236-d24e1f578453 tempest-SnapshotsActionsTest-1929562032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-46336612-417e-4879-916a-0b4221935d7f 1073741824 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:59:56 devstack sudo[99445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-46336612-417e-4879-916a-0b4221935d7f 1073741824 Nov 04 10:59:56 devstack sudo[99445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:59:57 devstack sudo[99445]: pam_unix(sudo:session): session closed for user root Nov 04 10:59:57 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-4f5e2b69-d057-4898-a236-d24e1f578453 tempest-SnapshotsActionsTest-1929562032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-46336612-417e-4879-916a-0b4221935d7f 1073741824" returned: 0 in 0.568s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:59:57 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-4f5e2b69-d057-4898-a236-d24e1f578453 tempest-SnapshotsActionsTest-1929562032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-46336612-417e-4879-916a-0b4221935d7f {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:59:57 devstack sudo[99451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-46336612-417e-4879-916a-0b4221935d7f Nov 04 10:59:57 devstack sudo[99451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:59:57 devstack sudo[99451]: pam_unix(sudo:session): session closed for user root Nov 04 10:59:57 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-4f5e2b69-d057-4898-a236-d24e1f578453 tempest-SnapshotsActionsTest-1929562032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-46336612-417e-4879-916a-0b4221935d7f" returned: 0 in 0.347s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:59:57 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-4f5e2b69-d057-4898-a236-d24e1f578453 tempest-SnapshotsActionsTest-1929562032 None] <== create_volume: return (979ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'} {{(pid=87272) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 04 10:59:57 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-4f5e2b69-d057-4898-a236-d24e1f578453 tempest-SnapshotsActionsTest-1929562032 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.981s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 10:59:57 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-4f5e2b69-d057-4898-a236-d24e1f578453 tempest-SnapshotsActionsTest-1929562032 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (090c3c61-9aff-43e1-9b96-1f69ffacc217) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-46336612-417e-4879-916a-0b4221935d7f', 'volume_size': 1}' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:59:57 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-4f5e2b69-d057-4898-a236-d24e1f578453 tempest-SnapshotsActionsTest-1929562032 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (739c485e-4a32-4e1c-ac39-8a570e8c084b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 10:59:57 devstack cinder-volume[87272]: INFO cinder.volume.flows.manager.create_volume [None req-4f5e2b69-d057-4898-a236-d24e1f578453 tempest-SnapshotsActionsTest-1929562032 None] Volume volume-46336612-417e-4879-916a-0b4221935d7f (46336612-417e-4879-916a-0b4221935d7f): created successfully Nov 04 10:59:57 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-4f5e2b69-d057-4898-a236-d24e1f578453 tempest-SnapshotsActionsTest-1929562032 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (739c485e-4a32-4e1c-ac39-8a570e8c084b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 10:59:57 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-4f5e2b69-d057-4898-a236-d24e1f578453 tempest-SnapshotsActionsTest-1929562032 None] Flow 'volume_create_manager' (c3ab86c1-1b25-4336-a8e5-087bc51a6bed) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87272) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 10:59:57 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-4f5e2b69-d057-4898-a236-d24e1f578453 tempest-SnapshotsActionsTest-1929562032 None] Created volume successfully. Nov 04 10:59:59 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-eaa8cc41-c433-4dad-9398-dbf9239c4a70 tempest-SnapshotsActionsTest-1929562032 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 10:59:59 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-eaa8cc41-c433-4dad-9398-dbf9239c4a70 tempest-SnapshotsActionsTest-1929562032 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 10:59:59 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.remotefs [None req-eaa8cc41-c433-4dad-9398-dbf9239c4a70 tempest-SnapshotsActionsTest-1929562032 None] Creating offline snapshot 7e49cd66-33cd-4c14-8069-bc249e5ebcbd of volume 46336612-417e-4879-916a-0b4221935d7f {{(pid=87272) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 04 10:59:59 devstack cinder-volume[87272]: DEBUG oslo.privsep.daemon [-] privsep: reply[10813684-a3fd-428e-9fb8-3cbab420d096]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 10:59:59 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-eaa8cc41-c433-4dad-9398-dbf9239c4a70 tempest-SnapshotsActionsTest-1929562032 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-46336612-417e-4879-916a-0b4221935d7f {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:59:59 devstack sudo[99454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-46336612-417e-4879-916a-0b4221935d7f Nov 04 10:59:59 devstack sudo[99454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 10:59:59 devstack sudo[99454]: pam_unix(sudo:session): session closed for user root Nov 04 10:59:59 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-eaa8cc41-c433-4dad-9398-dbf9239c4a70 tempest-SnapshotsActionsTest-1929562032 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-46336612-417e-4879-916a-0b4221935d7f" returned: 0 in 0.419s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 10:59:59 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-eaa8cc41-c433-4dad-9398-dbf9239c4a70 tempest-SnapshotsActionsTest-1929562032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-46336612-417e-4879-916a-0b4221935d7f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-46336612-417e-4879-916a-0b4221935d7f.7e49cd66-33cd-4c14-8069-bc249e5ebcbd 1G {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 10:59:59 devstack sudo[99459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-46336612-417e-4879-916a-0b4221935d7f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-46336612-417e-4879-916a-0b4221935d7f.7e49cd66-33cd-4c14-8069-bc249e5ebcbd 1G Nov 04 10:59:59 devstack sudo[99459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:00:00 devstack cinder-volume[87272]: DEBUG cinder.volume.flows.manager.create_volume [None req-63735209-6905-440b-ad7c-fdfe6a01ef55 tempest-TestServerVolumeAttachmentScenario-1780213436 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87272) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 11:00:00 devstack sudo[99459]: pam_unix(sudo:session): session closed for user root Nov 04 11:00:00 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-63735209-6905-440b-ad7c-fdfe6a01ef55 tempest-TestServerVolumeAttachmentScenario-1780213436 None] Flow 'volume_create_manager' (b2cfb2c7-f3ee-4c7c-b58d-3c2d7e59514d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 11:00:00 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-63735209-6905-440b-ad7c-fdfe6a01ef55 tempest-TestServerVolumeAttachmentScenario-1780213436 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (64316d84-013f-4591-b84f-8fc928e9e091) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:00:00 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-eaa8cc41-c433-4dad-9398-dbf9239c4a70 tempest-SnapshotsActionsTest-1929562032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-46336612-417e-4879-916a-0b4221935d7f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-46336612-417e-4879-916a-0b4221935d7f.7e49cd66-33cd-4c14-8069-bc249e5ebcbd 1G" returned: 0 in 0.631s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:00:00 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-eaa8cc41-c433-4dad-9398-dbf9239c4a70 tempest-SnapshotsActionsTest-1929562032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-46336612-417e-4879-916a-0b4221935d7f -F qcow2 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-46336612-417e-4879-916a-0b4221935d7f.7e49cd66-33cd-4c14-8069-bc249e5ebcbd {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:00:00 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-63735209-6905-440b-ad7c-fdfe6a01ef55 tempest-TestServerVolumeAttachmentScenario-1780213436 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (64316d84-013f-4591-b84f-8fc928e9e091) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T10:00:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1843969620',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ed2c409-12aa-418d-bc8a-71a138668e4e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='597a0d6c7b2647dc82d82fee268813c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T10:00:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T10:00:00Z,use_quota=True,user_id='b6974cfb045e47d7a6a9d70e55d94cc7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8989e4f-21e3-4f0a-9584-0d818784e883),volume_type_id=f8989e4f-21e3-4f0a-9584-0d818784e883)' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:00:00 devstack sudo[99466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-46336612-417e-4879-916a-0b4221935d7f -F qcow2 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-46336612-417e-4879-916a-0b4221935d7f.7e49cd66-33cd-4c14-8069-bc249e5ebcbd Nov 04 11:00:00 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-63735209-6905-440b-ad7c-fdfe6a01ef55 tempest-TestServerVolumeAttachmentScenario-1780213436 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb6027d6-1b09-4844-af3e-97fdab975fd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:00:00 devstack sudo[99466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:00:00 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-63735209-6905-440b-ad7c-fdfe6a01ef55 tempest-TestServerVolumeAttachmentScenario-1780213436 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb6027d6-1b09-4844-af3e-97fdab975fd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:00:00 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-63735209-6905-440b-ad7c-fdfe6a01ef55 tempest-TestServerVolumeAttachmentScenario-1780213436 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba271f2d-685d-4a24-9d14-bbd951a48597) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:00:00 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-63735209-6905-440b-ad7c-fdfe6a01ef55 tempest-TestServerVolumeAttachmentScenario-1780213436 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba271f2d-685d-4a24-9d14-bbd951a48597) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0ed2c409-12aa-418d-bc8a-71a138668e4e', 'volume_name': 'volume-0ed2c409-12aa-418d-bc8a-71a138668e4e', 'volume_size': 1}' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:00:00 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-63735209-6905-440b-ad7c-fdfe6a01ef55 tempest-TestServerVolumeAttachmentScenario-1780213436 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c37f85b5-071d-430f-89f6-efd7b8f683d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:00:00 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-63735209-6905-440b-ad7c-fdfe6a01ef55 tempest-TestServerVolumeAttachmentScenario-1780213436 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c37f85b5-071d-430f-89f6-efd7b8f683d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:00:00 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-63735209-6905-440b-ad7c-fdfe6a01ef55 tempest-TestServerVolumeAttachmentScenario-1780213436 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (553e3254-36a1-462f-b44d-c6f372b9506d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:00:00 devstack cinder-volume[87272]: INFO cinder.volume.flows.manager.create_volume [None req-63735209-6905-440b-ad7c-fdfe6a01ef55 tempest-TestServerVolumeAttachmentScenario-1780213436 None] Volume 0ed2c409-12aa-418d-bc8a-71a138668e4e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0ed2c409-12aa-418d-bc8a-71a138668e4e', 'volume_size': 1} Nov 04 11:00:00 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-63735209-6905-440b-ad7c-fdfe6a01ef55 tempest-TestServerVolumeAttachmentScenario-1780213436 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 11:00:00 devstack cinder-volume[87272]: DEBUG cinder.volume.flows.manager.create_volume [None req-e54f6166-cc43-4248-8b55-34b3af6d6a79 tempest-TestServerVolumeAttachmentScenario-1780213436 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87272) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 11:00:00 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-e54f6166-cc43-4248-8b55-34b3af6d6a79 tempest-TestServerVolumeAttachmentScenario-1780213436 None] Flow 'volume_create_manager' (8c167772-ef33-4128-973f-657fd651109b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 11:00:00 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-e54f6166-cc43-4248-8b55-34b3af6d6a79 tempest-TestServerVolumeAttachmentScenario-1780213436 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (58d5a61c-4ea2-4a57-aaef-e2065185d836) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:00:00 devstack sudo[99466]: pam_unix(sudo:session): session closed for user root Nov 04 11:00:00 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-e54f6166-cc43-4248-8b55-34b3af6d6a79 tempest-TestServerVolumeAttachmentScenario-1780213436 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (58d5a61c-4ea2-4a57-aaef-e2065185d836) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T10:00:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-2041752812',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b4ff3daf-3d02-4ddd-aac2-e49ee57577aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='597a0d6c7b2647dc82d82fee268813c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T10:00:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T10:00:00Z,use_quota=True,user_id='b6974cfb045e47d7a6a9d70e55d94cc7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8989e4f-21e3-4f0a-9584-0d818784e883),volume_type_id=f8989e4f-21e3-4f0a-9584-0d818784e883)' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:00:00 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-e54f6166-cc43-4248-8b55-34b3af6d6a79 tempest-TestServerVolumeAttachmentScenario-1780213436 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c99907a7-146c-41b3-97ae-c16533e9325a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:00:00 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-e54f6166-cc43-4248-8b55-34b3af6d6a79 tempest-TestServerVolumeAttachmentScenario-1780213436 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c99907a7-146c-41b3-97ae-c16533e9325a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:00:00 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-e54f6166-cc43-4248-8b55-34b3af6d6a79 tempest-TestServerVolumeAttachmentScenario-1780213436 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ea89414-89b6-4eaf-be5e-9f0dcc56ba82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:00:00 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-e54f6166-cc43-4248-8b55-34b3af6d6a79 tempest-TestServerVolumeAttachmentScenario-1780213436 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ea89414-89b6-4eaf-be5e-9f0dcc56ba82) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b4ff3daf-3d02-4ddd-aac2-e49ee57577aa', 'volume_name': 'volume-b4ff3daf-3d02-4ddd-aac2-e49ee57577aa', 'volume_size': 1}' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:00:00 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-e54f6166-cc43-4248-8b55-34b3af6d6a79 tempest-TestServerVolumeAttachmentScenario-1780213436 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07cc30b9-6c56-49b3-ab49-efa0e7a07b5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:00:00 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-e54f6166-cc43-4248-8b55-34b3af6d6a79 tempest-TestServerVolumeAttachmentScenario-1780213436 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07cc30b9-6c56-49b3-ab49-efa0e7a07b5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:00:00 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-e54f6166-cc43-4248-8b55-34b3af6d6a79 tempest-TestServerVolumeAttachmentScenario-1780213436 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a56041b2-9cfb-460e-bfff-f84269d64081) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:00:00 devstack cinder-volume[87272]: INFO cinder.volume.flows.manager.create_volume [None req-e54f6166-cc43-4248-8b55-34b3af6d6a79 tempest-TestServerVolumeAttachmentScenario-1780213436 None] Volume b4ff3daf-3d02-4ddd-aac2-e49ee57577aa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b4ff3daf-3d02-4ddd-aac2-e49ee57577aa', 'volume_size': 1} Nov 04 11:00:00 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-e54f6166-cc43-4248-8b55-34b3af6d6a79 tempest-TestServerVolumeAttachmentScenario-1780213436 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 11:00:00 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-eaa8cc41-c433-4dad-9398-dbf9239c4a70 tempest-SnapshotsActionsTest-1929562032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-46336612-417e-4879-916a-0b4221935d7f -F qcow2 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-46336612-417e-4879-916a-0b4221935d7f.7e49cd66-33cd-4c14-8069-bc249e5ebcbd" returned: 0 in 0.448s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:00:00 devstack cinder-volume[87272]: WARNING cinder.volume.drivers.remotefs [None req-eaa8cc41-c433-4dad-9398-dbf9239c4a70 tempest-SnapshotsActionsTest-1929562032 None] /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-46336612-417e-4879-916a-0b4221935d7f.7e49cd66-33cd-4c14-8069-bc249e5ebcbd is being set with open permissions: ugo+rw Nov 04 11:00:00 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-eaa8cc41-c433-4dad-9398-dbf9239c4a70 tempest-SnapshotsActionsTest-1929562032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-46336612-417e-4879-916a-0b4221935d7f.7e49cd66-33cd-4c14-8069-bc249e5ebcbd {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:00:00 devstack sudo[99472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-46336612-417e-4879-916a-0b4221935d7f.7e49cd66-33cd-4c14-8069-bc249e5ebcbd Nov 04 11:00:00 devstack sudo[99472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:00:00 devstack sudo[99472]: pam_unix(sudo:session): session closed for user root Nov 04 11:00:00 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-eaa8cc41-c433-4dad-9398-dbf9239c4a70 tempest-SnapshotsActionsTest-1929562032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-46336612-417e-4879-916a-0b4221935d7f.7e49cd66-33cd-4c14-8069-bc249e5ebcbd" returned: 0 in 0.323s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:00:00 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-eaa8cc41-c433-4dad-9398-dbf9239c4a70 tempest-SnapshotsActionsTest-1929562032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-46336612-417e-4879-916a-0b4221935d7f.info {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:00:00 devstack sudo[99475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-46336612-417e-4879-916a-0b4221935d7f.info Nov 04 11:00:00 devstack sudo[99475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:00:01 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-a15053f7-61c5-4ee4-b7a3-7c7df07d11a0 tempest-GroupsTest-1974299367 None] Group tempest-Group1-1736045483: creating Nov 04 11:00:01 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-a15053f7-61c5-4ee4-b7a3-7c7df07d11a0 tempest-GroupsTest-1974299367 None] Group tempest-Group1-1736045483: created successfully Nov 04 11:00:01 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-a15053f7-61c5-4ee4-b7a3-7c7df07d11a0 tempest-GroupsTest-1974299367 None] Create group completed successfully. Nov 04 11:00:01 devstack sudo[99475]: pam_unix(sudo:session): session closed for user root Nov 04 11:00:01 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-eaa8cc41-c433-4dad-9398-dbf9239c4a70 tempest-SnapshotsActionsTest-1929562032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-46336612-417e-4879-916a-0b4221935d7f.info" returned: 0 in 0.294s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:00:01 devstack cinder-volume[87272]: WARNING cinder.volume.drivers.remotefs [None req-eaa8cc41-c433-4dad-9398-dbf9239c4a70 tempest-SnapshotsActionsTest-1929562032 None] /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-46336612-417e-4879-916a-0b4221935d7f.info is being set with open permissions: ugo+rw Nov 04 11:00:01 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-eaa8cc41-c433-4dad-9398-dbf9239c4a70 tempest-SnapshotsActionsTest-1929562032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-46336612-417e-4879-916a-0b4221935d7f.info {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:00:01 devstack sudo[99478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-46336612-417e-4879-916a-0b4221935d7f.info Nov 04 11:00:01 devstack sudo[99478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:00:01 devstack sudo[99478]: pam_unix(sudo:session): session closed for user root Nov 04 11:00:01 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-eaa8cc41-c433-4dad-9398-dbf9239c4a70 tempest-SnapshotsActionsTest-1929562032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-46336612-417e-4879-916a-0b4221935d7f.info" returned: 0 in 0.280s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:00:01 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-eaa8cc41-c433-4dad-9398-dbf9239c4a70 tempest-SnapshotsActionsTest-1929562032 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.514s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 11:00:01 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-63735209-6905-440b-ad7c-fdfe6a01ef55 tempest-TestServerVolumeAttachmentScenario-1780213436 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.332s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 11:00:01 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-63735209-6905-440b-ad7c-fdfe6a01ef55 tempest-TestServerVolumeAttachmentScenario-1780213436 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T10:00:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1843969620',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ed2c409-12aa-418d-bc8a-71a138668e4e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='597a0d6c7b2647dc82d82fee268813c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T10:00:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T10:00:00Z,use_quota=True,user_id='b6974cfb045e47d7a6a9d70e55d94cc7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8989e4f-21e3-4f0a-9584-0d818784e883),volume_type_id=f8989e4f-21e3-4f0a-9584-0d818784e883)}" {{(pid=87272) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 04 11:00:01 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.remotefs [None req-63735209-6905-440b-ad7c-fdfe6a01ef55 tempest-TestServerVolumeAttachmentScenario-1780213436 None] Creating volume 0ed2c409-12aa-418d-bc8a-71a138668e4e {{(pid=87272) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 11:00:01 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-63735209-6905-440b-ad7c-fdfe6a01ef55 tempest-TestServerVolumeAttachmentScenario-1780213436 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 11:00:01 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-63735209-6905-440b-ad7c-fdfe6a01ef55 tempest-TestServerVolumeAttachmentScenario-1780213436 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 11:00:01 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-63735209-6905-440b-ad7c-fdfe6a01ef55 tempest-TestServerVolumeAttachmentScenario-1780213436 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898': None} {{(pid=87272) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 11:00:01 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-63735209-6905-440b-ad7c-fdfe6a01ef55 tempest-TestServerVolumeAttachmentScenario-1780213436 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'] {{(pid=87272) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 11:00:01 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-63735209-6905-440b-ad7c-fdfe6a01ef55 tempest-TestServerVolumeAttachmentScenario-1780213436 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 11:00:01 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-63735209-6905-440b-ad7c-fdfe6a01ef55 tempest-TestServerVolumeAttachmentScenario-1780213436 None] Selected osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898 as target Quobyte volume. {{(pid=87272) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 11:00:01 devstack cinder-volume[87272]: INFO cinder.volume.drivers.remotefs [None req-63735209-6905-440b-ad7c-fdfe6a01ef55 tempest-TestServerVolumeAttachmentScenario-1780213436 None] casted to osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898 Nov 04 11:00:01 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-63735209-6905-440b-ad7c-fdfe6a01ef55 tempest-TestServerVolumeAttachmentScenario-1780213436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-0ed2c409-12aa-418d-bc8a-71a138668e4e 1073741824 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:00:01 devstack sudo[99481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-0ed2c409-12aa-418d-bc8a-71a138668e4e 1073741824 Nov 04 11:00:01 devstack sudo[99481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:00:01 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-eaa8cc41-c433-4dad-9398-dbf9239c4a70 tempest-SnapshotsActionsTest-1929562032 None] Create snapshot completed successfully Nov 04 11:00:02 devstack sudo[99481]: pam_unix(sudo:session): session closed for user root Nov 04 11:00:02 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-63735209-6905-440b-ad7c-fdfe6a01ef55 tempest-TestServerVolumeAttachmentScenario-1780213436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-0ed2c409-12aa-418d-bc8a-71a138668e4e 1073741824" returned: 0 in 0.503s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:00:02 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-63735209-6905-440b-ad7c-fdfe6a01ef55 tempest-TestServerVolumeAttachmentScenario-1780213436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-0ed2c409-12aa-418d-bc8a-71a138668e4e {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:00:02 devstack sudo[99487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-0ed2c409-12aa-418d-bc8a-71a138668e4e Nov 04 11:00:02 devstack sudo[99487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:00:02 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-27c2a8b8-d2b1-438b-924a-371a5c1d0f71 tempest-GroupsTest-1974299367 None] Group tempest-Group2-2049433204: creating Nov 04 11:00:02 devstack sudo[99487]: pam_unix(sudo:session): session closed for user root Nov 04 11:00:02 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-63735209-6905-440b-ad7c-fdfe6a01ef55 tempest-TestServerVolumeAttachmentScenario-1780213436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-0ed2c409-12aa-418d-bc8a-71a138668e4e" returned: 0 in 0.301s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:00:02 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-63735209-6905-440b-ad7c-fdfe6a01ef55 tempest-TestServerVolumeAttachmentScenario-1780213436 None] <== create_volume: return (864ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'} {{(pid=87272) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 04 11:00:02 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-63735209-6905-440b-ad7c-fdfe6a01ef55 tempest-TestServerVolumeAttachmentScenario-1780213436 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.869s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 11:00:02 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-e54f6166-cc43-4248-8b55-34b3af6d6a79 tempest-TestServerVolumeAttachmentScenario-1780213436 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.848s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 11:00:02 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-e54f6166-cc43-4248-8b55-34b3af6d6a79 tempest-TestServerVolumeAttachmentScenario-1780213436 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T10:00:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-2041752812',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b4ff3daf-3d02-4ddd-aac2-e49ee57577aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='597a0d6c7b2647dc82d82fee268813c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T10:00:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T10:00:00Z,use_quota=True,user_id='b6974cfb045e47d7a6a9d70e55d94cc7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8989e4f-21e3-4f0a-9584-0d818784e883),volume_type_id=f8989e4f-21e3-4f0a-9584-0d818784e883)}" {{(pid=87272) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 04 11:00:02 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.remotefs [None req-e54f6166-cc43-4248-8b55-34b3af6d6a79 tempest-TestServerVolumeAttachmentScenario-1780213436 None] Creating volume b4ff3daf-3d02-4ddd-aac2-e49ee57577aa {{(pid=87272) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 11:00:02 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-e54f6166-cc43-4248-8b55-34b3af6d6a79 tempest-TestServerVolumeAttachmentScenario-1780213436 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 11:00:02 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-e54f6166-cc43-4248-8b55-34b3af6d6a79 tempest-TestServerVolumeAttachmentScenario-1780213436 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 11:00:02 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-e54f6166-cc43-4248-8b55-34b3af6d6a79 tempest-TestServerVolumeAttachmentScenario-1780213436 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898': None} {{(pid=87272) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 11:00:02 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-e54f6166-cc43-4248-8b55-34b3af6d6a79 tempest-TestServerVolumeAttachmentScenario-1780213436 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'] {{(pid=87272) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 11:00:02 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-e54f6166-cc43-4248-8b55-34b3af6d6a79 tempest-TestServerVolumeAttachmentScenario-1780213436 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 11:00:02 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-e54f6166-cc43-4248-8b55-34b3af6d6a79 tempest-TestServerVolumeAttachmentScenario-1780213436 None] Selected osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898 as target Quobyte volume. {{(pid=87272) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 11:00:02 devstack cinder-volume[87272]: INFO cinder.volume.drivers.remotefs [None req-e54f6166-cc43-4248-8b55-34b3af6d6a79 tempest-TestServerVolumeAttachmentScenario-1780213436 None] casted to osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898 Nov 04 11:00:02 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-e54f6166-cc43-4248-8b55-34b3af6d6a79 tempest-TestServerVolumeAttachmentScenario-1780213436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-b4ff3daf-3d02-4ddd-aac2-e49ee57577aa 1073741824 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:00:02 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-27c2a8b8-d2b1-438b-924a-371a5c1d0f71 tempest-GroupsTest-1974299367 None] Group tempest-Group2-2049433204: created successfully Nov 04 11:00:02 devstack sudo[99490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-b4ff3daf-3d02-4ddd-aac2-e49ee57577aa 1073741824 Nov 04 11:00:02 devstack sudo[99490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:00:02 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-63735209-6905-440b-ad7c-fdfe6a01ef55 tempest-TestServerVolumeAttachmentScenario-1780213436 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (553e3254-36a1-462f-b44d-c6f372b9506d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0ed2c409-12aa-418d-bc8a-71a138668e4e', 'volume_size': 1}' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:00:02 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-63735209-6905-440b-ad7c-fdfe6a01ef55 tempest-TestServerVolumeAttachmentScenario-1780213436 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (32a46806-1546-4183-aa2d-146961b0cdf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:00:02 devstack cinder-volume[87272]: INFO cinder.volume.flows.manager.create_volume [None req-63735209-6905-440b-ad7c-fdfe6a01ef55 tempest-TestServerVolumeAttachmentScenario-1780213436 None] Volume volume-0ed2c409-12aa-418d-bc8a-71a138668e4e (0ed2c409-12aa-418d-bc8a-71a138668e4e): created successfully Nov 04 11:00:02 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-63735209-6905-440b-ad7c-fdfe6a01ef55 tempest-TestServerVolumeAttachmentScenario-1780213436 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (32a46806-1546-4183-aa2d-146961b0cdf1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:00:02 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-63735209-6905-440b-ad7c-fdfe6a01ef55 tempest-TestServerVolumeAttachmentScenario-1780213436 None] Flow 'volume_create_manager' (b2cfb2c7-f3ee-4c7c-b58d-3c2d7e59514d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87272) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 11:00:02 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-27c2a8b8-d2b1-438b-924a-371a5c1d0f71 tempest-GroupsTest-1974299367 None] Create group completed successfully. Nov 04 11:00:02 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-63735209-6905-440b-ad7c-fdfe6a01ef55 tempest-TestServerVolumeAttachmentScenario-1780213436 None] Created volume successfully. Nov 04 11:00:02 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-d60821f7-1d68-44ad-93bc-6533d642ec19 tempest-SnapshotsActionsTest-1929562032 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 11:00:03 devstack sudo[99490]: pam_unix(sudo:session): session closed for user root Nov 04 11:00:03 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-e54f6166-cc43-4248-8b55-34b3af6d6a79 tempest-TestServerVolumeAttachmentScenario-1780213436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-b4ff3daf-3d02-4ddd-aac2-e49ee57577aa 1073741824" returned: 0 in 0.593s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:00:03 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-e54f6166-cc43-4248-8b55-34b3af6d6a79 tempest-TestServerVolumeAttachmentScenario-1780213436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-b4ff3daf-3d02-4ddd-aac2-e49ee57577aa {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:00:03 devstack sudo[99496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-b4ff3daf-3d02-4ddd-aac2-e49ee57577aa Nov 04 11:00:03 devstack sudo[99496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:00:03 devstack sudo[99496]: pam_unix(sudo:session): session closed for user root Nov 04 11:00:03 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-e54f6166-cc43-4248-8b55-34b3af6d6a79 tempest-TestServerVolumeAttachmentScenario-1780213436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-b4ff3daf-3d02-4ddd-aac2-e49ee57577aa" returned: 0 in 0.255s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:00:03 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-e54f6166-cc43-4248-8b55-34b3af6d6a79 tempest-TestServerVolumeAttachmentScenario-1780213436 None] <== create_volume: return (893ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'} {{(pid=87272) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 04 11:00:03 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-e54f6166-cc43-4248-8b55-34b3af6d6a79 tempest-TestServerVolumeAttachmentScenario-1780213436 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.896s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 11:00:03 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-d60821f7-1d68-44ad-93bc-6533d642ec19 tempest-SnapshotsActionsTest-1929562032 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.462s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 11:00:03 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-e54f6166-cc43-4248-8b55-34b3af6d6a79 tempest-TestServerVolumeAttachmentScenario-1780213436 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a56041b2-9cfb-460e-bfff-f84269d64081) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b4ff3daf-3d02-4ddd-aac2-e49ee57577aa', 'volume_size': 1}' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:00:03 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-e54f6166-cc43-4248-8b55-34b3af6d6a79 tempest-TestServerVolumeAttachmentScenario-1780213436 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9b50529-ff8f-48fe-b0c2-b7f97ff3c68e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:00:03 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.remotefs [None req-d60821f7-1d68-44ad-93bc-6533d642ec19 tempest-SnapshotsActionsTest-1929562032 None] Creating offline snapshot 059f5d9d-0120-4442-88bc-a095fbaa1b4f of volume 46336612-417e-4879-916a-0b4221935d7f {{(pid=87272) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 04 11:00:03 devstack cinder-volume[87272]: INFO cinder.volume.flows.manager.create_volume [None req-e54f6166-cc43-4248-8b55-34b3af6d6a79 tempest-TestServerVolumeAttachmentScenario-1780213436 None] Volume volume-b4ff3daf-3d02-4ddd-aac2-e49ee57577aa (b4ff3daf-3d02-4ddd-aac2-e49ee57577aa): created successfully Nov 04 11:00:03 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-e54f6166-cc43-4248-8b55-34b3af6d6a79 tempest-TestServerVolumeAttachmentScenario-1780213436 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9b50529-ff8f-48fe-b0c2-b7f97ff3c68e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:00:03 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-e54f6166-cc43-4248-8b55-34b3af6d6a79 tempest-TestServerVolumeAttachmentScenario-1780213436 None] Flow 'volume_create_manager' (8c167772-ef33-4128-973f-657fd651109b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87272) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 11:00:03 devstack cinder-volume[87272]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b1a2b90-f409-4d7b-9d4e-89dddf0af9d4]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 11:00:03 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-d60821f7-1d68-44ad-93bc-6533d642ec19 tempest-SnapshotsActionsTest-1929562032 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-46336612-417e-4879-916a-0b4221935d7f.7e49cd66-33cd-4c14-8069-bc249e5ebcbd {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:00:03 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-e54f6166-cc43-4248-8b55-34b3af6d6a79 tempest-TestServerVolumeAttachmentScenario-1780213436 None] Created volume successfully. Nov 04 11:00:03 devstack sudo[99499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-46336612-417e-4879-916a-0b4221935d7f.7e49cd66-33cd-4c14-8069-bc249e5ebcbd Nov 04 11:00:03 devstack sudo[99499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:00:04 devstack sudo[99499]: pam_unix(sudo:session): session closed for user root Nov 04 11:00:04 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-d60821f7-1d68-44ad-93bc-6533d642ec19 tempest-SnapshotsActionsTest-1929562032 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-46336612-417e-4879-916a-0b4221935d7f.7e49cd66-33cd-4c14-8069-bc249e5ebcbd" returned: 0 in 0.684s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:00:04 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.remotefs [None req-d60821f7-1d68-44ad-93bc-6533d642ec19 tempest-SnapshotsActionsTest-1929562032 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-46336612-417e-4879-916a-0b4221935d7f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87272) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 11:00:04 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-d60821f7-1d68-44ad-93bc-6533d642ec19 tempest-SnapshotsActionsTest-1929562032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-46336612-417e-4879-916a-0b4221935d7f.7e49cd66-33cd-4c14-8069-bc249e5ebcbd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-46336612-417e-4879-916a-0b4221935d7f.059f5d9d-0120-4442-88bc-a095fbaa1b4f 1G {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:00:04 devstack sudo[99507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-46336612-417e-4879-916a-0b4221935d7f.7e49cd66-33cd-4c14-8069-bc249e5ebcbd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-46336612-417e-4879-916a-0b4221935d7f.059f5d9d-0120-4442-88bc-a095fbaa1b4f 1G Nov 04 11:00:04 devstack sudo[99507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:00:04 devstack cinder-volume[87272]: DEBUG cinder.volume.flows.manager.create_volume [None req-1f53766f-cf25-4c1d-a228-6054702f026b tempest-GroupsTest-1974299367 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87272) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 11:00:04 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-1f53766f-cf25-4c1d-a228-6054702f026b tempest-GroupsTest-1974299367 None] Flow 'volume_create_manager' (5eb15b5d-0816-4c5e-9788-45c8b0b9a378) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 11:00:04 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-1f53766f-cf25-4c1d-a228-6054702f026b tempest-GroupsTest-1974299367 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5011b54-7540-402b-9b56-97b3df618d8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:00:04 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-1f53766f-cf25-4c1d-a228-6054702f026b tempest-GroupsTest-1974299367 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5011b54-7540-402b-9b56-97b3df618d8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T10:00:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1204066828',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=797640cd-29ee-4536-b8d1-8e63ecde51ea,host='devstack@QuobyteHD#QuobyteHD',id=a14908f7-3789-4f74-bd0e-55d0ecbd69f0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c11ecc2479e48b7994f620ee5b75a68',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T10:00:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T10:00:04Z,use_quota=True,user_id='a45c797c53b54da8aa3776c65df93f7f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5a19e368-b18a-4e2c-b104-69c8848e4f47),volume_type_id=5a19e368-b18a-4e2c-b104-69c8848e4f47)' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:00:04 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-1f53766f-cf25-4c1d-a228-6054702f026b tempest-GroupsTest-1974299367 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (efb2d739-3a3b-498f-b8cf-893a44321655) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:00:04 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-1f53766f-cf25-4c1d-a228-6054702f026b tempest-GroupsTest-1974299367 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (efb2d739-3a3b-498f-b8cf-893a44321655) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:00:04 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-1f53766f-cf25-4c1d-a228-6054702f026b tempest-GroupsTest-1974299367 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f1dfa983-0293-4e20-a98f-1cfaad7ad9b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:00:04 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-1f53766f-cf25-4c1d-a228-6054702f026b tempest-GroupsTest-1974299367 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f1dfa983-0293-4e20-a98f-1cfaad7ad9b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a14908f7-3789-4f74-bd0e-55d0ecbd69f0', 'volume_name': 'volume-a14908f7-3789-4f74-bd0e-55d0ecbd69f0', 'volume_size': 1}' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:00:04 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-1f53766f-cf25-4c1d-a228-6054702f026b tempest-GroupsTest-1974299367 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ee244b4-75a0-4393-8e84-267b34ec070a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:00:04 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-1f53766f-cf25-4c1d-a228-6054702f026b tempest-GroupsTest-1974299367 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ee244b4-75a0-4393-8e84-267b34ec070a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:00:04 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-1f53766f-cf25-4c1d-a228-6054702f026b tempest-GroupsTest-1974299367 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bcfab328-2083-4e81-854c-cb3e3c06fd5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:00:04 devstack cinder-volume[87272]: INFO cinder.volume.flows.manager.create_volume [None req-1f53766f-cf25-4c1d-a228-6054702f026b tempest-GroupsTest-1974299367 None] Volume a14908f7-3789-4f74-bd0e-55d0ecbd69f0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a14908f7-3789-4f74-bd0e-55d0ecbd69f0', 'volume_size': 1} Nov 04 11:00:04 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-1f53766f-cf25-4c1d-a228-6054702f026b tempest-GroupsTest-1974299367 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 11:00:04 devstack sudo[99507]: pam_unix(sudo:session): session closed for user root Nov 04 11:00:04 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-d60821f7-1d68-44ad-93bc-6533d642ec19 tempest-SnapshotsActionsTest-1929562032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-46336612-417e-4879-916a-0b4221935d7f.7e49cd66-33cd-4c14-8069-bc249e5ebcbd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-46336612-417e-4879-916a-0b4221935d7f.059f5d9d-0120-4442-88bc-a095fbaa1b4f 1G" returned: 0 in 0.756s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:00:04 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-d60821f7-1d68-44ad-93bc-6533d642ec19 tempest-SnapshotsActionsTest-1929562032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-46336612-417e-4879-916a-0b4221935d7f.7e49cd66-33cd-4c14-8069-bc249e5ebcbd -F qcow2 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-46336612-417e-4879-916a-0b4221935d7f.059f5d9d-0120-4442-88bc-a095fbaa1b4f {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:00:04 devstack sudo[99513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-46336612-417e-4879-916a-0b4221935d7f.7e49cd66-33cd-4c14-8069-bc249e5ebcbd -F qcow2 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-46336612-417e-4879-916a-0b4221935d7f.059f5d9d-0120-4442-88bc-a095fbaa1b4f Nov 04 11:00:04 devstack sudo[99513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:00:05 devstack sudo[99513]: pam_unix(sudo:session): session closed for user root Nov 04 11:00:05 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-d60821f7-1d68-44ad-93bc-6533d642ec19 tempest-SnapshotsActionsTest-1929562032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-46336612-417e-4879-916a-0b4221935d7f.7e49cd66-33cd-4c14-8069-bc249e5ebcbd -F qcow2 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-46336612-417e-4879-916a-0b4221935d7f.059f5d9d-0120-4442-88bc-a095fbaa1b4f" returned: 0 in 0.335s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:00:05 devstack cinder-volume[87272]: WARNING cinder.volume.drivers.remotefs [None req-d60821f7-1d68-44ad-93bc-6533d642ec19 tempest-SnapshotsActionsTest-1929562032 None] /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-46336612-417e-4879-916a-0b4221935d7f.059f5d9d-0120-4442-88bc-a095fbaa1b4f is being set with open permissions: ugo+rw Nov 04 11:00:05 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-d60821f7-1d68-44ad-93bc-6533d642ec19 tempest-SnapshotsActionsTest-1929562032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-46336612-417e-4879-916a-0b4221935d7f.059f5d9d-0120-4442-88bc-a095fbaa1b4f {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:00:05 devstack sudo[99518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-46336612-417e-4879-916a-0b4221935d7f.059f5d9d-0120-4442-88bc-a095fbaa1b4f Nov 04 11:00:05 devstack sudo[99518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:00:05 devstack sudo[99518]: pam_unix(sudo:session): session closed for user root Nov 04 11:00:05 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-d60821f7-1d68-44ad-93bc-6533d642ec19 tempest-SnapshotsActionsTest-1929562032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-46336612-417e-4879-916a-0b4221935d7f.059f5d9d-0120-4442-88bc-a095fbaa1b4f" returned: 0 in 0.273s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:00:05 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-d60821f7-1d68-44ad-93bc-6533d642ec19 tempest-SnapshotsActionsTest-1929562032 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.255s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 11:00:05 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-1f53766f-cf25-4c1d-a228-6054702f026b tempest-GroupsTest-1974299367 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.110s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 11:00:05 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-1f53766f-cf25-4c1d-a228-6054702f026b tempest-GroupsTest-1974299367 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=797640cd-29ee-4536-b8d1-8e63ecde51ea,created_at=2026-11-04T10:00:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1204066828',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=797640cd-29ee-4536-b8d1-8e63ecde51ea,host='devstack@QuobyteHD#QuobyteHD',id=a14908f7-3789-4f74-bd0e-55d0ecbd69f0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c11ecc2479e48b7994f620ee5b75a68',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T10:00:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T10:00:04Z,use_quota=True,user_id='a45c797c53b54da8aa3776c65df93f7f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5a19e368-b18a-4e2c-b104-69c8848e4f47),volume_type_id=5a19e368-b18a-4e2c-b104-69c8848e4f47)}" {{(pid=87272) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 04 11:00:05 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.remotefs [None req-1f53766f-cf25-4c1d-a228-6054702f026b tempest-GroupsTest-1974299367 None] Creating volume a14908f7-3789-4f74-bd0e-55d0ecbd69f0 {{(pid=87272) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 11:00:05 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-1f53766f-cf25-4c1d-a228-6054702f026b tempest-GroupsTest-1974299367 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 11:00:05 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-1f53766f-cf25-4c1d-a228-6054702f026b tempest-GroupsTest-1974299367 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 11:00:05 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-1f53766f-cf25-4c1d-a228-6054702f026b tempest-GroupsTest-1974299367 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898': None} {{(pid=87272) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 11:00:05 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-1f53766f-cf25-4c1d-a228-6054702f026b tempest-GroupsTest-1974299367 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'] {{(pid=87272) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 11:00:05 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-1f53766f-cf25-4c1d-a228-6054702f026b tempest-GroupsTest-1974299367 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 11:00:05 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-1f53766f-cf25-4c1d-a228-6054702f026b tempest-GroupsTest-1974299367 None] Selected osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898 as target Quobyte volume. {{(pid=87272) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 11:00:05 devstack cinder-volume[87272]: INFO cinder.volume.drivers.remotefs [None req-1f53766f-cf25-4c1d-a228-6054702f026b tempest-GroupsTest-1974299367 None] casted to osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898 Nov 04 11:00:05 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-1f53766f-cf25-4c1d-a228-6054702f026b tempest-GroupsTest-1974299367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-a14908f7-3789-4f74-bd0e-55d0ecbd69f0 1073741824 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:00:05 devstack sudo[99521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-a14908f7-3789-4f74-bd0e-55d0ecbd69f0 1073741824 Nov 04 11:00:05 devstack sudo[99521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:00:05 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-d60821f7-1d68-44ad-93bc-6533d642ec19 tempest-SnapshotsActionsTest-1929562032 None] Create snapshot completed successfully Nov 04 11:00:06 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-e9696d29-d8b7-45c4-adad-fc2d9e7c97b9 tempest-SnapshotsActionsTest-824471239 None] Acquiring lock "cinder-059f5d9d-0120-4442-88bc-a095fbaa1b4f-delete_snapshot" by "delete_snapshot" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 11:00:06 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-e9696d29-d8b7-45c4-adad-fc2d9e7c97b9 tempest-SnapshotsActionsTest-824471239 None] Lock "cinder-059f5d9d-0120-4442-88bc-a095fbaa1b4f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 11:00:06 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-e9696d29-d8b7-45c4-adad-fc2d9e7c97b9 tempest-SnapshotsActionsTest-824471239 None] Acquiring lock "cinder-quobyte-46336612-417e-4879-916a-0b4221935d7f" by "delete_snapshot" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 11:00:06 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-e9696d29-d8b7-45c4-adad-fc2d9e7c97b9 tempest-SnapshotsActionsTest-824471239 None] Lock "cinder-quobyte-46336612-417e-4879-916a-0b4221935d7f" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 11:00:06 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-e9696d29-d8b7-45c4-adad-fc2d9e7c97b9 tempest-SnapshotsActionsTest-824471239 None] Acquiring lock "cinder-quobyte-059f5d9d-0120-4442-88bc-a095fbaa1b4f" by "_delete_snapshot" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 11:00:06 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-e9696d29-d8b7-45c4-adad-fc2d9e7c97b9 tempest-SnapshotsActionsTest-824471239 None] Lock "cinder-quobyte-059f5d9d-0120-4442-88bc-a095fbaa1b4f" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 11:00:06 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.remotefs [None req-e9696d29-d8b7-45c4-adad-fc2d9e7c97b9 tempest-SnapshotsActionsTest-824471239 None] Deleting offline snapshot 059f5d9d-0120-4442-88bc-a095fbaa1b4f of volume 46336612-417e-4879-916a-0b4221935d7f {{(pid=87272) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 04 11:00:06 devstack sudo[99521]: pam_unix(sudo:session): session closed for user root Nov 04 11:00:06 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.remotefs [None req-e9696d29-d8b7-45c4-adad-fc2d9e7c97b9 tempest-SnapshotsActionsTest-824471239 None] snapshot_file for this snap is: volume-46336612-417e-4879-916a-0b4221935d7f.059f5d9d-0120-4442-88bc-a095fbaa1b4f {{(pid=87272) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 04 11:00:06 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-1f53766f-cf25-4c1d-a228-6054702f026b tempest-GroupsTest-1974299367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-a14908f7-3789-4f74-bd0e-55d0ecbd69f0 1073741824" returned: 0 in 0.708s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:00:06 devstack cinder-volume[87272]: DEBUG oslo.privsep.daemon [-] privsep: reply[19fcdd86-650c-4334-9516-8f677b314a94]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 11:00:06 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-e9696d29-d8b7-45c4-adad-fc2d9e7c97b9 tempest-SnapshotsActionsTest-824471239 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-46336612-417e-4879-916a-0b4221935d7f.059f5d9d-0120-4442-88bc-a095fbaa1b4f {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:00:06 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-1f53766f-cf25-4c1d-a228-6054702f026b tempest-GroupsTest-1974299367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-a14908f7-3789-4f74-bd0e-55d0ecbd69f0 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:00:06 devstack sudo[99535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-a14908f7-3789-4f74-bd0e-55d0ecbd69f0 Nov 04 11:00:06 devstack sudo[99535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:00:06 devstack sudo[99534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-46336612-417e-4879-916a-0b4221935d7f.059f5d9d-0120-4442-88bc-a095fbaa1b4f Nov 04 11:00:06 devstack sudo[99534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:00:06 devstack sudo[99535]: pam_unix(sudo:session): session closed for user root Nov 04 11:00:06 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-1f53766f-cf25-4c1d-a228-6054702f026b tempest-GroupsTest-1974299367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-a14908f7-3789-4f74-bd0e-55d0ecbd69f0" returned: 0 in 0.335s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:00:06 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-1f53766f-cf25-4c1d-a228-6054702f026b tempest-GroupsTest-1974299367 None] <== create_volume: return (1107ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'} {{(pid=87272) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 04 11:00:06 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-1f53766f-cf25-4c1d-a228-6054702f026b tempest-GroupsTest-1974299367 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.110s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 11:00:06 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-1f53766f-cf25-4c1d-a228-6054702f026b tempest-GroupsTest-1974299367 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bcfab328-2083-4e81-854c-cb3e3c06fd5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a14908f7-3789-4f74-bd0e-55d0ecbd69f0', 'volume_size': 1}' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:00:06 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-1f53766f-cf25-4c1d-a228-6054702f026b tempest-GroupsTest-1974299367 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c3d5905-4d37-49ad-9d89-7f7b3230d8ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:00:06 devstack cinder-volume[87272]: INFO cinder.volume.flows.manager.create_volume [None req-1f53766f-cf25-4c1d-a228-6054702f026b tempest-GroupsTest-1974299367 None] Volume volume-a14908f7-3789-4f74-bd0e-55d0ecbd69f0 (a14908f7-3789-4f74-bd0e-55d0ecbd69f0): created successfully Nov 04 11:00:06 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-1f53766f-cf25-4c1d-a228-6054702f026b tempest-GroupsTest-1974299367 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c3d5905-4d37-49ad-9d89-7f7b3230d8ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:00:06 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-1f53766f-cf25-4c1d-a228-6054702f026b tempest-GroupsTest-1974299367 None] Flow 'volume_create_manager' (5eb15b5d-0816-4c5e-9788-45c8b0b9a378) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87272) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 11:00:06 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-1f53766f-cf25-4c1d-a228-6054702f026b tempest-GroupsTest-1974299367 None] Created volume successfully. Nov 04 11:00:06 devstack sudo[99534]: pam_unix(sudo:session): session closed for user root Nov 04 11:00:06 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-e9696d29-d8b7-45c4-adad-fc2d9e7c97b9 tempest-SnapshotsActionsTest-824471239 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-46336612-417e-4879-916a-0b4221935d7f.059f5d9d-0120-4442-88bc-a095fbaa1b4f" returned: 0 in 0.600s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:00:06 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.remotefs [None req-e9696d29-d8b7-45c4-adad-fc2d9e7c97b9 tempest-SnapshotsActionsTest-824471239 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-46336612-417e-4879-916a-0b4221935d7f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87272) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 11:00:07 devstack cinder-volume[87272]: DEBUG oslo.privsep.daemon [-] privsep: reply[0392286c-09e2-46a9-af99-05317dc7e067]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 11:00:07 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-e9696d29-d8b7-45c4-adad-fc2d9e7c97b9 tempest-SnapshotsActionsTest-824471239 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-46336612-417e-4879-916a-0b4221935d7f.7e49cd66-33cd-4c14-8069-bc249e5ebcbd {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:00:07 devstack sudo[99553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-46336612-417e-4879-916a-0b4221935d7f.7e49cd66-33cd-4c14-8069-bc249e5ebcbd Nov 04 11:00:07 devstack sudo[99553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:00:07 devstack sudo[99553]: pam_unix(sudo:session): session closed for user root Nov 04 11:00:07 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-e9696d29-d8b7-45c4-adad-fc2d9e7c97b9 tempest-SnapshotsActionsTest-824471239 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-46336612-417e-4879-916a-0b4221935d7f.7e49cd66-33cd-4c14-8069-bc249e5ebcbd" returned: 0 in 0.484s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:00:07 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.remotefs [None req-e9696d29-d8b7-45c4-adad-fc2d9e7c97b9 tempest-SnapshotsActionsTest-824471239 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-46336612-417e-4879-916a-0b4221935d7f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87272) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 11:00:07 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-e9696d29-d8b7-45c4-adad-fc2d9e7c97b9 tempest-SnapshotsActionsTest-824471239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-46336612-417e-4879-916a-0b4221935d7f.059f5d9d-0120-4442-88bc-a095fbaa1b4f {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:00:07 devstack sudo[99558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-46336612-417e-4879-916a-0b4221935d7f.059f5d9d-0120-4442-88bc-a095fbaa1b4f Nov 04 11:00:07 devstack sudo[99558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:00:08 devstack sudo[99558]: pam_unix(sudo:session): session closed for user root Nov 04 11:00:08 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-e9696d29-d8b7-45c4-adad-fc2d9e7c97b9 tempest-SnapshotsActionsTest-824471239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-46336612-417e-4879-916a-0b4221935d7f.059f5d9d-0120-4442-88bc-a095fbaa1b4f" returned: 0 in 0.507s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:00:08 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-e9696d29-d8b7-45c4-adad-fc2d9e7c97b9 tempest-SnapshotsActionsTest-824471239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-46336612-417e-4879-916a-0b4221935d7f.059f5d9d-0120-4442-88bc-a095fbaa1b4f {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:00:08 devstack sudo[99566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-46336612-417e-4879-916a-0b4221935d7f.059f5d9d-0120-4442-88bc-a095fbaa1b4f Nov 04 11:00:08 devstack sudo[99566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:00:08 devstack sudo[99566]: pam_unix(sudo:session): session closed for user root Nov 04 11:00:08 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-e9696d29-d8b7-45c4-adad-fc2d9e7c97b9 tempest-SnapshotsActionsTest-824471239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-46336612-417e-4879-916a-0b4221935d7f.059f5d9d-0120-4442-88bc-a095fbaa1b4f" returned: 0 in 0.282s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:00:08 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-e9696d29-d8b7-45c4-adad-fc2d9e7c97b9 tempest-SnapshotsActionsTest-824471239 None] Lock "cinder-quobyte-059f5d9d-0120-4442-88bc-a095fbaa1b4f" released by "_delete_snapshot" :: held 2.087s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 11:00:08 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-e9696d29-d8b7-45c4-adad-fc2d9e7c97b9 tempest-SnapshotsActionsTest-824471239 None] Lock "cinder-quobyte-46336612-417e-4879-916a-0b4221935d7f" released by "delete_snapshot" :: held 2.117s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 11:00:08 devstack cinder-volume[87272]: DEBUG cinder.quota [None req-e9696d29-d8b7-45c4-adad-fc2d9e7c97b9 tempest-SnapshotsActionsTest-824471239 None] Created reservations ['5f96e6e2-8f50-4388-bc94-fa9e04da8eac', 'd582bc13-182b-4d13-bde7-24f59c95c513', 'dc8d766b-2c6b-407f-91b4-1fdafd8c2c5e', '5cb59e7a-b7e3-4cd2-9579-1935f5ba361f'] {{(pid=87272) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 11:00:08 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-e9696d29-d8b7-45c4-adad-fc2d9e7c97b9 tempest-SnapshotsActionsTest-824471239 None] Delete snapshot completed successfully. Nov 04 11:00:08 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-e9696d29-d8b7-45c4-adad-fc2d9e7c97b9 tempest-SnapshotsActionsTest-824471239 None] Lock "cinder-059f5d9d-0120-4442-88bc-a095fbaa1b4f-delete_snapshot" released by "delete_snapshot" :: held 2.362s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 11:00:08 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-ade3fa75-e8d3-4bcf-abbb-a436d4084d9e tempest-GroupsTest-1974299367 None] Acquiring lock "cinder-quobyte-a14908f7-3789-4f74-bd0e-55d0ecbd69f0" by "delete_volume" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 11:00:08 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-ade3fa75-e8d3-4bcf-abbb-a436d4084d9e tempest-GroupsTest-1974299367 None] Lock "cinder-quobyte-a14908f7-3789-4f74-bd0e-55d0ecbd69f0" acquired by "delete_volume" :: waited 0.037s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 11:00:08 devstack cinder-volume[87272]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea485c9c-1387-43ac-9ea4-854d622de182]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 11:00:08 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-ade3fa75-e8d3-4bcf-abbb-a436d4084d9e tempest-GroupsTest-1974299367 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-a14908f7-3789-4f74-bd0e-55d0ecbd69f0 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:00:08 devstack sudo[99570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-a14908f7-3789-4f74-bd0e-55d0ecbd69f0 Nov 04 11:00:08 devstack sudo[99570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:00:09 devstack sudo[99570]: pam_unix(sudo:session): session closed for user root Nov 04 11:00:09 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-ade3fa75-e8d3-4bcf-abbb-a436d4084d9e tempest-GroupsTest-1974299367 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-a14908f7-3789-4f74-bd0e-55d0ecbd69f0" returned: 0 in 0.469s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:00:09 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-ade3fa75-e8d3-4bcf-abbb-a436d4084d9e tempest-GroupsTest-1974299367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-a14908f7-3789-4f74-bd0e-55d0ecbd69f0 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:00:09 devstack sudo[99575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-a14908f7-3789-4f74-bd0e-55d0ecbd69f0 Nov 04 11:00:09 devstack sudo[99575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:00:09 devstack sudo[99575]: pam_unix(sudo:session): session closed for user root Nov 04 11:00:09 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-ade3fa75-e8d3-4bcf-abbb-a436d4084d9e tempest-GroupsTest-1974299367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-a14908f7-3789-4f74-bd0e-55d0ecbd69f0" returned: 0 in 0.605s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:00:09 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-ade3fa75-e8d3-4bcf-abbb-a436d4084d9e tempest-GroupsTest-1974299367 None] Lock "cinder-quobyte-a14908f7-3789-4f74-bd0e-55d0ecbd69f0" released by "delete_volume" :: held 1.162s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 11:00:10 devstack cinder-volume[87272]: DEBUG cinder.quota [None req-ade3fa75-e8d3-4bcf-abbb-a436d4084d9e tempest-GroupsTest-1974299367 None] Created reservations ['1aa280f3-e92d-42a5-be77-2a261c80a126'] {{(pid=87272) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 11:00:10 devstack cinder-volume[87272]: WARNING cinder.quota [None req-ade3fa75-e8d3-4bcf-abbb-a436d4084d9e tempest-GroupsTest-1974299367 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1011751424 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1011751424, it is now deprecated. Please use the default quota class for default quota. Nov 04 11:00:10 devstack cinder-volume[87272]: WARNING cinder.quota [None req-ade3fa75-e8d3-4bcf-abbb-a436d4084d9e tempest-GroupsTest-1974299367 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1011751424 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1011751424, it is now deprecated. Please use the default quota class for default quota. Nov 04 11:00:10 devstack cinder-volume[87272]: DEBUG cinder.quota [None req-ade3fa75-e8d3-4bcf-abbb-a436d4084d9e tempest-GroupsTest-1974299367 None] Created reservations ['b1aa6810-b859-464c-8cbd-63e5883d9392', 'e0b336bc-7098-4818-9f8d-7177be65f9d5', 'e89e4366-035a-4a7d-9618-27a9dec44e04', 'ff1db7db-a3db-4e5a-8f41-ea43ef920fe2'] {{(pid=87272) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 11:00:10 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-ade3fa75-e8d3-4bcf-abbb-a436d4084d9e tempest-GroupsTest-1974299367 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 11:00:10 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-ade3fa75-e8d3-4bcf-abbb-a436d4084d9e tempest-GroupsTest-1974299367 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 11:00:10 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-ade3fa75-e8d3-4bcf-abbb-a436d4084d9e tempest-GroupsTest-1974299367 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898': None} {{(pid=87272) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 11:00:10 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-ade3fa75-e8d3-4bcf-abbb-a436d4084d9e tempest-GroupsTest-1974299367 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'] {{(pid=87272) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 11:00:10 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-ade3fa75-e8d3-4bcf-abbb-a436d4084d9e tempest-GroupsTest-1974299367 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 11:00:10 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-ade3fa75-e8d3-4bcf-abbb-a436d4084d9e tempest-GroupsTest-1974299367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:00:10 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-e594f486-2b88-4760-8b90-3f8fcee9e493 tempest-SnapshotsActionsTest-1929562032 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 11:00:10 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-e594f486-2b88-4760-8b90-3f8fcee9e493 tempest-SnapshotsActionsTest-1929562032 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 11:00:10 devstack sudo[99636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1 Nov 04 11:00:10 devstack sudo[99636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:00:10 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.remotefs [None req-e594f486-2b88-4760-8b90-3f8fcee9e493 tempest-SnapshotsActionsTest-1929562032 None] Creating offline snapshot ed12d6a8-2f5d-41b3-8254-d6d381857df3 of volume 46336612-417e-4879-916a-0b4221935d7f {{(pid=87272) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 04 11:00:10 devstack cinder-volume[87272]: DEBUG oslo.privsep.daemon [-] privsep: reply[e574da32-13f2-4f01-bfb1-a1d0a0baf114]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 11:00:10 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-e594f486-2b88-4760-8b90-3f8fcee9e493 tempest-SnapshotsActionsTest-1929562032 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-46336612-417e-4879-916a-0b4221935d7f.7e49cd66-33cd-4c14-8069-bc249e5ebcbd {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:00:10 devstack sudo[99643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-46336612-417e-4879-916a-0b4221935d7f.7e49cd66-33cd-4c14-8069-bc249e5ebcbd Nov 04 11:00:10 devstack sudo[99643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:00:10 devstack sudo[99636]: pam_unix(sudo:session): session closed for user root Nov 04 11:00:10 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-ade3fa75-e8d3-4bcf-abbb-a436d4084d9e tempest-GroupsTest-1974299367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1" returned: 0 in 0.563s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:00:10 devstack cinder-volume[87272]: DEBUG cinder.manager [None req-ade3fa75-e8d3-4bcf-abbb-a436d4084d9e tempest-GroupsTest-1974299367 None] Notifying Schedulers of capabilities ... {{(pid=87272) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 11:00:10 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-ade3fa75-e8d3-4bcf-abbb-a436d4084d9e tempest-GroupsTest-1974299367 None] Delete group completed successfully. Nov 04 11:00:11 devstack sudo[99643]: pam_unix(sudo:session): session closed for user root Nov 04 11:00:11 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-e594f486-2b88-4760-8b90-3f8fcee9e493 tempest-SnapshotsActionsTest-1929562032 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-46336612-417e-4879-916a-0b4221935d7f.7e49cd66-33cd-4c14-8069-bc249e5ebcbd" returned: 0 in 0.505s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:00:11 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.remotefs [None req-e594f486-2b88-4760-8b90-3f8fcee9e493 tempest-SnapshotsActionsTest-1929562032 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-46336612-417e-4879-916a-0b4221935d7f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87272) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 11:00:11 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-e594f486-2b88-4760-8b90-3f8fcee9e493 tempest-SnapshotsActionsTest-1929562032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-46336612-417e-4879-916a-0b4221935d7f.7e49cd66-33cd-4c14-8069-bc249e5ebcbd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-46336612-417e-4879-916a-0b4221935d7f.ed12d6a8-2f5d-41b3-8254-d6d381857df3 1G {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:00:11 devstack sudo[99654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-46336612-417e-4879-916a-0b4221935d7f.7e49cd66-33cd-4c14-8069-bc249e5ebcbd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-46336612-417e-4879-916a-0b4221935d7f.ed12d6a8-2f5d-41b3-8254-d6d381857df3 1G Nov 04 11:00:11 devstack sudo[99654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:00:11 devstack cinder-volume[87272]: DEBUG cinder.quota [None req-f76c42ad-857e-4fd9-aa00-1dd56e770ddf tempest-GroupsTest-1974299367 None] Created reservations ['e292b787-de05-4761-b6b4-0753763be15a'] {{(pid=87272) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 11:00:11 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-f76c42ad-857e-4fd9-aa00-1dd56e770ddf tempest-GroupsTest-1974299367 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 11:00:11 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-f76c42ad-857e-4fd9-aa00-1dd56e770ddf tempest-GroupsTest-1974299367 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 11:00:11 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-f76c42ad-857e-4fd9-aa00-1dd56e770ddf tempest-GroupsTest-1974299367 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898': None} {{(pid=87272) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 11:00:11 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-f76c42ad-857e-4fd9-aa00-1dd56e770ddf tempest-GroupsTest-1974299367 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'] {{(pid=87272) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 11:00:11 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-f76c42ad-857e-4fd9-aa00-1dd56e770ddf tempest-GroupsTest-1974299367 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 11:00:11 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-f76c42ad-857e-4fd9-aa00-1dd56e770ddf tempest-GroupsTest-1974299367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:00:11 devstack sudo[99659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1 Nov 04 11:00:11 devstack sudo[99659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:00:11 devstack sudo[99654]: pam_unix(sudo:session): session closed for user root Nov 04 11:00:11 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-e594f486-2b88-4760-8b90-3f8fcee9e493 tempest-SnapshotsActionsTest-1929562032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-46336612-417e-4879-916a-0b4221935d7f.7e49cd66-33cd-4c14-8069-bc249e5ebcbd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-46336612-417e-4879-916a-0b4221935d7f.ed12d6a8-2f5d-41b3-8254-d6d381857df3 1G" returned: 0 in 0.706s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:00:11 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-e594f486-2b88-4760-8b90-3f8fcee9e493 tempest-SnapshotsActionsTest-1929562032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-46336612-417e-4879-916a-0b4221935d7f.7e49cd66-33cd-4c14-8069-bc249e5ebcbd -F qcow2 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-46336612-417e-4879-916a-0b4221935d7f.ed12d6a8-2f5d-41b3-8254-d6d381857df3 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:00:11 devstack sudo[99661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-46336612-417e-4879-916a-0b4221935d7f.7e49cd66-33cd-4c14-8069-bc249e5ebcbd -F qcow2 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-46336612-417e-4879-916a-0b4221935d7f.ed12d6a8-2f5d-41b3-8254-d6d381857df3 Nov 04 11:00:11 devstack sudo[99661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:00:12 devstack sudo[99659]: pam_unix(sudo:session): session closed for user root Nov 04 11:00:12 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-f76c42ad-857e-4fd9-aa00-1dd56e770ddf tempest-GroupsTest-1974299367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1" returned: 0 in 0.318s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:00:12 devstack cinder-volume[87272]: DEBUG cinder.manager [None req-f76c42ad-857e-4fd9-aa00-1dd56e770ddf tempest-GroupsTest-1974299367 None] Notifying Schedulers of capabilities ... {{(pid=87272) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 11:00:12 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-f76c42ad-857e-4fd9-aa00-1dd56e770ddf tempest-GroupsTest-1974299367 None] Delete group completed successfully. Nov 04 11:00:12 devstack sudo[99661]: pam_unix(sudo:session): session closed for user root Nov 04 11:00:12 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-e594f486-2b88-4760-8b90-3f8fcee9e493 tempest-SnapshotsActionsTest-1929562032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-46336612-417e-4879-916a-0b4221935d7f.7e49cd66-33cd-4c14-8069-bc249e5ebcbd -F qcow2 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-46336612-417e-4879-916a-0b4221935d7f.ed12d6a8-2f5d-41b3-8254-d6d381857df3" returned: 0 in 0.331s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:00:12 devstack cinder-volume[87272]: WARNING cinder.volume.drivers.remotefs [None req-e594f486-2b88-4760-8b90-3f8fcee9e493 tempest-SnapshotsActionsTest-1929562032 None] /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-46336612-417e-4879-916a-0b4221935d7f.ed12d6a8-2f5d-41b3-8254-d6d381857df3 is being set with open permissions: ugo+rw Nov 04 11:00:12 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-e594f486-2b88-4760-8b90-3f8fcee9e493 tempest-SnapshotsActionsTest-1929562032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-46336612-417e-4879-916a-0b4221935d7f.ed12d6a8-2f5d-41b3-8254-d6d381857df3 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:00:12 devstack sudo[99667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-46336612-417e-4879-916a-0b4221935d7f.ed12d6a8-2f5d-41b3-8254-d6d381857df3 Nov 04 11:00:12 devstack sudo[99667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:00:12 devstack sudo[99667]: pam_unix(sudo:session): session closed for user root Nov 04 11:00:12 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-e594f486-2b88-4760-8b90-3f8fcee9e493 tempest-SnapshotsActionsTest-1929562032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-46336612-417e-4879-916a-0b4221935d7f.ed12d6a8-2f5d-41b3-8254-d6d381857df3" returned: 0 in 0.280s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:00:12 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-e594f486-2b88-4760-8b90-3f8fcee9e493 tempest-SnapshotsActionsTest-1929562032 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.103s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 11:00:12 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-e594f486-2b88-4760-8b90-3f8fcee9e493 tempest-SnapshotsActionsTest-1929562032 None] Create snapshot completed successfully Nov 04 11:00:13 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-623fa4c7-d8d9-4102-9b57-5544c6f27b25 tempest-GroupsTest-1974299367 None] Group tempest-GroupsTest-Group-531972847: creating Nov 04 11:00:13 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-623fa4c7-d8d9-4102-9b57-5544c6f27b25 tempest-GroupsTest-1974299367 None] Group tempest-GroupsTest-Group-531972847: created successfully Nov 04 11:00:13 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-623fa4c7-d8d9-4102-9b57-5544c6f27b25 tempest-GroupsTest-1974299367 None] Create group completed successfully. Nov 04 11:00:13 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-ead6cc5d-1c3c-4d5d-a4d4-a7017ee25e94 tempest-SnapshotsActionsTest-824471239 None] Acquiring lock "cinder-ed12d6a8-2f5d-41b3-8254-d6d381857df3-delete_snapshot" by "delete_snapshot" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 11:00:13 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-ead6cc5d-1c3c-4d5d-a4d4-a7017ee25e94 tempest-SnapshotsActionsTest-824471239 None] Lock "cinder-ed12d6a8-2f5d-41b3-8254-d6d381857df3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 11:00:13 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-ead6cc5d-1c3c-4d5d-a4d4-a7017ee25e94 tempest-SnapshotsActionsTest-824471239 None] Acquiring lock "cinder-quobyte-46336612-417e-4879-916a-0b4221935d7f" by "delete_snapshot" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 11:00:13 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-ead6cc5d-1c3c-4d5d-a4d4-a7017ee25e94 tempest-SnapshotsActionsTest-824471239 None] Lock "cinder-quobyte-46336612-417e-4879-916a-0b4221935d7f" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 11:00:13 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-ead6cc5d-1c3c-4d5d-a4d4-a7017ee25e94 tempest-SnapshotsActionsTest-824471239 None] Acquiring lock "cinder-quobyte-ed12d6a8-2f5d-41b3-8254-d6d381857df3" by "_delete_snapshot" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 11:00:13 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-ead6cc5d-1c3c-4d5d-a4d4-a7017ee25e94 tempest-SnapshotsActionsTest-824471239 None] Lock "cinder-quobyte-ed12d6a8-2f5d-41b3-8254-d6d381857df3" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 11:00:13 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.remotefs [None req-ead6cc5d-1c3c-4d5d-a4d4-a7017ee25e94 tempest-SnapshotsActionsTest-824471239 None] Deleting offline snapshot ed12d6a8-2f5d-41b3-8254-d6d381857df3 of volume 46336612-417e-4879-916a-0b4221935d7f {{(pid=87272) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 04 11:00:13 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.remotefs [None req-ead6cc5d-1c3c-4d5d-a4d4-a7017ee25e94 tempest-SnapshotsActionsTest-824471239 None] snapshot_file for this snap is: volume-46336612-417e-4879-916a-0b4221935d7f.ed12d6a8-2f5d-41b3-8254-d6d381857df3 {{(pid=87272) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 04 11:00:13 devstack cinder-volume[87272]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad0c4087-aa15-4b8b-a83f-088ce2d7edb2]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 11:00:13 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-ead6cc5d-1c3c-4d5d-a4d4-a7017ee25e94 tempest-SnapshotsActionsTest-824471239 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-46336612-417e-4879-916a-0b4221935d7f.ed12d6a8-2f5d-41b3-8254-d6d381857df3 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:00:14 devstack sudo[99670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-46336612-417e-4879-916a-0b4221935d7f.ed12d6a8-2f5d-41b3-8254-d6d381857df3 Nov 04 11:00:14 devstack cinder-volume[87272]: DEBUG oslo_service.periodic_task [None req-236af0be-7f9d-4c80-b3d7-d645a9cd0dd1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87272) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 04 11:00:14 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-236af0be-7f9d-4c80-b3d7-d645a9cd0dd1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 11:00:14 devstack sudo[99670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:00:14 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-236af0be-7f9d-4c80-b3d7-d645a9cd0dd1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 11:00:14 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-236af0be-7f9d-4c80-b3d7-d645a9cd0dd1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898': None} {{(pid=87272) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 11:00:14 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-236af0be-7f9d-4c80-b3d7-d645a9cd0dd1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'] {{(pid=87272) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 11:00:14 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-236af0be-7f9d-4c80-b3d7-d645a9cd0dd1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 11:00:14 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-236af0be-7f9d-4c80-b3d7-d645a9cd0dd1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:00:14 devstack sudo[99672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1 Nov 04 11:00:14 devstack sudo[99672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:00:14 devstack sudo[99672]: pam_unix(sudo:session): session closed for user root Nov 04 11:00:14 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-236af0be-7f9d-4c80-b3d7-d645a9cd0dd1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1" returned: 0 in 0.318s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:00:14 devstack cinder-volume[87272]: DEBUG cinder.manager [None req-236af0be-7f9d-4c80-b3d7-d645a9cd0dd1 None None] Notifying Schedulers of capabilities ... {{(pid=87272) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 11:00:14 devstack cinder-volume[87272]: DEBUG oslo_service.periodic_task [None req-236af0be-7f9d-4c80-b3d7-d645a9cd0dd1 None None] Running periodic task VolumeManager._thread_info {{(pid=87272) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 04 11:00:14 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-236af0be-7f9d-4c80-b3d7-d645a9cd0dd1 None None] thread count: 28 {{(pid=87272) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 04 11:00:14 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-236af0be-7f9d-4c80-b3d7-d645a9cd0dd1 None None] thread info: [<_MainThread(MainThread, started 127085713244288)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87272) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 04 11:00:14 devstack sudo[99670]: pam_unix(sudo:session): session closed for user root Nov 04 11:00:14 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-ead6cc5d-1c3c-4d5d-a4d4-a7017ee25e94 tempest-SnapshotsActionsTest-824471239 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-46336612-417e-4879-916a-0b4221935d7f.ed12d6a8-2f5d-41b3-8254-d6d381857df3" returned: 0 in 0.586s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:00:14 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.remotefs [None req-ead6cc5d-1c3c-4d5d-a4d4-a7017ee25e94 tempest-SnapshotsActionsTest-824471239 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-46336612-417e-4879-916a-0b4221935d7f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87272) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 11:00:14 devstack cinder-volume[87272]: DEBUG oslo.privsep.daemon [-] privsep: reply[f396cd99-7764-4901-aa93-dbf654402510]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 11:00:14 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-ead6cc5d-1c3c-4d5d-a4d4-a7017ee25e94 tempest-SnapshotsActionsTest-824471239 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-46336612-417e-4879-916a-0b4221935d7f.7e49cd66-33cd-4c14-8069-bc249e5ebcbd {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:00:14 devstack sudo[99679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-46336612-417e-4879-916a-0b4221935d7f.7e49cd66-33cd-4c14-8069-bc249e5ebcbd Nov 04 11:00:14 devstack sudo[99679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:00:15 devstack sudo[99679]: pam_unix(sudo:session): session closed for user root Nov 04 11:00:15 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-ead6cc5d-1c3c-4d5d-a4d4-a7017ee25e94 tempest-SnapshotsActionsTest-824471239 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-46336612-417e-4879-916a-0b4221935d7f.7e49cd66-33cd-4c14-8069-bc249e5ebcbd" returned: 0 in 0.575s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:00:15 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.remotefs [None req-ead6cc5d-1c3c-4d5d-a4d4-a7017ee25e94 tempest-SnapshotsActionsTest-824471239 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-46336612-417e-4879-916a-0b4221935d7f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87272) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 11:00:15 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-ead6cc5d-1c3c-4d5d-a4d4-a7017ee25e94 tempest-SnapshotsActionsTest-824471239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-46336612-417e-4879-916a-0b4221935d7f.ed12d6a8-2f5d-41b3-8254-d6d381857df3 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:00:15 devstack sudo[99685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-46336612-417e-4879-916a-0b4221935d7f.ed12d6a8-2f5d-41b3-8254-d6d381857df3 Nov 04 11:00:15 devstack sudo[99685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:00:15 devstack cinder-volume[87272]: DEBUG cinder.volume.flows.manager.create_volume [None req-ae7c52ed-9a41-4ec3-a07e-905327891224 tempest-GroupsTest-1974299367 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87272) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 11:00:15 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-ae7c52ed-9a41-4ec3-a07e-905327891224 tempest-GroupsTest-1974299367 None] Flow 'volume_create_manager' (db943559-3bf4-4333-b922-c179a273c0c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 11:00:15 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-ae7c52ed-9a41-4ec3-a07e-905327891224 tempest-GroupsTest-1974299367 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3cacc554-d81f-44d4-93e2-a9b36f395e01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:00:15 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-ae7c52ed-9a41-4ec3-a07e-905327891224 tempest-GroupsTest-1974299367 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3cacc554-d81f-44d4-93e2-a9b36f395e01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T10:00:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1393569284',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=e9c77822-e262-4195-9083-dad7601e2f87,host='devstack@QuobyteHD#QuobyteHD',id=a0a0413e-9b5c-4ef9-bbec-36c3e3383e17,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c11ecc2479e48b7994f620ee5b75a68',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T10:00:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T10:00:15Z,use_quota=True,user_id='a45c797c53b54da8aa3776c65df93f7f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5768423-8985-4951-9837-3be3e74397e9),volume_type_id=e5768423-8985-4951-9837-3be3e74397e9)' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:00:15 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-ae7c52ed-9a41-4ec3-a07e-905327891224 tempest-GroupsTest-1974299367 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (832fa135-8338-481d-9512-c0fbc5984eb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:00:15 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-ae7c52ed-9a41-4ec3-a07e-905327891224 tempest-GroupsTest-1974299367 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (832fa135-8338-481d-9512-c0fbc5984eb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:00:15 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-ae7c52ed-9a41-4ec3-a07e-905327891224 tempest-GroupsTest-1974299367 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a7589c74-9337-47f1-8748-30c9f8af332c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:00:15 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-ae7c52ed-9a41-4ec3-a07e-905327891224 tempest-GroupsTest-1974299367 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a7589c74-9337-47f1-8748-30c9f8af332c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a0a0413e-9b5c-4ef9-bbec-36c3e3383e17', 'volume_name': 'volume-a0a0413e-9b5c-4ef9-bbec-36c3e3383e17', 'volume_size': 1}' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:00:15 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-ae7c52ed-9a41-4ec3-a07e-905327891224 tempest-GroupsTest-1974299367 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (078561d5-e19f-4af1-be47-7f4d84c11946) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:00:15 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-ae7c52ed-9a41-4ec3-a07e-905327891224 tempest-GroupsTest-1974299367 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (078561d5-e19f-4af1-be47-7f4d84c11946) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:00:15 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-ae7c52ed-9a41-4ec3-a07e-905327891224 tempest-GroupsTest-1974299367 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b850913-1370-44c7-a805-50b9306e89b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:00:15 devstack cinder-volume[87272]: INFO cinder.volume.flows.manager.create_volume [None req-ae7c52ed-9a41-4ec3-a07e-905327891224 tempest-GroupsTest-1974299367 None] Volume a0a0413e-9b5c-4ef9-bbec-36c3e3383e17: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a0a0413e-9b5c-4ef9-bbec-36c3e3383e17', 'volume_size': 1} Nov 04 11:00:15 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-ae7c52ed-9a41-4ec3-a07e-905327891224 tempest-GroupsTest-1974299367 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 11:00:15 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-ae7c52ed-9a41-4ec3-a07e-905327891224 tempest-GroupsTest-1974299367 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 11:00:15 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-ae7c52ed-9a41-4ec3-a07e-905327891224 tempest-GroupsTest-1974299367 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=e9c77822-e262-4195-9083-dad7601e2f87,created_at=2026-11-04T10:00:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1393569284',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=e9c77822-e262-4195-9083-dad7601e2f87,host='devstack@QuobyteHD#QuobyteHD',id=a0a0413e-9b5c-4ef9-bbec-36c3e3383e17,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c11ecc2479e48b7994f620ee5b75a68',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T10:00:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T10:00:15Z,use_quota=True,user_id='a45c797c53b54da8aa3776c65df93f7f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5768423-8985-4951-9837-3be3e74397e9),volume_type_id=e5768423-8985-4951-9837-3be3e74397e9)}" {{(pid=87272) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 04 11:00:15 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.remotefs [None req-ae7c52ed-9a41-4ec3-a07e-905327891224 tempest-GroupsTest-1974299367 None] Creating volume a0a0413e-9b5c-4ef9-bbec-36c3e3383e17 {{(pid=87272) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 11:00:15 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-ae7c52ed-9a41-4ec3-a07e-905327891224 tempest-GroupsTest-1974299367 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 11:00:15 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-ae7c52ed-9a41-4ec3-a07e-905327891224 tempest-GroupsTest-1974299367 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 11:00:15 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-ae7c52ed-9a41-4ec3-a07e-905327891224 tempest-GroupsTest-1974299367 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898': None} {{(pid=87272) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 11:00:15 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-ae7c52ed-9a41-4ec3-a07e-905327891224 tempest-GroupsTest-1974299367 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'] {{(pid=87272) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 11:00:15 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-ae7c52ed-9a41-4ec3-a07e-905327891224 tempest-GroupsTest-1974299367 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 11:00:15 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-ae7c52ed-9a41-4ec3-a07e-905327891224 tempest-GroupsTest-1974299367 None] Selected osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898 as target Quobyte volume. {{(pid=87272) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 11:00:15 devstack cinder-volume[87272]: INFO cinder.volume.drivers.remotefs [None req-ae7c52ed-9a41-4ec3-a07e-905327891224 tempest-GroupsTest-1974299367 None] casted to osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898 Nov 04 11:00:15 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-ae7c52ed-9a41-4ec3-a07e-905327891224 tempest-GroupsTest-1974299367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-a0a0413e-9b5c-4ef9-bbec-36c3e3383e17 1073741824 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:00:15 devstack sudo[99691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-a0a0413e-9b5c-4ef9-bbec-36c3e3383e17 1073741824 Nov 04 11:00:15 devstack sudo[99691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:00:15 devstack sudo[99685]: pam_unix(sudo:session): session closed for user root Nov 04 11:00:15 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-ead6cc5d-1c3c-4d5d-a4d4-a7017ee25e94 tempest-SnapshotsActionsTest-824471239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-46336612-417e-4879-916a-0b4221935d7f.ed12d6a8-2f5d-41b3-8254-d6d381857df3" returned: 0 in 0.566s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:00:15 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-ead6cc5d-1c3c-4d5d-a4d4-a7017ee25e94 tempest-SnapshotsActionsTest-824471239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-46336612-417e-4879-916a-0b4221935d7f.ed12d6a8-2f5d-41b3-8254-d6d381857df3 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:00:15 devstack sudo[99693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-46336612-417e-4879-916a-0b4221935d7f.ed12d6a8-2f5d-41b3-8254-d6d381857df3 Nov 04 11:00:15 devstack sudo[99693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:00:16 devstack sudo[99693]: pam_unix(sudo:session): session closed for user root Nov 04 11:00:16 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-ead6cc5d-1c3c-4d5d-a4d4-a7017ee25e94 tempest-SnapshotsActionsTest-824471239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-46336612-417e-4879-916a-0b4221935d7f.ed12d6a8-2f5d-41b3-8254-d6d381857df3" returned: 0 in 0.348s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:00:16 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-ead6cc5d-1c3c-4d5d-a4d4-a7017ee25e94 tempest-SnapshotsActionsTest-824471239 None] Lock "cinder-quobyte-ed12d6a8-2f5d-41b3-8254-d6d381857df3" released by "_delete_snapshot" :: held 2.282s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 11:00:16 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-ead6cc5d-1c3c-4d5d-a4d4-a7017ee25e94 tempest-SnapshotsActionsTest-824471239 None] Lock "cinder-quobyte-46336612-417e-4879-916a-0b4221935d7f" released by "delete_snapshot" :: held 2.322s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 11:00:16 devstack cinder-volume[87272]: DEBUG cinder.quota [None req-ead6cc5d-1c3c-4d5d-a4d4-a7017ee25e94 tempest-SnapshotsActionsTest-824471239 None] Created reservations ['3171fc86-dab9-44b1-855d-bc5ddc0989e1', '66fc8e54-31fc-487a-8ed4-66241a762b6c', 'f7289194-7f57-4bd5-a958-bfa06d8865e8', '0251c5a6-f99d-4d13-a5a7-ba831cf1847c'] {{(pid=87272) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 11:00:16 devstack sudo[99691]: pam_unix(sudo:session): session closed for user root Nov 04 11:00:16 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-ead6cc5d-1c3c-4d5d-a4d4-a7017ee25e94 tempest-SnapshotsActionsTest-824471239 None] Delete snapshot completed successfully. Nov 04 11:00:16 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-ae7c52ed-9a41-4ec3-a07e-905327891224 tempest-GroupsTest-1974299367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-a0a0413e-9b5c-4ef9-bbec-36c3e3383e17 1073741824" returned: 0 in 0.696s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:00:16 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-ead6cc5d-1c3c-4d5d-a4d4-a7017ee25e94 tempest-SnapshotsActionsTest-824471239 None] Lock "cinder-ed12d6a8-2f5d-41b3-8254-d6d381857df3-delete_snapshot" released by "delete_snapshot" :: held 2.567s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 11:00:16 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-ae7c52ed-9a41-4ec3-a07e-905327891224 tempest-GroupsTest-1974299367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-a0a0413e-9b5c-4ef9-bbec-36c3e3383e17 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:00:16 devstack sudo[99701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-a0a0413e-9b5c-4ef9-bbec-36c3e3383e17 Nov 04 11:00:16 devstack sudo[99701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:00:16 devstack sudo[99701]: pam_unix(sudo:session): session closed for user root Nov 04 11:00:16 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-ae7c52ed-9a41-4ec3-a07e-905327891224 tempest-GroupsTest-1974299367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-a0a0413e-9b5c-4ef9-bbec-36c3e3383e17" returned: 0 in 0.297s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:00:16 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-ae7c52ed-9a41-4ec3-a07e-905327891224 tempest-GroupsTest-1974299367 None] <== create_volume: return (1062ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'} {{(pid=87272) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 04 11:00:16 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-ae7c52ed-9a41-4ec3-a07e-905327891224 tempest-GroupsTest-1974299367 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.065s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 11:00:16 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-ae7c52ed-9a41-4ec3-a07e-905327891224 tempest-GroupsTest-1974299367 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b850913-1370-44c7-a805-50b9306e89b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a0a0413e-9b5c-4ef9-bbec-36c3e3383e17', 'volume_size': 1}' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:00:16 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-ae7c52ed-9a41-4ec3-a07e-905327891224 tempest-GroupsTest-1974299367 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f7625b6-09cd-42d3-82a7-32f4b8954bfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:00:16 devstack cinder-volume[87272]: INFO cinder.volume.flows.manager.create_volume [None req-ae7c52ed-9a41-4ec3-a07e-905327891224 tempest-GroupsTest-1974299367 None] Volume volume-a0a0413e-9b5c-4ef9-bbec-36c3e3383e17 (a0a0413e-9b5c-4ef9-bbec-36c3e3383e17): created successfully Nov 04 11:00:16 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-ae7c52ed-9a41-4ec3-a07e-905327891224 tempest-GroupsTest-1974299367 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f7625b6-09cd-42d3-82a7-32f4b8954bfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:00:16 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-ae7c52ed-9a41-4ec3-a07e-905327891224 tempest-GroupsTest-1974299367 None] Flow 'volume_create_manager' (db943559-3bf4-4333-b922-c179a273c0c5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87272) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 11:00:16 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-ae7c52ed-9a41-4ec3-a07e-905327891224 tempest-GroupsTest-1974299367 None] Created volume successfully. Nov 04 11:00:17 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-15a9b500-4afd-441e-8f6c-1a3e5b93bea4 tempest-SnapshotsActionsTest-1929562032 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 11:00:17 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-15a9b500-4afd-441e-8f6c-1a3e5b93bea4 tempest-SnapshotsActionsTest-1929562032 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 11:00:17 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.remotefs [None req-15a9b500-4afd-441e-8f6c-1a3e5b93bea4 tempest-SnapshotsActionsTest-1929562032 None] Creating offline snapshot ee44845b-06d7-429f-ac7f-dcb5859b59a7 of volume 46336612-417e-4879-916a-0b4221935d7f {{(pid=87272) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 04 11:00:17 devstack cinder-volume[87272]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2912a0e-6a10-4c67-8297-d177a43f8d10]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 11:00:17 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-15a9b500-4afd-441e-8f6c-1a3e5b93bea4 tempest-SnapshotsActionsTest-1929562032 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-46336612-417e-4879-916a-0b4221935d7f.7e49cd66-33cd-4c14-8069-bc249e5ebcbd {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:00:17 devstack sudo[99704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-46336612-417e-4879-916a-0b4221935d7f.7e49cd66-33cd-4c14-8069-bc249e5ebcbd Nov 04 11:00:17 devstack sudo[99704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:00:17 devstack sudo[99704]: pam_unix(sudo:session): session closed for user root Nov 04 11:00:17 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-15a9b500-4afd-441e-8f6c-1a3e5b93bea4 tempest-SnapshotsActionsTest-1929562032 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-46336612-417e-4879-916a-0b4221935d7f.7e49cd66-33cd-4c14-8069-bc249e5ebcbd" returned: 0 in 0.392s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:00:17 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.remotefs [None req-15a9b500-4afd-441e-8f6c-1a3e5b93bea4 tempest-SnapshotsActionsTest-1929562032 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-46336612-417e-4879-916a-0b4221935d7f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87272) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 11:00:17 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-15a9b500-4afd-441e-8f6c-1a3e5b93bea4 tempest-SnapshotsActionsTest-1929562032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-46336612-417e-4879-916a-0b4221935d7f.7e49cd66-33cd-4c14-8069-bc249e5ebcbd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-46336612-417e-4879-916a-0b4221935d7f.ee44845b-06d7-429f-ac7f-dcb5859b59a7 1G {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:00:17 devstack sudo[99709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-46336612-417e-4879-916a-0b4221935d7f.7e49cd66-33cd-4c14-8069-bc249e5ebcbd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-46336612-417e-4879-916a-0b4221935d7f.ee44845b-06d7-429f-ac7f-dcb5859b59a7 1G Nov 04 11:00:17 devstack sudo[99709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:00:18 devstack sudo[99709]: pam_unix(sudo:session): session closed for user root Nov 04 11:00:18 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-15a9b500-4afd-441e-8f6c-1a3e5b93bea4 tempest-SnapshotsActionsTest-1929562032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-46336612-417e-4879-916a-0b4221935d7f.7e49cd66-33cd-4c14-8069-bc249e5ebcbd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-46336612-417e-4879-916a-0b4221935d7f.ee44845b-06d7-429f-ac7f-dcb5859b59a7 1G" returned: 0 in 0.487s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:00:18 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-15a9b500-4afd-441e-8f6c-1a3e5b93bea4 tempest-SnapshotsActionsTest-1929562032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-46336612-417e-4879-916a-0b4221935d7f.7e49cd66-33cd-4c14-8069-bc249e5ebcbd -F qcow2 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-46336612-417e-4879-916a-0b4221935d7f.ee44845b-06d7-429f-ac7f-dcb5859b59a7 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:00:18 devstack sudo[99715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-46336612-417e-4879-916a-0b4221935d7f.7e49cd66-33cd-4c14-8069-bc249e5ebcbd -F qcow2 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-46336612-417e-4879-916a-0b4221935d7f.ee44845b-06d7-429f-ac7f-dcb5859b59a7 Nov 04 11:00:18 devstack sudo[99715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:00:18 devstack sudo[99715]: pam_unix(sudo:session): session closed for user root Nov 04 11:00:18 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-15a9b500-4afd-441e-8f6c-1a3e5b93bea4 tempest-SnapshotsActionsTest-1929562032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-46336612-417e-4879-916a-0b4221935d7f.7e49cd66-33cd-4c14-8069-bc249e5ebcbd -F qcow2 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-46336612-417e-4879-916a-0b4221935d7f.ee44845b-06d7-429f-ac7f-dcb5859b59a7" returned: 0 in 0.372s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:00:18 devstack cinder-volume[87272]: WARNING cinder.volume.drivers.remotefs [None req-15a9b500-4afd-441e-8f6c-1a3e5b93bea4 tempest-SnapshotsActionsTest-1929562032 None] /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-46336612-417e-4879-916a-0b4221935d7f.ee44845b-06d7-429f-ac7f-dcb5859b59a7 is being set with open permissions: ugo+rw Nov 04 11:00:18 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-15a9b500-4afd-441e-8f6c-1a3e5b93bea4 tempest-SnapshotsActionsTest-1929562032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-46336612-417e-4879-916a-0b4221935d7f.ee44845b-06d7-429f-ac7f-dcb5859b59a7 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:00:18 devstack sudo[99720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-46336612-417e-4879-916a-0b4221935d7f.ee44845b-06d7-429f-ac7f-dcb5859b59a7 Nov 04 11:00:18 devstack sudo[99720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:00:18 devstack cinder-volume[87272]: DEBUG cinder.volume.flows.manager.create_volume [None req-ed14058d-e2df-4728-a318-b9435ff353a1 tempest-GroupsTest-1974299367 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87272) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 11:00:18 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-ed14058d-e2df-4728-a318-b9435ff353a1 tempest-GroupsTest-1974299367 None] Flow 'volume_create_manager' (91b1afbc-0c2b-4281-95b2-f9ad031921c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 11:00:18 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-ed14058d-e2df-4728-a318-b9435ff353a1 tempest-GroupsTest-1974299367 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff1cc3f2-e310-45cc-85f5-41c272ddf52e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:00:18 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-ed14058d-e2df-4728-a318-b9435ff353a1 tempest-GroupsTest-1974299367 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff1cc3f2-e310-45cc-85f5-41c272ddf52e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T10:00:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1917700292',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=e9c77822-e262-4195-9083-dad7601e2f87,host='devstack@QuobyteHD#QuobyteHD',id=34f58600-03d3-4233-a393-3548387d357c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c11ecc2479e48b7994f620ee5b75a68',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T10:00:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T10:00:19Z,use_quota=True,user_id='a45c797c53b54da8aa3776c65df93f7f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5768423-8985-4951-9837-3be3e74397e9),volume_type_id=e5768423-8985-4951-9837-3be3e74397e9)' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:00:18 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-ed14058d-e2df-4728-a318-b9435ff353a1 tempest-GroupsTest-1974299367 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d338dc1-6584-491f-abff-37a80fadc720) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:00:18 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-ed14058d-e2df-4728-a318-b9435ff353a1 tempest-GroupsTest-1974299367 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d338dc1-6584-491f-abff-37a80fadc720) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:00:18 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-ed14058d-e2df-4728-a318-b9435ff353a1 tempest-GroupsTest-1974299367 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94d93ab9-39f4-4ee9-ae17-7857433461e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:00:18 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-ed14058d-e2df-4728-a318-b9435ff353a1 tempest-GroupsTest-1974299367 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94d93ab9-39f4-4ee9-ae17-7857433461e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '34f58600-03d3-4233-a393-3548387d357c', 'volume_name': 'volume-34f58600-03d3-4233-a393-3548387d357c', 'volume_size': 1}' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:00:18 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-ed14058d-e2df-4728-a318-b9435ff353a1 tempest-GroupsTest-1974299367 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (43bc95a9-7b0f-4491-b247-cd1ce0fa612d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:00:18 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-ed14058d-e2df-4728-a318-b9435ff353a1 tempest-GroupsTest-1974299367 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (43bc95a9-7b0f-4491-b247-cd1ce0fa612d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:00:18 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-ed14058d-e2df-4728-a318-b9435ff353a1 tempest-GroupsTest-1974299367 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c2e47f68-892e-4306-a51a-dc3fe6a20e5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:00:18 devstack cinder-volume[87272]: INFO cinder.volume.flows.manager.create_volume [None req-ed14058d-e2df-4728-a318-b9435ff353a1 tempest-GroupsTest-1974299367 None] Volume 34f58600-03d3-4233-a393-3548387d357c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-34f58600-03d3-4233-a393-3548387d357c', 'volume_size': 1} Nov 04 11:00:18 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-ed14058d-e2df-4728-a318-b9435ff353a1 tempest-GroupsTest-1974299367 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 11:00:19 devstack sudo[99720]: pam_unix(sudo:session): session closed for user root Nov 04 11:00:19 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-15a9b500-4afd-441e-8f6c-1a3e5b93bea4 tempest-SnapshotsActionsTest-1929562032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-46336612-417e-4879-916a-0b4221935d7f.ee44845b-06d7-429f-ac7f-dcb5859b59a7" returned: 0 in 0.381s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:00:19 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-15a9b500-4afd-441e-8f6c-1a3e5b93bea4 tempest-SnapshotsActionsTest-1929562032 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.737s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 11:00:19 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-ed14058d-e2df-4728-a318-b9435ff353a1 tempest-GroupsTest-1974299367 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.122s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 11:00:19 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-ed14058d-e2df-4728-a318-b9435ff353a1 tempest-GroupsTest-1974299367 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=e9c77822-e262-4195-9083-dad7601e2f87,created_at=2026-11-04T10:00:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1917700292',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=e9c77822-e262-4195-9083-dad7601e2f87,host='devstack@QuobyteHD#QuobyteHD',id=34f58600-03d3-4233-a393-3548387d357c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c11ecc2479e48b7994f620ee5b75a68',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T10:00:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T10:00:19Z,use_quota=True,user_id='a45c797c53b54da8aa3776c65df93f7f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5768423-8985-4951-9837-3be3e74397e9),volume_type_id=e5768423-8985-4951-9837-3be3e74397e9)}" {{(pid=87272) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 04 11:00:19 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.remotefs [None req-ed14058d-e2df-4728-a318-b9435ff353a1 tempest-GroupsTest-1974299367 None] Creating volume 34f58600-03d3-4233-a393-3548387d357c {{(pid=87272) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 11:00:19 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-ed14058d-e2df-4728-a318-b9435ff353a1 tempest-GroupsTest-1974299367 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 11:00:19 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-ed14058d-e2df-4728-a318-b9435ff353a1 tempest-GroupsTest-1974299367 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 11:00:19 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-ed14058d-e2df-4728-a318-b9435ff353a1 tempest-GroupsTest-1974299367 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898': None} {{(pid=87272) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 11:00:19 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-ed14058d-e2df-4728-a318-b9435ff353a1 tempest-GroupsTest-1974299367 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'] {{(pid=87272) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 11:00:19 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-ed14058d-e2df-4728-a318-b9435ff353a1 tempest-GroupsTest-1974299367 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 11:00:19 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-ed14058d-e2df-4728-a318-b9435ff353a1 tempest-GroupsTest-1974299367 None] Selected osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898 as target Quobyte volume. {{(pid=87272) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 11:00:19 devstack cinder-volume[87272]: INFO cinder.volume.drivers.remotefs [None req-ed14058d-e2df-4728-a318-b9435ff353a1 tempest-GroupsTest-1974299367 None] casted to osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898 Nov 04 11:00:19 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-ed14058d-e2df-4728-a318-b9435ff353a1 tempest-GroupsTest-1974299367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-34f58600-03d3-4233-a393-3548387d357c 1073741824 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:00:19 devstack sudo[99725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-34f58600-03d3-4233-a393-3548387d357c 1073741824 Nov 04 11:00:19 devstack sudo[99725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:00:19 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-15a9b500-4afd-441e-8f6c-1a3e5b93bea4 tempest-SnapshotsActionsTest-1929562032 None] Create snapshot completed successfully Nov 04 11:00:19 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-07248631-19d8-4910-8df2-97e34954dedb tempest-SnapshotsActionsTest-824471239 None] Acquiring lock "cinder-ee44845b-06d7-429f-ac7f-dcb5859b59a7-delete_snapshot" by "delete_snapshot" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 11:00:19 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-07248631-19d8-4910-8df2-97e34954dedb tempest-SnapshotsActionsTest-824471239 None] Lock "cinder-ee44845b-06d7-429f-ac7f-dcb5859b59a7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 11:00:19 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-07248631-19d8-4910-8df2-97e34954dedb tempest-SnapshotsActionsTest-824471239 None] Acquiring lock "cinder-quobyte-46336612-417e-4879-916a-0b4221935d7f" by "delete_snapshot" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 11:00:19 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-07248631-19d8-4910-8df2-97e34954dedb tempest-SnapshotsActionsTest-824471239 None] Lock "cinder-quobyte-46336612-417e-4879-916a-0b4221935d7f" acquired by "delete_snapshot" :: waited 0.044s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 11:00:19 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-07248631-19d8-4910-8df2-97e34954dedb tempest-SnapshotsActionsTest-824471239 None] Acquiring lock "cinder-quobyte-ee44845b-06d7-429f-ac7f-dcb5859b59a7" by "_delete_snapshot" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 11:00:19 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-07248631-19d8-4910-8df2-97e34954dedb tempest-SnapshotsActionsTest-824471239 None] Lock "cinder-quobyte-ee44845b-06d7-429f-ac7f-dcb5859b59a7" acquired by "_delete_snapshot" :: waited 0.033s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 11:00:19 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.remotefs [None req-07248631-19d8-4910-8df2-97e34954dedb tempest-SnapshotsActionsTest-824471239 None] Deleting offline snapshot ee44845b-06d7-429f-ac7f-dcb5859b59a7 of volume 46336612-417e-4879-916a-0b4221935d7f {{(pid=87272) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 04 11:00:19 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.remotefs [None req-07248631-19d8-4910-8df2-97e34954dedb tempest-SnapshotsActionsTest-824471239 None] snapshot_file for this snap is: volume-46336612-417e-4879-916a-0b4221935d7f.ee44845b-06d7-429f-ac7f-dcb5859b59a7 {{(pid=87272) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 04 11:00:19 devstack cinder-volume[87272]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ef16ba2-2da0-46b9-8624-e344d16e9508]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 11:00:19 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-07248631-19d8-4910-8df2-97e34954dedb tempest-SnapshotsActionsTest-824471239 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-46336612-417e-4879-916a-0b4221935d7f.ee44845b-06d7-429f-ac7f-dcb5859b59a7 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:00:19 devstack sudo[99725]: pam_unix(sudo:session): session closed for user root Nov 04 11:00:19 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-ed14058d-e2df-4728-a318-b9435ff353a1 tempest-GroupsTest-1974299367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-34f58600-03d3-4233-a393-3548387d357c 1073741824" returned: 0 in 0.705s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:00:19 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-ed14058d-e2df-4728-a318-b9435ff353a1 tempest-GroupsTest-1974299367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-34f58600-03d3-4233-a393-3548387d357c {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:00:19 devstack sudo[99734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-34f58600-03d3-4233-a393-3548387d357c Nov 04 11:00:19 devstack sudo[99734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:00:19 devstack sudo[99733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-46336612-417e-4879-916a-0b4221935d7f.ee44845b-06d7-429f-ac7f-dcb5859b59a7 Nov 04 11:00:19 devstack sudo[99733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:00:20 devstack sudo[99734]: pam_unix(sudo:session): session closed for user root Nov 04 11:00:20 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-ed14058d-e2df-4728-a318-b9435ff353a1 tempest-GroupsTest-1974299367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-34f58600-03d3-4233-a393-3548387d357c" returned: 0 in 0.536s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:00:20 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-ed14058d-e2df-4728-a318-b9435ff353a1 tempest-GroupsTest-1974299367 None] <== create_volume: return (1306ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'} {{(pid=87272) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 04 11:00:20 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-ed14058d-e2df-4728-a318-b9435ff353a1 tempest-GroupsTest-1974299367 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.309s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 11:00:20 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-ed14058d-e2df-4728-a318-b9435ff353a1 tempest-GroupsTest-1974299367 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c2e47f68-892e-4306-a51a-dc3fe6a20e5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-34f58600-03d3-4233-a393-3548387d357c', 'volume_size': 1}' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:00:20 devstack sudo[99733]: pam_unix(sudo:session): session closed for user root Nov 04 11:00:20 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-ed14058d-e2df-4728-a318-b9435ff353a1 tempest-GroupsTest-1974299367 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d084cf9c-93d2-42c5-80f6-b97613b747f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:00:20 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-07248631-19d8-4910-8df2-97e34954dedb tempest-SnapshotsActionsTest-824471239 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-46336612-417e-4879-916a-0b4221935d7f.ee44845b-06d7-429f-ac7f-dcb5859b59a7" returned: 0 in 0.649s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:00:20 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.remotefs [None req-07248631-19d8-4910-8df2-97e34954dedb tempest-SnapshotsActionsTest-824471239 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-46336612-417e-4879-916a-0b4221935d7f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87272) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 11:00:20 devstack cinder-volume[87272]: INFO cinder.volume.flows.manager.create_volume [None req-ed14058d-e2df-4728-a318-b9435ff353a1 tempest-GroupsTest-1974299367 None] Volume volume-34f58600-03d3-4233-a393-3548387d357c (34f58600-03d3-4233-a393-3548387d357c): created successfully Nov 04 11:00:20 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-ed14058d-e2df-4728-a318-b9435ff353a1 tempest-GroupsTest-1974299367 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d084cf9c-93d2-42c5-80f6-b97613b747f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:00:20 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-ed14058d-e2df-4728-a318-b9435ff353a1 tempest-GroupsTest-1974299367 None] Flow 'volume_create_manager' (91b1afbc-0c2b-4281-95b2-f9ad031921c1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87272) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 11:00:20 devstack cinder-volume[87272]: DEBUG oslo.privsep.daemon [-] privsep: reply[be978f40-2e6f-45af-8e53-12f14d7be7d0]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 11:00:20 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-07248631-19d8-4910-8df2-97e34954dedb tempest-SnapshotsActionsTest-824471239 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-46336612-417e-4879-916a-0b4221935d7f.7e49cd66-33cd-4c14-8069-bc249e5ebcbd {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:00:20 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-ed14058d-e2df-4728-a318-b9435ff353a1 tempest-GroupsTest-1974299367 None] Created volume successfully. Nov 04 11:00:20 devstack sudo[99742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-46336612-417e-4879-916a-0b4221935d7f.7e49cd66-33cd-4c14-8069-bc249e5ebcbd Nov 04 11:00:20 devstack sudo[99742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:00:21 devstack sudo[99742]: pam_unix(sudo:session): session closed for user root Nov 04 11:00:21 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-07248631-19d8-4910-8df2-97e34954dedb tempest-SnapshotsActionsTest-824471239 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-46336612-417e-4879-916a-0b4221935d7f.7e49cd66-33cd-4c14-8069-bc249e5ebcbd" returned: 0 in 0.592s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:00:21 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.remotefs [None req-07248631-19d8-4910-8df2-97e34954dedb tempest-SnapshotsActionsTest-824471239 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-46336612-417e-4879-916a-0b4221935d7f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87272) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 11:00:21 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-07248631-19d8-4910-8df2-97e34954dedb tempest-SnapshotsActionsTest-824471239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-46336612-417e-4879-916a-0b4221935d7f.ee44845b-06d7-429f-ac7f-dcb5859b59a7 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:00:21 devstack sudo[99758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-46336612-417e-4879-916a-0b4221935d7f.ee44845b-06d7-429f-ac7f-dcb5859b59a7 Nov 04 11:00:21 devstack sudo[99758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:00:21 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-ec771003-d6ec-4adc-8ba2-248297178420 tempest-GroupsTest-1974299367 None] Update group completed successfully. Nov 04 11:00:21 devstack sudo[99758]: pam_unix(sudo:session): session closed for user root Nov 04 11:00:21 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-07248631-19d8-4910-8df2-97e34954dedb tempest-SnapshotsActionsTest-824471239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-46336612-417e-4879-916a-0b4221935d7f.ee44845b-06d7-429f-ac7f-dcb5859b59a7" returned: 0 in 0.711s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:00:21 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-07248631-19d8-4910-8df2-97e34954dedb tempest-SnapshotsActionsTest-824471239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-46336612-417e-4879-916a-0b4221935d7f.ee44845b-06d7-429f-ac7f-dcb5859b59a7 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:00:21 devstack sudo[99764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-46336612-417e-4879-916a-0b4221935d7f.ee44845b-06d7-429f-ac7f-dcb5859b59a7 Nov 04 11:00:21 devstack sudo[99764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:00:22 devstack sudo[99764]: pam_unix(sudo:session): session closed for user root Nov 04 11:00:22 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-07248631-19d8-4910-8df2-97e34954dedb tempest-SnapshotsActionsTest-824471239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-46336612-417e-4879-916a-0b4221935d7f.ee44845b-06d7-429f-ac7f-dcb5859b59a7" returned: 0 in 0.320s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:00:22 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-07248631-19d8-4910-8df2-97e34954dedb tempest-SnapshotsActionsTest-824471239 None] Lock "cinder-quobyte-ee44845b-06d7-429f-ac7f-dcb5859b59a7" released by "_delete_snapshot" :: held 2.409s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 11:00:22 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-07248631-19d8-4910-8df2-97e34954dedb tempest-SnapshotsActionsTest-824471239 None] Lock "cinder-quobyte-46336612-417e-4879-916a-0b4221935d7f" released by "delete_snapshot" :: held 2.456s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 11:00:22 devstack cinder-volume[87272]: DEBUG cinder.quota [None req-07248631-19d8-4910-8df2-97e34954dedb tempest-SnapshotsActionsTest-824471239 None] Created reservations ['239bae79-c075-4ad3-9c1f-71749c2028c5', '66e60f1c-2337-4868-afd3-ea0c0a9ce1b1', '8975cc68-93b0-4ca8-83a9-41d69278b2b5', '54c617d1-6af3-404d-9d34-6c3d75a6a59e'] {{(pid=87272) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 11:00:22 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-07248631-19d8-4910-8df2-97e34954dedb tempest-SnapshotsActionsTest-824471239 None] Delete snapshot completed successfully. Nov 04 11:00:22 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-07248631-19d8-4910-8df2-97e34954dedb tempest-SnapshotsActionsTest-824471239 None] Lock "cinder-ee44845b-06d7-429f-ac7f-dcb5859b59a7-delete_snapshot" released by "delete_snapshot" :: held 2.721s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 11:00:23 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-4573ed33-cca1-4e80-8775-b2575b129593 tempest-GroupsTest-1974299367 None] Update group completed successfully. Nov 04 11:00:23 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-029de77b-aeb3-4d83-a986-2e14c07ae117 tempest-SnapshotsActionsTest-1929562032 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 11:00:23 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-029de77b-aeb3-4d83-a986-2e14c07ae117 tempest-SnapshotsActionsTest-1929562032 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 11:00:23 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.remotefs [None req-029de77b-aeb3-4d83-a986-2e14c07ae117 tempest-SnapshotsActionsTest-1929562032 None] Creating offline snapshot 6135bab8-0c01-4718-b95f-c7f56fd9b6ad of volume 46336612-417e-4879-916a-0b4221935d7f {{(pid=87272) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 04 11:00:23 devstack cinder-volume[87272]: INFO cinder.volume.manager [req-4e043faf-05c4-4264-aea2-720fff464262 req-95a25a0d-fc5e-4520-a7c5-ff3e8e52cc1e tempest-TestMinimumBasicScenario-423304152 None] Terminate volume connection completed successfully. Nov 04 11:00:23 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [req-4e043faf-05c4-4264-aea2-720fff464262 req-95a25a0d-fc5e-4520-a7c5-ff3e8e52cc1e tempest-TestMinimumBasicScenario-423304152 None] Deleting attachment 0e6a4df3-87a8-4718-bde3-8ce23cdf9a44. {{(pid=87272) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 04 11:00:23 devstack cinder-volume[87272]: DEBUG oslo.privsep.daemon [-] privsep: reply[350d86d3-1ddb-4539-8f9e-c4352d46b54f]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 11:00:23 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-029de77b-aeb3-4d83-a986-2e14c07ae117 tempest-SnapshotsActionsTest-1929562032 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-46336612-417e-4879-916a-0b4221935d7f.7e49cd66-33cd-4c14-8069-bc249e5ebcbd {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:00:23 devstack sudo[99773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-46336612-417e-4879-916a-0b4221935d7f.7e49cd66-33cd-4c14-8069-bc249e5ebcbd Nov 04 11:00:23 devstack sudo[99773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:00:24 devstack sudo[99773]: pam_unix(sudo:session): session closed for user root Nov 04 11:00:24 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-029de77b-aeb3-4d83-a986-2e14c07ae117 tempest-SnapshotsActionsTest-1929562032 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-46336612-417e-4879-916a-0b4221935d7f.7e49cd66-33cd-4c14-8069-bc249e5ebcbd" returned: 0 in 0.482s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:00:24 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.remotefs [None req-029de77b-aeb3-4d83-a986-2e14c07ae117 tempest-SnapshotsActionsTest-1929562032 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-46336612-417e-4879-916a-0b4221935d7f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87272) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 11:00:24 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-029de77b-aeb3-4d83-a986-2e14c07ae117 tempest-SnapshotsActionsTest-1929562032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-46336612-417e-4879-916a-0b4221935d7f.7e49cd66-33cd-4c14-8069-bc249e5ebcbd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-46336612-417e-4879-916a-0b4221935d7f.6135bab8-0c01-4718-b95f-c7f56fd9b6ad 1G {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:00:24 devstack sudo[99797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-46336612-417e-4879-916a-0b4221935d7f.7e49cd66-33cd-4c14-8069-bc249e5ebcbd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-46336612-417e-4879-916a-0b4221935d7f.6135bab8-0c01-4718-b95f-c7f56fd9b6ad 1G Nov 04 11:00:24 devstack sudo[99797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:00:24 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-31dbe7f0-826e-4b91-a78b-badd501d59d8 tempest-TestMinimumBasicScenario-423304152 None] Acquiring lock "cinder-a2187971-7944-4eb9-a57d-41ad89a3a539-delete_volume" by "delete_volume" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 11:00:24 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-31dbe7f0-826e-4b91-a78b-badd501d59d8 tempest-TestMinimumBasicScenario-423304152 None] Lock "cinder-a2187971-7944-4eb9-a57d-41ad89a3a539-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 11:00:24 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-31dbe7f0-826e-4b91-a78b-badd501d59d8 tempest-TestMinimumBasicScenario-423304152 None] Acquiring lock "cinder-quobyte-a2187971-7944-4eb9-a57d-41ad89a3a539" by "delete_volume" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 11:00:24 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-31dbe7f0-826e-4b91-a78b-badd501d59d8 tempest-TestMinimumBasicScenario-423304152 None] Lock "cinder-quobyte-a2187971-7944-4eb9-a57d-41ad89a3a539" acquired by "delete_volume" :: waited 0.020s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 11:00:24 devstack cinder-volume[87272]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5b9a558-1b45-4b81-bcb7-c90650fc78e7]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 11:00:24 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-31dbe7f0-826e-4b91-a78b-badd501d59d8 tempest-TestMinimumBasicScenario-423304152 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-a2187971-7944-4eb9-a57d-41ad89a3a539 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:00:24 devstack sudo[99799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-a2187971-7944-4eb9-a57d-41ad89a3a539 Nov 04 11:00:24 devstack sudo[99799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:00:24 devstack sudo[99797]: pam_unix(sudo:session): session closed for user root Nov 04 11:00:24 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-029de77b-aeb3-4d83-a986-2e14c07ae117 tempest-SnapshotsActionsTest-1929562032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-46336612-417e-4879-916a-0b4221935d7f.7e49cd66-33cd-4c14-8069-bc249e5ebcbd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-46336612-417e-4879-916a-0b4221935d7f.6135bab8-0c01-4718-b95f-c7f56fd9b6ad 1G" returned: 0 in 0.541s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:00:24 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-029de77b-aeb3-4d83-a986-2e14c07ae117 tempest-SnapshotsActionsTest-1929562032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-46336612-417e-4879-916a-0b4221935d7f.7e49cd66-33cd-4c14-8069-bc249e5ebcbd -F qcow2 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-46336612-417e-4879-916a-0b4221935d7f.6135bab8-0c01-4718-b95f-c7f56fd9b6ad {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:00:24 devstack sudo[99805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-46336612-417e-4879-916a-0b4221935d7f.7e49cd66-33cd-4c14-8069-bc249e5ebcbd -F qcow2 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-46336612-417e-4879-916a-0b4221935d7f.6135bab8-0c01-4718-b95f-c7f56fd9b6ad Nov 04 11:00:24 devstack sudo[99805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:00:24 devstack sudo[99799]: pam_unix(sudo:session): session closed for user root Nov 04 11:00:24 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-31dbe7f0-826e-4b91-a78b-badd501d59d8 tempest-TestMinimumBasicScenario-423304152 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-a2187971-7944-4eb9-a57d-41ad89a3a539" returned: 0 in 0.446s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:00:24 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-31dbe7f0-826e-4b91-a78b-badd501d59d8 tempest-TestMinimumBasicScenario-423304152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-a2187971-7944-4eb9-a57d-41ad89a3a539 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:00:24 devstack sudo[99810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-a2187971-7944-4eb9-a57d-41ad89a3a539 Nov 04 11:00:24 devstack sudo[99810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:00:25 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-8bd43552-1666-408a-81d0-7db5a573fc40 tempest-GroupsTest-1974299367 None] Acquiring lock "cinder-quobyte-34f58600-03d3-4233-a393-3548387d357c" by "delete_volume" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 11:00:25 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-8bd43552-1666-408a-81d0-7db5a573fc40 tempest-GroupsTest-1974299367 None] Lock "cinder-quobyte-34f58600-03d3-4233-a393-3548387d357c" acquired by "delete_volume" :: waited 0.026s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 11:00:25 devstack cinder-volume[87272]: DEBUG oslo.privsep.daemon [-] privsep: reply[554888d6-5cfe-4e6c-b607-50dee97b3d77]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 11:00:25 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-8bd43552-1666-408a-81d0-7db5a573fc40 tempest-GroupsTest-1974299367 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-34f58600-03d3-4233-a393-3548387d357c {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:00:25 devstack sudo[99805]: pam_unix(sudo:session): session closed for user root Nov 04 11:00:25 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-029de77b-aeb3-4d83-a986-2e14c07ae117 tempest-SnapshotsActionsTest-1929562032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-46336612-417e-4879-916a-0b4221935d7f.7e49cd66-33cd-4c14-8069-bc249e5ebcbd -F qcow2 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-46336612-417e-4879-916a-0b4221935d7f.6135bab8-0c01-4718-b95f-c7f56fd9b6ad" returned: 0 in 0.412s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:00:25 devstack cinder-volume[87272]: WARNING cinder.volume.drivers.remotefs [None req-029de77b-aeb3-4d83-a986-2e14c07ae117 tempest-SnapshotsActionsTest-1929562032 None] /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-46336612-417e-4879-916a-0b4221935d7f.6135bab8-0c01-4718-b95f-c7f56fd9b6ad is being set with open permissions: ugo+rw Nov 04 11:00:25 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-029de77b-aeb3-4d83-a986-2e14c07ae117 tempest-SnapshotsActionsTest-1929562032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-46336612-417e-4879-916a-0b4221935d7f.6135bab8-0c01-4718-b95f-c7f56fd9b6ad {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:00:25 devstack sudo[99810]: pam_unix(sudo:session): session closed for user root Nov 04 11:00:25 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-31dbe7f0-826e-4b91-a78b-badd501d59d8 tempest-TestMinimumBasicScenario-423304152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-a2187971-7944-4eb9-a57d-41ad89a3a539" returned: 0 in 0.304s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:00:25 devstack sudo[99818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-46336612-417e-4879-916a-0b4221935d7f.6135bab8-0c01-4718-b95f-c7f56fd9b6ad Nov 04 11:00:25 devstack sudo[99818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:00:25 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-31dbe7f0-826e-4b91-a78b-badd501d59d8 tempest-TestMinimumBasicScenario-423304152 None] Lock "cinder-quobyte-a2187971-7944-4eb9-a57d-41ad89a3a539" released by "delete_volume" :: held 0.828s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 11:00:25 devstack cinder-volume[87272]: DEBUG cinder.quota [None req-31dbe7f0-826e-4b91-a78b-badd501d59d8 tempest-TestMinimumBasicScenario-423304152 None] Created reservations ['17ad4dca-d017-49da-a737-766db01529bb', '7e7994fa-f6c6-4e8f-ba0d-1d150999baff', 'ea9fd8a7-7f18-486d-9c70-556b002bc3bc', 'a7a3e2f6-7749-42fa-81c7-ac38ded02dad'] {{(pid=87272) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 11:00:25 devstack sudo[99817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-34f58600-03d3-4233-a393-3548387d357c Nov 04 11:00:25 devstack sudo[99817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:00:25 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-31dbe7f0-826e-4b91-a78b-badd501d59d8 tempest-TestMinimumBasicScenario-423304152 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 11:00:25 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-31dbe7f0-826e-4b91-a78b-badd501d59d8 tempest-TestMinimumBasicScenario-423304152 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 11:00:25 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-31dbe7f0-826e-4b91-a78b-badd501d59d8 tempest-TestMinimumBasicScenario-423304152 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898': None} {{(pid=87272) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 11:00:25 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-31dbe7f0-826e-4b91-a78b-badd501d59d8 tempest-TestMinimumBasicScenario-423304152 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'] {{(pid=87272) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 11:00:25 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-31dbe7f0-826e-4b91-a78b-badd501d59d8 tempest-TestMinimumBasicScenario-423304152 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 11:00:25 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-31dbe7f0-826e-4b91-a78b-badd501d59d8 tempest-TestMinimumBasicScenario-423304152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:00:25 devstack sudo[99823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1 Nov 04 11:00:25 devstack sudo[99823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:00:25 devstack sudo[99818]: pam_unix(sudo:session): session closed for user root Nov 04 11:00:25 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-029de77b-aeb3-4d83-a986-2e14c07ae117 tempest-SnapshotsActionsTest-1929562032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-46336612-417e-4879-916a-0b4221935d7f.6135bab8-0c01-4718-b95f-c7f56fd9b6ad" returned: 0 in 0.304s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:00:25 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-029de77b-aeb3-4d83-a986-2e14c07ae117 tempest-SnapshotsActionsTest-1929562032 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.937s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 11:00:25 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-029de77b-aeb3-4d83-a986-2e14c07ae117 tempest-SnapshotsActionsTest-1929562032 None] Create snapshot completed successfully Nov 04 11:00:25 devstack sudo[99817]: pam_unix(sudo:session): session closed for user root Nov 04 11:00:25 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-8bd43552-1666-408a-81d0-7db5a573fc40 tempest-GroupsTest-1974299367 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-34f58600-03d3-4233-a393-3548387d357c" returned: 0 in 0.543s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:00:25 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-8bd43552-1666-408a-81d0-7db5a573fc40 tempest-GroupsTest-1974299367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-34f58600-03d3-4233-a393-3548387d357c {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:00:25 devstack sudo[99823]: pam_unix(sudo:session): session closed for user root Nov 04 11:00:25 devstack sudo[99830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-34f58600-03d3-4233-a393-3548387d357c Nov 04 11:00:25 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-31dbe7f0-826e-4b91-a78b-badd501d59d8 tempest-TestMinimumBasicScenario-423304152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1" returned: 0 in 0.381s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:00:25 devstack sudo[99830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:00:25 devstack cinder-volume[87272]: DEBUG cinder.manager [None req-31dbe7f0-826e-4b91-a78b-badd501d59d8 tempest-TestMinimumBasicScenario-423304152 None] Notifying Schedulers of capabilities ... {{(pid=87272) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 11:00:25 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-31dbe7f0-826e-4b91-a78b-badd501d59d8 tempest-TestMinimumBasicScenario-423304152 None] Deleted volume successfully. Nov 04 11:00:25 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-31dbe7f0-826e-4b91-a78b-badd501d59d8 tempest-TestMinimumBasicScenario-423304152 None] Lock "cinder-a2187971-7944-4eb9-a57d-41ad89a3a539-delete_volume" released by "delete_volume" :: held 1.514s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 11:00:25 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-4b4a5349-02fb-4638-af46-e8174f44bce3 tempest-SnapshotsActionsTest-824471239 None] Acquiring lock "cinder-6135bab8-0c01-4718-b95f-c7f56fd9b6ad-delete_snapshot" by "delete_snapshot" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 11:00:25 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-4b4a5349-02fb-4638-af46-e8174f44bce3 tempest-SnapshotsActionsTest-824471239 None] Lock "cinder-6135bab8-0c01-4718-b95f-c7f56fd9b6ad-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 11:00:25 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-4b4a5349-02fb-4638-af46-e8174f44bce3 tempest-SnapshotsActionsTest-824471239 None] Acquiring lock "cinder-quobyte-46336612-417e-4879-916a-0b4221935d7f" by "delete_snapshot" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 11:00:25 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-4b4a5349-02fb-4638-af46-e8174f44bce3 tempest-SnapshotsActionsTest-824471239 None] Lock "cinder-quobyte-46336612-417e-4879-916a-0b4221935d7f" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 11:00:25 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-4b4a5349-02fb-4638-af46-e8174f44bce3 tempest-SnapshotsActionsTest-824471239 None] Acquiring lock "cinder-quobyte-6135bab8-0c01-4718-b95f-c7f56fd9b6ad" by "_delete_snapshot" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 11:00:25 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-4b4a5349-02fb-4638-af46-e8174f44bce3 tempest-SnapshotsActionsTest-824471239 None] Lock "cinder-quobyte-6135bab8-0c01-4718-b95f-c7f56fd9b6ad" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 11:00:25 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.remotefs [None req-4b4a5349-02fb-4638-af46-e8174f44bce3 tempest-SnapshotsActionsTest-824471239 None] Deleting offline snapshot 6135bab8-0c01-4718-b95f-c7f56fd9b6ad of volume 46336612-417e-4879-916a-0b4221935d7f {{(pid=87272) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 04 11:00:26 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.remotefs [None req-4b4a5349-02fb-4638-af46-e8174f44bce3 tempest-SnapshotsActionsTest-824471239 None] snapshot_file for this snap is: volume-46336612-417e-4879-916a-0b4221935d7f.6135bab8-0c01-4718-b95f-c7f56fd9b6ad {{(pid=87272) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 04 11:00:26 devstack sudo[99830]: pam_unix(sudo:session): session closed for user root Nov 04 11:00:26 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-8bd43552-1666-408a-81d0-7db5a573fc40 tempest-GroupsTest-1974299367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-34f58600-03d3-4233-a393-3548387d357c" returned: 0 in 0.366s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:00:26 devstack cinder-volume[87272]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b0bdc5a-8ee1-4b9b-bbad-9e840a5f2462]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 11:00:26 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-4b4a5349-02fb-4638-af46-e8174f44bce3 tempest-SnapshotsActionsTest-824471239 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-46336612-417e-4879-916a-0b4221935d7f.6135bab8-0c01-4718-b95f-c7f56fd9b6ad {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:00:26 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-8bd43552-1666-408a-81d0-7db5a573fc40 tempest-GroupsTest-1974299367 None] Lock "cinder-quobyte-34f58600-03d3-4233-a393-3548387d357c" released by "delete_volume" :: held 1.020s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 11:00:26 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-8bd43552-1666-408a-81d0-7db5a573fc40 tempest-GroupsTest-1974299367 None] Acquiring lock "cinder-quobyte-a0a0413e-9b5c-4ef9-bbec-36c3e3383e17" by "delete_volume" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 11:00:26 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-8bd43552-1666-408a-81d0-7db5a573fc40 tempest-GroupsTest-1974299367 None] Lock "cinder-quobyte-a0a0413e-9b5c-4ef9-bbec-36c3e3383e17" acquired by "delete_volume" :: waited 0.039s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 11:00:26 devstack cinder-volume[87272]: DEBUG oslo.privsep.daemon [-] privsep: reply[36356280-a51a-4966-b9ea-b9783b0a9d65]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 11:00:26 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-8bd43552-1666-408a-81d0-7db5a573fc40 tempest-GroupsTest-1974299367 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-a0a0413e-9b5c-4ef9-bbec-36c3e3383e17 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:00:26 devstack sudo[99842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-46336612-417e-4879-916a-0b4221935d7f.6135bab8-0c01-4718-b95f-c7f56fd9b6ad Nov 04 11:00:26 devstack sudo[99842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:00:26 devstack sudo[99847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-a0a0413e-9b5c-4ef9-bbec-36c3e3383e17 Nov 04 11:00:26 devstack sudo[99847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:00:26 devstack sudo[99842]: pam_unix(sudo:session): session closed for user root Nov 04 11:00:26 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-4b4a5349-02fb-4638-af46-e8174f44bce3 tempest-SnapshotsActionsTest-824471239 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-46336612-417e-4879-916a-0b4221935d7f.6135bab8-0c01-4718-b95f-c7f56fd9b6ad" returned: 0 in 0.698s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:00:26 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.remotefs [None req-4b4a5349-02fb-4638-af46-e8174f44bce3 tempest-SnapshotsActionsTest-824471239 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-46336612-417e-4879-916a-0b4221935d7f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87272) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 11:00:26 devstack sudo[99847]: pam_unix(sudo:session): session closed for user root Nov 04 11:00:26 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-8bd43552-1666-408a-81d0-7db5a573fc40 tempest-GroupsTest-1974299367 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-a0a0413e-9b5c-4ef9-bbec-36c3e3383e17" returned: 0 in 0.573s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:00:26 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-8bd43552-1666-408a-81d0-7db5a573fc40 tempest-GroupsTest-1974299367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-a0a0413e-9b5c-4ef9-bbec-36c3e3383e17 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:00:26 devstack cinder-volume[87272]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb352f86-56de-4c7d-b039-f88041925709]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 11:00:26 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-4b4a5349-02fb-4638-af46-e8174f44bce3 tempest-SnapshotsActionsTest-824471239 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-46336612-417e-4879-916a-0b4221935d7f.7e49cd66-33cd-4c14-8069-bc249e5ebcbd {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:00:26 devstack sudo[99898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-a0a0413e-9b5c-4ef9-bbec-36c3e3383e17 Nov 04 11:00:26 devstack sudo[99898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:00:26 devstack sudo[99899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-46336612-417e-4879-916a-0b4221935d7f.7e49cd66-33cd-4c14-8069-bc249e5ebcbd Nov 04 11:00:26 devstack sudo[99899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:00:27 devstack sudo[99898]: pam_unix(sudo:session): session closed for user root Nov 04 11:00:27 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-8bd43552-1666-408a-81d0-7db5a573fc40 tempest-GroupsTest-1974299367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-a0a0413e-9b5c-4ef9-bbec-36c3e3383e17" returned: 0 in 0.358s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:00:27 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-8bd43552-1666-408a-81d0-7db5a573fc40 tempest-GroupsTest-1974299367 None] Lock "cinder-quobyte-a0a0413e-9b5c-4ef9-bbec-36c3e3383e17" released by "delete_volume" :: held 1.028s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 11:00:27 devstack sudo[99899]: pam_unix(sudo:session): session closed for user root Nov 04 11:00:27 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-4b4a5349-02fb-4638-af46-e8174f44bce3 tempest-SnapshotsActionsTest-824471239 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-46336612-417e-4879-916a-0b4221935d7f.7e49cd66-33cd-4c14-8069-bc249e5ebcbd" returned: 0 in 0.459s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:00:27 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.remotefs [None req-4b4a5349-02fb-4638-af46-e8174f44bce3 tempest-SnapshotsActionsTest-824471239 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-46336612-417e-4879-916a-0b4221935d7f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87272) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 11:00:27 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-4b4a5349-02fb-4638-af46-e8174f44bce3 tempest-SnapshotsActionsTest-824471239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-46336612-417e-4879-916a-0b4221935d7f.6135bab8-0c01-4718-b95f-c7f56fd9b6ad {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:00:27 devstack cinder-volume[87272]: DEBUG cinder.quota [None req-8bd43552-1666-408a-81d0-7db5a573fc40 tempest-GroupsTest-1974299367 None] Created reservations ['5d658131-aa77-499d-9a4f-590fbd5956f9'] {{(pid=87272) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 11:00:27 devstack sudo[99908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-46336612-417e-4879-916a-0b4221935d7f.6135bab8-0c01-4718-b95f-c7f56fd9b6ad Nov 04 11:00:27 devstack sudo[99908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:00:27 devstack cinder-volume[87272]: WARNING cinder.quota [None req-8bd43552-1666-408a-81d0-7db5a573fc40 tempest-GroupsTest-1974299367 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1712478816 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1712478816, it is now deprecated. Please use the default quota class for default quota. Nov 04 11:00:27 devstack cinder-volume[87272]: WARNING cinder.quota [None req-8bd43552-1666-408a-81d0-7db5a573fc40 tempest-GroupsTest-1974299367 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1712478816 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1712478816, it is now deprecated. Please use the default quota class for default quota. Nov 04 11:00:27 devstack cinder-volume[87272]: DEBUG cinder.quota [None req-8bd43552-1666-408a-81d0-7db5a573fc40 tempest-GroupsTest-1974299367 None] Created reservations ['0abf67e8-781b-4a79-b3ed-088fe8724a8f', '967abb8a-916d-49ad-8439-bae6ec8e0af3', 'cbeb23ad-cfa6-46b9-be6b-2570bea0d38a', '17cc7964-7790-4491-8f13-acb11399a964'] {{(pid=87272) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 11:00:27 devstack cinder-volume[87272]: DEBUG cinder.quota [None req-8bd43552-1666-408a-81d0-7db5a573fc40 tempest-GroupsTest-1974299367 None] Created reservations ['3cd43200-d247-4f96-8b50-58525f3b6cef', '071dd2c6-e94c-4326-ab89-31cc74625720', 'ccd77782-289d-4014-a908-7ec75e92e502', '4e63f348-08ba-4dac-8d99-ab12115c56d6'] {{(pid=87272) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 11:00:27 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-8bd43552-1666-408a-81d0-7db5a573fc40 tempest-GroupsTest-1974299367 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 11:00:27 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-8bd43552-1666-408a-81d0-7db5a573fc40 tempest-GroupsTest-1974299367 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 11:00:27 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-8bd43552-1666-408a-81d0-7db5a573fc40 tempest-GroupsTest-1974299367 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898': None} {{(pid=87272) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 11:00:27 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-8bd43552-1666-408a-81d0-7db5a573fc40 tempest-GroupsTest-1974299367 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'] {{(pid=87272) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 11:00:27 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-8bd43552-1666-408a-81d0-7db5a573fc40 tempest-GroupsTest-1974299367 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 11:00:27 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-8bd43552-1666-408a-81d0-7db5a573fc40 tempest-GroupsTest-1974299367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:00:27 devstack sudo[99915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1 Nov 04 11:00:27 devstack sudo[99915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:00:27 devstack sudo[99908]: pam_unix(sudo:session): session closed for user root Nov 04 11:00:27 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-4b4a5349-02fb-4638-af46-e8174f44bce3 tempest-SnapshotsActionsTest-824471239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-46336612-417e-4879-916a-0b4221935d7f.6135bab8-0c01-4718-b95f-c7f56fd9b6ad" returned: 0 in 0.590s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:00:27 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-4b4a5349-02fb-4638-af46-e8174f44bce3 tempest-SnapshotsActionsTest-824471239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-46336612-417e-4879-916a-0b4221935d7f.6135bab8-0c01-4718-b95f-c7f56fd9b6ad {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:00:27 devstack sudo[99917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-46336612-417e-4879-916a-0b4221935d7f.6135bab8-0c01-4718-b95f-c7f56fd9b6ad Nov 04 11:00:27 devstack sudo[99917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:00:28 devstack sudo[99915]: pam_unix(sudo:session): session closed for user root Nov 04 11:00:28 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-8bd43552-1666-408a-81d0-7db5a573fc40 tempest-GroupsTest-1974299367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1" returned: 0 in 0.338s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:00:28 devstack cinder-volume[87272]: DEBUG cinder.manager [None req-8bd43552-1666-408a-81d0-7db5a573fc40 tempest-GroupsTest-1974299367 None] Notifying Schedulers of capabilities ... {{(pid=87272) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 11:00:28 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-8bd43552-1666-408a-81d0-7db5a573fc40 tempest-GroupsTest-1974299367 None] Delete group completed successfully. Nov 04 11:00:28 devstack sudo[99917]: pam_unix(sudo:session): session closed for user root Nov 04 11:00:28 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-4b4a5349-02fb-4638-af46-e8174f44bce3 tempest-SnapshotsActionsTest-824471239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-46336612-417e-4879-916a-0b4221935d7f.6135bab8-0c01-4718-b95f-c7f56fd9b6ad" returned: 0 in 0.358s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:00:28 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-4b4a5349-02fb-4638-af46-e8174f44bce3 tempest-SnapshotsActionsTest-824471239 None] Lock "cinder-quobyte-6135bab8-0c01-4718-b95f-c7f56fd9b6ad" released by "_delete_snapshot" :: held 2.276s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 11:00:28 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-4b4a5349-02fb-4638-af46-e8174f44bce3 tempest-SnapshotsActionsTest-824471239 None] Lock "cinder-quobyte-46336612-417e-4879-916a-0b4221935d7f" released by "delete_snapshot" :: held 2.309s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 11:00:28 devstack cinder-volume[87272]: DEBUG cinder.quota [None req-4b4a5349-02fb-4638-af46-e8174f44bce3 tempest-SnapshotsActionsTest-824471239 None] Created reservations ['61481bb3-45a1-4bca-9b6e-bd09787cb3b9', '7bb23cf6-34da-4403-b7e3-6b1cae9fe7cb', '5a020042-8915-4f43-a323-427ad4bc9ffe', 'fa60ef1b-23e5-4792-ae75-7dc2b09c25a0'] {{(pid=87272) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 11:00:28 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-4b4a5349-02fb-4638-af46-e8174f44bce3 tempest-SnapshotsActionsTest-824471239 None] Delete snapshot completed successfully. Nov 04 11:00:28 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-4b4a5349-02fb-4638-af46-e8174f44bce3 tempest-SnapshotsActionsTest-824471239 None] Lock "cinder-6135bab8-0c01-4718-b95f-c7f56fd9b6ad-delete_snapshot" released by "delete_snapshot" :: held 2.509s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 11:00:30 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-25ca4ec8-baa3-4c59-9b92-1fe32b704ee6 tempest-SnapshotsActionsTest-1929562032 None] Acquiring lock "cinder-7e49cd66-33cd-4c14-8069-bc249e5ebcbd-delete_snapshot" by "delete_snapshot" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 11:00:30 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-25ca4ec8-baa3-4c59-9b92-1fe32b704ee6 tempest-SnapshotsActionsTest-1929562032 None] Lock "cinder-7e49cd66-33cd-4c14-8069-bc249e5ebcbd-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 11:00:30 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-25ca4ec8-baa3-4c59-9b92-1fe32b704ee6 tempest-SnapshotsActionsTest-1929562032 None] Acquiring lock "cinder-quobyte-46336612-417e-4879-916a-0b4221935d7f" by "delete_snapshot" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 11:00:30 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-25ca4ec8-baa3-4c59-9b92-1fe32b704ee6 tempest-SnapshotsActionsTest-1929562032 None] Lock "cinder-quobyte-46336612-417e-4879-916a-0b4221935d7f" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 11:00:30 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-25ca4ec8-baa3-4c59-9b92-1fe32b704ee6 tempest-SnapshotsActionsTest-1929562032 None] Acquiring lock "cinder-quobyte-7e49cd66-33cd-4c14-8069-bc249e5ebcbd" by "_delete_snapshot" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 11:00:30 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-25ca4ec8-baa3-4c59-9b92-1fe32b704ee6 tempest-SnapshotsActionsTest-1929562032 None] Lock "cinder-quobyte-7e49cd66-33cd-4c14-8069-bc249e5ebcbd" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 11:00:30 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.remotefs [None req-25ca4ec8-baa3-4c59-9b92-1fe32b704ee6 tempest-SnapshotsActionsTest-1929562032 None] Deleting offline snapshot 7e49cd66-33cd-4c14-8069-bc249e5ebcbd of volume 46336612-417e-4879-916a-0b4221935d7f {{(pid=87272) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 04 11:00:30 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.remotefs [None req-25ca4ec8-baa3-4c59-9b92-1fe32b704ee6 tempest-SnapshotsActionsTest-1929562032 None] snapshot_file for this snap is: volume-46336612-417e-4879-916a-0b4221935d7f.7e49cd66-33cd-4c14-8069-bc249e5ebcbd {{(pid=87272) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 04 11:00:30 devstack cinder-volume[87272]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdef6d09-84ef-4c80-934e-382b0bf6e9f1]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 11:00:30 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-25ca4ec8-baa3-4c59-9b92-1fe32b704ee6 tempest-SnapshotsActionsTest-1929562032 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-46336612-417e-4879-916a-0b4221935d7f.7e49cd66-33cd-4c14-8069-bc249e5ebcbd {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:00:30 devstack sudo[99921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-46336612-417e-4879-916a-0b4221935d7f.7e49cd66-33cd-4c14-8069-bc249e5ebcbd Nov 04 11:00:30 devstack sudo[99921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:00:30 devstack sudo[99921]: pam_unix(sudo:session): session closed for user root Nov 04 11:00:30 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-25ca4ec8-baa3-4c59-9b92-1fe32b704ee6 tempest-SnapshotsActionsTest-1929562032 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-46336612-417e-4879-916a-0b4221935d7f.7e49cd66-33cd-4c14-8069-bc249e5ebcbd" returned: 0 in 0.437s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:00:30 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.remotefs [None req-25ca4ec8-baa3-4c59-9b92-1fe32b704ee6 tempest-SnapshotsActionsTest-1929562032 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-46336612-417e-4879-916a-0b4221935d7f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87272) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 11:00:30 devstack cinder-volume[87272]: DEBUG oslo.privsep.daemon [-] privsep: reply[49a71054-f860-4042-9078-1e4dce7e9b96]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 11:00:30 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-25ca4ec8-baa3-4c59-9b92-1fe32b704ee6 tempest-SnapshotsActionsTest-1929562032 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-46336612-417e-4879-916a-0b4221935d7f {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:00:30 devstack sudo[99928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-46336612-417e-4879-916a-0b4221935d7f Nov 04 11:00:30 devstack sudo[99928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:00:31 devstack sudo[99928]: pam_unix(sudo:session): session closed for user root Nov 04 11:00:31 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-25ca4ec8-baa3-4c59-9b92-1fe32b704ee6 tempest-SnapshotsActionsTest-1929562032 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-46336612-417e-4879-916a-0b4221935d7f" returned: 0 in 0.481s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:00:31 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-25ca4ec8-baa3-4c59-9b92-1fe32b704ee6 tempest-SnapshotsActionsTest-1929562032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-46336612-417e-4879-916a-0b4221935d7f.7e49cd66-33cd-4c14-8069-bc249e5ebcbd {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:00:31 devstack sudo[99933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-46336612-417e-4879-916a-0b4221935d7f.7e49cd66-33cd-4c14-8069-bc249e5ebcbd Nov 04 11:00:31 devstack sudo[99933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:00:31 devstack sudo[99933]: pam_unix(sudo:session): session closed for user root Nov 04 11:00:31 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-25ca4ec8-baa3-4c59-9b92-1fe32b704ee6 tempest-SnapshotsActionsTest-1929562032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-46336612-417e-4879-916a-0b4221935d7f.7e49cd66-33cd-4c14-8069-bc249e5ebcbd" returned: 0 in 0.476s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:00:31 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-25ca4ec8-baa3-4c59-9b92-1fe32b704ee6 tempest-SnapshotsActionsTest-1929562032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-46336612-417e-4879-916a-0b4221935d7f.7e49cd66-33cd-4c14-8069-bc249e5ebcbd {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:00:31 devstack sudo[99939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-46336612-417e-4879-916a-0b4221935d7f.7e49cd66-33cd-4c14-8069-bc249e5ebcbd Nov 04 11:00:31 devstack sudo[99939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:00:32 devstack sudo[99939]: pam_unix(sudo:session): session closed for user root Nov 04 11:00:32 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-25ca4ec8-baa3-4c59-9b92-1fe32b704ee6 tempest-SnapshotsActionsTest-1929562032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-46336612-417e-4879-916a-0b4221935d7f.7e49cd66-33cd-4c14-8069-bc249e5ebcbd" returned: 0 in 0.375s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:00:32 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-25ca4ec8-baa3-4c59-9b92-1fe32b704ee6 tempest-SnapshotsActionsTest-1929562032 None] Lock "cinder-quobyte-7e49cd66-33cd-4c14-8069-bc249e5ebcbd" released by "_delete_snapshot" :: held 1.981s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 11:00:32 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-25ca4ec8-baa3-4c59-9b92-1fe32b704ee6 tempest-SnapshotsActionsTest-1929562032 None] Lock "cinder-quobyte-46336612-417e-4879-916a-0b4221935d7f" released by "delete_snapshot" :: held 2.018s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 11:00:32 devstack cinder-volume[87272]: DEBUG cinder.quota [None req-25ca4ec8-baa3-4c59-9b92-1fe32b704ee6 tempest-SnapshotsActionsTest-1929562032 None] Created reservations ['870eb30a-50c3-47b4-ba69-f37f6442672b', '5de6fc39-8ff1-4b34-9efd-27aab8311db9', '22c52c8d-db07-4f12-84d0-3663c5761111', 'b8947c85-e5f3-4f0e-9937-513f91975efa'] {{(pid=87272) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 11:00:32 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-25ca4ec8-baa3-4c59-9b92-1fe32b704ee6 tempest-SnapshotsActionsTest-1929562032 None] Delete snapshot completed successfully. Nov 04 11:00:32 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-25ca4ec8-baa3-4c59-9b92-1fe32b704ee6 tempest-SnapshotsActionsTest-1929562032 None] Lock "cinder-7e49cd66-33cd-4c14-8069-bc249e5ebcbd-delete_snapshot" released by "delete_snapshot" :: held 2.263s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 11:00:33 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-c4736a33-31c4-41ae-bcaf-dfd2d1115756 tempest-SnapshotsActionsTest-1929562032 None] Acquiring lock "cinder-46336612-417e-4879-916a-0b4221935d7f-delete_volume" by "delete_volume" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 11:00:33 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-c4736a33-31c4-41ae-bcaf-dfd2d1115756 tempest-SnapshotsActionsTest-1929562032 None] Lock "cinder-46336612-417e-4879-916a-0b4221935d7f-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 11:00:33 devstack cinder-volume[87272]: DEBUG dbcounter [-] [87272] Writing DB stats cinder:UPDATE=137,cinder:SELECT=129,cinder:DELETE=8,cinder:INSERT=29 {{(pid=87272) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 11:00:33 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-c4736a33-31c4-41ae-bcaf-dfd2d1115756 tempest-SnapshotsActionsTest-1929562032 None] Acquiring lock "cinder-quobyte-46336612-417e-4879-916a-0b4221935d7f" by "delete_volume" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 11:00:33 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-c4736a33-31c4-41ae-bcaf-dfd2d1115756 tempest-SnapshotsActionsTest-1929562032 None] Lock "cinder-quobyte-46336612-417e-4879-916a-0b4221935d7f" acquired by "delete_volume" :: waited 0.066s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 11:00:33 devstack cinder-volume[87272]: DEBUG oslo.privsep.daemon [-] privsep: reply[31d2c60f-538d-4738-b442-e134676732c4]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 11:00:33 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-c4736a33-31c4-41ae-bcaf-dfd2d1115756 tempest-SnapshotsActionsTest-1929562032 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-46336612-417e-4879-916a-0b4221935d7f {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:00:33 devstack sudo[99942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-46336612-417e-4879-916a-0b4221935d7f Nov 04 11:00:33 devstack sudo[99942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:00:34 devstack sudo[99942]: pam_unix(sudo:session): session closed for user root Nov 04 11:00:34 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-c4736a33-31c4-41ae-bcaf-dfd2d1115756 tempest-SnapshotsActionsTest-1929562032 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-46336612-417e-4879-916a-0b4221935d7f" returned: 0 in 0.460s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:00:34 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-c4736a33-31c4-41ae-bcaf-dfd2d1115756 tempest-SnapshotsActionsTest-1929562032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-46336612-417e-4879-916a-0b4221935d7f {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:00:34 devstack sudo[99948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-46336612-417e-4879-916a-0b4221935d7f Nov 04 11:00:34 devstack sudo[99948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:00:34 devstack sudo[99948]: pam_unix(sudo:session): session closed for user root Nov 04 11:00:34 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-c4736a33-31c4-41ae-bcaf-dfd2d1115756 tempest-SnapshotsActionsTest-1929562032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-46336612-417e-4879-916a-0b4221935d7f" returned: 0 in 0.349s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:00:34 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-c4736a33-31c4-41ae-bcaf-dfd2d1115756 tempest-SnapshotsActionsTest-1929562032 None] Lock "cinder-quobyte-46336612-417e-4879-916a-0b4221935d7f" released by "delete_volume" :: held 0.948s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 11:00:34 devstack cinder-volume[87272]: DEBUG cinder.quota [None req-c4736a33-31c4-41ae-bcaf-dfd2d1115756 tempest-SnapshotsActionsTest-1929562032 None] Created reservations ['1370f47f-cc69-4e97-abf4-3fb814a532b7', '95b1173e-0c7a-4dac-a0c8-ad449a546e3c', 'a6ca5e71-dedf-4203-afbf-cd0cffd1400f', '44f0ab54-8222-41fb-bc55-f38c6b63b75f'] {{(pid=87272) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 11:00:34 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-c4736a33-31c4-41ae-bcaf-dfd2d1115756 tempest-SnapshotsActionsTest-1929562032 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 11:00:34 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-c4736a33-31c4-41ae-bcaf-dfd2d1115756 tempest-SnapshotsActionsTest-1929562032 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 11:00:34 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-c4736a33-31c4-41ae-bcaf-dfd2d1115756 tempest-SnapshotsActionsTest-1929562032 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898': None} {{(pid=87272) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 11:00:34 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-c4736a33-31c4-41ae-bcaf-dfd2d1115756 tempest-SnapshotsActionsTest-1929562032 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'] {{(pid=87272) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 11:00:34 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-c4736a33-31c4-41ae-bcaf-dfd2d1115756 tempest-SnapshotsActionsTest-1929562032 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 11:00:34 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-c4736a33-31c4-41ae-bcaf-dfd2d1115756 tempest-SnapshotsActionsTest-1929562032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:00:34 devstack sudo[99952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1 Nov 04 11:00:34 devstack sudo[99952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:00:35 devstack sudo[99952]: pam_unix(sudo:session): session closed for user root Nov 04 11:00:35 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-c4736a33-31c4-41ae-bcaf-dfd2d1115756 tempest-SnapshotsActionsTest-1929562032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1" returned: 0 in 0.445s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:00:35 devstack cinder-volume[87272]: DEBUG cinder.manager [None req-c4736a33-31c4-41ae-bcaf-dfd2d1115756 tempest-SnapshotsActionsTest-1929562032 None] Notifying Schedulers of capabilities ... {{(pid=87272) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 11:00:35 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-c4736a33-31c4-41ae-bcaf-dfd2d1115756 tempest-SnapshotsActionsTest-1929562032 None] Deleted volume successfully. Nov 04 11:00:35 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-c4736a33-31c4-41ae-bcaf-dfd2d1115756 tempest-SnapshotsActionsTest-1929562032 None] Lock "cinder-46336612-417e-4879-916a-0b4221935d7f-delete_volume" released by "delete_volume" :: held 1.751s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 11:00:36 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [req-0265821e-149c-49b0-ae02-16ef1202177d req-ba2b77c9-627d-41f8-8166-ed67788a1a36 tempest-TestServerVolumeAttachmentScenario-1780213436 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 11:00:36 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [req-0265821e-149c-49b0-ae02-16ef1202177d req-ba2b77c9-627d-41f8-8166-ed67788a1a36 tempest-TestServerVolumeAttachmentScenario-1780213436 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 11:00:36 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [req-0265821e-149c-49b0-ae02-16ef1202177d req-ba2b77c9-627d-41f8-8166-ed67788a1a36 tempest-TestServerVolumeAttachmentScenario-1780213436 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.019s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 11:00:36 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [req-0265821e-149c-49b0-ae02-16ef1202177d req-ba2b77c9-627d-41f8-8166-ed67788a1a36 tempest-TestServerVolumeAttachmentScenario-1780213436 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898', 'name': 'volume-0ed2c409-12aa-418d-bc8a-71a138668e4e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '9fb8961b-edb3-420a-9e3e-9cc18cb88435', 'enforce_multipath': True} {{(pid=87272) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 04 11:00:36 devstack cinder-volume[87272]: INFO cinder.volume.manager [req-0265821e-149c-49b0-ae02-16ef1202177d req-ba2b77c9-627d-41f8-8166-ed67788a1a36 tempest-TestServerVolumeAttachmentScenario-1780213436 None] attachment_update completed successfully. Nov 04 11:00:39 devstack cinder-volume[87272]: DEBUG cinder.volume.flows.manager.create_volume [None req-af15cf19-44f4-465f-a179-11fd9b36861b tempest-VolumeQuotasAdminTestJSON-970420209 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87272) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 11:00:39 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-af15cf19-44f4-465f-a179-11fd9b36861b tempest-VolumeQuotasAdminTestJSON-970420209 None] Flow 'volume_create_manager' (89e7534a-260f-4ee4-b3c0-551632f2bae1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 11:00:39 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-af15cf19-44f4-465f-a179-11fd9b36861b tempest-VolumeQuotasAdminTestJSON-970420209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f95442e9-a442-489d-9e34-54da40387377) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:00:39 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-af15cf19-44f4-465f-a179-11fd9b36861b tempest-VolumeQuotasAdminTestJSON-970420209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f95442e9-a442-489d-9e34-54da40387377) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T10:00:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-957278226',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea02d302-c09b-44dc-b9b2-f6f8e60c405c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea84a97ba6c34cb78ae8700e8c9253d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T10:00:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T10:00:39Z,use_quota=True,user_id='c52d0ee391174567a2d7ce2716c6e5b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8989e4f-21e3-4f0a-9584-0d818784e883),volume_type_id=f8989e4f-21e3-4f0a-9584-0d818784e883)' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:00:39 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-af15cf19-44f4-465f-a179-11fd9b36861b tempest-VolumeQuotasAdminTestJSON-970420209 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd0b6b80-86af-44ca-b806-d4456257c00f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:00:39 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-af15cf19-44f4-465f-a179-11fd9b36861b tempest-VolumeQuotasAdminTestJSON-970420209 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd0b6b80-86af-44ca-b806-d4456257c00f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:00:39 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-af15cf19-44f4-465f-a179-11fd9b36861b tempest-VolumeQuotasAdminTestJSON-970420209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d63700c-fd64-4abe-aa47-f3d5078808f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:00:39 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-af15cf19-44f4-465f-a179-11fd9b36861b tempest-VolumeQuotasAdminTestJSON-970420209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d63700c-fd64-4abe-aa47-f3d5078808f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ea02d302-c09b-44dc-b9b2-f6f8e60c405c', 'volume_name': 'volume-ea02d302-c09b-44dc-b9b2-f6f8e60c405c', 'volume_size': 1}' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:00:39 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-af15cf19-44f4-465f-a179-11fd9b36861b tempest-VolumeQuotasAdminTestJSON-970420209 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e478983-4493-4263-bb72-079666fff849) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:00:39 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-af15cf19-44f4-465f-a179-11fd9b36861b tempest-VolumeQuotasAdminTestJSON-970420209 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e478983-4493-4263-bb72-079666fff849) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:00:39 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-af15cf19-44f4-465f-a179-11fd9b36861b tempest-VolumeQuotasAdminTestJSON-970420209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e871f2e-866b-4ec2-bf12-66a5edb2a841) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:00:39 devstack cinder-volume[87272]: INFO cinder.volume.flows.manager.create_volume [None req-af15cf19-44f4-465f-a179-11fd9b36861b tempest-VolumeQuotasAdminTestJSON-970420209 None] Volume ea02d302-c09b-44dc-b9b2-f6f8e60c405c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ea02d302-c09b-44dc-b9b2-f6f8e60c405c', 'volume_size': 1} Nov 04 11:00:39 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-af15cf19-44f4-465f-a179-11fd9b36861b tempest-VolumeQuotasAdminTestJSON-970420209 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 11:00:39 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-af15cf19-44f4-465f-a179-11fd9b36861b tempest-VolumeQuotasAdminTestJSON-970420209 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 11:00:39 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-af15cf19-44f4-465f-a179-11fd9b36861b tempest-VolumeQuotasAdminTestJSON-970420209 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T10:00:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-957278226',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea02d302-c09b-44dc-b9b2-f6f8e60c405c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea84a97ba6c34cb78ae8700e8c9253d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T10:00:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T10:00:39Z,use_quota=True,user_id='c52d0ee391174567a2d7ce2716c6e5b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8989e4f-21e3-4f0a-9584-0d818784e883),volume_type_id=f8989e4f-21e3-4f0a-9584-0d818784e883)}" {{(pid=87272) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 04 11:00:39 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.remotefs [None req-af15cf19-44f4-465f-a179-11fd9b36861b tempest-VolumeQuotasAdminTestJSON-970420209 None] Creating volume ea02d302-c09b-44dc-b9b2-f6f8e60c405c {{(pid=87272) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 11:00:39 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-af15cf19-44f4-465f-a179-11fd9b36861b tempest-VolumeQuotasAdminTestJSON-970420209 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 11:00:39 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-af15cf19-44f4-465f-a179-11fd9b36861b tempest-VolumeQuotasAdminTestJSON-970420209 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 11:00:39 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-af15cf19-44f4-465f-a179-11fd9b36861b tempest-VolumeQuotasAdminTestJSON-970420209 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898': None} {{(pid=87272) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 11:00:39 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-af15cf19-44f4-465f-a179-11fd9b36861b tempest-VolumeQuotasAdminTestJSON-970420209 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'] {{(pid=87272) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 11:00:39 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-af15cf19-44f4-465f-a179-11fd9b36861b tempest-VolumeQuotasAdminTestJSON-970420209 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 11:00:39 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-af15cf19-44f4-465f-a179-11fd9b36861b tempest-VolumeQuotasAdminTestJSON-970420209 None] Selected osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898 as target Quobyte volume. {{(pid=87272) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 11:00:39 devstack cinder-volume[87272]: INFO cinder.volume.drivers.remotefs [None req-af15cf19-44f4-465f-a179-11fd9b36861b tempest-VolumeQuotasAdminTestJSON-970420209 None] casted to osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898 Nov 04 11:00:39 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-af15cf19-44f4-465f-a179-11fd9b36861b tempest-VolumeQuotasAdminTestJSON-970420209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-ea02d302-c09b-44dc-b9b2-f6f8e60c405c 1073741824 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:00:39 devstack sudo[100385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-ea02d302-c09b-44dc-b9b2-f6f8e60c405c 1073741824 Nov 04 11:00:39 devstack sudo[100385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:00:39 devstack sudo[100385]: pam_unix(sudo:session): session closed for user root Nov 04 11:00:39 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-af15cf19-44f4-465f-a179-11fd9b36861b tempest-VolumeQuotasAdminTestJSON-970420209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-ea02d302-c09b-44dc-b9b2-f6f8e60c405c 1073741824" returned: 0 in 0.589s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:00:40 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-af15cf19-44f4-465f-a179-11fd9b36861b tempest-VolumeQuotasAdminTestJSON-970420209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-ea02d302-c09b-44dc-b9b2-f6f8e60c405c {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:00:40 devstack sudo[100391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-ea02d302-c09b-44dc-b9b2-f6f8e60c405c Nov 04 11:00:40 devstack sudo[100391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:00:40 devstack sudo[100391]: pam_unix(sudo:session): session closed for user root Nov 04 11:00:40 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-af15cf19-44f4-465f-a179-11fd9b36861b tempest-VolumeQuotasAdminTestJSON-970420209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-ea02d302-c09b-44dc-b9b2-f6f8e60c405c" returned: 0 in 0.495s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:00:40 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-af15cf19-44f4-465f-a179-11fd9b36861b tempest-VolumeQuotasAdminTestJSON-970420209 None] <== create_volume: return (1175ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'} {{(pid=87272) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 04 11:00:40 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-af15cf19-44f4-465f-a179-11fd9b36861b tempest-VolumeQuotasAdminTestJSON-970420209 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.180s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 11:00:40 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-af15cf19-44f4-465f-a179-11fd9b36861b tempest-VolumeQuotasAdminTestJSON-970420209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e871f2e-866b-4ec2-bf12-66a5edb2a841) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ea02d302-c09b-44dc-b9b2-f6f8e60c405c', 'volume_size': 1}' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:00:40 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-af15cf19-44f4-465f-a179-11fd9b36861b tempest-VolumeQuotasAdminTestJSON-970420209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (76f5cdcc-b214-49f3-b405-6a4593d4bbbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:00:40 devstack cinder-volume[87272]: INFO cinder.volume.flows.manager.create_volume [None req-af15cf19-44f4-465f-a179-11fd9b36861b tempest-VolumeQuotasAdminTestJSON-970420209 None] Volume volume-ea02d302-c09b-44dc-b9b2-f6f8e60c405c (ea02d302-c09b-44dc-b9b2-f6f8e60c405c): created successfully Nov 04 11:00:40 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-af15cf19-44f4-465f-a179-11fd9b36861b tempest-VolumeQuotasAdminTestJSON-970420209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (76f5cdcc-b214-49f3-b405-6a4593d4bbbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:00:40 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-af15cf19-44f4-465f-a179-11fd9b36861b tempest-VolumeQuotasAdminTestJSON-970420209 None] Flow 'volume_create_manager' (89e7534a-260f-4ee4-b3c0-551632f2bae1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87272) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 11:00:40 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-af15cf19-44f4-465f-a179-11fd9b36861b tempest-VolumeQuotasAdminTestJSON-970420209 None] Created volume successfully. Nov 04 11:00:41 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-4d9daf72-0527-4cda-ad7e-76b40378de6d tempest-VolumeQuotasAdminTestJSON-970420209 None] Acquiring lock "cinder-ea02d302-c09b-44dc-b9b2-f6f8e60c405c-delete_volume" by "delete_volume" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 11:00:41 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-4d9daf72-0527-4cda-ad7e-76b40378de6d tempest-VolumeQuotasAdminTestJSON-970420209 None] Lock "cinder-ea02d302-c09b-44dc-b9b2-f6f8e60c405c-delete_volume" acquired by "delete_volume" :: waited 0.056s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 11:00:41 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-4d9daf72-0527-4cda-ad7e-76b40378de6d tempest-VolumeQuotasAdminTestJSON-970420209 None] Acquiring lock "cinder-quobyte-ea02d302-c09b-44dc-b9b2-f6f8e60c405c" by "delete_volume" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 11:00:41 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-4d9daf72-0527-4cda-ad7e-76b40378de6d tempest-VolumeQuotasAdminTestJSON-970420209 None] Lock "cinder-quobyte-ea02d302-c09b-44dc-b9b2-f6f8e60c405c" acquired by "delete_volume" :: waited 0.026s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 11:00:41 devstack cinder-volume[87272]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee8076b9-6c80-4e1f-ba11-0f981cd2ff3a]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 11:00:41 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-4d9daf72-0527-4cda-ad7e-76b40378de6d tempest-VolumeQuotasAdminTestJSON-970420209 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-ea02d302-c09b-44dc-b9b2-f6f8e60c405c {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:00:41 devstack sudo[100395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-ea02d302-c09b-44dc-b9b2-f6f8e60c405c Nov 04 11:00:41 devstack sudo[100395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:00:42 devstack sudo[100395]: pam_unix(sudo:session): session closed for user root Nov 04 11:00:42 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-4d9daf72-0527-4cda-ad7e-76b40378de6d tempest-VolumeQuotasAdminTestJSON-970420209 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-ea02d302-c09b-44dc-b9b2-f6f8e60c405c" returned: 0 in 0.465s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:00:42 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-4d9daf72-0527-4cda-ad7e-76b40378de6d tempest-VolumeQuotasAdminTestJSON-970420209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-ea02d302-c09b-44dc-b9b2-f6f8e60c405c {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:00:42 devstack sudo[100400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-ea02d302-c09b-44dc-b9b2-f6f8e60c405c Nov 04 11:00:42 devstack sudo[100400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:00:42 devstack sudo[100400]: pam_unix(sudo:session): session closed for user root Nov 04 11:00:42 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-4d9daf72-0527-4cda-ad7e-76b40378de6d tempest-VolumeQuotasAdminTestJSON-970420209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-ea02d302-c09b-44dc-b9b2-f6f8e60c405c" returned: 0 in 0.353s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:00:42 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-4d9daf72-0527-4cda-ad7e-76b40378de6d tempest-VolumeQuotasAdminTestJSON-970420209 None] Lock "cinder-quobyte-ea02d302-c09b-44dc-b9b2-f6f8e60c405c" released by "delete_volume" :: held 0.869s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 11:00:42 devstack cinder-volume[87272]: DEBUG cinder.quota [None req-4d9daf72-0527-4cda-ad7e-76b40378de6d tempest-VolumeQuotasAdminTestJSON-970420209 None] Created reservations ['b553bf43-e64f-428c-b046-adda49e08334', '6bbe5e4b-6d6e-4fc8-ae46-abc908f3aa9a', 'a19205a5-f44c-4b0d-90bd-00209cb5b669', 'fc9bde26-f616-4c74-a536-dcfb8f8517d6'] {{(pid=87272) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 11:00:42 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-4d9daf72-0527-4cda-ad7e-76b40378de6d tempest-VolumeQuotasAdminTestJSON-970420209 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 11:00:42 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-4d9daf72-0527-4cda-ad7e-76b40378de6d tempest-VolumeQuotasAdminTestJSON-970420209 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 11:00:42 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-4d9daf72-0527-4cda-ad7e-76b40378de6d tempest-VolumeQuotasAdminTestJSON-970420209 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898': None} {{(pid=87272) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 11:00:42 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-4d9daf72-0527-4cda-ad7e-76b40378de6d tempest-VolumeQuotasAdminTestJSON-970420209 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'] {{(pid=87272) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 11:00:42 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-4d9daf72-0527-4cda-ad7e-76b40378de6d tempest-VolumeQuotasAdminTestJSON-970420209 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 11:00:42 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-4d9daf72-0527-4cda-ad7e-76b40378de6d tempest-VolumeQuotasAdminTestJSON-970420209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:00:42 devstack sudo[100403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1 Nov 04 11:00:42 devstack sudo[100403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:00:43 devstack sudo[100403]: pam_unix(sudo:session): session closed for user root Nov 04 11:00:43 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-4d9daf72-0527-4cda-ad7e-76b40378de6d tempest-VolumeQuotasAdminTestJSON-970420209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1" returned: 0 in 0.389s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:00:43 devstack cinder-volume[87272]: DEBUG cinder.manager [None req-4d9daf72-0527-4cda-ad7e-76b40378de6d tempest-VolumeQuotasAdminTestJSON-970420209 None] Notifying Schedulers of capabilities ... {{(pid=87272) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 11:00:43 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-4d9daf72-0527-4cda-ad7e-76b40378de6d tempest-VolumeQuotasAdminTestJSON-970420209 None] Deleted volume successfully. Nov 04 11:00:43 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-4d9daf72-0527-4cda-ad7e-76b40378de6d tempest-VolumeQuotasAdminTestJSON-970420209 None] Lock "cinder-ea02d302-c09b-44dc-b9b2-f6f8e60c405c-delete_volume" released by "delete_volume" :: held 1.619s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 11:00:43 devstack cinder-volume[87272]: DEBUG cinder.volume.flows.manager.create_volume [None req-d51b98b3-cf67-4ef9-bea6-2f4ee1c64bf0 tempest-VolumeQuotasAdminTestJSON-970420209 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87272) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 11:00:43 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-d51b98b3-cf67-4ef9-bea6-2f4ee1c64bf0 tempest-VolumeQuotasAdminTestJSON-970420209 None] Flow 'volume_create_manager' (67fd3327-c958-4559-872e-d4ca708d430c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 11:00:43 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-d51b98b3-cf67-4ef9-bea6-2f4ee1c64bf0 tempest-VolumeQuotasAdminTestJSON-970420209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0eb1bb23-40f1-49ee-be95-3aa7664305ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:00:43 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-d51b98b3-cf67-4ef9-bea6-2f4ee1c64bf0 tempest-VolumeQuotasAdminTestJSON-970420209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0eb1bb23-40f1-49ee-be95-3aa7664305ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T10:00:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-817955853',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=52222295-9c6b-4567-b55d-ed1a2752d415,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea84a97ba6c34cb78ae8700e8c9253d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T10:00:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T10:00:43Z,use_quota=True,user_id='c52d0ee391174567a2d7ce2716c6e5b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8989e4f-21e3-4f0a-9584-0d818784e883),volume_type_id=f8989e4f-21e3-4f0a-9584-0d818784e883)' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:00:43 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-d51b98b3-cf67-4ef9-bea6-2f4ee1c64bf0 tempest-VolumeQuotasAdminTestJSON-970420209 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9cc0c9c2-92be-4f44-b89e-9634122b1922) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:00:43 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-d51b98b3-cf67-4ef9-bea6-2f4ee1c64bf0 tempest-VolumeQuotasAdminTestJSON-970420209 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9cc0c9c2-92be-4f44-b89e-9634122b1922) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:00:43 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-d51b98b3-cf67-4ef9-bea6-2f4ee1c64bf0 tempest-VolumeQuotasAdminTestJSON-970420209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38226471-f56c-41d2-bb9a-453b32fe3f5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:00:43 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-d51b98b3-cf67-4ef9-bea6-2f4ee1c64bf0 tempest-VolumeQuotasAdminTestJSON-970420209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38226471-f56c-41d2-bb9a-453b32fe3f5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '52222295-9c6b-4567-b55d-ed1a2752d415', 'volume_name': 'volume-52222295-9c6b-4567-b55d-ed1a2752d415', 'volume_size': 1}' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:00:43 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-d51b98b3-cf67-4ef9-bea6-2f4ee1c64bf0 tempest-VolumeQuotasAdminTestJSON-970420209 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd1e4f8e-b5f3-410f-aa33-1b8015bdbd47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:00:43 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-d51b98b3-cf67-4ef9-bea6-2f4ee1c64bf0 tempest-VolumeQuotasAdminTestJSON-970420209 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd1e4f8e-b5f3-410f-aa33-1b8015bdbd47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:00:43 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-d51b98b3-cf67-4ef9-bea6-2f4ee1c64bf0 tempest-VolumeQuotasAdminTestJSON-970420209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (954d6a0e-c1fc-4762-9384-e45469bf0c8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:00:43 devstack cinder-volume[87272]: INFO cinder.volume.flows.manager.create_volume [None req-d51b98b3-cf67-4ef9-bea6-2f4ee1c64bf0 tempest-VolumeQuotasAdminTestJSON-970420209 None] Volume 52222295-9c6b-4567-b55d-ed1a2752d415: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-52222295-9c6b-4567-b55d-ed1a2752d415', 'volume_size': 1} Nov 04 11:00:43 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-d51b98b3-cf67-4ef9-bea6-2f4ee1c64bf0 tempest-VolumeQuotasAdminTestJSON-970420209 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 11:00:43 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-d51b98b3-cf67-4ef9-bea6-2f4ee1c64bf0 tempest-VolumeQuotasAdminTestJSON-970420209 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 11:00:43 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-d51b98b3-cf67-4ef9-bea6-2f4ee1c64bf0 tempest-VolumeQuotasAdminTestJSON-970420209 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T10:00:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-817955853',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=52222295-9c6b-4567-b55d-ed1a2752d415,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea84a97ba6c34cb78ae8700e8c9253d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T10:00:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T10:00:43Z,use_quota=True,user_id='c52d0ee391174567a2d7ce2716c6e5b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8989e4f-21e3-4f0a-9584-0d818784e883),volume_type_id=f8989e4f-21e3-4f0a-9584-0d818784e883)}" {{(pid=87272) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 04 11:00:43 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.remotefs [None req-d51b98b3-cf67-4ef9-bea6-2f4ee1c64bf0 tempest-VolumeQuotasAdminTestJSON-970420209 None] Creating volume 52222295-9c6b-4567-b55d-ed1a2752d415 {{(pid=87272) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 11:00:43 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-d51b98b3-cf67-4ef9-bea6-2f4ee1c64bf0 tempest-VolumeQuotasAdminTestJSON-970420209 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 11:00:43 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-d51b98b3-cf67-4ef9-bea6-2f4ee1c64bf0 tempest-VolumeQuotasAdminTestJSON-970420209 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 11:00:43 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-d51b98b3-cf67-4ef9-bea6-2f4ee1c64bf0 tempest-VolumeQuotasAdminTestJSON-970420209 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898': None} {{(pid=87272) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 11:00:43 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-d51b98b3-cf67-4ef9-bea6-2f4ee1c64bf0 tempest-VolumeQuotasAdminTestJSON-970420209 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'] {{(pid=87272) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 11:00:43 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-d51b98b3-cf67-4ef9-bea6-2f4ee1c64bf0 tempest-VolumeQuotasAdminTestJSON-970420209 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 11:00:43 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-d51b98b3-cf67-4ef9-bea6-2f4ee1c64bf0 tempest-VolumeQuotasAdminTestJSON-970420209 None] Selected osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898 as target Quobyte volume. {{(pid=87272) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 11:00:43 devstack cinder-volume[87272]: INFO cinder.volume.drivers.remotefs [None req-d51b98b3-cf67-4ef9-bea6-2f4ee1c64bf0 tempest-VolumeQuotasAdminTestJSON-970420209 None] casted to osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898 Nov 04 11:00:43 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-d51b98b3-cf67-4ef9-bea6-2f4ee1c64bf0 tempest-VolumeQuotasAdminTestJSON-970420209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-52222295-9c6b-4567-b55d-ed1a2752d415 1073741824 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:00:43 devstack sudo[100406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-52222295-9c6b-4567-b55d-ed1a2752d415 1073741824 Nov 04 11:00:43 devstack sudo[100406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:00:44 devstack sudo[100406]: pam_unix(sudo:session): session closed for user root Nov 04 11:00:44 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-d51b98b3-cf67-4ef9-bea6-2f4ee1c64bf0 tempest-VolumeQuotasAdminTestJSON-970420209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-52222295-9c6b-4567-b55d-ed1a2752d415 1073741824" returned: 0 in 0.652s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:00:44 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-d51b98b3-cf67-4ef9-bea6-2f4ee1c64bf0 tempest-VolumeQuotasAdminTestJSON-970420209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-52222295-9c6b-4567-b55d-ed1a2752d415 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:00:44 devstack sudo[100415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-52222295-9c6b-4567-b55d-ed1a2752d415 Nov 04 11:00:44 devstack sudo[100415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:00:44 devstack sudo[100415]: pam_unix(sudo:session): session closed for user root Nov 04 11:00:44 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-d51b98b3-cf67-4ef9-bea6-2f4ee1c64bf0 tempest-VolumeQuotasAdminTestJSON-970420209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-52222295-9c6b-4567-b55d-ed1a2752d415" returned: 0 in 0.329s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:00:44 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-d51b98b3-cf67-4ef9-bea6-2f4ee1c64bf0 tempest-VolumeQuotasAdminTestJSON-970420209 None] <== create_volume: return (1053ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'} {{(pid=87272) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 04 11:00:44 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-d51b98b3-cf67-4ef9-bea6-2f4ee1c64bf0 tempest-VolumeQuotasAdminTestJSON-970420209 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.062s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 11:00:44 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-d51b98b3-cf67-4ef9-bea6-2f4ee1c64bf0 tempest-VolumeQuotasAdminTestJSON-970420209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (954d6a0e-c1fc-4762-9384-e45469bf0c8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-52222295-9c6b-4567-b55d-ed1a2752d415', 'volume_size': 1}' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:00:44 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-d51b98b3-cf67-4ef9-bea6-2f4ee1c64bf0 tempest-VolumeQuotasAdminTestJSON-970420209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46855651-c4bd-4f13-a375-0d0bb352897f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:00:44 devstack cinder-volume[87272]: INFO cinder.volume.flows.manager.create_volume [None req-d51b98b3-cf67-4ef9-bea6-2f4ee1c64bf0 tempest-VolumeQuotasAdminTestJSON-970420209 None] Volume volume-52222295-9c6b-4567-b55d-ed1a2752d415 (52222295-9c6b-4567-b55d-ed1a2752d415): created successfully Nov 04 11:00:44 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-d51b98b3-cf67-4ef9-bea6-2f4ee1c64bf0 tempest-VolumeQuotasAdminTestJSON-970420209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46855651-c4bd-4f13-a375-0d0bb352897f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:00:44 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-d51b98b3-cf67-4ef9-bea6-2f4ee1c64bf0 tempest-VolumeQuotasAdminTestJSON-970420209 None] Flow 'volume_create_manager' (67fd3327-c958-4559-872e-d4ca708d430c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87272) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 11:00:44 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-d51b98b3-cf67-4ef9-bea6-2f4ee1c64bf0 tempest-VolumeQuotasAdminTestJSON-970420209 None] Created volume successfully. Nov 04 11:00:45 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [req-10ef6b01-f3f8-43cf-a756-9c96fbb16655 req-56e9a4d4-9d77-4456-b4b3-3ea14441cfb5 tempest-TestServerVolumeAttachmentScenario-1780213436 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 11:00:45 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [req-10ef6b01-f3f8-43cf-a756-9c96fbb16655 req-56e9a4d4-9d77-4456-b4b3-3ea14441cfb5 tempest-TestServerVolumeAttachmentScenario-1780213436 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 11:00:45 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [req-10ef6b01-f3f8-43cf-a756-9c96fbb16655 req-56e9a4d4-9d77-4456-b4b3-3ea14441cfb5 tempest-TestServerVolumeAttachmentScenario-1780213436 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.020s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 11:00:45 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [req-10ef6b01-f3f8-43cf-a756-9c96fbb16655 req-56e9a4d4-9d77-4456-b4b3-3ea14441cfb5 tempest-TestServerVolumeAttachmentScenario-1780213436 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898', 'name': 'volume-b4ff3daf-3d02-4ddd-aac2-e49ee57577aa', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f3d21116-81ff-4033-af25-090367c90328', 'enforce_multipath': True} {{(pid=87272) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 04 11:00:45 devstack cinder-volume[87272]: INFO cinder.volume.manager [req-10ef6b01-f3f8-43cf-a756-9c96fbb16655 req-56e9a4d4-9d77-4456-b4b3-3ea14441cfb5 tempest-TestServerVolumeAttachmentScenario-1780213436 None] attachment_update completed successfully. Nov 04 11:00:46 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-92b829ef-064a-469f-bd63-968423d603c9 tempest-VolumeQuotasAdminTestJSON-1828150459 None] Transfer volume completed successfully. Nov 04 11:00:46 devstack cinder-volume[87272]: DEBUG cinder.volume.flows.manager.create_volume [None req-43d3a6bd-951f-4768-bb53-d7625fd8b82a tempest-CreateVolumesFromSnapshotTest-1102546986 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87272) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 11:00:46 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-43d3a6bd-951f-4768-bb53-d7625fd8b82a tempest-CreateVolumesFromSnapshotTest-1102546986 None] Flow 'volume_create_manager' (1e712da4-194f-4931-9057-db47cfdad529) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 11:00:46 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-43d3a6bd-951f-4768-bb53-d7625fd8b82a tempest-CreateVolumesFromSnapshotTest-1102546986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (570fbeba-5032-4b4c-ba7b-73f75e74436b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:00:46 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-43d3a6bd-951f-4768-bb53-d7625fd8b82a tempest-CreateVolumesFromSnapshotTest-1102546986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (570fbeba-5032-4b4c-ba7b-73f75e74436b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T10:00:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-487972634',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b49eddf-ecef-4369-a9a9-9545727024ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b86d54028a245849d7daa5b00958de5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T10:00:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T10:00:47Z,use_quota=True,user_id='e28c53370b204f2197bd2177ce1b4b1c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8989e4f-21e3-4f0a-9584-0d818784e883),volume_type_id=f8989e4f-21e3-4f0a-9584-0d818784e883)' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:00:46 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-43d3a6bd-951f-4768-bb53-d7625fd8b82a tempest-CreateVolumesFromSnapshotTest-1102546986 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b1b03b0-85c2-4f6f-9899-617efbe716ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:00:46 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-43d3a6bd-951f-4768-bb53-d7625fd8b82a tempest-CreateVolumesFromSnapshotTest-1102546986 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b1b03b0-85c2-4f6f-9899-617efbe716ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:00:46 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-43d3a6bd-951f-4768-bb53-d7625fd8b82a tempest-CreateVolumesFromSnapshotTest-1102546986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27d50596-a5a6-4601-9123-b72544307601) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:00:46 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-43d3a6bd-951f-4768-bb53-d7625fd8b82a tempest-CreateVolumesFromSnapshotTest-1102546986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27d50596-a5a6-4601-9123-b72544307601) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6b49eddf-ecef-4369-a9a9-9545727024ec', 'volume_name': 'volume-6b49eddf-ecef-4369-a9a9-9545727024ec', 'volume_size': 1}' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:00:46 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-43d3a6bd-951f-4768-bb53-d7625fd8b82a tempest-CreateVolumesFromSnapshotTest-1102546986 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3502a1a-6571-43e7-9361-28f5bcebab5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:00:46 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-43d3a6bd-951f-4768-bb53-d7625fd8b82a tempest-CreateVolumesFromSnapshotTest-1102546986 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3502a1a-6571-43e7-9361-28f5bcebab5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:00:46 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-43d3a6bd-951f-4768-bb53-d7625fd8b82a tempest-CreateVolumesFromSnapshotTest-1102546986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5499e36e-2c2e-4e1f-8740-7edd25b36544) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:00:46 devstack cinder-volume[87272]: INFO cinder.volume.flows.manager.create_volume [None req-43d3a6bd-951f-4768-bb53-d7625fd8b82a tempest-CreateVolumesFromSnapshotTest-1102546986 None] Volume 6b49eddf-ecef-4369-a9a9-9545727024ec: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6b49eddf-ecef-4369-a9a9-9545727024ec', 'volume_size': 1} Nov 04 11:00:46 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-43d3a6bd-951f-4768-bb53-d7625fd8b82a tempest-CreateVolumesFromSnapshotTest-1102546986 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 11:00:46 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-43d3a6bd-951f-4768-bb53-d7625fd8b82a tempest-CreateVolumesFromSnapshotTest-1102546986 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 11:00:46 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-43d3a6bd-951f-4768-bb53-d7625fd8b82a tempest-CreateVolumesFromSnapshotTest-1102546986 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T10:00:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-487972634',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b49eddf-ecef-4369-a9a9-9545727024ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b86d54028a245849d7daa5b00958de5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T10:00:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T10:00:47Z,use_quota=True,user_id='e28c53370b204f2197bd2177ce1b4b1c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8989e4f-21e3-4f0a-9584-0d818784e883),volume_type_id=f8989e4f-21e3-4f0a-9584-0d818784e883)}" {{(pid=87272) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 04 11:00:46 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.remotefs [None req-43d3a6bd-951f-4768-bb53-d7625fd8b82a tempest-CreateVolumesFromSnapshotTest-1102546986 None] Creating volume 6b49eddf-ecef-4369-a9a9-9545727024ec {{(pid=87272) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 11:00:46 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-43d3a6bd-951f-4768-bb53-d7625fd8b82a tempest-CreateVolumesFromSnapshotTest-1102546986 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 11:00:46 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-43d3a6bd-951f-4768-bb53-d7625fd8b82a tempest-CreateVolumesFromSnapshotTest-1102546986 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 11:00:46 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-43d3a6bd-951f-4768-bb53-d7625fd8b82a tempest-CreateVolumesFromSnapshotTest-1102546986 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898': None} {{(pid=87272) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 11:00:46 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-43d3a6bd-951f-4768-bb53-d7625fd8b82a tempest-CreateVolumesFromSnapshotTest-1102546986 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'] {{(pid=87272) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 11:00:46 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-43d3a6bd-951f-4768-bb53-d7625fd8b82a tempest-CreateVolumesFromSnapshotTest-1102546986 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 11:00:46 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-43d3a6bd-951f-4768-bb53-d7625fd8b82a tempest-CreateVolumesFromSnapshotTest-1102546986 None] Selected osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898 as target Quobyte volume. {{(pid=87272) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 11:00:46 devstack cinder-volume[87272]: INFO cinder.volume.drivers.remotefs [None req-43d3a6bd-951f-4768-bb53-d7625fd8b82a tempest-CreateVolumesFromSnapshotTest-1102546986 None] casted to osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898 Nov 04 11:00:46 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-43d3a6bd-951f-4768-bb53-d7625fd8b82a tempest-CreateVolumesFromSnapshotTest-1102546986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-6b49eddf-ecef-4369-a9a9-9545727024ec 1073741824 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:00:46 devstack sudo[100429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-6b49eddf-ecef-4369-a9a9-9545727024ec 1073741824 Nov 04 11:00:46 devstack sudo[100429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:00:47 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-72941137-3114-48bf-8752-ab0faa9c0db8 tempest-VolumeQuotasAdminTestJSON-853309542 None] Acquiring lock "cinder-52222295-9c6b-4567-b55d-ed1a2752d415-delete_volume" by "delete_volume" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 11:00:47 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-72941137-3114-48bf-8752-ab0faa9c0db8 tempest-VolumeQuotasAdminTestJSON-853309542 None] Lock "cinder-52222295-9c6b-4567-b55d-ed1a2752d415-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 11:00:47 devstack cinder-volume[87272]: DEBUG dbcounter [-] [87272] Writing DB stats cinder:SELECT=139,cinder:INSERT=34,cinder:UPDATE=142,cinder:DELETE=8 {{(pid=87272) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 11:00:47 devstack cinder-volume[87272]: INFO cinder.volume.manager [req-0bae9025-8496-41af-bf93-ed6e7ddcf25c req-595c8259-7491-40b7-a052-cbbe74a62344 tempest-TestServerVolumeAttachmentScenario-1780213436 None] Terminate volume connection completed successfully. Nov 04 11:00:47 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [req-0bae9025-8496-41af-bf93-ed6e7ddcf25c req-595c8259-7491-40b7-a052-cbbe74a62344 tempest-TestServerVolumeAttachmentScenario-1780213436 None] Deleting attachment f3d21116-81ff-4033-af25-090367c90328. {{(pid=87272) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 04 11:00:47 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-72941137-3114-48bf-8752-ab0faa9c0db8 tempest-VolumeQuotasAdminTestJSON-853309542 None] Acquiring lock "cinder-quobyte-52222295-9c6b-4567-b55d-ed1a2752d415" by "delete_volume" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 11:00:47 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-72941137-3114-48bf-8752-ab0faa9c0db8 tempest-VolumeQuotasAdminTestJSON-853309542 None] Lock "cinder-quobyte-52222295-9c6b-4567-b55d-ed1a2752d415" acquired by "delete_volume" :: waited 0.024s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 11:00:47 devstack cinder-volume[87272]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5ccb148-962d-4b02-8eab-269c37563553]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 11:00:47 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-72941137-3114-48bf-8752-ab0faa9c0db8 tempest-VolumeQuotasAdminTestJSON-853309542 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-52222295-9c6b-4567-b55d-ed1a2752d415 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:00:47 devstack sudo[100429]: pam_unix(sudo:session): session closed for user root Nov 04 11:00:47 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-43d3a6bd-951f-4768-bb53-d7625fd8b82a tempest-CreateVolumesFromSnapshotTest-1102546986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-6b49eddf-ecef-4369-a9a9-9545727024ec 1073741824" returned: 0 in 0.742s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:00:47 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-43d3a6bd-951f-4768-bb53-d7625fd8b82a tempest-CreateVolumesFromSnapshotTest-1102546986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-6b49eddf-ecef-4369-a9a9-9545727024ec {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:00:47 devstack sudo[100437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-52222295-9c6b-4567-b55d-ed1a2752d415 Nov 04 11:00:47 devstack sudo[100437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:00:47 devstack sudo[100438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-6b49eddf-ecef-4369-a9a9-9545727024ec Nov 04 11:00:47 devstack sudo[100438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:00:48 devstack sudo[100438]: pam_unix(sudo:session): session closed for user root Nov 04 11:00:48 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-43d3a6bd-951f-4768-bb53-d7625fd8b82a tempest-CreateVolumesFromSnapshotTest-1102546986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-6b49eddf-ecef-4369-a9a9-9545727024ec" returned: 0 in 0.334s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:00:48 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-43d3a6bd-951f-4768-bb53-d7625fd8b82a tempest-CreateVolumesFromSnapshotTest-1102546986 None] <== create_volume: return (1159ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'} {{(pid=87272) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 04 11:00:48 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-43d3a6bd-951f-4768-bb53-d7625fd8b82a tempest-CreateVolumesFromSnapshotTest-1102546986 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.162s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 11:00:48 devstack sudo[100437]: pam_unix(sudo:session): session closed for user root Nov 04 11:00:48 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-43d3a6bd-951f-4768-bb53-d7625fd8b82a tempest-CreateVolumesFromSnapshotTest-1102546986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5499e36e-2c2e-4e1f-8740-7edd25b36544) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6b49eddf-ecef-4369-a9a9-9545727024ec', 'volume_size': 1}' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:00:48 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-43d3a6bd-951f-4768-bb53-d7625fd8b82a tempest-CreateVolumesFromSnapshotTest-1102546986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (61c2bfec-ee17-4f26-a391-6eb342dca48a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:00:48 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-72941137-3114-48bf-8752-ab0faa9c0db8 tempest-VolumeQuotasAdminTestJSON-853309542 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-52222295-9c6b-4567-b55d-ed1a2752d415" returned: 0 in 0.439s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:00:48 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-72941137-3114-48bf-8752-ab0faa9c0db8 tempest-VolumeQuotasAdminTestJSON-853309542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-52222295-9c6b-4567-b55d-ed1a2752d415 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:00:48 devstack cinder-volume[87272]: INFO cinder.volume.flows.manager.create_volume [None req-43d3a6bd-951f-4768-bb53-d7625fd8b82a tempest-CreateVolumesFromSnapshotTest-1102546986 None] Volume volume-6b49eddf-ecef-4369-a9a9-9545727024ec (6b49eddf-ecef-4369-a9a9-9545727024ec): created successfully Nov 04 11:00:48 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-43d3a6bd-951f-4768-bb53-d7625fd8b82a tempest-CreateVolumesFromSnapshotTest-1102546986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (61c2bfec-ee17-4f26-a391-6eb342dca48a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:00:48 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-43d3a6bd-951f-4768-bb53-d7625fd8b82a tempest-CreateVolumesFromSnapshotTest-1102546986 None] Flow 'volume_create_manager' (1e712da4-194f-4931-9057-db47cfdad529) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87272) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 11:00:48 devstack sudo[100445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-52222295-9c6b-4567-b55d-ed1a2752d415 Nov 04 11:00:48 devstack sudo[100445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:00:48 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-43d3a6bd-951f-4768-bb53-d7625fd8b82a tempest-CreateVolumesFromSnapshotTest-1102546986 None] Created volume successfully. Nov 04 11:00:48 devstack sudo[100445]: pam_unix(sudo:session): session closed for user root Nov 04 11:00:48 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-72941137-3114-48bf-8752-ab0faa9c0db8 tempest-VolumeQuotasAdminTestJSON-853309542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-52222295-9c6b-4567-b55d-ed1a2752d415" returned: 0 in 0.290s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:00:48 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-72941137-3114-48bf-8752-ab0faa9c0db8 tempest-VolumeQuotasAdminTestJSON-853309542 None] Lock "cinder-quobyte-52222295-9c6b-4567-b55d-ed1a2752d415" released by "delete_volume" :: held 0.800s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 11:00:48 devstack cinder-volume[87272]: DEBUG cinder.quota [None req-72941137-3114-48bf-8752-ab0faa9c0db8 tempest-VolumeQuotasAdminTestJSON-853309542 None] Created reservations ['3cbdc763-a267-41e3-be68-93e0f8b50694', '5649c944-eb46-45a4-b398-bc88587492c9', '0cc844fb-6b16-46f1-992f-579cd383e4ea', 'ce76e9c7-a1b6-4dca-8a2b-0098939301d1'] {{(pid=87272) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 11:00:48 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-72941137-3114-48bf-8752-ab0faa9c0db8 tempest-VolumeQuotasAdminTestJSON-853309542 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 11:00:48 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-72941137-3114-48bf-8752-ab0faa9c0db8 tempest-VolumeQuotasAdminTestJSON-853309542 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 11:00:48 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-72941137-3114-48bf-8752-ab0faa9c0db8 tempest-VolumeQuotasAdminTestJSON-853309542 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898': None} {{(pid=87272) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 11:00:48 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-72941137-3114-48bf-8752-ab0faa9c0db8 tempest-VolumeQuotasAdminTestJSON-853309542 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'] {{(pid=87272) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 11:00:48 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-72941137-3114-48bf-8752-ab0faa9c0db8 tempest-VolumeQuotasAdminTestJSON-853309542 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 11:00:48 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-72941137-3114-48bf-8752-ab0faa9c0db8 tempest-VolumeQuotasAdminTestJSON-853309542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:00:48 devstack sudo[100448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1 Nov 04 11:00:48 devstack sudo[100448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:00:48 devstack sudo[100448]: pam_unix(sudo:session): session closed for user root Nov 04 11:00:48 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-72941137-3114-48bf-8752-ab0faa9c0db8 tempest-VolumeQuotasAdminTestJSON-853309542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1" returned: 0 in 0.331s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:00:48 devstack cinder-volume[87272]: DEBUG cinder.manager [None req-72941137-3114-48bf-8752-ab0faa9c0db8 tempest-VolumeQuotasAdminTestJSON-853309542 None] Notifying Schedulers of capabilities ... {{(pid=87272) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 11:00:48 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-72941137-3114-48bf-8752-ab0faa9c0db8 tempest-VolumeQuotasAdminTestJSON-853309542 None] Deleted volume successfully. Nov 04 11:00:48 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-72941137-3114-48bf-8752-ab0faa9c0db8 tempest-VolumeQuotasAdminTestJSON-853309542 None] Lock "cinder-52222295-9c6b-4567-b55d-ed1a2752d415-delete_volume" released by "delete_volume" :: held 1.423s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 11:00:49 devstack cinder-volume[87272]: INFO cinder.volume.manager [req-0a95a8da-73a4-4e27-a4db-ed11cb6ec6de req-dfb39203-258b-4420-8b5b-bb8af28d8134 tempest-TestServerVolumeAttachmentScenario-1780213436 None] Terminate volume connection completed successfully. Nov 04 11:00:49 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [req-0a95a8da-73a4-4e27-a4db-ed11cb6ec6de req-dfb39203-258b-4420-8b5b-bb8af28d8134 tempest-TestServerVolumeAttachmentScenario-1780213436 None] Deleting attachment 9fb8961b-edb3-420a-9e3e-9cc18cb88435. {{(pid=87272) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 04 11:00:49 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-6c2eaa14-9bb1-4837-9a1c-9ec198f04d51 tempest-CreateVolumesFromSnapshotTest-1102546986 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 11:00:49 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-6c2eaa14-9bb1-4837-9a1c-9ec198f04d51 tempest-CreateVolumesFromSnapshotTest-1102546986 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 11:00:49 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.remotefs [None req-6c2eaa14-9bb1-4837-9a1c-9ec198f04d51 tempest-CreateVolumesFromSnapshotTest-1102546986 None] Creating offline snapshot 3258c275-6b69-4317-b012-6f09371d5257 of volume 6b49eddf-ecef-4369-a9a9-9545727024ec {{(pid=87272) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 04 11:00:49 devstack cinder-volume[87272]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ab3c164-ad69-43e3-ad54-0859984c6f55]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 11:00:49 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-6c2eaa14-9bb1-4837-9a1c-9ec198f04d51 tempest-CreateVolumesFromSnapshotTest-1102546986 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-6b49eddf-ecef-4369-a9a9-9545727024ec {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:00:49 devstack sudo[100478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-6b49eddf-ecef-4369-a9a9-9545727024ec Nov 04 11:00:49 devstack sudo[100478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:00:49 devstack sudo[100478]: pam_unix(sudo:session): session closed for user root Nov 04 11:00:49 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-6c2eaa14-9bb1-4837-9a1c-9ec198f04d51 tempest-CreateVolumesFromSnapshotTest-1102546986 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-6b49eddf-ecef-4369-a9a9-9545727024ec" returned: 0 in 0.436s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:00:49 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-6c2eaa14-9bb1-4837-9a1c-9ec198f04d51 tempest-CreateVolumesFromSnapshotTest-1102546986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-6b49eddf-ecef-4369-a9a9-9545727024ec,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-6b49eddf-ecef-4369-a9a9-9545727024ec.3258c275-6b69-4317-b012-6f09371d5257 1G {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:00:49 devstack sudo[100483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-6b49eddf-ecef-4369-a9a9-9545727024ec,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-6b49eddf-ecef-4369-a9a9-9545727024ec.3258c275-6b69-4317-b012-6f09371d5257 1G Nov 04 11:00:49 devstack sudo[100483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:00:50 devstack sudo[100483]: pam_unix(sudo:session): session closed for user root Nov 04 11:00:50 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-6c2eaa14-9bb1-4837-9a1c-9ec198f04d51 tempest-CreateVolumesFromSnapshotTest-1102546986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-6b49eddf-ecef-4369-a9a9-9545727024ec,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-6b49eddf-ecef-4369-a9a9-9545727024ec.3258c275-6b69-4317-b012-6f09371d5257 1G" returned: 0 in 0.618s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:00:50 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-6c2eaa14-9bb1-4837-9a1c-9ec198f04d51 tempest-CreateVolumesFromSnapshotTest-1102546986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6b49eddf-ecef-4369-a9a9-9545727024ec -F qcow2 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-6b49eddf-ecef-4369-a9a9-9545727024ec.3258c275-6b69-4317-b012-6f09371d5257 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:00:50 devstack sudo[100489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6b49eddf-ecef-4369-a9a9-9545727024ec -F qcow2 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-6b49eddf-ecef-4369-a9a9-9545727024ec.3258c275-6b69-4317-b012-6f09371d5257 Nov 04 11:00:50 devstack sudo[100489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:00:50 devstack sudo[100489]: pam_unix(sudo:session): session closed for user root Nov 04 11:00:50 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-6c2eaa14-9bb1-4837-9a1c-9ec198f04d51 tempest-CreateVolumesFromSnapshotTest-1102546986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6b49eddf-ecef-4369-a9a9-9545727024ec -F qcow2 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-6b49eddf-ecef-4369-a9a9-9545727024ec.3258c275-6b69-4317-b012-6f09371d5257" returned: 0 in 0.503s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:00:50 devstack cinder-volume[87272]: WARNING cinder.volume.drivers.remotefs [None req-6c2eaa14-9bb1-4837-9a1c-9ec198f04d51 tempest-CreateVolumesFromSnapshotTest-1102546986 None] /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-6b49eddf-ecef-4369-a9a9-9545727024ec.3258c275-6b69-4317-b012-6f09371d5257 is being set with open permissions: ugo+rw Nov 04 11:00:50 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-6c2eaa14-9bb1-4837-9a1c-9ec198f04d51 tempest-CreateVolumesFromSnapshotTest-1102546986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-6b49eddf-ecef-4369-a9a9-9545727024ec.3258c275-6b69-4317-b012-6f09371d5257 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:00:50 devstack sudo[100513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-6b49eddf-ecef-4369-a9a9-9545727024ec.3258c275-6b69-4317-b012-6f09371d5257 Nov 04 11:00:51 devstack sudo[100513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:00:51 devstack sudo[100513]: pam_unix(sudo:session): session closed for user root Nov 04 11:00:51 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-6c2eaa14-9bb1-4837-9a1c-9ec198f04d51 tempest-CreateVolumesFromSnapshotTest-1102546986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-6b49eddf-ecef-4369-a9a9-9545727024ec.3258c275-6b69-4317-b012-6f09371d5257" returned: 0 in 0.327s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:00:51 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-6c2eaa14-9bb1-4837-9a1c-9ec198f04d51 tempest-CreateVolumesFromSnapshotTest-1102546986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-6b49eddf-ecef-4369-a9a9-9545727024ec.info {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:00:51 devstack sudo[100518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-6b49eddf-ecef-4369-a9a9-9545727024ec.info Nov 04 11:00:51 devstack sudo[100518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:00:51 devstack sudo[100518]: pam_unix(sudo:session): session closed for user root Nov 04 11:00:51 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-6c2eaa14-9bb1-4837-9a1c-9ec198f04d51 tempest-CreateVolumesFromSnapshotTest-1102546986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-6b49eddf-ecef-4369-a9a9-9545727024ec.info" returned: 0 in 0.356s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:00:51 devstack cinder-volume[87272]: WARNING cinder.volume.drivers.remotefs [None req-6c2eaa14-9bb1-4837-9a1c-9ec198f04d51 tempest-CreateVolumesFromSnapshotTest-1102546986 None] /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-6b49eddf-ecef-4369-a9a9-9545727024ec.info is being set with open permissions: ugo+rw Nov 04 11:00:51 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-6c2eaa14-9bb1-4837-9a1c-9ec198f04d51 tempest-CreateVolumesFromSnapshotTest-1102546986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-6b49eddf-ecef-4369-a9a9-9545727024ec.info {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:00:51 devstack sudo[100521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-6b49eddf-ecef-4369-a9a9-9545727024ec.info Nov 04 11:00:51 devstack sudo[100521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:00:52 devstack sudo[100521]: pam_unix(sudo:session): session closed for user root Nov 04 11:00:52 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-6c2eaa14-9bb1-4837-9a1c-9ec198f04d51 tempest-CreateVolumesFromSnapshotTest-1102546986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-6b49eddf-ecef-4369-a9a9-9545727024ec.info" returned: 0 in 0.426s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:00:52 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-6c2eaa14-9bb1-4837-9a1c-9ec198f04d51 tempest-CreateVolumesFromSnapshotTest-1102546986 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.821s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 11:00:52 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-6c2eaa14-9bb1-4837-9a1c-9ec198f04d51 tempest-CreateVolumesFromSnapshotTest-1102546986 None] Create snapshot completed successfully Nov 04 11:00:53 devstack cinder-volume[87272]: DEBUG cinder.volume.flows.manager.create_volume [None req-de134b85-6ad8-4d70-9d16-5eabaa352645 tempest-CreateVolumesFromSnapshotTest-1102546986 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87272) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 11:00:53 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-de134b85-6ad8-4d70-9d16-5eabaa352645 tempest-CreateVolumesFromSnapshotTest-1102546986 None] Flow 'volume_create_manager' (ca302a7b-a2eb-443d-b00a-ccbf8d46942c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 11:00:53 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-de134b85-6ad8-4d70-9d16-5eabaa352645 tempest-CreateVolumesFromSnapshotTest-1102546986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b100ea31-889d-4c75-bd8d-6d58ecb75161) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:00:53 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-de134b85-6ad8-4d70-9d16-5eabaa352645 tempest-CreateVolumesFromSnapshotTest-1102546986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b100ea31-889d-4c75-bd8d-6d58ecb75161) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T10:00:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2063437843',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e73311f6-e9eb-45a4-91b4-5574f0bbc66c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b86d54028a245849d7daa5b00958de5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T10:00:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T10:00:53Z,use_quota=True,user_id='e28c53370b204f2197bd2177ce1b4b1c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8989e4f-21e3-4f0a-9584-0d818784e883),volume_type_id=f8989e4f-21e3-4f0a-9584-0d818784e883)' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:00:53 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-de134b85-6ad8-4d70-9d16-5eabaa352645 tempest-CreateVolumesFromSnapshotTest-1102546986 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dbf91da1-0ae2-4512-8bf0-d47e0958a016) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:00:53 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-de134b85-6ad8-4d70-9d16-5eabaa352645 tempest-CreateVolumesFromSnapshotTest-1102546986 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dbf91da1-0ae2-4512-8bf0-d47e0958a016) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:00:53 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-de134b85-6ad8-4d70-9d16-5eabaa352645 tempest-CreateVolumesFromSnapshotTest-1102546986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (125299c7-6f20-4a90-91b5-8ae22953fcda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:00:53 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-de134b85-6ad8-4d70-9d16-5eabaa352645 tempest-CreateVolumesFromSnapshotTest-1102546986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (125299c7-6f20-4a90-91b5-8ae22953fcda) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e73311f6-e9eb-45a4-91b4-5574f0bbc66c', 'volume_name': 'volume-e73311f6-e9eb-45a4-91b4-5574f0bbc66c', 'volume_size': 1}' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:00:53 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-de134b85-6ad8-4d70-9d16-5eabaa352645 tempest-CreateVolumesFromSnapshotTest-1102546986 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54c87abf-788e-4350-b11e-6f5b3ba64700) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:00:53 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-de134b85-6ad8-4d70-9d16-5eabaa352645 tempest-CreateVolumesFromSnapshotTest-1102546986 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54c87abf-788e-4350-b11e-6f5b3ba64700) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:00:53 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-de134b85-6ad8-4d70-9d16-5eabaa352645 tempest-CreateVolumesFromSnapshotTest-1102546986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1c785ba-4e29-43d5-9cd3-d555d9f0efc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:00:53 devstack cinder-volume[87272]: INFO cinder.volume.flows.manager.create_volume [None req-de134b85-6ad8-4d70-9d16-5eabaa352645 tempest-CreateVolumesFromSnapshotTest-1102546986 None] Volume e73311f6-e9eb-45a4-91b4-5574f0bbc66c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e73311f6-e9eb-45a4-91b4-5574f0bbc66c', 'volume_size': 1} Nov 04 11:00:53 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-de134b85-6ad8-4d70-9d16-5eabaa352645 tempest-CreateVolumesFromSnapshotTest-1102546986 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 11:00:53 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-de134b85-6ad8-4d70-9d16-5eabaa352645 tempest-CreateVolumesFromSnapshotTest-1102546986 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 11:00:53 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-de134b85-6ad8-4d70-9d16-5eabaa352645 tempest-CreateVolumesFromSnapshotTest-1102546986 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T10:00:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2063437843',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e73311f6-e9eb-45a4-91b4-5574f0bbc66c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b86d54028a245849d7daa5b00958de5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T10:00:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T10:00:53Z,use_quota=True,user_id='e28c53370b204f2197bd2177ce1b4b1c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8989e4f-21e3-4f0a-9584-0d818784e883),volume_type_id=f8989e4f-21e3-4f0a-9584-0d818784e883)}" {{(pid=87272) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 04 11:00:53 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.remotefs [None req-de134b85-6ad8-4d70-9d16-5eabaa352645 tempest-CreateVolumesFromSnapshotTest-1102546986 None] Creating volume e73311f6-e9eb-45a4-91b4-5574f0bbc66c {{(pid=87272) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 11:00:53 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-de134b85-6ad8-4d70-9d16-5eabaa352645 tempest-CreateVolumesFromSnapshotTest-1102546986 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 11:00:53 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-de134b85-6ad8-4d70-9d16-5eabaa352645 tempest-CreateVolumesFromSnapshotTest-1102546986 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 11:00:53 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-de134b85-6ad8-4d70-9d16-5eabaa352645 tempest-CreateVolumesFromSnapshotTest-1102546986 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898': None} {{(pid=87272) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 11:00:53 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-de134b85-6ad8-4d70-9d16-5eabaa352645 tempest-CreateVolumesFromSnapshotTest-1102546986 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'] {{(pid=87272) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 11:00:53 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-de134b85-6ad8-4d70-9d16-5eabaa352645 tempest-CreateVolumesFromSnapshotTest-1102546986 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 11:00:53 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-de134b85-6ad8-4d70-9d16-5eabaa352645 tempest-CreateVolumesFromSnapshotTest-1102546986 None] Selected osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898 as target Quobyte volume. {{(pid=87272) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 11:00:53 devstack cinder-volume[87272]: INFO cinder.volume.drivers.remotefs [None req-de134b85-6ad8-4d70-9d16-5eabaa352645 tempest-CreateVolumesFromSnapshotTest-1102546986 None] casted to osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898 Nov 04 11:00:53 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-de134b85-6ad8-4d70-9d16-5eabaa352645 tempest-CreateVolumesFromSnapshotTest-1102546986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-e73311f6-e9eb-45a4-91b4-5574f0bbc66c 1073741824 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:00:53 devstack sudo[100529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-e73311f6-e9eb-45a4-91b4-5574f0bbc66c 1073741824 Nov 04 11:00:53 devstack sudo[100529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:00:53 devstack cinder-volume[87272]: DEBUG cinder.volume.flows.manager.create_volume [None req-606266b9-7c36-4c88-9222-5501af121d21 tempest-CreateVolumesFromSnapshotTest-1102546986 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87272) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 11:00:54 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-606266b9-7c36-4c88-9222-5501af121d21 tempest-CreateVolumesFromSnapshotTest-1102546986 None] Flow 'volume_create_manager' (3c57dce4-09af-4985-a932-d691732657e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 11:00:54 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-606266b9-7c36-4c88-9222-5501af121d21 tempest-CreateVolumesFromSnapshotTest-1102546986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b681fa0-c044-4489-b044-938e84820d86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:00:54 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-606266b9-7c36-4c88-9222-5501af121d21 tempest-CreateVolumesFromSnapshotTest-1102546986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b681fa0-c044-4489-b044-938e84820d86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T10:00:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1153188552',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=071d399f-3743-4471-ba7d-1efec0af20e1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b86d54028a245849d7daa5b00958de5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T10:00:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T10:00:54Z,use_quota=True,user_id='e28c53370b204f2197bd2177ce1b4b1c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8989e4f-21e3-4f0a-9584-0d818784e883),volume_type_id=f8989e4f-21e3-4f0a-9584-0d818784e883)' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:00:54 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-606266b9-7c36-4c88-9222-5501af121d21 tempest-CreateVolumesFromSnapshotTest-1102546986 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3f51220-4d30-4bca-a2c7-38191d04c50e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:00:54 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-606266b9-7c36-4c88-9222-5501af121d21 tempest-CreateVolumesFromSnapshotTest-1102546986 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3f51220-4d30-4bca-a2c7-38191d04c50e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:00:54 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-606266b9-7c36-4c88-9222-5501af121d21 tempest-CreateVolumesFromSnapshotTest-1102546986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a685e71-ab2e-4222-a4f7-7a1ff1c5622f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:00:54 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-606266b9-7c36-4c88-9222-5501af121d21 tempest-CreateVolumesFromSnapshotTest-1102546986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a685e71-ab2e-4222-a4f7-7a1ff1c5622f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '071d399f-3743-4471-ba7d-1efec0af20e1', 'volume_name': 'volume-071d399f-3743-4471-ba7d-1efec0af20e1', 'volume_size': 1}' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:00:54 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-606266b9-7c36-4c88-9222-5501af121d21 tempest-CreateVolumesFromSnapshotTest-1102546986 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e59b303-86d5-4ea1-89c2-fec8c59963c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:00:54 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-606266b9-7c36-4c88-9222-5501af121d21 tempest-CreateVolumesFromSnapshotTest-1102546986 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e59b303-86d5-4ea1-89c2-fec8c59963c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:00:54 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-606266b9-7c36-4c88-9222-5501af121d21 tempest-CreateVolumesFromSnapshotTest-1102546986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (93f1abcd-d7ca-42da-8983-046c082393ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:00:54 devstack cinder-volume[87272]: INFO cinder.volume.flows.manager.create_volume [None req-606266b9-7c36-4c88-9222-5501af121d21 tempest-CreateVolumesFromSnapshotTest-1102546986 None] Volume 071d399f-3743-4471-ba7d-1efec0af20e1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-071d399f-3743-4471-ba7d-1efec0af20e1', 'volume_size': 1} Nov 04 11:00:54 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-606266b9-7c36-4c88-9222-5501af121d21 tempest-CreateVolumesFromSnapshotTest-1102546986 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 11:00:54 devstack sudo[100529]: pam_unix(sudo:session): session closed for user root Nov 04 11:00:54 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-de134b85-6ad8-4d70-9d16-5eabaa352645 tempest-CreateVolumesFromSnapshotTest-1102546986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-e73311f6-e9eb-45a4-91b4-5574f0bbc66c 1073741824" returned: 0 in 1.049s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:00:54 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-de134b85-6ad8-4d70-9d16-5eabaa352645 tempest-CreateVolumesFromSnapshotTest-1102546986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-e73311f6-e9eb-45a4-91b4-5574f0bbc66c {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:00:54 devstack sudo[100535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-e73311f6-e9eb-45a4-91b4-5574f0bbc66c Nov 04 11:00:54 devstack sudo[100535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:00:54 devstack cinder-volume[87272]: DEBUG cinder.volume.flows.manager.create_volume [None req-06065a97-930b-4628-9fcf-ec8caa12b42e tempest-VolumeRetypeWithoutMigrationTest-1700915263 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87272) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 11:00:54 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-06065a97-930b-4628-9fcf-ec8caa12b42e tempest-VolumeRetypeWithoutMigrationTest-1700915263 None] Flow 'volume_create_manager' (bf598b8b-e772-4114-b3e4-44e5cd11c55b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 11:00:54 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-06065a97-930b-4628-9fcf-ec8caa12b42e tempest-VolumeRetypeWithoutMigrationTest-1700915263 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dcbf23f5-3055-4efa-8d27-65ddcc7bcd31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:00:54 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-06065a97-930b-4628-9fcf-ec8caa12b42e tempest-VolumeRetypeWithoutMigrationTest-1700915263 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dcbf23f5-3055-4efa-8d27-65ddcc7bcd31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T10:00:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1848819612',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6149d4cf-c79d-4898-a7bf-39836eaa4d1d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b5db7ff4b32a4a40866b2999846c33d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T10:00:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T10:00:55Z,use_quota=True,user_id='b069311d0f274bbcafba8e786c98c6e3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(22064e13-af71-490d-85a3-49b9553241e5),volume_type_id=22064e13-af71-490d-85a3-49b9553241e5)' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:00:54 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-06065a97-930b-4628-9fcf-ec8caa12b42e tempest-VolumeRetypeWithoutMigrationTest-1700915263 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (26be91bd-3020-4962-b176-4ccb39473817) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:00:54 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-06065a97-930b-4628-9fcf-ec8caa12b42e tempest-VolumeRetypeWithoutMigrationTest-1700915263 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (26be91bd-3020-4962-b176-4ccb39473817) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:00:54 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-06065a97-930b-4628-9fcf-ec8caa12b42e tempest-VolumeRetypeWithoutMigrationTest-1700915263 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (15f260ec-8972-45e9-86de-a84e3bb69d17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:00:54 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-06065a97-930b-4628-9fcf-ec8caa12b42e tempest-VolumeRetypeWithoutMigrationTest-1700915263 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (15f260ec-8972-45e9-86de-a84e3bb69d17) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6149d4cf-c79d-4898-a7bf-39836eaa4d1d', 'volume_name': 'volume-6149d4cf-c79d-4898-a7bf-39836eaa4d1d', 'volume_size': 1}' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:00:54 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-06065a97-930b-4628-9fcf-ec8caa12b42e tempest-VolumeRetypeWithoutMigrationTest-1700915263 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc1e053b-339b-40f5-8bf3-1fda8107d247) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:00:54 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-06065a97-930b-4628-9fcf-ec8caa12b42e tempest-VolumeRetypeWithoutMigrationTest-1700915263 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc1e053b-339b-40f5-8bf3-1fda8107d247) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:00:54 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-06065a97-930b-4628-9fcf-ec8caa12b42e tempest-VolumeRetypeWithoutMigrationTest-1700915263 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e40dee11-a55b-4962-a175-6a035aab53e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:00:54 devstack cinder-volume[87272]: INFO cinder.volume.flows.manager.create_volume [None req-06065a97-930b-4628-9fcf-ec8caa12b42e tempest-VolumeRetypeWithoutMigrationTest-1700915263 None] Volume 6149d4cf-c79d-4898-a7bf-39836eaa4d1d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6149d4cf-c79d-4898-a7bf-39836eaa4d1d', 'volume_size': 1} Nov 04 11:00:54 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-06065a97-930b-4628-9fcf-ec8caa12b42e tempest-VolumeRetypeWithoutMigrationTest-1700915263 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 11:00:54 devstack cinder-volume[87272]: DEBUG cinder.volume.flows.manager.create_volume [None req-1f121071-b29d-41a4-adef-37bd15c024fa tempest-CreateVolumesFromSnapshotTest-1102546986 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87272) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 11:00:54 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-1f121071-b29d-41a4-adef-37bd15c024fa tempest-CreateVolumesFromSnapshotTest-1102546986 None] Flow 'volume_create_manager' (0fe0e5df-8936-4186-bf2e-f8e1f10bee27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 11:00:54 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-1f121071-b29d-41a4-adef-37bd15c024fa tempest-CreateVolumesFromSnapshotTest-1102546986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c0beafef-32a9-4c97-92bf-8520a65c1437) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:00:54 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-1f121071-b29d-41a4-adef-37bd15c024fa tempest-CreateVolumesFromSnapshotTest-1102546986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c0beafef-32a9-4c97-92bf-8520a65c1437) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T10:00:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2142698619',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=03bb086d-cccf-435c-af4b-51bf35d49c6e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b86d54028a245849d7daa5b00958de5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T10:00:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T10:00:55Z,use_quota=True,user_id='e28c53370b204f2197bd2177ce1b4b1c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8989e4f-21e3-4f0a-9584-0d818784e883),volume_type_id=f8989e4f-21e3-4f0a-9584-0d818784e883)' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:00:54 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-1f121071-b29d-41a4-adef-37bd15c024fa tempest-CreateVolumesFromSnapshotTest-1102546986 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80347e87-a015-483d-b25a-958a23e3bf10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:00:54 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-1f121071-b29d-41a4-adef-37bd15c024fa tempest-CreateVolumesFromSnapshotTest-1102546986 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80347e87-a015-483d-b25a-958a23e3bf10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:00:54 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-1f121071-b29d-41a4-adef-37bd15c024fa tempest-CreateVolumesFromSnapshotTest-1102546986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e22ad84-5d9f-4cc7-986e-ac100f002d2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:00:54 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-1f121071-b29d-41a4-adef-37bd15c024fa tempest-CreateVolumesFromSnapshotTest-1102546986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e22ad84-5d9f-4cc7-986e-ac100f002d2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '03bb086d-cccf-435c-af4b-51bf35d49c6e', 'volume_name': 'volume-03bb086d-cccf-435c-af4b-51bf35d49c6e', 'volume_size': 1}' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:00:54 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-1f121071-b29d-41a4-adef-37bd15c024fa tempest-CreateVolumesFromSnapshotTest-1102546986 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7923e92c-4ee7-4423-a8dc-eb127b8d6b74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:00:55 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-1f121071-b29d-41a4-adef-37bd15c024fa tempest-CreateVolumesFromSnapshotTest-1102546986 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7923e92c-4ee7-4423-a8dc-eb127b8d6b74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:00:55 devstack sudo[100535]: pam_unix(sudo:session): session closed for user root Nov 04 11:00:55 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-1f121071-b29d-41a4-adef-37bd15c024fa tempest-CreateVolumesFromSnapshotTest-1102546986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33d43a04-9327-48b3-bb02-83f1938b5544) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:00:55 devstack cinder-volume[87272]: INFO cinder.volume.flows.manager.create_volume [None req-1f121071-b29d-41a4-adef-37bd15c024fa tempest-CreateVolumesFromSnapshotTest-1102546986 None] Volume 03bb086d-cccf-435c-af4b-51bf35d49c6e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-03bb086d-cccf-435c-af4b-51bf35d49c6e', 'volume_size': 1} Nov 04 11:00:55 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-1f121071-b29d-41a4-adef-37bd15c024fa tempest-CreateVolumesFromSnapshotTest-1102546986 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 11:00:55 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-de134b85-6ad8-4d70-9d16-5eabaa352645 tempest-CreateVolumesFromSnapshotTest-1102546986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-e73311f6-e9eb-45a4-91b4-5574f0bbc66c" returned: 0 in 0.409s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:00:55 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-de134b85-6ad8-4d70-9d16-5eabaa352645 tempest-CreateVolumesFromSnapshotTest-1102546986 None] <== create_volume: return (1531ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'} {{(pid=87272) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 04 11:00:55 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-de134b85-6ad8-4d70-9d16-5eabaa352645 tempest-CreateVolumesFromSnapshotTest-1102546986 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.535s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 11:00:55 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-606266b9-7c36-4c88-9222-5501af121d21 tempest-CreateVolumesFromSnapshotTest-1102546986 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.779s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 11:00:55 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-606266b9-7c36-4c88-9222-5501af121d21 tempest-CreateVolumesFromSnapshotTest-1102546986 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T10:00:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1153188552',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=071d399f-3743-4471-ba7d-1efec0af20e1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b86d54028a245849d7daa5b00958de5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T10:00:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T10:00:54Z,use_quota=True,user_id='e28c53370b204f2197bd2177ce1b4b1c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8989e4f-21e3-4f0a-9584-0d818784e883),volume_type_id=f8989e4f-21e3-4f0a-9584-0d818784e883)}" {{(pid=87272) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 04 11:00:55 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.remotefs [None req-606266b9-7c36-4c88-9222-5501af121d21 tempest-CreateVolumesFromSnapshotTest-1102546986 None] Creating volume 071d399f-3743-4471-ba7d-1efec0af20e1 {{(pid=87272) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 11:00:55 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-606266b9-7c36-4c88-9222-5501af121d21 tempest-CreateVolumesFromSnapshotTest-1102546986 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 11:00:55 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-606266b9-7c36-4c88-9222-5501af121d21 tempest-CreateVolumesFromSnapshotTest-1102546986 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 11:00:55 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-606266b9-7c36-4c88-9222-5501af121d21 tempest-CreateVolumesFromSnapshotTest-1102546986 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898': None} {{(pid=87272) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 11:00:55 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-606266b9-7c36-4c88-9222-5501af121d21 tempest-CreateVolumesFromSnapshotTest-1102546986 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'] {{(pid=87272) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 11:00:55 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-606266b9-7c36-4c88-9222-5501af121d21 tempest-CreateVolumesFromSnapshotTest-1102546986 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 11:00:55 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-606266b9-7c36-4c88-9222-5501af121d21 tempest-CreateVolumesFromSnapshotTest-1102546986 None] Selected osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898 as target Quobyte volume. {{(pid=87272) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 11:00:55 devstack cinder-volume[87272]: INFO cinder.volume.drivers.remotefs [None req-606266b9-7c36-4c88-9222-5501af121d21 tempest-CreateVolumesFromSnapshotTest-1102546986 None] casted to osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898 Nov 04 11:00:55 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-606266b9-7c36-4c88-9222-5501af121d21 tempest-CreateVolumesFromSnapshotTest-1102546986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-071d399f-3743-4471-ba7d-1efec0af20e1 1073741824 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:00:55 devstack sudo[100538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-071d399f-3743-4471-ba7d-1efec0af20e1 1073741824 Nov 04 11:00:55 devstack sudo[100538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:00:55 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-de134b85-6ad8-4d70-9d16-5eabaa352645 tempest-CreateVolumesFromSnapshotTest-1102546986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1c785ba-4e29-43d5-9cd3-d555d9f0efc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e73311f6-e9eb-45a4-91b4-5574f0bbc66c', 'volume_size': 1}' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:00:55 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-de134b85-6ad8-4d70-9d16-5eabaa352645 tempest-CreateVolumesFromSnapshotTest-1102546986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b023466-35b2-40e6-833d-66720c66f8e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:00:55 devstack cinder-volume[87272]: INFO cinder.volume.flows.manager.create_volume [None req-de134b85-6ad8-4d70-9d16-5eabaa352645 tempest-CreateVolumesFromSnapshotTest-1102546986 None] Volume volume-e73311f6-e9eb-45a4-91b4-5574f0bbc66c (e73311f6-e9eb-45a4-91b4-5574f0bbc66c): created successfully Nov 04 11:00:55 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-de134b85-6ad8-4d70-9d16-5eabaa352645 tempest-CreateVolumesFromSnapshotTest-1102546986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b023466-35b2-40e6-833d-66720c66f8e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:00:55 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-de134b85-6ad8-4d70-9d16-5eabaa352645 tempest-CreateVolumesFromSnapshotTest-1102546986 None] Flow 'volume_create_manager' (ca302a7b-a2eb-443d-b00a-ccbf8d46942c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87272) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 11:00:55 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-de134b85-6ad8-4d70-9d16-5eabaa352645 tempest-CreateVolumesFromSnapshotTest-1102546986 None] Created volume successfully. Nov 04 11:00:55 devstack cinder-volume[87272]: DEBUG cinder.volume.flows.manager.create_volume [None req-30b83b49-7279-440f-bd85-6c2e9d903aec tempest-CreateVolumesFromSnapshotTest-1102546986 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87272) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 11:00:55 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-30b83b49-7279-440f-bd85-6c2e9d903aec tempest-CreateVolumesFromSnapshotTest-1102546986 None] Flow 'volume_create_manager' (0b8492a3-47d5-43f8-8602-aff7dd47ebfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 11:00:55 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-30b83b49-7279-440f-bd85-6c2e9d903aec tempest-CreateVolumesFromSnapshotTest-1102546986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (50a5f517-4cef-4625-a680-5a696fc191ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:00:55 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-30b83b49-7279-440f-bd85-6c2e9d903aec tempest-CreateVolumesFromSnapshotTest-1102546986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (50a5f517-4cef-4625-a680-5a696fc191ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T10:00:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2024375946',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8417310b-cf92-4392-8e95-25a1dcd24b1f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b86d54028a245849d7daa5b00958de5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T10:00:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T10:00:55Z,use_quota=True,user_id='e28c53370b204f2197bd2177ce1b4b1c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8989e4f-21e3-4f0a-9584-0d818784e883),volume_type_id=f8989e4f-21e3-4f0a-9584-0d818784e883)' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:00:55 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-30b83b49-7279-440f-bd85-6c2e9d903aec tempest-CreateVolumesFromSnapshotTest-1102546986 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3147b548-cd3d-4c4e-be4c-e549c90dcbb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:00:55 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-30b83b49-7279-440f-bd85-6c2e9d903aec tempest-CreateVolumesFromSnapshotTest-1102546986 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3147b548-cd3d-4c4e-be4c-e549c90dcbb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:00:55 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-30b83b49-7279-440f-bd85-6c2e9d903aec tempest-CreateVolumesFromSnapshotTest-1102546986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d3c697d-722e-4d1e-bf5d-2ab31b33aa7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:00:55 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-30b83b49-7279-440f-bd85-6c2e9d903aec tempest-CreateVolumesFromSnapshotTest-1102546986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d3c697d-722e-4d1e-bf5d-2ab31b33aa7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8417310b-cf92-4392-8e95-25a1dcd24b1f', 'volume_name': 'volume-8417310b-cf92-4392-8e95-25a1dcd24b1f', 'volume_size': 1}' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:00:55 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-30b83b49-7279-440f-bd85-6c2e9d903aec tempest-CreateVolumesFromSnapshotTest-1102546986 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (977189f9-91ed-4b7f-b13e-c49384579a86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:00:55 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-30b83b49-7279-440f-bd85-6c2e9d903aec tempest-CreateVolumesFromSnapshotTest-1102546986 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (977189f9-91ed-4b7f-b13e-c49384579a86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:00:55 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-30b83b49-7279-440f-bd85-6c2e9d903aec tempest-CreateVolumesFromSnapshotTest-1102546986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0129b4b6-d5a2-4623-91b8-46584dabe9f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:00:55 devstack cinder-volume[87272]: INFO cinder.volume.flows.manager.create_volume [None req-30b83b49-7279-440f-bd85-6c2e9d903aec tempest-CreateVolumesFromSnapshotTest-1102546986 None] Volume 8417310b-cf92-4392-8e95-25a1dcd24b1f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8417310b-cf92-4392-8e95-25a1dcd24b1f', 'volume_size': 1} Nov 04 11:00:55 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-30b83b49-7279-440f-bd85-6c2e9d903aec tempest-CreateVolumesFromSnapshotTest-1102546986 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 11:00:55 devstack cinder-volume[87272]: DEBUG cinder.volume.flows.manager.create_volume [None req-cfcc28b5-874c-409d-840b-7f5727a3318b tempest-CreateVolumesFromSnapshotTest-1102546986 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87272) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 11:00:55 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-cfcc28b5-874c-409d-840b-7f5727a3318b tempest-CreateVolumesFromSnapshotTest-1102546986 None] Flow 'volume_create_manager' (7e5538b3-1a2d-4b40-a46c-b0f25340084d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 11:00:55 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-cfcc28b5-874c-409d-840b-7f5727a3318b tempest-CreateVolumesFromSnapshotTest-1102546986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (edc0056b-e947-46b1-ac4a-4db296533d3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:00:55 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-cfcc28b5-874c-409d-840b-7f5727a3318b tempest-CreateVolumesFromSnapshotTest-1102546986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (edc0056b-e947-46b1-ac4a-4db296533d3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T10:00:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-217101219',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1e8db366-ef1a-42a1-bbac-463482f2323e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b86d54028a245849d7daa5b00958de5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T10:00:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T10:00:56Z,use_quota=True,user_id='e28c53370b204f2197bd2177ce1b4b1c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8989e4f-21e3-4f0a-9584-0d818784e883),volume_type_id=f8989e4f-21e3-4f0a-9584-0d818784e883)' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:00:55 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-cfcc28b5-874c-409d-840b-7f5727a3318b tempest-CreateVolumesFromSnapshotTest-1102546986 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de12dd73-e6fd-4a4b-a95d-dcdd453cac6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:00:55 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-cfcc28b5-874c-409d-840b-7f5727a3318b tempest-CreateVolumesFromSnapshotTest-1102546986 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de12dd73-e6fd-4a4b-a95d-dcdd453cac6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:00:55 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-cfcc28b5-874c-409d-840b-7f5727a3318b tempest-CreateVolumesFromSnapshotTest-1102546986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (163b3f55-44a1-4c5c-9cf5-0bbb6120bffe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:00:55 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-cfcc28b5-874c-409d-840b-7f5727a3318b tempest-CreateVolumesFromSnapshotTest-1102546986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (163b3f55-44a1-4c5c-9cf5-0bbb6120bffe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1e8db366-ef1a-42a1-bbac-463482f2323e', 'volume_name': 'volume-1e8db366-ef1a-42a1-bbac-463482f2323e', 'volume_size': 1}' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:00:55 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-cfcc28b5-874c-409d-840b-7f5727a3318b tempest-CreateVolumesFromSnapshotTest-1102546986 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd1522e4-d176-4cb1-a8fd-09c63dfebf84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:00:55 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-cfcc28b5-874c-409d-840b-7f5727a3318b tempest-CreateVolumesFromSnapshotTest-1102546986 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd1522e4-d176-4cb1-a8fd-09c63dfebf84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:00:55 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-cfcc28b5-874c-409d-840b-7f5727a3318b tempest-CreateVolumesFromSnapshotTest-1102546986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c3fb3f4-b0b4-4cbd-b84c-8fd47eea03f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:00:55 devstack cinder-volume[87272]: INFO cinder.volume.flows.manager.create_volume [None req-cfcc28b5-874c-409d-840b-7f5727a3318b tempest-CreateVolumesFromSnapshotTest-1102546986 None] Volume 1e8db366-ef1a-42a1-bbac-463482f2323e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1e8db366-ef1a-42a1-bbac-463482f2323e', 'volume_size': 1} Nov 04 11:00:55 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-cfcc28b5-874c-409d-840b-7f5727a3318b tempest-CreateVolumesFromSnapshotTest-1102546986 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 11:00:55 devstack sudo[100538]: pam_unix(sudo:session): session closed for user root Nov 04 11:00:55 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-606266b9-7c36-4c88-9222-5501af121d21 tempest-CreateVolumesFromSnapshotTest-1102546986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-071d399f-3743-4471-ba7d-1efec0af20e1 1073741824" returned: 0 in 0.721s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:00:55 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-606266b9-7c36-4c88-9222-5501af121d21 tempest-CreateVolumesFromSnapshotTest-1102546986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-071d399f-3743-4471-ba7d-1efec0af20e1 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:00:55 devstack sudo[100544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-071d399f-3743-4471-ba7d-1efec0af20e1 Nov 04 11:00:55 devstack sudo[100544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:00:56 devstack sudo[100544]: pam_unix(sudo:session): session closed for user root Nov 04 11:00:56 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-606266b9-7c36-4c88-9222-5501af121d21 tempest-CreateVolumesFromSnapshotTest-1102546986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-071d399f-3743-4471-ba7d-1efec0af20e1" returned: 0 in 0.349s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:00:56 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-606266b9-7c36-4c88-9222-5501af121d21 tempest-CreateVolumesFromSnapshotTest-1102546986 None] <== create_volume: return (1125ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'} {{(pid=87272) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 04 11:00:56 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-606266b9-7c36-4c88-9222-5501af121d21 tempest-CreateVolumesFromSnapshotTest-1102546986 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.129s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 11:00:56 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-06065a97-930b-4628-9fcf-ec8caa12b42e tempest-VolumeRetypeWithoutMigrationTest-1700915263 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.330s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 11:00:56 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-06065a97-930b-4628-9fcf-ec8caa12b42e tempest-VolumeRetypeWithoutMigrationTest-1700915263 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T10:00:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1848819612',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6149d4cf-c79d-4898-a7bf-39836eaa4d1d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b5db7ff4b32a4a40866b2999846c33d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T10:00:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T10:00:55Z,use_quota=True,user_id='b069311d0f274bbcafba8e786c98c6e3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(22064e13-af71-490d-85a3-49b9553241e5),volume_type_id=22064e13-af71-490d-85a3-49b9553241e5)}" {{(pid=87272) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 04 11:00:56 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.remotefs [None req-06065a97-930b-4628-9fcf-ec8caa12b42e tempest-VolumeRetypeWithoutMigrationTest-1700915263 None] Creating volume 6149d4cf-c79d-4898-a7bf-39836eaa4d1d {{(pid=87272) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 11:00:56 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-06065a97-930b-4628-9fcf-ec8caa12b42e tempest-VolumeRetypeWithoutMigrationTest-1700915263 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 11:00:56 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-06065a97-930b-4628-9fcf-ec8caa12b42e tempest-VolumeRetypeWithoutMigrationTest-1700915263 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 11:00:56 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-06065a97-930b-4628-9fcf-ec8caa12b42e tempest-VolumeRetypeWithoutMigrationTest-1700915263 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898': None} {{(pid=87272) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 11:00:56 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-06065a97-930b-4628-9fcf-ec8caa12b42e tempest-VolumeRetypeWithoutMigrationTest-1700915263 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'] {{(pid=87272) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 11:00:56 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-06065a97-930b-4628-9fcf-ec8caa12b42e tempest-VolumeRetypeWithoutMigrationTest-1700915263 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 11:00:56 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-06065a97-930b-4628-9fcf-ec8caa12b42e tempest-VolumeRetypeWithoutMigrationTest-1700915263 None] Selected osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898 as target Quobyte volume. {{(pid=87272) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 11:00:56 devstack cinder-volume[87272]: INFO cinder.volume.drivers.remotefs [None req-06065a97-930b-4628-9fcf-ec8caa12b42e tempest-VolumeRetypeWithoutMigrationTest-1700915263 None] casted to osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898 Nov 04 11:00:56 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-06065a97-930b-4628-9fcf-ec8caa12b42e tempest-VolumeRetypeWithoutMigrationTest-1700915263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-6149d4cf-c79d-4898-a7bf-39836eaa4d1d 1073741824 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:00:56 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-606266b9-7c36-4c88-9222-5501af121d21 tempest-CreateVolumesFromSnapshotTest-1102546986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (93f1abcd-d7ca-42da-8983-046c082393ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-071d399f-3743-4471-ba7d-1efec0af20e1', 'volume_size': 1}' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:00:56 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-606266b9-7c36-4c88-9222-5501af121d21 tempest-CreateVolumesFromSnapshotTest-1102546986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (47a3dcc5-198c-450a-b3f2-22b2c53fb759) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:00:56 devstack sudo[100547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-6149d4cf-c79d-4898-a7bf-39836eaa4d1d 1073741824 Nov 04 11:00:56 devstack sudo[100547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:00:56 devstack cinder-volume[87272]: INFO cinder.volume.flows.manager.create_volume [None req-606266b9-7c36-4c88-9222-5501af121d21 tempest-CreateVolumesFromSnapshotTest-1102546986 None] Volume volume-071d399f-3743-4471-ba7d-1efec0af20e1 (071d399f-3743-4471-ba7d-1efec0af20e1): created successfully Nov 04 11:00:56 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-606266b9-7c36-4c88-9222-5501af121d21 tempest-CreateVolumesFromSnapshotTest-1102546986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (47a3dcc5-198c-450a-b3f2-22b2c53fb759) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:00:56 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-606266b9-7c36-4c88-9222-5501af121d21 tempest-CreateVolumesFromSnapshotTest-1102546986 None] Flow 'volume_create_manager' (3c57dce4-09af-4985-a932-d691732657e3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87272) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 11:00:56 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-606266b9-7c36-4c88-9222-5501af121d21 tempest-CreateVolumesFromSnapshotTest-1102546986 None] Created volume successfully. Nov 04 11:00:56 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-bb191197-8e91-435f-8dad-03e43ef488e5 tempest-TestServerVolumeAttachmentScenario-1780213436 None] Acquiring lock "cinder-b4ff3daf-3d02-4ddd-aac2-e49ee57577aa-delete_volume" by "delete_volume" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 11:00:56 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-bb191197-8e91-435f-8dad-03e43ef488e5 tempest-TestServerVolumeAttachmentScenario-1780213436 None] Lock "cinder-b4ff3daf-3d02-4ddd-aac2-e49ee57577aa-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 11:00:56 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-bb191197-8e91-435f-8dad-03e43ef488e5 tempest-TestServerVolumeAttachmentScenario-1780213436 None] Acquiring lock "cinder-quobyte-b4ff3daf-3d02-4ddd-aac2-e49ee57577aa" by "delete_volume" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 11:00:56 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-bb191197-8e91-435f-8dad-03e43ef488e5 tempest-TestServerVolumeAttachmentScenario-1780213436 None] Lock "cinder-quobyte-b4ff3daf-3d02-4ddd-aac2-e49ee57577aa" acquired by "delete_volume" :: waited 0.017s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 11:00:56 devstack cinder-volume[87272]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cbef12b-2f99-4a93-955f-6e22ae55ad84]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 11:00:56 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-bb191197-8e91-435f-8dad-03e43ef488e5 tempest-TestServerVolumeAttachmentScenario-1780213436 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-b4ff3daf-3d02-4ddd-aac2-e49ee57577aa {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:00:56 devstack sudo[100547]: pam_unix(sudo:session): session closed for user root Nov 04 11:00:56 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-06065a97-930b-4628-9fcf-ec8caa12b42e tempest-VolumeRetypeWithoutMigrationTest-1700915263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-6149d4cf-c79d-4898-a7bf-39836eaa4d1d 1073741824" returned: 0 in 0.670s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:00:56 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-06065a97-930b-4628-9fcf-ec8caa12b42e tempest-VolumeRetypeWithoutMigrationTest-1700915263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-6149d4cf-c79d-4898-a7bf-39836eaa4d1d {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:00:56 devstack sudo[100555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-6149d4cf-c79d-4898-a7bf-39836eaa4d1d Nov 04 11:00:56 devstack sudo[100555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:00:56 devstack sudo[100554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-b4ff3daf-3d02-4ddd-aac2-e49ee57577aa Nov 04 11:00:56 devstack sudo[100554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:00:57 devstack sudo[100555]: pam_unix(sudo:session): session closed for user root Nov 04 11:00:57 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-06065a97-930b-4628-9fcf-ec8caa12b42e tempest-VolumeRetypeWithoutMigrationTest-1700915263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-6149d4cf-c79d-4898-a7bf-39836eaa4d1d" returned: 0 in 0.293s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:00:57 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-06065a97-930b-4628-9fcf-ec8caa12b42e tempest-VolumeRetypeWithoutMigrationTest-1700915263 None] <== create_volume: return (1015ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'} {{(pid=87272) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 04 11:00:57 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-06065a97-930b-4628-9fcf-ec8caa12b42e tempest-VolumeRetypeWithoutMigrationTest-1700915263 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.019s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 11:00:57 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-1f121071-b29d-41a4-adef-37bd15c024fa tempest-CreateVolumesFromSnapshotTest-1102546986 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.163s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 11:00:57 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-1f121071-b29d-41a4-adef-37bd15c024fa tempest-CreateVolumesFromSnapshotTest-1102546986 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T10:00:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2142698619',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=03bb086d-cccf-435c-af4b-51bf35d49c6e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b86d54028a245849d7daa5b00958de5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T10:00:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T10:00:55Z,use_quota=True,user_id='e28c53370b204f2197bd2177ce1b4b1c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8989e4f-21e3-4f0a-9584-0d818784e883),volume_type_id=f8989e4f-21e3-4f0a-9584-0d818784e883)}" {{(pid=87272) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 04 11:00:57 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.remotefs [None req-1f121071-b29d-41a4-adef-37bd15c024fa tempest-CreateVolumesFromSnapshotTest-1102546986 None] Creating volume 03bb086d-cccf-435c-af4b-51bf35d49c6e {{(pid=87272) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 11:00:57 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-1f121071-b29d-41a4-adef-37bd15c024fa tempest-CreateVolumesFromSnapshotTest-1102546986 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 11:00:57 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-1f121071-b29d-41a4-adef-37bd15c024fa tempest-CreateVolumesFromSnapshotTest-1102546986 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 11:00:57 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-1f121071-b29d-41a4-adef-37bd15c024fa tempest-CreateVolumesFromSnapshotTest-1102546986 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898': None} {{(pid=87272) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 11:00:57 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-1f121071-b29d-41a4-adef-37bd15c024fa tempest-CreateVolumesFromSnapshotTest-1102546986 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'] {{(pid=87272) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 11:00:57 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-1f121071-b29d-41a4-adef-37bd15c024fa tempest-CreateVolumesFromSnapshotTest-1102546986 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 11:00:57 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-1f121071-b29d-41a4-adef-37bd15c024fa tempest-CreateVolumesFromSnapshotTest-1102546986 None] Selected osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898 as target Quobyte volume. {{(pid=87272) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 11:00:57 devstack cinder-volume[87272]: INFO cinder.volume.drivers.remotefs [None req-1f121071-b29d-41a4-adef-37bd15c024fa tempest-CreateVolumesFromSnapshotTest-1102546986 None] casted to osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898 Nov 04 11:00:57 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-1f121071-b29d-41a4-adef-37bd15c024fa tempest-CreateVolumesFromSnapshotTest-1102546986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-03bb086d-cccf-435c-af4b-51bf35d49c6e 1073741824 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:00:57 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-06065a97-930b-4628-9fcf-ec8caa12b42e tempest-VolumeRetypeWithoutMigrationTest-1700915263 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e40dee11-a55b-4962-a175-6a035aab53e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6149d4cf-c79d-4898-a7bf-39836eaa4d1d', 'volume_size': 1}' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:00:57 devstack sudo[100563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-03bb086d-cccf-435c-af4b-51bf35d49c6e 1073741824 Nov 04 11:00:57 devstack sudo[100563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:00:57 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-06065a97-930b-4628-9fcf-ec8caa12b42e tempest-VolumeRetypeWithoutMigrationTest-1700915263 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d89d0c1-d679-40d4-8785-3dc45dab814d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:00:57 devstack cinder-volume[87272]: INFO cinder.volume.flows.manager.create_volume [None req-06065a97-930b-4628-9fcf-ec8caa12b42e tempest-VolumeRetypeWithoutMigrationTest-1700915263 None] Volume volume-6149d4cf-c79d-4898-a7bf-39836eaa4d1d (6149d4cf-c79d-4898-a7bf-39836eaa4d1d): created successfully Nov 04 11:00:57 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-06065a97-930b-4628-9fcf-ec8caa12b42e tempest-VolumeRetypeWithoutMigrationTest-1700915263 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d89d0c1-d679-40d4-8785-3dc45dab814d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:00:57 devstack sudo[100554]: pam_unix(sudo:session): session closed for user root Nov 04 11:00:57 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-06065a97-930b-4628-9fcf-ec8caa12b42e tempest-VolumeRetypeWithoutMigrationTest-1700915263 None] Flow 'volume_create_manager' (bf598b8b-e772-4114-b3e4-44e5cd11c55b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87272) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 11:00:57 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-bb191197-8e91-435f-8dad-03e43ef488e5 tempest-TestServerVolumeAttachmentScenario-1780213436 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-b4ff3daf-3d02-4ddd-aac2-e49ee57577aa" returned: 0 in 0.444s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:00:57 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-bb191197-8e91-435f-8dad-03e43ef488e5 tempest-TestServerVolumeAttachmentScenario-1780213436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-b4ff3daf-3d02-4ddd-aac2-e49ee57577aa {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:00:57 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-06065a97-930b-4628-9fcf-ec8caa12b42e tempest-VolumeRetypeWithoutMigrationTest-1700915263 None] Created volume successfully. Nov 04 11:00:57 devstack sudo[100565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-b4ff3daf-3d02-4ddd-aac2-e49ee57577aa Nov 04 11:00:57 devstack sudo[100565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:00:57 devstack sudo[100565]: pam_unix(sudo:session): session closed for user root Nov 04 11:00:57 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-bb191197-8e91-435f-8dad-03e43ef488e5 tempest-TestServerVolumeAttachmentScenario-1780213436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-b4ff3daf-3d02-4ddd-aac2-e49ee57577aa" returned: 0 in 0.318s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:00:57 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-bb191197-8e91-435f-8dad-03e43ef488e5 tempest-TestServerVolumeAttachmentScenario-1780213436 None] Lock "cinder-quobyte-b4ff3daf-3d02-4ddd-aac2-e49ee57577aa" released by "delete_volume" :: held 0.823s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 11:00:57 devstack cinder-volume[87272]: DEBUG cinder.quota [None req-bb191197-8e91-435f-8dad-03e43ef488e5 tempest-TestServerVolumeAttachmentScenario-1780213436 None] Created reservations ['a73efbba-a7c9-423a-ac49-77eace180e52', '173aebe9-dff7-421c-a93d-f13b8b440e79', '5329101b-d399-45cc-a145-f15abaafe223', '2e96cf37-27b9-425a-a256-ed0921506880'] {{(pid=87272) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 11:00:57 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-bb191197-8e91-435f-8dad-03e43ef488e5 tempest-TestServerVolumeAttachmentScenario-1780213436 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 11:00:57 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-bb191197-8e91-435f-8dad-03e43ef488e5 tempest-TestServerVolumeAttachmentScenario-1780213436 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 11:00:57 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-bb191197-8e91-435f-8dad-03e43ef488e5 tempest-TestServerVolumeAttachmentScenario-1780213436 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898': None} {{(pid=87272) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 11:00:57 devstack sudo[100563]: pam_unix(sudo:session): session closed for user root Nov 04 11:00:57 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-bb191197-8e91-435f-8dad-03e43ef488e5 tempest-TestServerVolumeAttachmentScenario-1780213436 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'] {{(pid=87272) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 11:00:57 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-bb191197-8e91-435f-8dad-03e43ef488e5 tempest-TestServerVolumeAttachmentScenario-1780213436 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 11:00:57 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-bb191197-8e91-435f-8dad-03e43ef488e5 tempest-TestServerVolumeAttachmentScenario-1780213436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:00:57 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-1f121071-b29d-41a4-adef-37bd15c024fa tempest-CreateVolumesFromSnapshotTest-1102546986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-03bb086d-cccf-435c-af4b-51bf35d49c6e 1073741824" returned: 0 in 0.598s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:00:57 devstack sudo[100572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1 Nov 04 11:00:57 devstack sudo[100572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:00:57 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-1f121071-b29d-41a4-adef-37bd15c024fa tempest-CreateVolumesFromSnapshotTest-1102546986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-03bb086d-cccf-435c-af4b-51bf35d49c6e {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:00:57 devstack sudo[100574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-03bb086d-cccf-435c-af4b-51bf35d49c6e Nov 04 11:00:57 devstack sudo[100574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:00:58 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-9dcee4fc-ec5d-4a71-9512-25036c2bafa5 tempest-TestServerVolumeAttachmentScenario-1780213436 None] Acquiring lock "cinder-0ed2c409-12aa-418d-bc8a-71a138668e4e-delete_volume" by "delete_volume" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 11:00:58 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-9dcee4fc-ec5d-4a71-9512-25036c2bafa5 tempest-TestServerVolumeAttachmentScenario-1780213436 None] Lock "cinder-0ed2c409-12aa-418d-bc8a-71a138668e4e-delete_volume" acquired by "delete_volume" :: waited 0.055s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 11:00:58 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-9dcee4fc-ec5d-4a71-9512-25036c2bafa5 tempest-TestServerVolumeAttachmentScenario-1780213436 None] Acquiring lock "cinder-quobyte-0ed2c409-12aa-418d-bc8a-71a138668e4e" by "delete_volume" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 11:00:58 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-9dcee4fc-ec5d-4a71-9512-25036c2bafa5 tempest-TestServerVolumeAttachmentScenario-1780213436 None] Lock "cinder-quobyte-0ed2c409-12aa-418d-bc8a-71a138668e4e" acquired by "delete_volume" :: waited 0.025s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 11:00:58 devstack sudo[100572]: pam_unix(sudo:session): session closed for user root Nov 04 11:00:58 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-bb191197-8e91-435f-8dad-03e43ef488e5 tempest-TestServerVolumeAttachmentScenario-1780213436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1" returned: 0 in 0.445s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:00:58 devstack cinder-volume[87272]: DEBUG cinder.manager [None req-bb191197-8e91-435f-8dad-03e43ef488e5 tempest-TestServerVolumeAttachmentScenario-1780213436 None] Notifying Schedulers of capabilities ... {{(pid=87272) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 11:00:58 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-bb191197-8e91-435f-8dad-03e43ef488e5 tempest-TestServerVolumeAttachmentScenario-1780213436 None] Deleted volume successfully. Nov 04 11:00:58 devstack cinder-volume[87272]: DEBUG oslo.privsep.daemon [-] privsep: reply[1467268f-be81-452c-b39b-4d73e9b6ee91]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 11:00:58 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-9dcee4fc-ec5d-4a71-9512-25036c2bafa5 tempest-TestServerVolumeAttachmentScenario-1780213436 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-0ed2c409-12aa-418d-bc8a-71a138668e4e {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:00:58 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-bb191197-8e91-435f-8dad-03e43ef488e5 tempest-TestServerVolumeAttachmentScenario-1780213436 None] Lock "cinder-b4ff3daf-3d02-4ddd-aac2-e49ee57577aa-delete_volume" released by "delete_volume" :: held 1.558s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 11:00:58 devstack sudo[100574]: pam_unix(sudo:session): session closed for user root Nov 04 11:00:58 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-1f121071-b29d-41a4-adef-37bd15c024fa tempest-CreateVolumesFromSnapshotTest-1102546986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-03bb086d-cccf-435c-af4b-51bf35d49c6e" returned: 0 in 0.430s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:00:58 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-1f121071-b29d-41a4-adef-37bd15c024fa tempest-CreateVolumesFromSnapshotTest-1102546986 None] <== create_volume: return (1107ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'} {{(pid=87272) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 04 11:00:58 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-1f121071-b29d-41a4-adef-37bd15c024fa tempest-CreateVolumesFromSnapshotTest-1102546986 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.110s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 11:00:58 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-30b83b49-7279-440f-bd85-6c2e9d903aec tempest-CreateVolumesFromSnapshotTest-1102546986 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.032s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 11:00:58 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-30b83b49-7279-440f-bd85-6c2e9d903aec tempest-CreateVolumesFromSnapshotTest-1102546986 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T10:00:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2024375946',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8417310b-cf92-4392-8e95-25a1dcd24b1f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b86d54028a245849d7daa5b00958de5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T10:00:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T10:00:55Z,use_quota=True,user_id='e28c53370b204f2197bd2177ce1b4b1c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8989e4f-21e3-4f0a-9584-0d818784e883),volume_type_id=f8989e4f-21e3-4f0a-9584-0d818784e883)}" {{(pid=87272) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 04 11:00:58 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.remotefs [None req-30b83b49-7279-440f-bd85-6c2e9d903aec tempest-CreateVolumesFromSnapshotTest-1102546986 None] Creating volume 8417310b-cf92-4392-8e95-25a1dcd24b1f {{(pid=87272) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 11:00:58 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-30b83b49-7279-440f-bd85-6c2e9d903aec tempest-CreateVolumesFromSnapshotTest-1102546986 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 11:00:58 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-30b83b49-7279-440f-bd85-6c2e9d903aec tempest-CreateVolumesFromSnapshotTest-1102546986 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 11:00:58 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-30b83b49-7279-440f-bd85-6c2e9d903aec tempest-CreateVolumesFromSnapshotTest-1102546986 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898': None} {{(pid=87272) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 11:00:58 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-30b83b49-7279-440f-bd85-6c2e9d903aec tempest-CreateVolumesFromSnapshotTest-1102546986 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'] {{(pid=87272) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 11:00:58 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-30b83b49-7279-440f-bd85-6c2e9d903aec tempest-CreateVolumesFromSnapshotTest-1102546986 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 11:00:58 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-30b83b49-7279-440f-bd85-6c2e9d903aec tempest-CreateVolumesFromSnapshotTest-1102546986 None] Selected osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898 as target Quobyte volume. {{(pid=87272) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 11:00:58 devstack cinder-volume[87272]: INFO cinder.volume.drivers.remotefs [None req-30b83b49-7279-440f-bd85-6c2e9d903aec tempest-CreateVolumesFromSnapshotTest-1102546986 None] casted to osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898 Nov 04 11:00:58 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-30b83b49-7279-440f-bd85-6c2e9d903aec tempest-CreateVolumesFromSnapshotTest-1102546986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-8417310b-cf92-4392-8e95-25a1dcd24b1f 1073741824 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:00:58 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-1f121071-b29d-41a4-adef-37bd15c024fa tempest-CreateVolumesFromSnapshotTest-1102546986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33d43a04-9327-48b3-bb02-83f1938b5544) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-03bb086d-cccf-435c-af4b-51bf35d49c6e', 'volume_size': 1}' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:00:58 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-1f121071-b29d-41a4-adef-37bd15c024fa tempest-CreateVolumesFromSnapshotTest-1102546986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3153e065-356a-4a22-ae54-6aeeb23eb1db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:00:58 devstack sudo[100579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-8417310b-cf92-4392-8e95-25a1dcd24b1f 1073741824 Nov 04 11:00:58 devstack sudo[100579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:00:58 devstack cinder-volume[87272]: INFO cinder.volume.flows.manager.create_volume [None req-1f121071-b29d-41a4-adef-37bd15c024fa tempest-CreateVolumesFromSnapshotTest-1102546986 None] Volume volume-03bb086d-cccf-435c-af4b-51bf35d49c6e (03bb086d-cccf-435c-af4b-51bf35d49c6e): created successfully Nov 04 11:00:58 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-1f121071-b29d-41a4-adef-37bd15c024fa tempest-CreateVolumesFromSnapshotTest-1102546986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3153e065-356a-4a22-ae54-6aeeb23eb1db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:00:58 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-1f121071-b29d-41a4-adef-37bd15c024fa tempest-CreateVolumesFromSnapshotTest-1102546986 None] Flow 'volume_create_manager' (0fe0e5df-8936-4186-bf2e-f8e1f10bee27) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87272) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 11:00:58 devstack sudo[100578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-0ed2c409-12aa-418d-bc8a-71a138668e4e Nov 04 11:00:58 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-1f121071-b29d-41a4-adef-37bd15c024fa tempest-CreateVolumesFromSnapshotTest-1102546986 None] Created volume successfully. Nov 04 11:00:58 devstack sudo[100578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:00:58 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-3691bf9e-23a2-4176-9c88-dec1181c9667 tempest-VolumeRetypeWithoutMigrationTest-1700915263 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 11:00:58 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-3691bf9e-23a2-4176-9c88-dec1181c9667 tempest-VolumeRetypeWithoutMigrationTest-1700915263 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 11:00:58 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-3691bf9e-23a2-4176-9c88-dec1181c9667 tempest-VolumeRetypeWithoutMigrationTest-1700915263 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898': None} {{(pid=87272) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 11:00:58 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-3691bf9e-23a2-4176-9c88-dec1181c9667 tempest-VolumeRetypeWithoutMigrationTest-1700915263 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'] {{(pid=87272) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 11:00:58 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-3691bf9e-23a2-4176-9c88-dec1181c9667 tempest-VolumeRetypeWithoutMigrationTest-1700915263 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 11:00:58 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-3691bf9e-23a2-4176-9c88-dec1181c9667 tempest-VolumeRetypeWithoutMigrationTest-1700915263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:00:58 devstack sudo[100582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1 Nov 04 11:00:58 devstack sudo[100582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:00:58 devstack sudo[100578]: pam_unix(sudo:session): session closed for user root Nov 04 11:00:58 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-9dcee4fc-ec5d-4a71-9512-25036c2bafa5 tempest-TestServerVolumeAttachmentScenario-1780213436 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-0ed2c409-12aa-418d-bc8a-71a138668e4e" returned: 0 in 0.508s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:00:58 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-9dcee4fc-ec5d-4a71-9512-25036c2bafa5 tempest-TestServerVolumeAttachmentScenario-1780213436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-0ed2c409-12aa-418d-bc8a-71a138668e4e {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:00:58 devstack sudo[100593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-0ed2c409-12aa-418d-bc8a-71a138668e4e Nov 04 11:00:58 devstack sudo[100582]: pam_unix(sudo:session): session closed for user root Nov 04 11:00:58 devstack sudo[100593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:00:58 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-3691bf9e-23a2-4176-9c88-dec1181c9667 tempest-VolumeRetypeWithoutMigrationTest-1700915263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1" returned: 0 in 0.308s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:00:58 devstack cinder-volume[87272]: DEBUG cinder.manager [None req-3691bf9e-23a2-4176-9c88-dec1181c9667 tempest-VolumeRetypeWithoutMigrationTest-1700915263 None] Notifying Schedulers of capabilities ... {{(pid=87272) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 11:00:58 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-3691bf9e-23a2-4176-9c88-dec1181c9667 tempest-VolumeRetypeWithoutMigrationTest-1700915263 None] Retype volume completed successfully. Nov 04 11:00:58 devstack sudo[100579]: pam_unix(sudo:session): session closed for user root Nov 04 11:00:58 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-30b83b49-7279-440f-bd85-6c2e9d903aec tempest-CreateVolumesFromSnapshotTest-1102546986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-8417310b-cf92-4392-8e95-25a1dcd24b1f 1073741824" returned: 0 in 0.620s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:00:58 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-30b83b49-7279-440f-bd85-6c2e9d903aec tempest-CreateVolumesFromSnapshotTest-1102546986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-8417310b-cf92-4392-8e95-25a1dcd24b1f {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:00:59 devstack sudo[100595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-8417310b-cf92-4392-8e95-25a1dcd24b1f Nov 04 11:00:59 devstack sudo[100595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:00:59 devstack sudo[100593]: pam_unix(sudo:session): session closed for user root Nov 04 11:00:59 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-9dcee4fc-ec5d-4a71-9512-25036c2bafa5 tempest-TestServerVolumeAttachmentScenario-1780213436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-0ed2c409-12aa-418d-bc8a-71a138668e4e" returned: 0 in 0.339s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:00:59 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-9dcee4fc-ec5d-4a71-9512-25036c2bafa5 tempest-TestServerVolumeAttachmentScenario-1780213436 None] Lock "cinder-quobyte-0ed2c409-12aa-418d-bc8a-71a138668e4e" released by "delete_volume" :: held 0.919s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 11:00:59 devstack cinder-volume[87272]: DEBUG cinder.quota [None req-9dcee4fc-ec5d-4a71-9512-25036c2bafa5 tempest-TestServerVolumeAttachmentScenario-1780213436 None] Created reservations ['61e7affd-60c0-4f24-8747-80ccf173c8f8', 'ba359eb0-d03d-4192-a2aa-3521785b2c5c', '86d9e87e-e1f6-4cef-9201-73aca6c1d46c', 'a07c28da-49fc-4931-b300-e39912c2d6bd'] {{(pid=87272) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 11:00:59 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-9dcee4fc-ec5d-4a71-9512-25036c2bafa5 tempest-TestServerVolumeAttachmentScenario-1780213436 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 11:00:59 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-9dcee4fc-ec5d-4a71-9512-25036c2bafa5 tempest-TestServerVolumeAttachmentScenario-1780213436 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 11:00:59 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-9dcee4fc-ec5d-4a71-9512-25036c2bafa5 tempest-TestServerVolumeAttachmentScenario-1780213436 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898': None} {{(pid=87272) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 11:00:59 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-9dcee4fc-ec5d-4a71-9512-25036c2bafa5 tempest-TestServerVolumeAttachmentScenario-1780213436 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'] {{(pid=87272) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 11:00:59 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-9dcee4fc-ec5d-4a71-9512-25036c2bafa5 tempest-TestServerVolumeAttachmentScenario-1780213436 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 11:00:59 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-9dcee4fc-ec5d-4a71-9512-25036c2bafa5 tempest-TestServerVolumeAttachmentScenario-1780213436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:00:59 devstack sudo[100599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1 Nov 04 11:00:59 devstack sudo[100599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:00:59 devstack sudo[100595]: pam_unix(sudo:session): session closed for user root Nov 04 11:00:59 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-30b83b49-7279-440f-bd85-6c2e9d903aec tempest-CreateVolumesFromSnapshotTest-1102546986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-8417310b-cf92-4392-8e95-25a1dcd24b1f" returned: 0 in 0.322s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:00:59 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-30b83b49-7279-440f-bd85-6c2e9d903aec tempest-CreateVolumesFromSnapshotTest-1102546986 None] <== create_volume: return (1017ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'} {{(pid=87272) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 04 11:00:59 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-30b83b49-7279-440f-bd85-6c2e9d903aec tempest-CreateVolumesFromSnapshotTest-1102546986 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.019s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 11:00:59 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-cfcc28b5-874c-409d-840b-7f5727a3318b tempest-CreateVolumesFromSnapshotTest-1102546986 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.569s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 11:00:59 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-cfcc28b5-874c-409d-840b-7f5727a3318b tempest-CreateVolumesFromSnapshotTest-1102546986 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T10:00:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-217101219',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1e8db366-ef1a-42a1-bbac-463482f2323e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b86d54028a245849d7daa5b00958de5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T10:00:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T10:00:56Z,use_quota=True,user_id='e28c53370b204f2197bd2177ce1b4b1c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8989e4f-21e3-4f0a-9584-0d818784e883),volume_type_id=f8989e4f-21e3-4f0a-9584-0d818784e883)}" {{(pid=87272) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 04 11:00:59 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.remotefs [None req-cfcc28b5-874c-409d-840b-7f5727a3318b tempest-CreateVolumesFromSnapshotTest-1102546986 None] Creating volume 1e8db366-ef1a-42a1-bbac-463482f2323e {{(pid=87272) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 11:00:59 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-cfcc28b5-874c-409d-840b-7f5727a3318b tempest-CreateVolumesFromSnapshotTest-1102546986 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 11:00:59 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-cfcc28b5-874c-409d-840b-7f5727a3318b tempest-CreateVolumesFromSnapshotTest-1102546986 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 11:00:59 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-cfcc28b5-874c-409d-840b-7f5727a3318b tempest-CreateVolumesFromSnapshotTest-1102546986 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898': None} {{(pid=87272) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 11:00:59 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-cfcc28b5-874c-409d-840b-7f5727a3318b tempest-CreateVolumesFromSnapshotTest-1102546986 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'] {{(pid=87272) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 11:00:59 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-cfcc28b5-874c-409d-840b-7f5727a3318b tempest-CreateVolumesFromSnapshotTest-1102546986 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 11:00:59 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-cfcc28b5-874c-409d-840b-7f5727a3318b tempest-CreateVolumesFromSnapshotTest-1102546986 None] Selected osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898 as target Quobyte volume. {{(pid=87272) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 11:00:59 devstack cinder-volume[87272]: INFO cinder.volume.drivers.remotefs [None req-cfcc28b5-874c-409d-840b-7f5727a3318b tempest-CreateVolumesFromSnapshotTest-1102546986 None] casted to osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898 Nov 04 11:00:59 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-cfcc28b5-874c-409d-840b-7f5727a3318b tempest-CreateVolumesFromSnapshotTest-1102546986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-1e8db366-ef1a-42a1-bbac-463482f2323e 1073741824 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:00:59 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-30b83b49-7279-440f-bd85-6c2e9d903aec tempest-CreateVolumesFromSnapshotTest-1102546986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0129b4b6-d5a2-4623-91b8-46584dabe9f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8417310b-cf92-4392-8e95-25a1dcd24b1f', 'volume_size': 1}' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:00:59 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-30b83b49-7279-440f-bd85-6c2e9d903aec tempest-CreateVolumesFromSnapshotTest-1102546986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6cd4b4e1-bd6c-47af-9962-0d2ed3b6030f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:00:59 devstack sudo[100601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-1e8db366-ef1a-42a1-bbac-463482f2323e 1073741824 Nov 04 11:00:59 devstack sudo[100601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:00:59 devstack cinder-volume[87272]: INFO cinder.volume.flows.manager.create_volume [None req-30b83b49-7279-440f-bd85-6c2e9d903aec tempest-CreateVolumesFromSnapshotTest-1102546986 None] Volume volume-8417310b-cf92-4392-8e95-25a1dcd24b1f (8417310b-cf92-4392-8e95-25a1dcd24b1f): created successfully Nov 04 11:00:59 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-30b83b49-7279-440f-bd85-6c2e9d903aec tempest-CreateVolumesFromSnapshotTest-1102546986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6cd4b4e1-bd6c-47af-9962-0d2ed3b6030f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:00:59 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-30b83b49-7279-440f-bd85-6c2e9d903aec tempest-CreateVolumesFromSnapshotTest-1102546986 None] Flow 'volume_create_manager' (0b8492a3-47d5-43f8-8602-aff7dd47ebfc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87272) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 11:00:59 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-30b83b49-7279-440f-bd85-6c2e9d903aec tempest-CreateVolumesFromSnapshotTest-1102546986 None] Created volume successfully. Nov 04 11:00:59 devstack sudo[100599]: pam_unix(sudo:session): session closed for user root Nov 04 11:00:59 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-9dcee4fc-ec5d-4a71-9512-25036c2bafa5 tempest-TestServerVolumeAttachmentScenario-1780213436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1" returned: 0 in 0.348s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:00:59 devstack cinder-volume[87272]: DEBUG cinder.manager [None req-9dcee4fc-ec5d-4a71-9512-25036c2bafa5 tempest-TestServerVolumeAttachmentScenario-1780213436 None] Notifying Schedulers of capabilities ... {{(pid=87272) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 11:00:59 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-9dcee4fc-ec5d-4a71-9512-25036c2bafa5 tempest-TestServerVolumeAttachmentScenario-1780213436 None] Deleted volume successfully. Nov 04 11:00:59 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-9dcee4fc-ec5d-4a71-9512-25036c2bafa5 tempest-TestServerVolumeAttachmentScenario-1780213436 None] Lock "cinder-0ed2c409-12aa-418d-bc8a-71a138668e4e-delete_volume" released by "delete_volume" :: held 1.594s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 11:00:59 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-b73bef51-25cf-403c-81c1-b75ffcec2dc9 tempest-VolumeRetypeWithoutMigrationTest-1700915263 None] Acquiring lock "cinder-6149d4cf-c79d-4898-a7bf-39836eaa4d1d-delete_volume" by "delete_volume" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 11:00:59 devstack sudo[100601]: pam_unix(sudo:session): session closed for user root Nov 04 11:00:59 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-cfcc28b5-874c-409d-840b-7f5727a3318b tempest-CreateVolumesFromSnapshotTest-1102546986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-1e8db366-ef1a-42a1-bbac-463482f2323e 1073741824" returned: 0 in 0.547s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:00:59 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-b73bef51-25cf-403c-81c1-b75ffcec2dc9 tempest-VolumeRetypeWithoutMigrationTest-1700915263 None] Lock "cinder-6149d4cf-c79d-4898-a7bf-39836eaa4d1d-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 11:00:59 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-cfcc28b5-874c-409d-840b-7f5727a3318b tempest-CreateVolumesFromSnapshotTest-1102546986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-1e8db366-ef1a-42a1-bbac-463482f2323e {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:00:59 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-b73bef51-25cf-403c-81c1-b75ffcec2dc9 tempest-VolumeRetypeWithoutMigrationTest-1700915263 None] Acquiring lock "cinder-quobyte-6149d4cf-c79d-4898-a7bf-39836eaa4d1d" by "delete_volume" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 11:01:00 devstack sudo[100608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-1e8db366-ef1a-42a1-bbac-463482f2323e Nov 04 11:01:00 devstack sudo[100608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:01:00 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-b73bef51-25cf-403c-81c1-b75ffcec2dc9 tempest-VolumeRetypeWithoutMigrationTest-1700915263 None] Lock "cinder-quobyte-6149d4cf-c79d-4898-a7bf-39836eaa4d1d" acquired by "delete_volume" :: waited 0.024s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 11:01:00 devstack cinder-volume[87272]: DEBUG oslo.privsep.daemon [-] privsep: reply[e333817f-ebb7-4a41-b71d-4ac832ff397e]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 11:01:00 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-b73bef51-25cf-403c-81c1-b75ffcec2dc9 tempest-VolumeRetypeWithoutMigrationTest-1700915263 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-6149d4cf-c79d-4898-a7bf-39836eaa4d1d {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:01:00 devstack sudo[100610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-6149d4cf-c79d-4898-a7bf-39836eaa4d1d Nov 04 11:01:00 devstack sudo[100610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:01:00 devstack sudo[100608]: pam_unix(sudo:session): session closed for user root Nov 04 11:01:00 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-cfcc28b5-874c-409d-840b-7f5727a3318b tempest-CreateVolumesFromSnapshotTest-1102546986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-1e8db366-ef1a-42a1-bbac-463482f2323e" returned: 0 in 0.319s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:01:00 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-cfcc28b5-874c-409d-840b-7f5727a3318b tempest-CreateVolumesFromSnapshotTest-1102546986 None] <== create_volume: return (955ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'} {{(pid=87272) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 04 11:01:00 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-cfcc28b5-874c-409d-840b-7f5727a3318b tempest-CreateVolumesFromSnapshotTest-1102546986 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.958s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 11:01:00 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-cfcc28b5-874c-409d-840b-7f5727a3318b tempest-CreateVolumesFromSnapshotTest-1102546986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c3fb3f4-b0b4-4cbd-b84c-8fd47eea03f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1e8db366-ef1a-42a1-bbac-463482f2323e', 'volume_size': 1}' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:01:00 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-cfcc28b5-874c-409d-840b-7f5727a3318b tempest-CreateVolumesFromSnapshotTest-1102546986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d2509cb7-f6d8-4dcd-9e9c-834c2e71c6e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:01:00 devstack cinder-volume[87272]: INFO cinder.volume.flows.manager.create_volume [None req-cfcc28b5-874c-409d-840b-7f5727a3318b tempest-CreateVolumesFromSnapshotTest-1102546986 None] Volume volume-1e8db366-ef1a-42a1-bbac-463482f2323e (1e8db366-ef1a-42a1-bbac-463482f2323e): created successfully Nov 04 11:01:00 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-cfcc28b5-874c-409d-840b-7f5727a3318b tempest-CreateVolumesFromSnapshotTest-1102546986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d2509cb7-f6d8-4dcd-9e9c-834c2e71c6e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:01:00 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-cfcc28b5-874c-409d-840b-7f5727a3318b tempest-CreateVolumesFromSnapshotTest-1102546986 None] Flow 'volume_create_manager' (7e5538b3-1a2d-4b40-a46c-b0f25340084d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87272) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 11:01:00 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-cfcc28b5-874c-409d-840b-7f5727a3318b tempest-CreateVolumesFromSnapshotTest-1102546986 None] Created volume successfully. Nov 04 11:01:00 devstack sudo[100610]: pam_unix(sudo:session): session closed for user root Nov 04 11:01:00 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-b73bef51-25cf-403c-81c1-b75ffcec2dc9 tempest-VolumeRetypeWithoutMigrationTest-1700915263 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-6149d4cf-c79d-4898-a7bf-39836eaa4d1d" returned: 0 in 0.439s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:01:00 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-b73bef51-25cf-403c-81c1-b75ffcec2dc9 tempest-VolumeRetypeWithoutMigrationTest-1700915263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-6149d4cf-c79d-4898-a7bf-39836eaa4d1d {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:01:00 devstack sudo[100617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-6149d4cf-c79d-4898-a7bf-39836eaa4d1d Nov 04 11:01:00 devstack sudo[100617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:01:00 devstack sudo[100617]: pam_unix(sudo:session): session closed for user root Nov 04 11:01:00 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-b73bef51-25cf-403c-81c1-b75ffcec2dc9 tempest-VolumeRetypeWithoutMigrationTest-1700915263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-6149d4cf-c79d-4898-a7bf-39836eaa4d1d" returned: 0 in 0.283s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:01:00 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-b73bef51-25cf-403c-81c1-b75ffcec2dc9 tempest-VolumeRetypeWithoutMigrationTest-1700915263 None] Lock "cinder-quobyte-6149d4cf-c79d-4898-a7bf-39836eaa4d1d" released by "delete_volume" :: held 0.794s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 11:01:00 devstack cinder-volume[87272]: WARNING cinder.quota [None req-b73bef51-25cf-403c-81c1-b75ffcec2dc9 tempest-VolumeRetypeWithoutMigrationTest-1700915263 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Nov 04 11:01:00 devstack cinder-volume[87272]: WARNING cinder.quota [None req-b73bef51-25cf-403c-81c1-b75ffcec2dc9 tempest-VolumeRetypeWithoutMigrationTest-1700915263 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Nov 04 11:01:00 devstack cinder-volume[87272]: DEBUG cinder.quota [None req-b73bef51-25cf-403c-81c1-b75ffcec2dc9 tempest-VolumeRetypeWithoutMigrationTest-1700915263 None] Created reservations ['ae0de963-9f1f-4896-b227-1f32fb3fddb5', '5953013f-0c58-4a81-ac80-c80ae0d9008f', '937e435e-7f29-4e52-b708-b3453c88235e', 'a38a58a0-a411-415e-a853-264bc2cdb978'] {{(pid=87272) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 11:01:01 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-b73bef51-25cf-403c-81c1-b75ffcec2dc9 tempest-VolumeRetypeWithoutMigrationTest-1700915263 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 11:01:01 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-b73bef51-25cf-403c-81c1-b75ffcec2dc9 tempest-VolumeRetypeWithoutMigrationTest-1700915263 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 11:01:01 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-b73bef51-25cf-403c-81c1-b75ffcec2dc9 tempest-VolumeRetypeWithoutMigrationTest-1700915263 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898': None} {{(pid=87272) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 11:01:01 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-b73bef51-25cf-403c-81c1-b75ffcec2dc9 tempest-VolumeRetypeWithoutMigrationTest-1700915263 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'] {{(pid=87272) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 11:01:01 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-b73bef51-25cf-403c-81c1-b75ffcec2dc9 tempest-VolumeRetypeWithoutMigrationTest-1700915263 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 11:01:01 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-b73bef51-25cf-403c-81c1-b75ffcec2dc9 tempest-VolumeRetypeWithoutMigrationTest-1700915263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:01:01 devstack sudo[100620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1 Nov 04 11:01:01 devstack sudo[100620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:01:01 devstack cinder-volume[87272]: DEBUG cinder.volume.flows.manager.create_volume [None req-bbc24722-e3c4-4df7-89f8-c3ac92819c0b tempest-VolumeQuotasNegativeTestJSON-1182348298 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87272) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 11:01:01 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-bbc24722-e3c4-4df7-89f8-c3ac92819c0b tempest-VolumeQuotasNegativeTestJSON-1182348298 None] Flow 'volume_create_manager' (c2e71f80-d13f-4be3-83fe-16da06218031) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 11:01:01 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-bbc24722-e3c4-4df7-89f8-c3ac92819c0b tempest-VolumeQuotasNegativeTestJSON-1182348298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (994649b3-36b7-4768-8a7f-a70122f14949) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:01:01 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-bbc24722-e3c4-4df7-89f8-c3ac92819c0b tempest-VolumeQuotasNegativeTestJSON-1182348298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (994649b3-36b7-4768-8a7f-a70122f14949) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T10:01:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-2058328327',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c0d1240a-aa80-4c7d-a4cd-28a940cd2c7e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='63b89fcc95974e4a9279e0c54c5812e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T10:01:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T10:01:01Z,use_quota=True,user_id='9553bdccae094890b9a769403cdb91db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8989e4f-21e3-4f0a-9584-0d818784e883),volume_type_id=f8989e4f-21e3-4f0a-9584-0d818784e883)' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:01:01 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-bbc24722-e3c4-4df7-89f8-c3ac92819c0b tempest-VolumeQuotasNegativeTestJSON-1182348298 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f33e473-db38-4b91-a2d4-6c44fa034b1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:01:01 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-bbc24722-e3c4-4df7-89f8-c3ac92819c0b tempest-VolumeQuotasNegativeTestJSON-1182348298 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f33e473-db38-4b91-a2d4-6c44fa034b1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:01:01 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-bbc24722-e3c4-4df7-89f8-c3ac92819c0b tempest-VolumeQuotasNegativeTestJSON-1182348298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (96cdeeba-51ee-459f-8d39-587bcbcf8812) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:01:01 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-bbc24722-e3c4-4df7-89f8-c3ac92819c0b tempest-VolumeQuotasNegativeTestJSON-1182348298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (96cdeeba-51ee-459f-8d39-587bcbcf8812) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c0d1240a-aa80-4c7d-a4cd-28a940cd2c7e', 'volume_name': 'volume-c0d1240a-aa80-4c7d-a4cd-28a940cd2c7e', 'volume_size': 1}' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:01:01 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-bbc24722-e3c4-4df7-89f8-c3ac92819c0b tempest-VolumeQuotasNegativeTestJSON-1182348298 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e198280-c816-42f0-b360-ed44fddc1a4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:01:01 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-bbc24722-e3c4-4df7-89f8-c3ac92819c0b tempest-VolumeQuotasNegativeTestJSON-1182348298 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e198280-c816-42f0-b360-ed44fddc1a4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:01:01 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-bbc24722-e3c4-4df7-89f8-c3ac92819c0b tempest-VolumeQuotasNegativeTestJSON-1182348298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b731c81d-3a41-4439-8010-4722a13159e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:01:01 devstack cinder-volume[87272]: INFO cinder.volume.flows.manager.create_volume [None req-bbc24722-e3c4-4df7-89f8-c3ac92819c0b tempest-VolumeQuotasNegativeTestJSON-1182348298 None] Volume c0d1240a-aa80-4c7d-a4cd-28a940cd2c7e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c0d1240a-aa80-4c7d-a4cd-28a940cd2c7e', 'volume_size': 1} Nov 04 11:01:01 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-bbc24722-e3c4-4df7-89f8-c3ac92819c0b tempest-VolumeQuotasNegativeTestJSON-1182348298 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 11:01:01 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-bbc24722-e3c4-4df7-89f8-c3ac92819c0b tempest-VolumeQuotasNegativeTestJSON-1182348298 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 11:01:01 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-bbc24722-e3c4-4df7-89f8-c3ac92819c0b tempest-VolumeQuotasNegativeTestJSON-1182348298 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T10:01:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-2058328327',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c0d1240a-aa80-4c7d-a4cd-28a940cd2c7e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='63b89fcc95974e4a9279e0c54c5812e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T10:01:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T10:01:01Z,use_quota=True,user_id='9553bdccae094890b9a769403cdb91db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8989e4f-21e3-4f0a-9584-0d818784e883),volume_type_id=f8989e4f-21e3-4f0a-9584-0d818784e883)}" {{(pid=87272) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 04 11:01:01 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.remotefs [None req-bbc24722-e3c4-4df7-89f8-c3ac92819c0b tempest-VolumeQuotasNegativeTestJSON-1182348298 None] Creating volume c0d1240a-aa80-4c7d-a4cd-28a940cd2c7e {{(pid=87272) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 11:01:01 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-bbc24722-e3c4-4df7-89f8-c3ac92819c0b tempest-VolumeQuotasNegativeTestJSON-1182348298 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 11:01:01 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-bbc24722-e3c4-4df7-89f8-c3ac92819c0b tempest-VolumeQuotasNegativeTestJSON-1182348298 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 11:01:01 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-bbc24722-e3c4-4df7-89f8-c3ac92819c0b tempest-VolumeQuotasNegativeTestJSON-1182348298 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898': None} {{(pid=87272) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 11:01:01 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-bbc24722-e3c4-4df7-89f8-c3ac92819c0b tempest-VolumeQuotasNegativeTestJSON-1182348298 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'] {{(pid=87272) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 11:01:01 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-bbc24722-e3c4-4df7-89f8-c3ac92819c0b tempest-VolumeQuotasNegativeTestJSON-1182348298 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 11:01:01 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-bbc24722-e3c4-4df7-89f8-c3ac92819c0b tempest-VolumeQuotasNegativeTestJSON-1182348298 None] Selected osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898 as target Quobyte volume. {{(pid=87272) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 11:01:01 devstack cinder-volume[87272]: INFO cinder.volume.drivers.remotefs [None req-bbc24722-e3c4-4df7-89f8-c3ac92819c0b tempest-VolumeQuotasNegativeTestJSON-1182348298 None] casted to osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898 Nov 04 11:01:01 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-bbc24722-e3c4-4df7-89f8-c3ac92819c0b tempest-VolumeQuotasNegativeTestJSON-1182348298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-c0d1240a-aa80-4c7d-a4cd-28a940cd2c7e 1073741824 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:01:01 devstack sudo[100620]: pam_unix(sudo:session): session closed for user root Nov 04 11:01:01 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-8e4d2f8b-6ef3-45de-94a8-9a8edfa4a609 tempest-CreateVolumesFromSnapshotTest-1102546986 None] Acquiring lock "cinder-1e8db366-ef1a-42a1-bbac-463482f2323e-delete_volume" by "delete_volume" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 11:01:01 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-b73bef51-25cf-403c-81c1-b75ffcec2dc9 tempest-VolumeRetypeWithoutMigrationTest-1700915263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1" returned: 0 in 0.372s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:01:01 devstack cinder-volume[87272]: DEBUG cinder.manager [None req-b73bef51-25cf-403c-81c1-b75ffcec2dc9 tempest-VolumeRetypeWithoutMigrationTest-1700915263 None] Notifying Schedulers of capabilities ... {{(pid=87272) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 11:01:01 devstack sudo[100623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-c0d1240a-aa80-4c7d-a4cd-28a940cd2c7e 1073741824 Nov 04 11:01:01 devstack sudo[100623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:01:01 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-b73bef51-25cf-403c-81c1-b75ffcec2dc9 tempest-VolumeRetypeWithoutMigrationTest-1700915263 None] Deleted volume successfully. Nov 04 11:01:01 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-8e4d2f8b-6ef3-45de-94a8-9a8edfa4a609 tempest-CreateVolumesFromSnapshotTest-1102546986 None] Lock "cinder-1e8db366-ef1a-42a1-bbac-463482f2323e-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 11:01:01 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-b73bef51-25cf-403c-81c1-b75ffcec2dc9 tempest-VolumeRetypeWithoutMigrationTest-1700915263 None] Lock "cinder-6149d4cf-c79d-4898-a7bf-39836eaa4d1d-delete_volume" released by "delete_volume" :: held 1.614s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 11:01:01 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-8e4d2f8b-6ef3-45de-94a8-9a8edfa4a609 tempest-CreateVolumesFromSnapshotTest-1102546986 None] Acquiring lock "cinder-quobyte-1e8db366-ef1a-42a1-bbac-463482f2323e" by "delete_volume" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 11:01:01 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-8e4d2f8b-6ef3-45de-94a8-9a8edfa4a609 tempest-CreateVolumesFromSnapshotTest-1102546986 None] Lock "cinder-quobyte-1e8db366-ef1a-42a1-bbac-463482f2323e" acquired by "delete_volume" :: waited 0.021s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 11:01:01 devstack cinder-volume[87272]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dd41b49-de6f-4eb2-8a33-82ad9526c237]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 11:01:01 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-8e4d2f8b-6ef3-45de-94a8-9a8edfa4a609 tempest-CreateVolumesFromSnapshotTest-1102546986 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-1e8db366-ef1a-42a1-bbac-463482f2323e {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:01:01 devstack sudo[100625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-1e8db366-ef1a-42a1-bbac-463482f2323e Nov 04 11:01:01 devstack sudo[100625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:01:02 devstack sudo[100623]: pam_unix(sudo:session): session closed for user root Nov 04 11:01:02 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-bbc24722-e3c4-4df7-89f8-c3ac92819c0b tempest-VolumeQuotasNegativeTestJSON-1182348298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-c0d1240a-aa80-4c7d-a4cd-28a940cd2c7e 1073741824" returned: 0 in 0.658s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:01:02 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-bbc24722-e3c4-4df7-89f8-c3ac92819c0b tempest-VolumeQuotasNegativeTestJSON-1182348298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-c0d1240a-aa80-4c7d-a4cd-28a940cd2c7e {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:01:02 devstack sudo[100635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-c0d1240a-aa80-4c7d-a4cd-28a940cd2c7e Nov 04 11:01:02 devstack sudo[100635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:01:02 devstack sudo[100625]: pam_unix(sudo:session): session closed for user root Nov 04 11:01:02 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-8e4d2f8b-6ef3-45de-94a8-9a8edfa4a609 tempest-CreateVolumesFromSnapshotTest-1102546986 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-1e8db366-ef1a-42a1-bbac-463482f2323e" returned: 0 in 0.537s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:01:02 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-8e4d2f8b-6ef3-45de-94a8-9a8edfa4a609 tempest-CreateVolumesFromSnapshotTest-1102546986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-1e8db366-ef1a-42a1-bbac-463482f2323e {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:01:02 devstack sudo[100637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-1e8db366-ef1a-42a1-bbac-463482f2323e Nov 04 11:01:02 devstack sudo[100637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:01:02 devstack sudo[100635]: pam_unix(sudo:session): session closed for user root Nov 04 11:01:02 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-bbc24722-e3c4-4df7-89f8-c3ac92819c0b tempest-VolumeQuotasNegativeTestJSON-1182348298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-c0d1240a-aa80-4c7d-a4cd-28a940cd2c7e" returned: 0 in 0.364s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:01:02 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-bbc24722-e3c4-4df7-89f8-c3ac92819c0b tempest-VolumeQuotasNegativeTestJSON-1182348298 None] <== create_volume: return (1100ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'} {{(pid=87272) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 04 11:01:02 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-bbc24722-e3c4-4df7-89f8-c3ac92819c0b tempest-VolumeQuotasNegativeTestJSON-1182348298 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.105s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 11:01:02 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-bbc24722-e3c4-4df7-89f8-c3ac92819c0b tempest-VolumeQuotasNegativeTestJSON-1182348298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b731c81d-3a41-4439-8010-4722a13159e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c0d1240a-aa80-4c7d-a4cd-28a940cd2c7e', 'volume_size': 1}' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:01:02 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-bbc24722-e3c4-4df7-89f8-c3ac92819c0b tempest-VolumeQuotasNegativeTestJSON-1182348298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe806da3-e08a-46b9-8e39-df76a53d4b08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:01:02 devstack cinder-volume[87272]: INFO cinder.volume.flows.manager.create_volume [None req-bbc24722-e3c4-4df7-89f8-c3ac92819c0b tempest-VolumeQuotasNegativeTestJSON-1182348298 None] Volume volume-c0d1240a-aa80-4c7d-a4cd-28a940cd2c7e (c0d1240a-aa80-4c7d-a4cd-28a940cd2c7e): created successfully Nov 04 11:01:02 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-bbc24722-e3c4-4df7-89f8-c3ac92819c0b tempest-VolumeQuotasNegativeTestJSON-1182348298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe806da3-e08a-46b9-8e39-df76a53d4b08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:01:02 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-bbc24722-e3c4-4df7-89f8-c3ac92819c0b tempest-VolumeQuotasNegativeTestJSON-1182348298 None] Flow 'volume_create_manager' (c2e71f80-d13f-4be3-83fe-16da06218031) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87272) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 11:01:02 devstack sudo[100637]: pam_unix(sudo:session): session closed for user root Nov 04 11:01:02 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-bbc24722-e3c4-4df7-89f8-c3ac92819c0b tempest-VolumeQuotasNegativeTestJSON-1182348298 None] Created volume successfully. Nov 04 11:01:02 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-8e4d2f8b-6ef3-45de-94a8-9a8edfa4a609 tempest-CreateVolumesFromSnapshotTest-1102546986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-1e8db366-ef1a-42a1-bbac-463482f2323e" returned: 0 in 0.436s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:01:02 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-8e4d2f8b-6ef3-45de-94a8-9a8edfa4a609 tempest-CreateVolumesFromSnapshotTest-1102546986 None] Lock "cinder-quobyte-1e8db366-ef1a-42a1-bbac-463482f2323e" released by "delete_volume" :: held 1.035s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 11:01:02 devstack cinder-volume[87272]: DEBUG cinder.quota [None req-8e4d2f8b-6ef3-45de-94a8-9a8edfa4a609 tempest-CreateVolumesFromSnapshotTest-1102546986 None] Created reservations ['d7322e78-d45a-4c4a-b26b-d1e56b747b60', 'd77f2d29-5452-49f3-b98a-c41524b4c739', '0b792d07-5501-481a-8033-b35a397ad3eb', 'f7ebcfe9-4371-4fbc-b376-2c6618ce5731'] {{(pid=87272) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 11:01:02 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-8e4d2f8b-6ef3-45de-94a8-9a8edfa4a609 tempest-CreateVolumesFromSnapshotTest-1102546986 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 11:01:02 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-8e4d2f8b-6ef3-45de-94a8-9a8edfa4a609 tempest-CreateVolumesFromSnapshotTest-1102546986 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 11:01:02 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-8e4d2f8b-6ef3-45de-94a8-9a8edfa4a609 tempest-CreateVolumesFromSnapshotTest-1102546986 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898': None} {{(pid=87272) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 11:01:02 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-8e4d2f8b-6ef3-45de-94a8-9a8edfa4a609 tempest-CreateVolumesFromSnapshotTest-1102546986 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'] {{(pid=87272) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 11:01:02 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-8e4d2f8b-6ef3-45de-94a8-9a8edfa4a609 tempest-CreateVolumesFromSnapshotTest-1102546986 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 11:01:02 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-8e4d2f8b-6ef3-45de-94a8-9a8edfa4a609 tempest-CreateVolumesFromSnapshotTest-1102546986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:01:02 devstack sudo[100642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1 Nov 04 11:01:02 devstack sudo[100642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:01:03 devstack sudo[100642]: pam_unix(sudo:session): session closed for user root Nov 04 11:01:03 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-8e4d2f8b-6ef3-45de-94a8-9a8edfa4a609 tempest-CreateVolumesFromSnapshotTest-1102546986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1" returned: 0 in 0.282s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:01:03 devstack cinder-volume[87272]: DEBUG cinder.manager [None req-8e4d2f8b-6ef3-45de-94a8-9a8edfa4a609 tempest-CreateVolumesFromSnapshotTest-1102546986 None] Notifying Schedulers of capabilities ... {{(pid=87272) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 11:01:03 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-8e4d2f8b-6ef3-45de-94a8-9a8edfa4a609 tempest-CreateVolumesFromSnapshotTest-1102546986 None] Deleted volume successfully. Nov 04 11:01:03 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-8e4d2f8b-6ef3-45de-94a8-9a8edfa4a609 tempest-CreateVolumesFromSnapshotTest-1102546986 None] Lock "cinder-1e8db366-ef1a-42a1-bbac-463482f2323e-delete_volume" released by "delete_volume" :: held 1.617s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 11:01:03 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-ecb20e29-83ea-4282-8f07-2d2f6075c9f3 tempest-CreateVolumesFromSnapshotTest-1102546986 None] Acquiring lock "cinder-8417310b-cf92-4392-8e95-25a1dcd24b1f-delete_volume" by "delete_volume" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 11:01:03 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-ecb20e29-83ea-4282-8f07-2d2f6075c9f3 tempest-CreateVolumesFromSnapshotTest-1102546986 None] Lock "cinder-8417310b-cf92-4392-8e95-25a1dcd24b1f-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 11:01:03 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-ecb20e29-83ea-4282-8f07-2d2f6075c9f3 tempest-CreateVolumesFromSnapshotTest-1102546986 None] Acquiring lock "cinder-quobyte-8417310b-cf92-4392-8e95-25a1dcd24b1f" by "delete_volume" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 11:01:03 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-ecb20e29-83ea-4282-8f07-2d2f6075c9f3 tempest-CreateVolumesFromSnapshotTest-1102546986 None] Lock "cinder-quobyte-8417310b-cf92-4392-8e95-25a1dcd24b1f" acquired by "delete_volume" :: waited 0.029s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 11:01:03 devstack cinder-volume[87272]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ddbd5b1-9748-492b-ae96-626dedca9806]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 11:01:03 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-ecb20e29-83ea-4282-8f07-2d2f6075c9f3 tempest-CreateVolumesFromSnapshotTest-1102546986 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-8417310b-cf92-4392-8e95-25a1dcd24b1f {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:01:04 devstack sudo[100646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-8417310b-cf92-4392-8e95-25a1dcd24b1f Nov 04 11:01:04 devstack sudo[100646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:01:04 devstack sudo[100646]: pam_unix(sudo:session): session closed for user root Nov 04 11:01:04 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-ecb20e29-83ea-4282-8f07-2d2f6075c9f3 tempest-CreateVolumesFromSnapshotTest-1102546986 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-8417310b-cf92-4392-8e95-25a1dcd24b1f" returned: 0 in 0.438s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:01:04 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-ecb20e29-83ea-4282-8f07-2d2f6075c9f3 tempest-CreateVolumesFromSnapshotTest-1102546986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-8417310b-cf92-4392-8e95-25a1dcd24b1f {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:01:04 devstack sudo[100653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-8417310b-cf92-4392-8e95-25a1dcd24b1f Nov 04 11:01:04 devstack sudo[100653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:01:04 devstack sudo[100653]: pam_unix(sudo:session): session closed for user root Nov 04 11:01:04 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-ecb20e29-83ea-4282-8f07-2d2f6075c9f3 tempest-CreateVolumesFromSnapshotTest-1102546986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-8417310b-cf92-4392-8e95-25a1dcd24b1f" returned: 0 in 0.324s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:01:04 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-ecb20e29-83ea-4282-8f07-2d2f6075c9f3 tempest-CreateVolumesFromSnapshotTest-1102546986 None] Lock "cinder-quobyte-8417310b-cf92-4392-8e95-25a1dcd24b1f" released by "delete_volume" :: held 0.839s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 11:01:04 devstack cinder-volume[87272]: DEBUG cinder.quota [None req-ecb20e29-83ea-4282-8f07-2d2f6075c9f3 tempest-CreateVolumesFromSnapshotTest-1102546986 None] Created reservations ['e0753c63-25cd-4f5c-abdb-a6e94450b595', '9faf833e-8077-42dc-a419-3f4b78bbd401', '6212236e-ced6-43cf-8dde-b4131e13502f', '3c94f387-b00b-4a7b-bb88-899fb45a38cc'] {{(pid=87272) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 11:01:04 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-ecb20e29-83ea-4282-8f07-2d2f6075c9f3 tempest-CreateVolumesFromSnapshotTest-1102546986 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 11:01:04 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-ecb20e29-83ea-4282-8f07-2d2f6075c9f3 tempest-CreateVolumesFromSnapshotTest-1102546986 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 11:01:04 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-ecb20e29-83ea-4282-8f07-2d2f6075c9f3 tempest-CreateVolumesFromSnapshotTest-1102546986 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898': None} {{(pid=87272) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 11:01:05 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-ecb20e29-83ea-4282-8f07-2d2f6075c9f3 tempest-CreateVolumesFromSnapshotTest-1102546986 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'] {{(pid=87272) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 11:01:05 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-ecb20e29-83ea-4282-8f07-2d2f6075c9f3 tempest-CreateVolumesFromSnapshotTest-1102546986 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 11:01:05 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-ecb20e29-83ea-4282-8f07-2d2f6075c9f3 tempest-CreateVolumesFromSnapshotTest-1102546986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:01:05 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-6f253157-f62e-4627-86b9-d74eba2056df tempest-VolumeQuotasNegativeTestJSON-1182348298 None] Acquiring lock "cinder-c0d1240a-aa80-4c7d-a4cd-28a940cd2c7e-delete_volume" by "delete_volume" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 11:01:05 devstack sudo[100656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1 Nov 04 11:01:05 devstack sudo[100656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:01:05 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-6f253157-f62e-4627-86b9-d74eba2056df tempest-VolumeQuotasNegativeTestJSON-1182348298 None] Lock "cinder-c0d1240a-aa80-4c7d-a4cd-28a940cd2c7e-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 11:01:05 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-e3ca3562-317a-47e4-91e5-e2bea4bc912a tempest-CreateVolumesFromSnapshotTest-1102546986 None] Acquiring lock "cinder-03bb086d-cccf-435c-af4b-51bf35d49c6e-delete_volume" by "delete_volume" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 11:01:05 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-e3ca3562-317a-47e4-91e5-e2bea4bc912a tempest-CreateVolumesFromSnapshotTest-1102546986 None] Lock "cinder-03bb086d-cccf-435c-af4b-51bf35d49c6e-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 11:01:05 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-6f253157-f62e-4627-86b9-d74eba2056df tempest-VolumeQuotasNegativeTestJSON-1182348298 None] Acquiring lock "cinder-quobyte-c0d1240a-aa80-4c7d-a4cd-28a940cd2c7e" by "delete_volume" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 11:01:05 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-6f253157-f62e-4627-86b9-d74eba2056df tempest-VolumeQuotasNegativeTestJSON-1182348298 None] Lock "cinder-quobyte-c0d1240a-aa80-4c7d-a4cd-28a940cd2c7e" acquired by "delete_volume" :: waited 0.040s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 11:01:05 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-e3ca3562-317a-47e4-91e5-e2bea4bc912a tempest-CreateVolumesFromSnapshotTest-1102546986 None] Acquiring lock "cinder-quobyte-03bb086d-cccf-435c-af4b-51bf35d49c6e" by "delete_volume" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 11:01:05 devstack cinder-volume[87272]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e4328c8-871e-4a33-839d-30aca882fdad]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 11:01:05 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-6f253157-f62e-4627-86b9-d74eba2056df tempest-VolumeQuotasNegativeTestJSON-1182348298 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-c0d1240a-aa80-4c7d-a4cd-28a940cd2c7e {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:01:05 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-e3ca3562-317a-47e4-91e5-e2bea4bc912a tempest-CreateVolumesFromSnapshotTest-1102546986 None] Lock "cinder-quobyte-03bb086d-cccf-435c-af4b-51bf35d49c6e" acquired by "delete_volume" :: waited 0.034s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 11:01:05 devstack cinder-volume[87272]: DEBUG oslo.privsep.daemon [-] privsep: reply[b53cf777-e879-4c6c-b94a-48c54659b56d]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 11:01:05 devstack sudo[100656]: pam_unix(sudo:session): session closed for user root Nov 04 11:01:05 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-e3ca3562-317a-47e4-91e5-e2bea4bc912a tempest-CreateVolumesFromSnapshotTest-1102546986 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-03bb086d-cccf-435c-af4b-51bf35d49c6e {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:01:05 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-ecb20e29-83ea-4282-8f07-2d2f6075c9f3 tempest-CreateVolumesFromSnapshotTest-1102546986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1" returned: 0 in 0.426s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:01:05 devstack cinder-volume[87272]: DEBUG cinder.manager [None req-ecb20e29-83ea-4282-8f07-2d2f6075c9f3 tempest-CreateVolumesFromSnapshotTest-1102546986 None] Notifying Schedulers of capabilities ... {{(pid=87272) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 11:01:05 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-ecb20e29-83ea-4282-8f07-2d2f6075c9f3 tempest-CreateVolumesFromSnapshotTest-1102546986 None] Deleted volume successfully. Nov 04 11:01:05 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-ecb20e29-83ea-4282-8f07-2d2f6075c9f3 tempest-CreateVolumesFromSnapshotTest-1102546986 None] Lock "cinder-8417310b-cf92-4392-8e95-25a1dcd24b1f-delete_volume" released by "delete_volume" :: held 1.704s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 11:01:05 devstack sudo[100659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-c0d1240a-aa80-4c7d-a4cd-28a940cd2c7e Nov 04 11:01:05 devstack sudo[100659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:01:05 devstack sudo[100660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-03bb086d-cccf-435c-af4b-51bf35d49c6e Nov 04 11:01:05 devstack sudo[100660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:01:05 devstack sudo[100659]: pam_unix(sudo:session): session closed for user root Nov 04 11:01:05 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-6f253157-f62e-4627-86b9-d74eba2056df tempest-VolumeQuotasNegativeTestJSON-1182348298 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-c0d1240a-aa80-4c7d-a4cd-28a940cd2c7e" returned: 0 in 0.525s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:01:05 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-6f253157-f62e-4627-86b9-d74eba2056df tempest-VolumeQuotasNegativeTestJSON-1182348298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-c0d1240a-aa80-4c7d-a4cd-28a940cd2c7e {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:01:05 devstack sudo[100669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-c0d1240a-aa80-4c7d-a4cd-28a940cd2c7e Nov 04 11:01:05 devstack sudo[100669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:01:05 devstack sudo[100660]: pam_unix(sudo:session): session closed for user root Nov 04 11:01:05 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-e3ca3562-317a-47e4-91e5-e2bea4bc912a tempest-CreateVolumesFromSnapshotTest-1102546986 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-03bb086d-cccf-435c-af4b-51bf35d49c6e" returned: 0 in 0.501s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:01:05 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-e3ca3562-317a-47e4-91e5-e2bea4bc912a tempest-CreateVolumesFromSnapshotTest-1102546986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-03bb086d-cccf-435c-af4b-51bf35d49c6e {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:01:05 devstack sudo[100671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-03bb086d-cccf-435c-af4b-51bf35d49c6e Nov 04 11:01:05 devstack sudo[100671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:01:06 devstack sudo[100669]: pam_unix(sudo:session): session closed for user root Nov 04 11:01:06 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-6f253157-f62e-4627-86b9-d74eba2056df tempest-VolumeQuotasNegativeTestJSON-1182348298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-c0d1240a-aa80-4c7d-a4cd-28a940cd2c7e" returned: 0 in 0.381s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:01:06 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-6f253157-f62e-4627-86b9-d74eba2056df tempest-VolumeQuotasNegativeTestJSON-1182348298 None] Lock "cinder-quobyte-c0d1240a-aa80-4c7d-a4cd-28a940cd2c7e" released by "delete_volume" :: held 0.997s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 11:01:06 devstack sudo[100671]: pam_unix(sudo:session): session closed for user root Nov 04 11:01:06 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-e3ca3562-317a-47e4-91e5-e2bea4bc912a tempest-CreateVolumesFromSnapshotTest-1102546986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-03bb086d-cccf-435c-af4b-51bf35d49c6e" returned: 0 in 0.402s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:01:06 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-e3ca3562-317a-47e4-91e5-e2bea4bc912a tempest-CreateVolumesFromSnapshotTest-1102546986 None] Lock "cinder-quobyte-03bb086d-cccf-435c-af4b-51bf35d49c6e" released by "delete_volume" :: held 0.992s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 11:01:06 devstack cinder-volume[87272]: DEBUG cinder.quota [None req-6f253157-f62e-4627-86b9-d74eba2056df tempest-VolumeQuotasNegativeTestJSON-1182348298 None] Created reservations ['8e268b4f-47e7-4d90-87b0-0d47d8d05277', '0200a703-96c2-4335-ba72-faa9414200fc', '80ac993d-288a-488f-a4b1-d18c465bcb34', '4970fbb7-558c-4fd4-b518-58c5e1d188d2'] {{(pid=87272) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 11:01:06 devstack cinder-volume[87272]: DEBUG cinder.quota [None req-e3ca3562-317a-47e4-91e5-e2bea4bc912a tempest-CreateVolumesFromSnapshotTest-1102546986 None] Created reservations ['a605f28e-b44c-4611-8c4a-931361c3e81b', '1ed48d9d-fdf0-4ab7-bd7d-cea0f552b480', '831f9d02-7361-4f27-8412-11a3d5ea791a', 'a6bb0759-56db-4ccf-b147-b425b462cb86'] {{(pid=87272) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 11:01:06 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-6f253157-f62e-4627-86b9-d74eba2056df tempest-VolumeQuotasNegativeTestJSON-1182348298 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 11:01:06 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-6f253157-f62e-4627-86b9-d74eba2056df tempest-VolumeQuotasNegativeTestJSON-1182348298 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 11:01:06 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-6f253157-f62e-4627-86b9-d74eba2056df tempest-VolumeQuotasNegativeTestJSON-1182348298 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898': None} {{(pid=87272) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 11:01:06 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-6f253157-f62e-4627-86b9-d74eba2056df tempest-VolumeQuotasNegativeTestJSON-1182348298 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'] {{(pid=87272) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 11:01:06 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-6f253157-f62e-4627-86b9-d74eba2056df tempest-VolumeQuotasNegativeTestJSON-1182348298 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 11:01:06 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-6f253157-f62e-4627-86b9-d74eba2056df tempest-VolumeQuotasNegativeTestJSON-1182348298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:01:06 devstack sudo[100677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1 Nov 04 11:01:06 devstack sudo[100677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:01:06 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-e3ca3562-317a-47e4-91e5-e2bea4bc912a tempest-CreateVolumesFromSnapshotTest-1102546986 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 11:01:06 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-e3ca3562-317a-47e4-91e5-e2bea4bc912a tempest-CreateVolumesFromSnapshotTest-1102546986 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 11:01:06 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-e3ca3562-317a-47e4-91e5-e2bea4bc912a tempest-CreateVolumesFromSnapshotTest-1102546986 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898': None} {{(pid=87272) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 11:01:06 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-e3ca3562-317a-47e4-91e5-e2bea4bc912a tempest-CreateVolumesFromSnapshotTest-1102546986 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'] {{(pid=87272) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 11:01:06 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-e3ca3562-317a-47e4-91e5-e2bea4bc912a tempest-CreateVolumesFromSnapshotTest-1102546986 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 11:01:06 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-e3ca3562-317a-47e4-91e5-e2bea4bc912a tempest-CreateVolumesFromSnapshotTest-1102546986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:01:06 devstack sudo[100679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1 Nov 04 11:01:06 devstack sudo[100679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:01:06 devstack sudo[100677]: pam_unix(sudo:session): session closed for user root Nov 04 11:01:06 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-6f253157-f62e-4627-86b9-d74eba2056df tempest-VolumeQuotasNegativeTestJSON-1182348298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1" returned: 0 in 0.328s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:01:06 devstack cinder-volume[87272]: DEBUG cinder.manager [None req-6f253157-f62e-4627-86b9-d74eba2056df tempest-VolumeQuotasNegativeTestJSON-1182348298 None] Notifying Schedulers of capabilities ... {{(pid=87272) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 11:01:06 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-6f253157-f62e-4627-86b9-d74eba2056df tempest-VolumeQuotasNegativeTestJSON-1182348298 None] Deleted volume successfully. Nov 04 11:01:06 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-6f253157-f62e-4627-86b9-d74eba2056df tempest-VolumeQuotasNegativeTestJSON-1182348298 None] Lock "cinder-c0d1240a-aa80-4c7d-a4cd-28a940cd2c7e-delete_volume" released by "delete_volume" :: held 1.803s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 11:01:06 devstack sudo[100679]: pam_unix(sudo:session): session closed for user root Nov 04 11:01:06 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-e3ca3562-317a-47e4-91e5-e2bea4bc912a tempest-CreateVolumesFromSnapshotTest-1102546986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1" returned: 0 in 0.371s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:01:06 devstack cinder-volume[87272]: DEBUG cinder.manager [None req-e3ca3562-317a-47e4-91e5-e2bea4bc912a tempest-CreateVolumesFromSnapshotTest-1102546986 None] Notifying Schedulers of capabilities ... {{(pid=87272) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 11:01:06 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-e3ca3562-317a-47e4-91e5-e2bea4bc912a tempest-CreateVolumesFromSnapshotTest-1102546986 None] Deleted volume successfully. Nov 04 11:01:06 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-e3ca3562-317a-47e4-91e5-e2bea4bc912a tempest-CreateVolumesFromSnapshotTest-1102546986 None] Lock "cinder-03bb086d-cccf-435c-af4b-51bf35d49c6e-delete_volume" released by "delete_volume" :: held 1.774s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 11:01:07 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-cc6b8c6e-3a3c-44a7-bf7a-6860f29af61b tempest-CreateVolumesFromSnapshotTest-1102546986 None] Acquiring lock "cinder-071d399f-3743-4471-ba7d-1efec0af20e1-delete_volume" by "delete_volume" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 11:01:07 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-cc6b8c6e-3a3c-44a7-bf7a-6860f29af61b tempest-CreateVolumesFromSnapshotTest-1102546986 None] Lock "cinder-071d399f-3743-4471-ba7d-1efec0af20e1-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 11:01:07 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-cc6b8c6e-3a3c-44a7-bf7a-6860f29af61b tempest-CreateVolumesFromSnapshotTest-1102546986 None] Acquiring lock "cinder-quobyte-071d399f-3743-4471-ba7d-1efec0af20e1" by "delete_volume" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 11:01:07 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-cc6b8c6e-3a3c-44a7-bf7a-6860f29af61b tempest-CreateVolumesFromSnapshotTest-1102546986 None] Lock "cinder-quobyte-071d399f-3743-4471-ba7d-1efec0af20e1" acquired by "delete_volume" :: waited 0.028s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 11:01:07 devstack cinder-volume[87272]: DEBUG oslo.privsep.daemon [-] privsep: reply[75f27a12-95ac-4d39-9b4e-a070b1d22907]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 11:01:07 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-cc6b8c6e-3a3c-44a7-bf7a-6860f29af61b tempest-CreateVolumesFromSnapshotTest-1102546986 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-071d399f-3743-4471-ba7d-1efec0af20e1 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:01:07 devstack sudo[100683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-071d399f-3743-4471-ba7d-1efec0af20e1 Nov 04 11:01:07 devstack sudo[100683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:01:08 devstack sudo[100683]: pam_unix(sudo:session): session closed for user root Nov 04 11:01:08 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-cc6b8c6e-3a3c-44a7-bf7a-6860f29af61b tempest-CreateVolumesFromSnapshotTest-1102546986 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-071d399f-3743-4471-ba7d-1efec0af20e1" returned: 0 in 0.476s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:01:08 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-cc6b8c6e-3a3c-44a7-bf7a-6860f29af61b tempest-CreateVolumesFromSnapshotTest-1102546986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-071d399f-3743-4471-ba7d-1efec0af20e1 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:01:08 devstack sudo[100689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-071d399f-3743-4471-ba7d-1efec0af20e1 Nov 04 11:01:08 devstack sudo[100689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:01:08 devstack sudo[100689]: pam_unix(sudo:session): session closed for user root Nov 04 11:01:08 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-cc6b8c6e-3a3c-44a7-bf7a-6860f29af61b tempest-CreateVolumesFromSnapshotTest-1102546986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-071d399f-3743-4471-ba7d-1efec0af20e1" returned: 0 in 0.333s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:01:08 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-cc6b8c6e-3a3c-44a7-bf7a-6860f29af61b tempest-CreateVolumesFromSnapshotTest-1102546986 None] Lock "cinder-quobyte-071d399f-3743-4471-ba7d-1efec0af20e1" released by "delete_volume" :: held 0.874s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 11:01:08 devstack cinder-volume[87272]: DEBUG cinder.quota [None req-cc6b8c6e-3a3c-44a7-bf7a-6860f29af61b tempest-CreateVolumesFromSnapshotTest-1102546986 None] Created reservations ['00241007-49c1-48b3-86cd-01d840d3d8cf', '79b1d770-8662-4e5c-9c70-df4d3fccfd10', '73cceb7f-1791-4871-b6f7-b46e1ab11301', '735e05bd-35ea-488d-9827-56c9ff78834b'] {{(pid=87272) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 11:01:08 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-cc6b8c6e-3a3c-44a7-bf7a-6860f29af61b tempest-CreateVolumesFromSnapshotTest-1102546986 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 11:01:08 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-cc6b8c6e-3a3c-44a7-bf7a-6860f29af61b tempest-CreateVolumesFromSnapshotTest-1102546986 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 11:01:08 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-cc6b8c6e-3a3c-44a7-bf7a-6860f29af61b tempest-CreateVolumesFromSnapshotTest-1102546986 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898': None} {{(pid=87272) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 11:01:08 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-cc6b8c6e-3a3c-44a7-bf7a-6860f29af61b tempest-CreateVolumesFromSnapshotTest-1102546986 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'] {{(pid=87272) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 11:01:08 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-cc6b8c6e-3a3c-44a7-bf7a-6860f29af61b tempest-CreateVolumesFromSnapshotTest-1102546986 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 11:01:08 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-cc6b8c6e-3a3c-44a7-bf7a-6860f29af61b tempest-CreateVolumesFromSnapshotTest-1102546986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:01:08 devstack sudo[100693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1 Nov 04 11:01:08 devstack sudo[100693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:01:08 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-2787234f-8e95-43e3-ab53-700aef98c377 tempest-CreateVolumesFromSnapshotTest-1102546986 None] Acquiring lock "cinder-e73311f6-e9eb-45a4-91b4-5574f0bbc66c-delete_volume" by "delete_volume" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 11:01:08 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-2787234f-8e95-43e3-ab53-700aef98c377 tempest-CreateVolumesFromSnapshotTest-1102546986 None] Lock "cinder-e73311f6-e9eb-45a4-91b4-5574f0bbc66c-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 11:01:08 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-2787234f-8e95-43e3-ab53-700aef98c377 tempest-CreateVolumesFromSnapshotTest-1102546986 None] Acquiring lock "cinder-quobyte-e73311f6-e9eb-45a4-91b4-5574f0bbc66c" by "delete_volume" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 11:01:08 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-2787234f-8e95-43e3-ab53-700aef98c377 tempest-CreateVolumesFromSnapshotTest-1102546986 None] Lock "cinder-quobyte-e73311f6-e9eb-45a4-91b4-5574f0bbc66c" acquired by "delete_volume" :: waited 0.026s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 11:01:08 devstack cinder-volume[87272]: DEBUG oslo.privsep.daemon [-] privsep: reply[b484d47b-c3d2-4910-a25c-cb0cafdddc40]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 11:01:08 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-2787234f-8e95-43e3-ab53-700aef98c377 tempest-CreateVolumesFromSnapshotTest-1102546986 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-e73311f6-e9eb-45a4-91b4-5574f0bbc66c {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:01:09 devstack sudo[100695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-e73311f6-e9eb-45a4-91b4-5574f0bbc66c Nov 04 11:01:09 devstack sudo[100695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:01:09 devstack sudo[100693]: pam_unix(sudo:session): session closed for user root Nov 04 11:01:09 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-cc6b8c6e-3a3c-44a7-bf7a-6860f29af61b tempest-CreateVolumesFromSnapshotTest-1102546986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1" returned: 0 in 0.416s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:01:09 devstack cinder-volume[87272]: DEBUG cinder.manager [None req-cc6b8c6e-3a3c-44a7-bf7a-6860f29af61b tempest-CreateVolumesFromSnapshotTest-1102546986 None] Notifying Schedulers of capabilities ... {{(pid=87272) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 11:01:09 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-cc6b8c6e-3a3c-44a7-bf7a-6860f29af61b tempest-CreateVolumesFromSnapshotTest-1102546986 None] Deleted volume successfully. Nov 04 11:01:09 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-cc6b8c6e-3a3c-44a7-bf7a-6860f29af61b tempest-CreateVolumesFromSnapshotTest-1102546986 None] Lock "cinder-071d399f-3743-4471-ba7d-1efec0af20e1-delete_volume" released by "delete_volume" :: held 1.616s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 11:01:09 devstack sudo[100695]: pam_unix(sudo:session): session closed for user root Nov 04 11:01:09 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-2787234f-8e95-43e3-ab53-700aef98c377 tempest-CreateVolumesFromSnapshotTest-1102546986 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-e73311f6-e9eb-45a4-91b4-5574f0bbc66c" returned: 0 in 0.514s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:01:09 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-2787234f-8e95-43e3-ab53-700aef98c377 tempest-CreateVolumesFromSnapshotTest-1102546986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-e73311f6-e9eb-45a4-91b4-5574f0bbc66c {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:01:09 devstack sudo[100701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-e73311f6-e9eb-45a4-91b4-5574f0bbc66c Nov 04 11:01:09 devstack sudo[100701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:01:09 devstack sudo[100701]: pam_unix(sudo:session): session closed for user root Nov 04 11:01:09 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-2787234f-8e95-43e3-ab53-700aef98c377 tempest-CreateVolumesFromSnapshotTest-1102546986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-e73311f6-e9eb-45a4-91b4-5574f0bbc66c" returned: 0 in 0.302s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:01:09 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-2787234f-8e95-43e3-ab53-700aef98c377 tempest-CreateVolumesFromSnapshotTest-1102546986 None] Lock "cinder-quobyte-e73311f6-e9eb-45a4-91b4-5574f0bbc66c" released by "delete_volume" :: held 0.876s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 11:01:09 devstack cinder-volume[87272]: DEBUG cinder.quota [None req-2787234f-8e95-43e3-ab53-700aef98c377 tempest-CreateVolumesFromSnapshotTest-1102546986 None] Created reservations ['c0227f21-97ae-4d8c-ae07-baba58ea6594', 'eb9647ad-3178-4dfd-9d1b-c511b582b307', '468f0d11-dc9d-42db-a81f-e7ed6d494b39', '55c097bd-8ad2-43b0-8150-142e0c911439'] {{(pid=87272) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 11:01:09 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-2787234f-8e95-43e3-ab53-700aef98c377 tempest-CreateVolumesFromSnapshotTest-1102546986 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 11:01:09 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-2787234f-8e95-43e3-ab53-700aef98c377 tempest-CreateVolumesFromSnapshotTest-1102546986 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 11:01:09 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-2787234f-8e95-43e3-ab53-700aef98c377 tempest-CreateVolumesFromSnapshotTest-1102546986 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898': None} {{(pid=87272) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 11:01:09 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-2787234f-8e95-43e3-ab53-700aef98c377 tempest-CreateVolumesFromSnapshotTest-1102546986 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'] {{(pid=87272) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 11:01:09 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-2787234f-8e95-43e3-ab53-700aef98c377 tempest-CreateVolumesFromSnapshotTest-1102546986 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 11:01:09 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-2787234f-8e95-43e3-ab53-700aef98c377 tempest-CreateVolumesFromSnapshotTest-1102546986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:01:09 devstack sudo[100704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1 Nov 04 11:01:09 devstack sudo[100704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:01:09 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-e78140c3-a881-44d4-857c-b4b87a48a086 tempest-CreateVolumesFromSnapshotTest-1102546986 None] Acquiring lock "cinder-3258c275-6b69-4317-b012-6f09371d5257-delete_snapshot" by "delete_snapshot" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 11:01:09 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-e78140c3-a881-44d4-857c-b4b87a48a086 tempest-CreateVolumesFromSnapshotTest-1102546986 None] Lock "cinder-3258c275-6b69-4317-b012-6f09371d5257-delete_snapshot" acquired by "delete_snapshot" :: waited 0.037s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 11:01:09 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-e78140c3-a881-44d4-857c-b4b87a48a086 tempest-CreateVolumesFromSnapshotTest-1102546986 None] Acquiring lock "cinder-quobyte-6b49eddf-ecef-4369-a9a9-9545727024ec" by "delete_snapshot" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 11:01:10 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-e78140c3-a881-44d4-857c-b4b87a48a086 tempest-CreateVolumesFromSnapshotTest-1102546986 None] Lock "cinder-quobyte-6b49eddf-ecef-4369-a9a9-9545727024ec" acquired by "delete_snapshot" :: waited 0.047s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 11:01:10 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-e78140c3-a881-44d4-857c-b4b87a48a086 tempest-CreateVolumesFromSnapshotTest-1102546986 None] Acquiring lock "cinder-quobyte-3258c275-6b69-4317-b012-6f09371d5257" by "_delete_snapshot" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 11:01:10 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-e78140c3-a881-44d4-857c-b4b87a48a086 tempest-CreateVolumesFromSnapshotTest-1102546986 None] Lock "cinder-quobyte-3258c275-6b69-4317-b012-6f09371d5257" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 11:01:10 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.remotefs [None req-e78140c3-a881-44d4-857c-b4b87a48a086 tempest-CreateVolumesFromSnapshotTest-1102546986 None] Deleting offline snapshot 3258c275-6b69-4317-b012-6f09371d5257 of volume 6b49eddf-ecef-4369-a9a9-9545727024ec {{(pid=87272) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 04 11:01:10 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.remotefs [None req-e78140c3-a881-44d4-857c-b4b87a48a086 tempest-CreateVolumesFromSnapshotTest-1102546986 None] snapshot_file for this snap is: volume-6b49eddf-ecef-4369-a9a9-9545727024ec.3258c275-6b69-4317-b012-6f09371d5257 {{(pid=87272) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 04 11:01:10 devstack cinder-volume[87272]: DEBUG oslo.privsep.daemon [-] privsep: reply[90984333-e2c8-4456-81d4-3c27f2f541e8]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 11:01:10 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-e78140c3-a881-44d4-857c-b4b87a48a086 tempest-CreateVolumesFromSnapshotTest-1102546986 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-6b49eddf-ecef-4369-a9a9-9545727024ec.3258c275-6b69-4317-b012-6f09371d5257 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:01:10 devstack sudo[100706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-6b49eddf-ecef-4369-a9a9-9545727024ec.3258c275-6b69-4317-b012-6f09371d5257 Nov 04 11:01:10 devstack sudo[100706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:01:10 devstack sudo[100704]: pam_unix(sudo:session): session closed for user root Nov 04 11:01:10 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-2787234f-8e95-43e3-ab53-700aef98c377 tempest-CreateVolumesFromSnapshotTest-1102546986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1" returned: 0 in 0.408s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:01:10 devstack cinder-volume[87272]: DEBUG cinder.manager [None req-2787234f-8e95-43e3-ab53-700aef98c377 tempest-CreateVolumesFromSnapshotTest-1102546986 None] Notifying Schedulers of capabilities ... {{(pid=87272) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 11:01:10 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-2787234f-8e95-43e3-ab53-700aef98c377 tempest-CreateVolumesFromSnapshotTest-1102546986 None] Deleted volume successfully. Nov 04 11:01:10 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-2787234f-8e95-43e3-ab53-700aef98c377 tempest-CreateVolumesFromSnapshotTest-1102546986 None] Lock "cinder-e73311f6-e9eb-45a4-91b4-5574f0bbc66c-delete_volume" released by "delete_volume" :: held 1.588s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 11:01:10 devstack sudo[100706]: pam_unix(sudo:session): session closed for user root Nov 04 11:01:10 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-e78140c3-a881-44d4-857c-b4b87a48a086 tempest-CreateVolumesFromSnapshotTest-1102546986 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-6b49eddf-ecef-4369-a9a9-9545727024ec.3258c275-6b69-4317-b012-6f09371d5257" returned: 0 in 0.530s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:01:10 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.remotefs [None req-e78140c3-a881-44d4-857c-b4b87a48a086 tempest-CreateVolumesFromSnapshotTest-1102546986 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6b49eddf-ecef-4369-a9a9-9545727024ec(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87272) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 11:01:10 devstack cinder-volume[87272]: DEBUG oslo.privsep.daemon [-] privsep: reply[6418c665-37c2-4d13-96a0-f143b93cb72a]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 11:01:10 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-e78140c3-a881-44d4-857c-b4b87a48a086 tempest-CreateVolumesFromSnapshotTest-1102546986 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-6b49eddf-ecef-4369-a9a9-9545727024ec {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:01:10 devstack sudo[100713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-6b49eddf-ecef-4369-a9a9-9545727024ec Nov 04 11:01:10 devstack sudo[100713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:01:11 devstack sudo[100713]: pam_unix(sudo:session): session closed for user root Nov 04 11:01:11 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-e78140c3-a881-44d4-857c-b4b87a48a086 tempest-CreateVolumesFromSnapshotTest-1102546986 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-6b49eddf-ecef-4369-a9a9-9545727024ec" returned: 0 in 0.425s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:01:11 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-e78140c3-a881-44d4-857c-b4b87a48a086 tempest-CreateVolumesFromSnapshotTest-1102546986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-6b49eddf-ecef-4369-a9a9-9545727024ec.3258c275-6b69-4317-b012-6f09371d5257 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:01:11 devstack sudo[100718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-6b49eddf-ecef-4369-a9a9-9545727024ec.3258c275-6b69-4317-b012-6f09371d5257 Nov 04 11:01:11 devstack sudo[100718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:01:11 devstack sudo[100718]: pam_unix(sudo:session): session closed for user root Nov 04 11:01:11 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-e78140c3-a881-44d4-857c-b4b87a48a086 tempest-CreateVolumesFromSnapshotTest-1102546986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-6b49eddf-ecef-4369-a9a9-9545727024ec.3258c275-6b69-4317-b012-6f09371d5257" returned: 0 in 0.429s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:01:11 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-e78140c3-a881-44d4-857c-b4b87a48a086 tempest-CreateVolumesFromSnapshotTest-1102546986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-6b49eddf-ecef-4369-a9a9-9545727024ec.3258c275-6b69-4317-b012-6f09371d5257 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:01:11 devstack sudo[100726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-6b49eddf-ecef-4369-a9a9-9545727024ec.3258c275-6b69-4317-b012-6f09371d5257 Nov 04 11:01:11 devstack sudo[100726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:01:11 devstack sudo[100726]: pam_unix(sudo:session): session closed for user root Nov 04 11:01:11 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-e78140c3-a881-44d4-857c-b4b87a48a086 tempest-CreateVolumesFromSnapshotTest-1102546986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-6b49eddf-ecef-4369-a9a9-9545727024ec.3258c275-6b69-4317-b012-6f09371d5257" returned: 0 in 0.272s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:01:11 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-e78140c3-a881-44d4-857c-b4b87a48a086 tempest-CreateVolumesFromSnapshotTest-1102546986 None] Lock "cinder-quobyte-3258c275-6b69-4317-b012-6f09371d5257" released by "_delete_snapshot" :: held 1.844s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 11:01:11 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-e78140c3-a881-44d4-857c-b4b87a48a086 tempest-CreateVolumesFromSnapshotTest-1102546986 None] Lock "cinder-quobyte-6b49eddf-ecef-4369-a9a9-9545727024ec" released by "delete_snapshot" :: held 1.882s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 11:01:12 devstack cinder-volume[87272]: DEBUG cinder.quota [None req-e78140c3-a881-44d4-857c-b4b87a48a086 tempest-CreateVolumesFromSnapshotTest-1102546986 None] Created reservations ['0269bb6b-30bc-48b8-832a-7e271c98157a', '562242cc-034b-408b-9fe4-988d029a009d', 'ad25e96f-5fb8-4ba5-a5a9-30bc43ba67c3', 'ec414cf2-b958-41ce-81dd-8a48caea33d0'] {{(pid=87272) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 11:01:12 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-e78140c3-a881-44d4-857c-b4b87a48a086 tempest-CreateVolumesFromSnapshotTest-1102546986 None] Delete snapshot completed successfully. Nov 04 11:01:12 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-e78140c3-a881-44d4-857c-b4b87a48a086 tempest-CreateVolumesFromSnapshotTest-1102546986 None] Lock "cinder-3258c275-6b69-4317-b012-6f09371d5257-delete_snapshot" released by "delete_snapshot" :: held 2.158s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 11:01:13 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-58df78f0-ac01-457d-b3be-ae68de4eeb30 tempest-CreateVolumesFromSnapshotTest-1102546986 None] Acquiring lock "cinder-6b49eddf-ecef-4369-a9a9-9545727024ec-delete_volume" by "delete_volume" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 11:01:13 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-58df78f0-ac01-457d-b3be-ae68de4eeb30 tempest-CreateVolumesFromSnapshotTest-1102546986 None] Lock "cinder-6b49eddf-ecef-4369-a9a9-9545727024ec-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 11:01:13 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-58df78f0-ac01-457d-b3be-ae68de4eeb30 tempest-CreateVolumesFromSnapshotTest-1102546986 None] Acquiring lock "cinder-quobyte-6b49eddf-ecef-4369-a9a9-9545727024ec" by "delete_volume" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 11:01:13 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-58df78f0-ac01-457d-b3be-ae68de4eeb30 tempest-CreateVolumesFromSnapshotTest-1102546986 None] Lock "cinder-quobyte-6b49eddf-ecef-4369-a9a9-9545727024ec" acquired by "delete_volume" :: waited 0.022s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 11:01:13 devstack cinder-volume[87272]: DEBUG oslo.privsep.daemon [-] privsep: reply[80c1c179-9f2b-421e-85f7-63795565950f]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 11:01:13 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-58df78f0-ac01-457d-b3be-ae68de4eeb30 tempest-CreateVolumesFromSnapshotTest-1102546986 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-6b49eddf-ecef-4369-a9a9-9545727024ec {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:01:13 devstack sudo[100730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-6b49eddf-ecef-4369-a9a9-9545727024ec Nov 04 11:01:13 devstack sudo[100730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:01:13 devstack sudo[100730]: pam_unix(sudo:session): session closed for user root Nov 04 11:01:13 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-58df78f0-ac01-457d-b3be-ae68de4eeb30 tempest-CreateVolumesFromSnapshotTest-1102546986 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-6b49eddf-ecef-4369-a9a9-9545727024ec" returned: 0 in 0.444s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:01:13 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-58df78f0-ac01-457d-b3be-ae68de4eeb30 tempest-CreateVolumesFromSnapshotTest-1102546986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-6b49eddf-ecef-4369-a9a9-9545727024ec {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:01:13 devstack sudo[100735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-6b49eddf-ecef-4369-a9a9-9545727024ec Nov 04 11:01:13 devstack sudo[100735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:01:14 devstack sudo[100735]: pam_unix(sudo:session): session closed for user root Nov 04 11:01:14 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-58df78f0-ac01-457d-b3be-ae68de4eeb30 tempest-CreateVolumesFromSnapshotTest-1102546986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-6b49eddf-ecef-4369-a9a9-9545727024ec" returned: 0 in 0.327s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:01:14 devstack cinder-volume[87272]: DEBUG oslo_service.periodic_task [None req-236af0be-7f9d-4c80-b3d7-d645a9cd0dd1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87272) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 04 11:01:14 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-236af0be-7f9d-4c80-b3d7-d645a9cd0dd1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 11:01:14 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-236af0be-7f9d-4c80-b3d7-d645a9cd0dd1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 11:01:14 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-236af0be-7f9d-4c80-b3d7-d645a9cd0dd1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898': None} {{(pid=87272) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 11:01:14 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-236af0be-7f9d-4c80-b3d7-d645a9cd0dd1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'] {{(pid=87272) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 11:01:14 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-236af0be-7f9d-4c80-b3d7-d645a9cd0dd1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 11:01:14 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-236af0be-7f9d-4c80-b3d7-d645a9cd0dd1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:01:14 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-58df78f0-ac01-457d-b3be-ae68de4eeb30 tempest-CreateVolumesFromSnapshotTest-1102546986 None] Lock "cinder-quobyte-6b49eddf-ecef-4369-a9a9-9545727024ec" released by "delete_volume" :: held 0.876s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 11:01:14 devstack sudo[100738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1 Nov 04 11:01:14 devstack sudo[100738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:01:14 devstack cinder-volume[87272]: DEBUG cinder.quota [None req-58df78f0-ac01-457d-b3be-ae68de4eeb30 tempest-CreateVolumesFromSnapshotTest-1102546986 None] Created reservations ['19d25225-7c9c-42fc-9332-d66615a5246f', '19b665a0-b4f3-4732-b871-1c3b8237d53a', '570abeda-6694-4531-bab2-c96631c11549', '87fa177a-dc41-477c-a629-3d726ba49abc'] {{(pid=87272) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 11:01:14 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-58df78f0-ac01-457d-b3be-ae68de4eeb30 tempest-CreateVolumesFromSnapshotTest-1102546986 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 11:01:14 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-58df78f0-ac01-457d-b3be-ae68de4eeb30 tempest-CreateVolumesFromSnapshotTest-1102546986 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 11:01:14 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-58df78f0-ac01-457d-b3be-ae68de4eeb30 tempest-CreateVolumesFromSnapshotTest-1102546986 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898': None} {{(pid=87272) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 11:01:14 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-58df78f0-ac01-457d-b3be-ae68de4eeb30 tempest-CreateVolumesFromSnapshotTest-1102546986 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'] {{(pid=87272) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 11:01:14 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-58df78f0-ac01-457d-b3be-ae68de4eeb30 tempest-CreateVolumesFromSnapshotTest-1102546986 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 11:01:14 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-58df78f0-ac01-457d-b3be-ae68de4eeb30 tempest-CreateVolumesFromSnapshotTest-1102546986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:01:14 devstack sudo[100740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1 Nov 04 11:01:14 devstack sudo[100740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:01:14 devstack sudo[100738]: pam_unix(sudo:session): session closed for user root Nov 04 11:01:14 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-236af0be-7f9d-4c80-b3d7-d645a9cd0dd1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1" returned: 0 in 0.359s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:01:14 devstack cinder-volume[87272]: DEBUG cinder.manager [None req-236af0be-7f9d-4c80-b3d7-d645a9cd0dd1 None None] Notifying Schedulers of capabilities ... {{(pid=87272) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 11:01:14 devstack cinder-volume[87272]: DEBUG oslo_service.periodic_task [None req-236af0be-7f9d-4c80-b3d7-d645a9cd0dd1 None None] Running periodic task VolumeManager._thread_info {{(pid=87272) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 04 11:01:14 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-236af0be-7f9d-4c80-b3d7-d645a9cd0dd1 None None] thread count: 28 {{(pid=87272) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 04 11:01:14 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-236af0be-7f9d-4c80-b3d7-d645a9cd0dd1 None None] thread info: [<_MainThread(MainThread, started 127085713244288)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87272) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 04 11:01:14 devstack sudo[100740]: pam_unix(sudo:session): session closed for user root Nov 04 11:01:14 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-58df78f0-ac01-457d-b3be-ae68de4eeb30 tempest-CreateVolumesFromSnapshotTest-1102546986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1" returned: 0 in 0.263s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:01:14 devstack cinder-volume[87272]: DEBUG cinder.manager [None req-58df78f0-ac01-457d-b3be-ae68de4eeb30 tempest-CreateVolumesFromSnapshotTest-1102546986 None] Notifying Schedulers of capabilities ... {{(pid=87272) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 11:01:14 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-58df78f0-ac01-457d-b3be-ae68de4eeb30 tempest-CreateVolumesFromSnapshotTest-1102546986 None] Deleted volume successfully. Nov 04 11:01:14 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-58df78f0-ac01-457d-b3be-ae68de4eeb30 tempest-CreateVolumesFromSnapshotTest-1102546986 None] Lock "cinder-6b49eddf-ecef-4369-a9a9-9545727024ec-delete_volume" released by "delete_volume" :: held 1.429s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 11:01:18 devstack cinder-volume[87272]: DEBUG cinder.volume.flows.manager.create_volume [None req-da004cc2-b79e-4931-8c89-bc0c9f969fa2 tempest-VolumeTypesAccessTest-1678847228 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87272) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 11:01:18 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-da004cc2-b79e-4931-8c89-bc0c9f969fa2 tempest-VolumeTypesAccessTest-1678847228 None] Flow 'volume_create_manager' (583eeb3c-c075-4f79-9c33-035f2ab7f4bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 11:01:18 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-da004cc2-b79e-4931-8c89-bc0c9f969fa2 tempest-VolumeTypesAccessTest-1678847228 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c247f77-48c1-41e0-8097-c8ea79217dba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:01:18 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-da004cc2-b79e-4931-8c89-bc0c9f969fa2 tempest-VolumeTypesAccessTest-1678847228 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c247f77-48c1-41e0-8097-c8ea79217dba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T10:01:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-768588461',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7add802e-9866-419f-9f07-bfaac6bdce0e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='00cffbc7cb294ccbb10f76aabce4d878',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T10:01:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T10:01:18Z,use_quota=True,user_id='66053024d20b4818a46faeb0e6a77aeb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c00a6ef5-a9ad-4057-8bc1-cd53cd1c10e1),volume_type_id=c00a6ef5-a9ad-4057-8bc1-cd53cd1c10e1)' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:01:18 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-da004cc2-b79e-4931-8c89-bc0c9f969fa2 tempest-VolumeTypesAccessTest-1678847228 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8fbbbe1-79a1-448c-9505-676b25a719fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:01:18 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-da004cc2-b79e-4931-8c89-bc0c9f969fa2 tempest-VolumeTypesAccessTest-1678847228 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8fbbbe1-79a1-448c-9505-676b25a719fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:01:18 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-da004cc2-b79e-4931-8c89-bc0c9f969fa2 tempest-VolumeTypesAccessTest-1678847228 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (876154c4-a5fe-481c-ad89-8146b6f898b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:01:18 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-da004cc2-b79e-4931-8c89-bc0c9f969fa2 tempest-VolumeTypesAccessTest-1678847228 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (876154c4-a5fe-481c-ad89-8146b6f898b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7add802e-9866-419f-9f07-bfaac6bdce0e', 'volume_name': 'volume-7add802e-9866-419f-9f07-bfaac6bdce0e', 'volume_size': 1}' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:01:18 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-da004cc2-b79e-4931-8c89-bc0c9f969fa2 tempest-VolumeTypesAccessTest-1678847228 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0911ff4-fca2-4670-a43b-69015194b90d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:01:18 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-da004cc2-b79e-4931-8c89-bc0c9f969fa2 tempest-VolumeTypesAccessTest-1678847228 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0911ff4-fca2-4670-a43b-69015194b90d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:01:18 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-da004cc2-b79e-4931-8c89-bc0c9f969fa2 tempest-VolumeTypesAccessTest-1678847228 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5726f2aa-8781-416a-a34d-3580f3b9578e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:01:18 devstack cinder-volume[87272]: INFO cinder.volume.flows.manager.create_volume [None req-da004cc2-b79e-4931-8c89-bc0c9f969fa2 tempest-VolumeTypesAccessTest-1678847228 None] Volume 7add802e-9866-419f-9f07-bfaac6bdce0e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7add802e-9866-419f-9f07-bfaac6bdce0e', 'volume_size': 1} Nov 04 11:01:18 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-da004cc2-b79e-4931-8c89-bc0c9f969fa2 tempest-VolumeTypesAccessTest-1678847228 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 11:01:18 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-da004cc2-b79e-4931-8c89-bc0c9f969fa2 tempest-VolumeTypesAccessTest-1678847228 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 11:01:18 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-da004cc2-b79e-4931-8c89-bc0c9f969fa2 tempest-VolumeTypesAccessTest-1678847228 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T10:01:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-768588461',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7add802e-9866-419f-9f07-bfaac6bdce0e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='00cffbc7cb294ccbb10f76aabce4d878',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T10:01:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T10:01:18Z,use_quota=True,user_id='66053024d20b4818a46faeb0e6a77aeb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c00a6ef5-a9ad-4057-8bc1-cd53cd1c10e1),volume_type_id=c00a6ef5-a9ad-4057-8bc1-cd53cd1c10e1)}" {{(pid=87272) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 04 11:01:18 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.remotefs [None req-da004cc2-b79e-4931-8c89-bc0c9f969fa2 tempest-VolumeTypesAccessTest-1678847228 None] Creating volume 7add802e-9866-419f-9f07-bfaac6bdce0e {{(pid=87272) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 11:01:18 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-da004cc2-b79e-4931-8c89-bc0c9f969fa2 tempest-VolumeTypesAccessTest-1678847228 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 11:01:18 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-da004cc2-b79e-4931-8c89-bc0c9f969fa2 tempest-VolumeTypesAccessTest-1678847228 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 11:01:18 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-da004cc2-b79e-4931-8c89-bc0c9f969fa2 tempest-VolumeTypesAccessTest-1678847228 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898': None} {{(pid=87272) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 11:01:18 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-da004cc2-b79e-4931-8c89-bc0c9f969fa2 tempest-VolumeTypesAccessTest-1678847228 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'] {{(pid=87272) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 11:01:18 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-da004cc2-b79e-4931-8c89-bc0c9f969fa2 tempest-VolumeTypesAccessTest-1678847228 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 11:01:18 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-da004cc2-b79e-4931-8c89-bc0c9f969fa2 tempest-VolumeTypesAccessTest-1678847228 None] Selected osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898 as target Quobyte volume. {{(pid=87272) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 11:01:18 devstack cinder-volume[87272]: INFO cinder.volume.drivers.remotefs [None req-da004cc2-b79e-4931-8c89-bc0c9f969fa2 tempest-VolumeTypesAccessTest-1678847228 None] casted to osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898 Nov 04 11:01:18 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-da004cc2-b79e-4931-8c89-bc0c9f969fa2 tempest-VolumeTypesAccessTest-1678847228 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-7add802e-9866-419f-9f07-bfaac6bdce0e 1073741824 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:01:18 devstack sudo[100745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-7add802e-9866-419f-9f07-bfaac6bdce0e 1073741824 Nov 04 11:01:18 devstack sudo[100745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:01:19 devstack sudo[100745]: pam_unix(sudo:session): session closed for user root Nov 04 11:01:19 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-da004cc2-b79e-4931-8c89-bc0c9f969fa2 tempest-VolumeTypesAccessTest-1678847228 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-7add802e-9866-419f-9f07-bfaac6bdce0e 1073741824" returned: 0 in 0.640s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:01:19 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-da004cc2-b79e-4931-8c89-bc0c9f969fa2 tempest-VolumeTypesAccessTest-1678847228 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-7add802e-9866-419f-9f07-bfaac6bdce0e {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:01:19 devstack sudo[100750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-7add802e-9866-419f-9f07-bfaac6bdce0e Nov 04 11:01:19 devstack sudo[100750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:01:19 devstack sudo[100750]: pam_unix(sudo:session): session closed for user root Nov 04 11:01:19 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-da004cc2-b79e-4931-8c89-bc0c9f969fa2 tempest-VolumeTypesAccessTest-1678847228 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-7add802e-9866-419f-9f07-bfaac6bdce0e" returned: 0 in 0.302s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:01:19 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-da004cc2-b79e-4931-8c89-bc0c9f969fa2 tempest-VolumeTypesAccessTest-1678847228 None] <== create_volume: return (992ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'} {{(pid=87272) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 04 11:01:19 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-da004cc2-b79e-4931-8c89-bc0c9f969fa2 tempest-VolumeTypesAccessTest-1678847228 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.995s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 11:01:19 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-da004cc2-b79e-4931-8c89-bc0c9f969fa2 tempest-VolumeTypesAccessTest-1678847228 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5726f2aa-8781-416a-a34d-3580f3b9578e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7add802e-9866-419f-9f07-bfaac6bdce0e', 'volume_size': 1}' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:01:19 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-da004cc2-b79e-4931-8c89-bc0c9f969fa2 tempest-VolumeTypesAccessTest-1678847228 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4f1f5606-3408-495a-8627-3ebf96fd3274) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:01:19 devstack cinder-volume[87272]: INFO cinder.volume.flows.manager.create_volume [None req-da004cc2-b79e-4931-8c89-bc0c9f969fa2 tempest-VolumeTypesAccessTest-1678847228 None] Volume volume-7add802e-9866-419f-9f07-bfaac6bdce0e (7add802e-9866-419f-9f07-bfaac6bdce0e): created successfully Nov 04 11:01:19 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-da004cc2-b79e-4931-8c89-bc0c9f969fa2 tempest-VolumeTypesAccessTest-1678847228 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4f1f5606-3408-495a-8627-3ebf96fd3274) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:01:19 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-da004cc2-b79e-4931-8c89-bc0c9f969fa2 tempest-VolumeTypesAccessTest-1678847228 None] Flow 'volume_create_manager' (583eeb3c-c075-4f79-9c33-035f2ab7f4bb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87272) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 11:01:19 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-da004cc2-b79e-4931-8c89-bc0c9f969fa2 tempest-VolumeTypesAccessTest-1678847228 None] Created volume successfully. Nov 04 11:01:20 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-bd7ca273-d9ad-493a-abef-c83b90ee4040 tempest-VolumeTypesAccessTest-1678847228 None] Acquiring lock "cinder-7add802e-9866-419f-9f07-bfaac6bdce0e-delete_volume" by "delete_volume" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 11:01:20 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-bd7ca273-d9ad-493a-abef-c83b90ee4040 tempest-VolumeTypesAccessTest-1678847228 None] Lock "cinder-7add802e-9866-419f-9f07-bfaac6bdce0e-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 11:01:20 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-bd7ca273-d9ad-493a-abef-c83b90ee4040 tempest-VolumeTypesAccessTest-1678847228 None] Acquiring lock "cinder-quobyte-7add802e-9866-419f-9f07-bfaac6bdce0e" by "delete_volume" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 11:01:20 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-bd7ca273-d9ad-493a-abef-c83b90ee4040 tempest-VolumeTypesAccessTest-1678847228 None] Lock "cinder-quobyte-7add802e-9866-419f-9f07-bfaac6bdce0e" acquired by "delete_volume" :: waited 0.022s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 11:01:20 devstack cinder-volume[87272]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ee28dc6-a47c-4524-b357-35a1ad85fb25]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 11:01:20 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-bd7ca273-d9ad-493a-abef-c83b90ee4040 tempest-VolumeTypesAccessTest-1678847228 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-7add802e-9866-419f-9f07-bfaac6bdce0e {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:01:21 devstack sudo[100753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-7add802e-9866-419f-9f07-bfaac6bdce0e Nov 04 11:01:21 devstack sudo[100753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:01:21 devstack sudo[100753]: pam_unix(sudo:session): session closed for user root Nov 04 11:01:21 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-bd7ca273-d9ad-493a-abef-c83b90ee4040 tempest-VolumeTypesAccessTest-1678847228 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-7add802e-9866-419f-9f07-bfaac6bdce0e" returned: 0 in 0.530s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:01:21 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-bd7ca273-d9ad-493a-abef-c83b90ee4040 tempest-VolumeTypesAccessTest-1678847228 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-7add802e-9866-419f-9f07-bfaac6bdce0e {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:01:21 devstack sudo[100764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-7add802e-9866-419f-9f07-bfaac6bdce0e Nov 04 11:01:21 devstack sudo[100764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:01:21 devstack sudo[100764]: pam_unix(sudo:session): session closed for user root Nov 04 11:01:21 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-bd7ca273-d9ad-493a-abef-c83b90ee4040 tempest-VolumeTypesAccessTest-1678847228 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-7add802e-9866-419f-9f07-bfaac6bdce0e" returned: 0 in 0.342s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:01:21 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-bd7ca273-d9ad-493a-abef-c83b90ee4040 tempest-VolumeTypesAccessTest-1678847228 None] Lock "cinder-quobyte-7add802e-9866-419f-9f07-bfaac6bdce0e" released by "delete_volume" :: held 0.939s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 11:01:21 devstack cinder-volume[87272]: WARNING cinder.quota [None req-bd7ca273-d9ad-493a-abef-c83b90ee4040 tempest-VolumeTypesAccessTest-1678847228 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-623013700 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-623013700, it is now deprecated. Please use the default quota class for default quota. Nov 04 11:01:21 devstack cinder-volume[87272]: WARNING cinder.quota [None req-bd7ca273-d9ad-493a-abef-c83b90ee4040 tempest-VolumeTypesAccessTest-1678847228 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-623013700 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-623013700, it is now deprecated. Please use the default quota class for default quota. Nov 04 11:01:21 devstack cinder-volume[87272]: DEBUG cinder.quota [None req-bd7ca273-d9ad-493a-abef-c83b90ee4040 tempest-VolumeTypesAccessTest-1678847228 None] Created reservations ['086882e1-0c82-4801-9c5e-ebed8b4b3531', 'ca274fc0-05ab-4d30-8fa5-80c560161edf', '5b6e630c-e6bc-44bb-8721-45c2da034905', '834964ea-716f-4b3a-8933-c75ca62d04f8'] {{(pid=87272) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 11:01:21 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-bd7ca273-d9ad-493a-abef-c83b90ee4040 tempest-VolumeTypesAccessTest-1678847228 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 11:01:21 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-bd7ca273-d9ad-493a-abef-c83b90ee4040 tempest-VolumeTypesAccessTest-1678847228 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 11:01:21 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-bd7ca273-d9ad-493a-abef-c83b90ee4040 tempest-VolumeTypesAccessTest-1678847228 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898': None} {{(pid=87272) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 11:01:21 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-bd7ca273-d9ad-493a-abef-c83b90ee4040 tempest-VolumeTypesAccessTest-1678847228 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'] {{(pid=87272) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 11:01:21 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-bd7ca273-d9ad-493a-abef-c83b90ee4040 tempest-VolumeTypesAccessTest-1678847228 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 11:01:21 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-bd7ca273-d9ad-493a-abef-c83b90ee4040 tempest-VolumeTypesAccessTest-1678847228 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:01:21 devstack sudo[100767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1 Nov 04 11:01:21 devstack sudo[100767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:01:22 devstack sudo[100767]: pam_unix(sudo:session): session closed for user root Nov 04 11:01:22 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-bd7ca273-d9ad-493a-abef-c83b90ee4040 tempest-VolumeTypesAccessTest-1678847228 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1" returned: 0 in 0.339s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:01:22 devstack cinder-volume[87272]: DEBUG cinder.manager [None req-bd7ca273-d9ad-493a-abef-c83b90ee4040 tempest-VolumeTypesAccessTest-1678847228 None] Notifying Schedulers of capabilities ... {{(pid=87272) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 11:01:22 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-bd7ca273-d9ad-493a-abef-c83b90ee4040 tempest-VolumeTypesAccessTest-1678847228 None] Deleted volume successfully. Nov 04 11:01:22 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-bd7ca273-d9ad-493a-abef-c83b90ee4040 tempest-VolumeTypesAccessTest-1678847228 None] Lock "cinder-7add802e-9866-419f-9f07-bfaac6bdce0e-delete_volume" released by "delete_volume" :: held 1.589s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 11:01:28 devstack cinder-volume[87272]: DEBUG cinder.volume.flows.manager.create_volume [None req-50d02de4-7357-453d-9c18-f8558bf19341 tempest-SnapshotMetadataTestJSON-793520384 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87272) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 11:01:28 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-50d02de4-7357-453d-9c18-f8558bf19341 tempest-SnapshotMetadataTestJSON-793520384 None] Flow 'volume_create_manager' (17ed0c23-c9ad-4836-9a15-c8f8f914d3c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 11:01:28 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-50d02de4-7357-453d-9c18-f8558bf19341 tempest-SnapshotMetadataTestJSON-793520384 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f43c925-49b8-4167-9ab2-337ff26a1c68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:01:28 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-50d02de4-7357-453d-9c18-f8558bf19341 tempest-SnapshotMetadataTestJSON-793520384 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f43c925-49b8-4167-9ab2-337ff26a1c68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T10:01:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1960042901',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=12e1fd57-1605-4251-82e0-9579f5479f5c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e5d561ad37554a84aba99ab230c2d1fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T10:01:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T10:01:29Z,use_quota=True,user_id='b755d1310e05460f9132cf42a40fdbca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8989e4f-21e3-4f0a-9584-0d818784e883),volume_type_id=f8989e4f-21e3-4f0a-9584-0d818784e883)' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:01:28 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-50d02de4-7357-453d-9c18-f8558bf19341 tempest-SnapshotMetadataTestJSON-793520384 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1613a128-229d-4ae9-8751-c59514f18084) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:01:28 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-50d02de4-7357-453d-9c18-f8558bf19341 tempest-SnapshotMetadataTestJSON-793520384 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1613a128-229d-4ae9-8751-c59514f18084) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:01:28 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-50d02de4-7357-453d-9c18-f8558bf19341 tempest-SnapshotMetadataTestJSON-793520384 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a94f739b-084f-4011-83d1-95c20870ad88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:01:28 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-50d02de4-7357-453d-9c18-f8558bf19341 tempest-SnapshotMetadataTestJSON-793520384 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a94f739b-084f-4011-83d1-95c20870ad88) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '12e1fd57-1605-4251-82e0-9579f5479f5c', 'volume_name': 'volume-12e1fd57-1605-4251-82e0-9579f5479f5c', 'volume_size': 1}' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:01:28 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-50d02de4-7357-453d-9c18-f8558bf19341 tempest-SnapshotMetadataTestJSON-793520384 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9520ec11-df15-4af0-8908-9e05b486a4e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:01:28 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-50d02de4-7357-453d-9c18-f8558bf19341 tempest-SnapshotMetadataTestJSON-793520384 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9520ec11-df15-4af0-8908-9e05b486a4e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:01:28 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-50d02de4-7357-453d-9c18-f8558bf19341 tempest-SnapshotMetadataTestJSON-793520384 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (42023102-71d8-42bf-9c98-e0e61de6452b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:01:28 devstack cinder-volume[87272]: INFO cinder.volume.flows.manager.create_volume [None req-50d02de4-7357-453d-9c18-f8558bf19341 tempest-SnapshotMetadataTestJSON-793520384 None] Volume 12e1fd57-1605-4251-82e0-9579f5479f5c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-12e1fd57-1605-4251-82e0-9579f5479f5c', 'volume_size': 1} Nov 04 11:01:28 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-50d02de4-7357-453d-9c18-f8558bf19341 tempest-SnapshotMetadataTestJSON-793520384 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 11:01:28 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-50d02de4-7357-453d-9c18-f8558bf19341 tempest-SnapshotMetadataTestJSON-793520384 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 11:01:28 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-50d02de4-7357-453d-9c18-f8558bf19341 tempest-SnapshotMetadataTestJSON-793520384 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T10:01:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1960042901',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=12e1fd57-1605-4251-82e0-9579f5479f5c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e5d561ad37554a84aba99ab230c2d1fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T10:01:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T10:01:29Z,use_quota=True,user_id='b755d1310e05460f9132cf42a40fdbca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8989e4f-21e3-4f0a-9584-0d818784e883),volume_type_id=f8989e4f-21e3-4f0a-9584-0d818784e883)}" {{(pid=87272) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 04 11:01:28 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.remotefs [None req-50d02de4-7357-453d-9c18-f8558bf19341 tempest-SnapshotMetadataTestJSON-793520384 None] Creating volume 12e1fd57-1605-4251-82e0-9579f5479f5c {{(pid=87272) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 11:01:28 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-50d02de4-7357-453d-9c18-f8558bf19341 tempest-SnapshotMetadataTestJSON-793520384 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 11:01:28 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-50d02de4-7357-453d-9c18-f8558bf19341 tempest-SnapshotMetadataTestJSON-793520384 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 11:01:28 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-50d02de4-7357-453d-9c18-f8558bf19341 tempest-SnapshotMetadataTestJSON-793520384 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898': None} {{(pid=87272) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 11:01:28 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-50d02de4-7357-453d-9c18-f8558bf19341 tempest-SnapshotMetadataTestJSON-793520384 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'] {{(pid=87272) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 11:01:28 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-50d02de4-7357-453d-9c18-f8558bf19341 tempest-SnapshotMetadataTestJSON-793520384 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 11:01:28 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-50d02de4-7357-453d-9c18-f8558bf19341 tempest-SnapshotMetadataTestJSON-793520384 None] Selected osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898 as target Quobyte volume. {{(pid=87272) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 11:01:28 devstack cinder-volume[87272]: INFO cinder.volume.drivers.remotefs [None req-50d02de4-7357-453d-9c18-f8558bf19341 tempest-SnapshotMetadataTestJSON-793520384 None] casted to osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898 Nov 04 11:01:28 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-50d02de4-7357-453d-9c18-f8558bf19341 tempest-SnapshotMetadataTestJSON-793520384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-12e1fd57-1605-4251-82e0-9579f5479f5c 1073741824 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:01:28 devstack sudo[100811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-12e1fd57-1605-4251-82e0-9579f5479f5c 1073741824 Nov 04 11:01:28 devstack sudo[100811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:01:29 devstack sudo[100811]: pam_unix(sudo:session): session closed for user root Nov 04 11:01:29 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-50d02de4-7357-453d-9c18-f8558bf19341 tempest-SnapshotMetadataTestJSON-793520384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-12e1fd57-1605-4251-82e0-9579f5479f5c 1073741824" returned: 0 in 0.590s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:01:29 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-50d02de4-7357-453d-9c18-f8558bf19341 tempest-SnapshotMetadataTestJSON-793520384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-12e1fd57-1605-4251-82e0-9579f5479f5c {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:01:29 devstack sudo[100818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-12e1fd57-1605-4251-82e0-9579f5479f5c Nov 04 11:01:29 devstack sudo[100818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:01:29 devstack sudo[100818]: pam_unix(sudo:session): session closed for user root Nov 04 11:01:29 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-50d02de4-7357-453d-9c18-f8558bf19341 tempest-SnapshotMetadataTestJSON-793520384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-12e1fd57-1605-4251-82e0-9579f5479f5c" returned: 0 in 0.306s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:01:29 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-50d02de4-7357-453d-9c18-f8558bf19341 tempest-SnapshotMetadataTestJSON-793520384 None] <== create_volume: return (959ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'} {{(pid=87272) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 04 11:01:29 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-50d02de4-7357-453d-9c18-f8558bf19341 tempest-SnapshotMetadataTestJSON-793520384 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.963s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 11:01:29 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-50d02de4-7357-453d-9c18-f8558bf19341 tempest-SnapshotMetadataTestJSON-793520384 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (42023102-71d8-42bf-9c98-e0e61de6452b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-12e1fd57-1605-4251-82e0-9579f5479f5c', 'volume_size': 1}' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:01:29 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-50d02de4-7357-453d-9c18-f8558bf19341 tempest-SnapshotMetadataTestJSON-793520384 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ba2575d-db62-42ee-b838-a16565500568) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:01:29 devstack cinder-volume[87272]: INFO cinder.volume.flows.manager.create_volume [None req-50d02de4-7357-453d-9c18-f8558bf19341 tempest-SnapshotMetadataTestJSON-793520384 None] Volume volume-12e1fd57-1605-4251-82e0-9579f5479f5c (12e1fd57-1605-4251-82e0-9579f5479f5c): created successfully Nov 04 11:01:29 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-50d02de4-7357-453d-9c18-f8558bf19341 tempest-SnapshotMetadataTestJSON-793520384 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ba2575d-db62-42ee-b838-a16565500568) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:01:29 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-50d02de4-7357-453d-9c18-f8558bf19341 tempest-SnapshotMetadataTestJSON-793520384 None] Flow 'volume_create_manager' (17ed0c23-c9ad-4836-9a15-c8f8f914d3c7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87272) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 11:01:29 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-50d02de4-7357-453d-9c18-f8558bf19341 tempest-SnapshotMetadataTestJSON-793520384 None] Created volume successfully. Nov 04 11:01:31 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-47650cda-6f21-4432-9a98-d084345e3702 tempest-SnapshotMetadataTestJSON-793520384 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 11:01:31 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-47650cda-6f21-4432-9a98-d084345e3702 tempest-SnapshotMetadataTestJSON-793520384 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 11:01:31 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.remotefs [None req-47650cda-6f21-4432-9a98-d084345e3702 tempest-SnapshotMetadataTestJSON-793520384 None] Creating offline snapshot 9630e865-5811-4b44-82fb-8f41fdb17ef5 of volume 12e1fd57-1605-4251-82e0-9579f5479f5c {{(pid=87272) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 04 11:01:31 devstack cinder-volume[87272]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1e33946-e166-462f-b779-a20aac6d4d20]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 11:01:31 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-47650cda-6f21-4432-9a98-d084345e3702 tempest-SnapshotMetadataTestJSON-793520384 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-12e1fd57-1605-4251-82e0-9579f5479f5c {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:01:31 devstack sudo[100821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-12e1fd57-1605-4251-82e0-9579f5479f5c Nov 04 11:01:31 devstack sudo[100821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:01:31 devstack sudo[100821]: pam_unix(sudo:session): session closed for user root Nov 04 11:01:31 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-47650cda-6f21-4432-9a98-d084345e3702 tempest-SnapshotMetadataTestJSON-793520384 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-12e1fd57-1605-4251-82e0-9579f5479f5c" returned: 0 in 0.398s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:01:31 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-47650cda-6f21-4432-9a98-d084345e3702 tempest-SnapshotMetadataTestJSON-793520384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-12e1fd57-1605-4251-82e0-9579f5479f5c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-12e1fd57-1605-4251-82e0-9579f5479f5c.9630e865-5811-4b44-82fb-8f41fdb17ef5 1G {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:01:31 devstack sudo[100827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-12e1fd57-1605-4251-82e0-9579f5479f5c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-12e1fd57-1605-4251-82e0-9579f5479f5c.9630e865-5811-4b44-82fb-8f41fdb17ef5 1G Nov 04 11:01:31 devstack sudo[100827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:01:32 devstack sudo[100827]: pam_unix(sudo:session): session closed for user root Nov 04 11:01:32 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-47650cda-6f21-4432-9a98-d084345e3702 tempest-SnapshotMetadataTestJSON-793520384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-12e1fd57-1605-4251-82e0-9579f5479f5c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-12e1fd57-1605-4251-82e0-9579f5479f5c.9630e865-5811-4b44-82fb-8f41fdb17ef5 1G" returned: 0 in 0.471s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:01:32 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-47650cda-6f21-4432-9a98-d084345e3702 tempest-SnapshotMetadataTestJSON-793520384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-12e1fd57-1605-4251-82e0-9579f5479f5c -F qcow2 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-12e1fd57-1605-4251-82e0-9579f5479f5c.9630e865-5811-4b44-82fb-8f41fdb17ef5 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:01:32 devstack sudo[100833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-12e1fd57-1605-4251-82e0-9579f5479f5c -F qcow2 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-12e1fd57-1605-4251-82e0-9579f5479f5c.9630e865-5811-4b44-82fb-8f41fdb17ef5 Nov 04 11:01:32 devstack sudo[100833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:01:32 devstack sudo[100833]: pam_unix(sudo:session): session closed for user root Nov 04 11:01:32 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-47650cda-6f21-4432-9a98-d084345e3702 tempest-SnapshotMetadataTestJSON-793520384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-12e1fd57-1605-4251-82e0-9579f5479f5c -F qcow2 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-12e1fd57-1605-4251-82e0-9579f5479f5c.9630e865-5811-4b44-82fb-8f41fdb17ef5" returned: 0 in 0.407s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:01:32 devstack cinder-volume[87272]: WARNING cinder.volume.drivers.remotefs [None req-47650cda-6f21-4432-9a98-d084345e3702 tempest-SnapshotMetadataTestJSON-793520384 None] /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-12e1fd57-1605-4251-82e0-9579f5479f5c.9630e865-5811-4b44-82fb-8f41fdb17ef5 is being set with open permissions: ugo+rw Nov 04 11:01:32 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-47650cda-6f21-4432-9a98-d084345e3702 tempest-SnapshotMetadataTestJSON-793520384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-12e1fd57-1605-4251-82e0-9579f5479f5c.9630e865-5811-4b44-82fb-8f41fdb17ef5 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:01:32 devstack sudo[100838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-12e1fd57-1605-4251-82e0-9579f5479f5c.9630e865-5811-4b44-82fb-8f41fdb17ef5 Nov 04 11:01:32 devstack sudo[100838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:01:32 devstack sudo[100838]: pam_unix(sudo:session): session closed for user root Nov 04 11:01:32 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-47650cda-6f21-4432-9a98-d084345e3702 tempest-SnapshotMetadataTestJSON-793520384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-12e1fd57-1605-4251-82e0-9579f5479f5c.9630e865-5811-4b44-82fb-8f41fdb17ef5" returned: 0 in 0.276s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:01:32 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-47650cda-6f21-4432-9a98-d084345e3702 tempest-SnapshotMetadataTestJSON-793520384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-12e1fd57-1605-4251-82e0-9579f5479f5c.info {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:01:32 devstack sudo[100841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-12e1fd57-1605-4251-82e0-9579f5479f5c.info Nov 04 11:01:32 devstack sudo[100841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:01:33 devstack sudo[100841]: pam_unix(sudo:session): session closed for user root Nov 04 11:01:33 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-47650cda-6f21-4432-9a98-d084345e3702 tempest-SnapshotMetadataTestJSON-793520384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-12e1fd57-1605-4251-82e0-9579f5479f5c.info" returned: 0 in 0.282s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:01:33 devstack cinder-volume[87272]: WARNING cinder.volume.drivers.remotefs [None req-47650cda-6f21-4432-9a98-d084345e3702 tempest-SnapshotMetadataTestJSON-793520384 None] /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-12e1fd57-1605-4251-82e0-9579f5479f5c.info is being set with open permissions: ugo+rw Nov 04 11:01:33 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-47650cda-6f21-4432-9a98-d084345e3702 tempest-SnapshotMetadataTestJSON-793520384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-12e1fd57-1605-4251-82e0-9579f5479f5c.info {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:01:33 devstack sudo[100844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-12e1fd57-1605-4251-82e0-9579f5479f5c.info Nov 04 11:01:33 devstack sudo[100844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:01:33 devstack sudo[100844]: pam_unix(sudo:session): session closed for user root Nov 04 11:01:33 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-47650cda-6f21-4432-9a98-d084345e3702 tempest-SnapshotMetadataTestJSON-793520384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-12e1fd57-1605-4251-82e0-9579f5479f5c.info" returned: 0 in 0.278s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:01:33 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-47650cda-6f21-4432-9a98-d084345e3702 tempest-SnapshotMetadataTestJSON-793520384 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.224s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 11:01:33 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-47650cda-6f21-4432-9a98-d084345e3702 tempest-SnapshotMetadataTestJSON-793520384 None] Create snapshot completed successfully Nov 04 11:01:35 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-b40782ff-78e0-47fa-8f30-144f97ad3e1c tempest-SnapshotMetadataTestJSON-793520384 None] Acquiring lock "cinder-9630e865-5811-4b44-82fb-8f41fdb17ef5-delete_snapshot" by "delete_snapshot" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 11:01:35 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-b40782ff-78e0-47fa-8f30-144f97ad3e1c tempest-SnapshotMetadataTestJSON-793520384 None] Lock "cinder-9630e865-5811-4b44-82fb-8f41fdb17ef5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 11:01:35 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-b40782ff-78e0-47fa-8f30-144f97ad3e1c tempest-SnapshotMetadataTestJSON-793520384 None] Acquiring lock "cinder-quobyte-12e1fd57-1605-4251-82e0-9579f5479f5c" by "delete_snapshot" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 11:01:35 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-b40782ff-78e0-47fa-8f30-144f97ad3e1c tempest-SnapshotMetadataTestJSON-793520384 None] Lock "cinder-quobyte-12e1fd57-1605-4251-82e0-9579f5479f5c" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 11:01:35 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-b40782ff-78e0-47fa-8f30-144f97ad3e1c tempest-SnapshotMetadataTestJSON-793520384 None] Acquiring lock "cinder-quobyte-9630e865-5811-4b44-82fb-8f41fdb17ef5" by "_delete_snapshot" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 11:01:35 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-b40782ff-78e0-47fa-8f30-144f97ad3e1c tempest-SnapshotMetadataTestJSON-793520384 None] Lock "cinder-quobyte-9630e865-5811-4b44-82fb-8f41fdb17ef5" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 11:01:35 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.remotefs [None req-b40782ff-78e0-47fa-8f30-144f97ad3e1c tempest-SnapshotMetadataTestJSON-793520384 None] Deleting offline snapshot 9630e865-5811-4b44-82fb-8f41fdb17ef5 of volume 12e1fd57-1605-4251-82e0-9579f5479f5c {{(pid=87272) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 04 11:01:35 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.remotefs [None req-b40782ff-78e0-47fa-8f30-144f97ad3e1c tempest-SnapshotMetadataTestJSON-793520384 None] snapshot_file for this snap is: volume-12e1fd57-1605-4251-82e0-9579f5479f5c.9630e865-5811-4b44-82fb-8f41fdb17ef5 {{(pid=87272) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 04 11:01:35 devstack cinder-volume[87272]: DEBUG oslo.privsep.daemon [-] privsep: reply[9da57e2b-d7c3-4aec-a842-808ef490fe8c]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 11:01:35 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-b40782ff-78e0-47fa-8f30-144f97ad3e1c tempest-SnapshotMetadataTestJSON-793520384 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-12e1fd57-1605-4251-82e0-9579f5479f5c.9630e865-5811-4b44-82fb-8f41fdb17ef5 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:01:35 devstack sudo[100848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-12e1fd57-1605-4251-82e0-9579f5479f5c.9630e865-5811-4b44-82fb-8f41fdb17ef5 Nov 04 11:01:35 devstack sudo[100848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:01:35 devstack sudo[100848]: pam_unix(sudo:session): session closed for user root Nov 04 11:01:35 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-b40782ff-78e0-47fa-8f30-144f97ad3e1c tempest-SnapshotMetadataTestJSON-793520384 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-12e1fd57-1605-4251-82e0-9579f5479f5c.9630e865-5811-4b44-82fb-8f41fdb17ef5" returned: 0 in 0.422s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:01:35 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.remotefs [None req-b40782ff-78e0-47fa-8f30-144f97ad3e1c tempest-SnapshotMetadataTestJSON-793520384 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-12e1fd57-1605-4251-82e0-9579f5479f5c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87272) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 11:01:35 devstack cinder-volume[87272]: DEBUG oslo.privsep.daemon [-] privsep: reply[353d1251-ec0d-4e9d-b5d3-e34147fb6069]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 11:01:35 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-b40782ff-78e0-47fa-8f30-144f97ad3e1c tempest-SnapshotMetadataTestJSON-793520384 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-12e1fd57-1605-4251-82e0-9579f5479f5c {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:01:36 devstack sudo[100853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-12e1fd57-1605-4251-82e0-9579f5479f5c Nov 04 11:01:36 devstack sudo[100853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:01:36 devstack sudo[100853]: pam_unix(sudo:session): session closed for user root Nov 04 11:01:36 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-b40782ff-78e0-47fa-8f30-144f97ad3e1c tempest-SnapshotMetadataTestJSON-793520384 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-12e1fd57-1605-4251-82e0-9579f5479f5c" returned: 0 in 0.438s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:01:36 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-b40782ff-78e0-47fa-8f30-144f97ad3e1c tempest-SnapshotMetadataTestJSON-793520384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-12e1fd57-1605-4251-82e0-9579f5479f5c.9630e865-5811-4b44-82fb-8f41fdb17ef5 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:01:36 devstack sudo[100859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-12e1fd57-1605-4251-82e0-9579f5479f5c.9630e865-5811-4b44-82fb-8f41fdb17ef5 Nov 04 11:01:36 devstack sudo[100859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:01:36 devstack sudo[100859]: pam_unix(sudo:session): session closed for user root Nov 04 11:01:36 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-b40782ff-78e0-47fa-8f30-144f97ad3e1c tempest-SnapshotMetadataTestJSON-793520384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-12e1fd57-1605-4251-82e0-9579f5479f5c.9630e865-5811-4b44-82fb-8f41fdb17ef5" returned: 0 in 0.472s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:01:36 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-b40782ff-78e0-47fa-8f30-144f97ad3e1c tempest-SnapshotMetadataTestJSON-793520384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-12e1fd57-1605-4251-82e0-9579f5479f5c.9630e865-5811-4b44-82fb-8f41fdb17ef5 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:01:36 devstack sudo[100866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-12e1fd57-1605-4251-82e0-9579f5479f5c.9630e865-5811-4b44-82fb-8f41fdb17ef5 Nov 04 11:01:36 devstack sudo[100866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:01:37 devstack sudo[100866]: pam_unix(sudo:session): session closed for user root Nov 04 11:01:37 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-b40782ff-78e0-47fa-8f30-144f97ad3e1c tempest-SnapshotMetadataTestJSON-793520384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-12e1fd57-1605-4251-82e0-9579f5479f5c.9630e865-5811-4b44-82fb-8f41fdb17ef5" returned: 0 in 0.295s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:01:37 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-b40782ff-78e0-47fa-8f30-144f97ad3e1c tempest-SnapshotMetadataTestJSON-793520384 None] Lock "cinder-quobyte-9630e865-5811-4b44-82fb-8f41fdb17ef5" released by "_delete_snapshot" :: held 1.779s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 11:01:37 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-b40782ff-78e0-47fa-8f30-144f97ad3e1c tempest-SnapshotMetadataTestJSON-793520384 None] Lock "cinder-quobyte-12e1fd57-1605-4251-82e0-9579f5479f5c" released by "delete_snapshot" :: held 1.815s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 11:01:37 devstack cinder-volume[87272]: DEBUG dbcounter [-] [87272] Writing DB stats cinder:SELECT=123,cinder:INSERT=37,cinder:UPDATE=172,cinder:DELETE=14 {{(pid=87272) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 11:01:37 devstack cinder-volume[87272]: DEBUG cinder.quota [None req-b40782ff-78e0-47fa-8f30-144f97ad3e1c tempest-SnapshotMetadataTestJSON-793520384 None] Created reservations ['96996d00-98de-4eae-a81f-a3f8055137af', '688604dd-22d9-4d3b-b2bc-fd00b2f6fde0', '2b53363f-a07f-422d-82fd-4f22f0e4f4de', '91eabb9a-787a-475d-a8ac-e35c552a0739'] {{(pid=87272) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 11:01:37 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-b40782ff-78e0-47fa-8f30-144f97ad3e1c tempest-SnapshotMetadataTestJSON-793520384 None] Delete snapshot completed successfully. Nov 04 11:01:37 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-b40782ff-78e0-47fa-8f30-144f97ad3e1c tempest-SnapshotMetadataTestJSON-793520384 None] Lock "cinder-9630e865-5811-4b44-82fb-8f41fdb17ef5-delete_snapshot" released by "delete_snapshot" :: held 2.003s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 11:01:37 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-f7eeafc0-1866-42ec-afbe-013169a54505 tempest-SnapshotMetadataTestJSON-793520384 None] Acquiring lock "cinder-12e1fd57-1605-4251-82e0-9579f5479f5c-delete_volume" by "delete_volume" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 11:01:37 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-f7eeafc0-1866-42ec-afbe-013169a54505 tempest-SnapshotMetadataTestJSON-793520384 None] Lock "cinder-12e1fd57-1605-4251-82e0-9579f5479f5c-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 11:01:37 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-f7eeafc0-1866-42ec-afbe-013169a54505 tempest-SnapshotMetadataTestJSON-793520384 None] Acquiring lock "cinder-quobyte-12e1fd57-1605-4251-82e0-9579f5479f5c" by "delete_volume" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 11:01:37 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-f7eeafc0-1866-42ec-afbe-013169a54505 tempest-SnapshotMetadataTestJSON-793520384 None] Lock "cinder-quobyte-12e1fd57-1605-4251-82e0-9579f5479f5c" acquired by "delete_volume" :: waited 0.017s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 11:01:37 devstack cinder-volume[87272]: DEBUG oslo.privsep.daemon [-] privsep: reply[f31665f3-bee8-43fc-bd62-c954c084aa32]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 11:01:37 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-f7eeafc0-1866-42ec-afbe-013169a54505 tempest-SnapshotMetadataTestJSON-793520384 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-12e1fd57-1605-4251-82e0-9579f5479f5c {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:01:37 devstack sudo[100869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-12e1fd57-1605-4251-82e0-9579f5479f5c Nov 04 11:01:37 devstack sudo[100869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:01:38 devstack sudo[100869]: pam_unix(sudo:session): session closed for user root Nov 04 11:01:38 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-f7eeafc0-1866-42ec-afbe-013169a54505 tempest-SnapshotMetadataTestJSON-793520384 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-12e1fd57-1605-4251-82e0-9579f5479f5c" returned: 0 in 0.409s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:01:38 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-f7eeafc0-1866-42ec-afbe-013169a54505 tempest-SnapshotMetadataTestJSON-793520384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-12e1fd57-1605-4251-82e0-9579f5479f5c {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:01:38 devstack sudo[100874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-12e1fd57-1605-4251-82e0-9579f5479f5c Nov 04 11:01:38 devstack sudo[100874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:01:38 devstack sudo[100874]: pam_unix(sudo:session): session closed for user root Nov 04 11:01:38 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-f7eeafc0-1866-42ec-afbe-013169a54505 tempest-SnapshotMetadataTestJSON-793520384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-12e1fd57-1605-4251-82e0-9579f5479f5c" returned: 0 in 0.293s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:01:38 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-f7eeafc0-1866-42ec-afbe-013169a54505 tempest-SnapshotMetadataTestJSON-793520384 None] Lock "cinder-quobyte-12e1fd57-1605-4251-82e0-9579f5479f5c" released by "delete_volume" :: held 0.784s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 11:01:38 devstack cinder-volume[87272]: DEBUG cinder.quota [None req-f7eeafc0-1866-42ec-afbe-013169a54505 tempest-SnapshotMetadataTestJSON-793520384 None] Created reservations ['0a60a155-5cee-4577-9969-af783ad59d23', 'be3325db-11b5-48eb-b0ae-99d3e95859ad', '3ce20a6f-e7e7-450e-aaa8-93d321f266c3', '6b8acd34-f584-4962-a327-1d623bf3c73e'] {{(pid=87272) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 11:01:38 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-f7eeafc0-1866-42ec-afbe-013169a54505 tempest-SnapshotMetadataTestJSON-793520384 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 11:01:38 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-f7eeafc0-1866-42ec-afbe-013169a54505 tempest-SnapshotMetadataTestJSON-793520384 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 11:01:38 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-f7eeafc0-1866-42ec-afbe-013169a54505 tempest-SnapshotMetadataTestJSON-793520384 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898': None} {{(pid=87272) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 11:01:38 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-f7eeafc0-1866-42ec-afbe-013169a54505 tempest-SnapshotMetadataTestJSON-793520384 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'] {{(pid=87272) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 11:01:38 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-f7eeafc0-1866-42ec-afbe-013169a54505 tempest-SnapshotMetadataTestJSON-793520384 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 11:01:38 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-f7eeafc0-1866-42ec-afbe-013169a54505 tempest-SnapshotMetadataTestJSON-793520384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:01:38 devstack sudo[100877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1 Nov 04 11:01:38 devstack sudo[100877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:01:38 devstack sudo[100877]: pam_unix(sudo:session): session closed for user root Nov 04 11:01:38 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-f7eeafc0-1866-42ec-afbe-013169a54505 tempest-SnapshotMetadataTestJSON-793520384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1" returned: 0 in 0.322s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:01:38 devstack cinder-volume[87272]: DEBUG cinder.manager [None req-f7eeafc0-1866-42ec-afbe-013169a54505 tempest-SnapshotMetadataTestJSON-793520384 None] Notifying Schedulers of capabilities ... {{(pid=87272) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 11:01:38 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-f7eeafc0-1866-42ec-afbe-013169a54505 tempest-SnapshotMetadataTestJSON-793520384 None] Deleted volume successfully. Nov 04 11:01:39 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-f7eeafc0-1866-42ec-afbe-013169a54505 tempest-SnapshotMetadataTestJSON-793520384 None] Lock "cinder-12e1fd57-1605-4251-82e0-9579f5479f5c-delete_volume" released by "delete_volume" :: held 1.414s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 11:01:42 devstack cinder-volume[87272]: DEBUG cinder.volume.flows.manager.create_volume [None req-b455d183-ffbf-43ff-a986-8c34c213925c tempest-TestImageHashVerification-383593588 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87272) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 11:01:42 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-b455d183-ffbf-43ff-a986-8c34c213925c tempest-TestImageHashVerification-383593588 None] Flow 'volume_create_manager' (58f60ae1-abf0-4213-a127-93b65696a04a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 11:01:42 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-b455d183-ffbf-43ff-a986-8c34c213925c tempest-TestImageHashVerification-383593588 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d36fae26-0f98-4a50-ad03-05d8fcef2ed3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:01:42 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-b455d183-ffbf-43ff-a986-8c34c213925c tempest-TestImageHashVerification-383593588 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d36fae26-0f98-4a50-ad03-05d8fcef2ed3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T10:01:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-1638762447',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5cab0739-c891-4a05-b972-3645568d2d5d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d2a0850cafc143588f81be134e701b0f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T10:01:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T10:01:43Z,use_quota=True,user_id='9bde9e01c2c84d9f8e3a6ececba18414',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8989e4f-21e3-4f0a-9584-0d818784e883),volume_type_id=f8989e4f-21e3-4f0a-9584-0d818784e883)' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:01:42 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-b455d183-ffbf-43ff-a986-8c34c213925c tempest-TestImageHashVerification-383593588 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9600cd7f-40d9-414d-8ceb-84be357af046) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:01:42 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-b455d183-ffbf-43ff-a986-8c34c213925c tempest-TestImageHashVerification-383593588 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9600cd7f-40d9-414d-8ceb-84be357af046) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:01:42 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-b455d183-ffbf-43ff-a986-8c34c213925c tempest-TestImageHashVerification-383593588 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a428db6-f431-4360-9afb-0f2e234104a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:01:42 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-b455d183-ffbf-43ff-a986-8c34c213925c tempest-TestImageHashVerification-383593588 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a428db6-f431-4360-9afb-0f2e234104a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5cab0739-c891-4a05-b972-3645568d2d5d', 'volume_name': 'volume-5cab0739-c891-4a05-b972-3645568d2d5d', 'volume_size': 1}' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:01:42 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-b455d183-ffbf-43ff-a986-8c34c213925c tempest-TestImageHashVerification-383593588 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (42f8cd0a-daf3-4c4c-b148-719e79e9a513) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:01:42 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-b455d183-ffbf-43ff-a986-8c34c213925c tempest-TestImageHashVerification-383593588 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (42f8cd0a-daf3-4c4c-b148-719e79e9a513) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:01:42 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-b455d183-ffbf-43ff-a986-8c34c213925c tempest-TestImageHashVerification-383593588 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eefa9ae6-dd47-4c18-b3a9-369bca5d888f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:01:42 devstack cinder-volume[87272]: INFO cinder.volume.flows.manager.create_volume [None req-b455d183-ffbf-43ff-a986-8c34c213925c tempest-TestImageHashVerification-383593588 None] Volume 5cab0739-c891-4a05-b972-3645568d2d5d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5cab0739-c891-4a05-b972-3645568d2d5d', 'volume_size': 1} Nov 04 11:01:42 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-b455d183-ffbf-43ff-a986-8c34c213925c tempest-TestImageHashVerification-383593588 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 11:01:42 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-b455d183-ffbf-43ff-a986-8c34c213925c tempest-TestImageHashVerification-383593588 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 11:01:42 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-b455d183-ffbf-43ff-a986-8c34c213925c tempest-TestImageHashVerification-383593588 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T10:01:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-1638762447',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5cab0739-c891-4a05-b972-3645568d2d5d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d2a0850cafc143588f81be134e701b0f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T10:01:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T10:01:43Z,use_quota=True,user_id='9bde9e01c2c84d9f8e3a6ececba18414',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8989e4f-21e3-4f0a-9584-0d818784e883),volume_type_id=f8989e4f-21e3-4f0a-9584-0d818784e883)}" {{(pid=87272) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 04 11:01:42 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.remotefs [None req-b455d183-ffbf-43ff-a986-8c34c213925c tempest-TestImageHashVerification-383593588 None] Creating volume 5cab0739-c891-4a05-b972-3645568d2d5d {{(pid=87272) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 11:01:42 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-b455d183-ffbf-43ff-a986-8c34c213925c tempest-TestImageHashVerification-383593588 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 11:01:42 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-b455d183-ffbf-43ff-a986-8c34c213925c tempest-TestImageHashVerification-383593588 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 11:01:42 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-b455d183-ffbf-43ff-a986-8c34c213925c tempest-TestImageHashVerification-383593588 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898': None} {{(pid=87272) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 11:01:42 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-b455d183-ffbf-43ff-a986-8c34c213925c tempest-TestImageHashVerification-383593588 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'] {{(pid=87272) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 11:01:42 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-b455d183-ffbf-43ff-a986-8c34c213925c tempest-TestImageHashVerification-383593588 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 11:01:42 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-b455d183-ffbf-43ff-a986-8c34c213925c tempest-TestImageHashVerification-383593588 None] Selected osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898 as target Quobyte volume. {{(pid=87272) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 11:01:42 devstack cinder-volume[87272]: INFO cinder.volume.drivers.remotefs [None req-b455d183-ffbf-43ff-a986-8c34c213925c tempest-TestImageHashVerification-383593588 None] casted to osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898 Nov 04 11:01:42 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-b455d183-ffbf-43ff-a986-8c34c213925c tempest-TestImageHashVerification-383593588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-5cab0739-c891-4a05-b972-3645568d2d5d 1073741824 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:01:42 devstack sudo[100880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-5cab0739-c891-4a05-b972-3645568d2d5d 1073741824 Nov 04 11:01:42 devstack sudo[100880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:01:43 devstack sudo[100880]: pam_unix(sudo:session): session closed for user root Nov 04 11:01:43 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-b455d183-ffbf-43ff-a986-8c34c213925c tempest-TestImageHashVerification-383593588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-5cab0739-c891-4a05-b972-3645568d2d5d 1073741824" returned: 0 in 0.593s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:01:43 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-b455d183-ffbf-43ff-a986-8c34c213925c tempest-TestImageHashVerification-383593588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-5cab0739-c891-4a05-b972-3645568d2d5d {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:01:43 devstack sudo[100886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-5cab0739-c891-4a05-b972-3645568d2d5d Nov 04 11:01:43 devstack sudo[100886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:01:43 devstack sudo[100886]: pam_unix(sudo:session): session closed for user root Nov 04 11:01:43 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-b455d183-ffbf-43ff-a986-8c34c213925c tempest-TestImageHashVerification-383593588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-5cab0739-c891-4a05-b972-3645568d2d5d" returned: 0 in 0.293s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:01:43 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-b455d183-ffbf-43ff-a986-8c34c213925c tempest-TestImageHashVerification-383593588 None] <== create_volume: return (968ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'} {{(pid=87272) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 04 11:01:43 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-b455d183-ffbf-43ff-a986-8c34c213925c tempest-TestImageHashVerification-383593588 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.973s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 11:01:43 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-b455d183-ffbf-43ff-a986-8c34c213925c tempest-TestImageHashVerification-383593588 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eefa9ae6-dd47-4c18-b3a9-369bca5d888f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5cab0739-c891-4a05-b972-3645568d2d5d', 'volume_size': 1}' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:01:43 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-b455d183-ffbf-43ff-a986-8c34c213925c tempest-TestImageHashVerification-383593588 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53ae9a23-a14a-47e9-a928-e697c2387b7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:01:43 devstack cinder-volume[87272]: INFO cinder.volume.flows.manager.create_volume [None req-b455d183-ffbf-43ff-a986-8c34c213925c tempest-TestImageHashVerification-383593588 None] Volume volume-5cab0739-c891-4a05-b972-3645568d2d5d (5cab0739-c891-4a05-b972-3645568d2d5d): created successfully Nov 04 11:01:43 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-b455d183-ffbf-43ff-a986-8c34c213925c tempest-TestImageHashVerification-383593588 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53ae9a23-a14a-47e9-a928-e697c2387b7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:01:43 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-b455d183-ffbf-43ff-a986-8c34c213925c tempest-TestImageHashVerification-383593588 None] Flow 'volume_create_manager' (58f60ae1-abf0-4213-a127-93b65696a04a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87272) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 11:01:43 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-b455d183-ffbf-43ff-a986-8c34c213925c tempest-TestImageHashVerification-383593588 None] Created volume successfully. Nov 04 11:01:44 devstack cinder-volume[87272]: DEBUG cinder.volume.flows.manager.create_volume [None req-f679f6ef-07a4-46d5-b621-05fa55db3dd9 tempest-VolumesListTestJSON-1678922499 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87272) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 11:01:44 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-f679f6ef-07a4-46d5-b621-05fa55db3dd9 tempest-VolumesListTestJSON-1678922499 None] Flow 'volume_create_manager' (46ccd828-02db-431a-b673-dcf2428354c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 11:01:44 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-f679f6ef-07a4-46d5-b621-05fa55db3dd9 tempest-VolumesListTestJSON-1678922499 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c0be3f34-c5a5-4f6f-b34a-9cd7b735bec0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:01:44 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-f679f6ef-07a4-46d5-b621-05fa55db3dd9 tempest-VolumesListTestJSON-1678922499 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c0be3f34-c5a5-4f6f-b34a-9cd7b735bec0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T10:01:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1225273999',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa6bc330-4fde-4ec6-9a2a-1d3009e2978c,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c678337d30c14ee89e280efae6478852',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T10:01:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T10:01:44Z,use_quota=True,user_id='2ad4219112be4ac988da3466fc052d86',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8989e4f-21e3-4f0a-9584-0d818784e883),volume_type_id=f8989e4f-21e3-4f0a-9584-0d818784e883)' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:01:44 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-f679f6ef-07a4-46d5-b621-05fa55db3dd9 tempest-VolumesListTestJSON-1678922499 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dfbeeabe-e375-47ce-a597-e07835b423be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:01:44 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-f679f6ef-07a4-46d5-b621-05fa55db3dd9 tempest-VolumesListTestJSON-1678922499 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dfbeeabe-e375-47ce-a597-e07835b423be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:01:44 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-f679f6ef-07a4-46d5-b621-05fa55db3dd9 tempest-VolumesListTestJSON-1678922499 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7becd550-835a-4872-a2b6-ef23575955a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:01:44 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-f679f6ef-07a4-46d5-b621-05fa55db3dd9 tempest-VolumesListTestJSON-1678922499 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7becd550-835a-4872-a2b6-ef23575955a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fa6bc330-4fde-4ec6-9a2a-1d3009e2978c', 'volume_name': 'volume-fa6bc330-4fde-4ec6-9a2a-1d3009e2978c', 'volume_size': 1}' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:01:44 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-f679f6ef-07a4-46d5-b621-05fa55db3dd9 tempest-VolumesListTestJSON-1678922499 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af01c329-cbe3-41ca-92b8-3e2b4c95882f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:01:44 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-f679f6ef-07a4-46d5-b621-05fa55db3dd9 tempest-VolumesListTestJSON-1678922499 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af01c329-cbe3-41ca-92b8-3e2b4c95882f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:01:44 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-f679f6ef-07a4-46d5-b621-05fa55db3dd9 tempest-VolumesListTestJSON-1678922499 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa6971cc-44e0-4f44-b1a1-5c905f75afa8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:01:44 devstack cinder-volume[87272]: INFO cinder.volume.flows.manager.create_volume [None req-f679f6ef-07a4-46d5-b621-05fa55db3dd9 tempest-VolumesListTestJSON-1678922499 None] Volume fa6bc330-4fde-4ec6-9a2a-1d3009e2978c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fa6bc330-4fde-4ec6-9a2a-1d3009e2978c', 'volume_size': 1} Nov 04 11:01:44 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-f679f6ef-07a4-46d5-b621-05fa55db3dd9 tempest-VolumesListTestJSON-1678922499 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 11:01:44 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-f679f6ef-07a4-46d5-b621-05fa55db3dd9 tempest-VolumesListTestJSON-1678922499 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 11:01:44 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-f679f6ef-07a4-46d5-b621-05fa55db3dd9 tempest-VolumesListTestJSON-1678922499 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T10:01:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1225273999',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa6bc330-4fde-4ec6-9a2a-1d3009e2978c,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c678337d30c14ee89e280efae6478852',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T10:01:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T10:01:44Z,use_quota=True,user_id='2ad4219112be4ac988da3466fc052d86',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8989e4f-21e3-4f0a-9584-0d818784e883),volume_type_id=f8989e4f-21e3-4f0a-9584-0d818784e883)}" {{(pid=87272) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 04 11:01:44 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.remotefs [None req-f679f6ef-07a4-46d5-b621-05fa55db3dd9 tempest-VolumesListTestJSON-1678922499 None] Creating volume fa6bc330-4fde-4ec6-9a2a-1d3009e2978c {{(pid=87272) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 11:01:44 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-f679f6ef-07a4-46d5-b621-05fa55db3dd9 tempest-VolumesListTestJSON-1678922499 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 11:01:44 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-f679f6ef-07a4-46d5-b621-05fa55db3dd9 tempest-VolumesListTestJSON-1678922499 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 11:01:44 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-f679f6ef-07a4-46d5-b621-05fa55db3dd9 tempest-VolumesListTestJSON-1678922499 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898': None} {{(pid=87272) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 11:01:44 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-f679f6ef-07a4-46d5-b621-05fa55db3dd9 tempest-VolumesListTestJSON-1678922499 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'] {{(pid=87272) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 11:01:44 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-f679f6ef-07a4-46d5-b621-05fa55db3dd9 tempest-VolumesListTestJSON-1678922499 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 11:01:44 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-f679f6ef-07a4-46d5-b621-05fa55db3dd9 tempest-VolumesListTestJSON-1678922499 None] Selected osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898 as target Quobyte volume. {{(pid=87272) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 11:01:44 devstack cinder-volume[87272]: INFO cinder.volume.drivers.remotefs [None req-f679f6ef-07a4-46d5-b621-05fa55db3dd9 tempest-VolumesListTestJSON-1678922499 None] casted to osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898 Nov 04 11:01:44 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-f679f6ef-07a4-46d5-b621-05fa55db3dd9 tempest-VolumesListTestJSON-1678922499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-fa6bc330-4fde-4ec6-9a2a-1d3009e2978c 1073741824 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:01:44 devstack sudo[100890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-fa6bc330-4fde-4ec6-9a2a-1d3009e2978c 1073741824 Nov 04 11:01:44 devstack sudo[100890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:01:44 devstack sudo[100890]: pam_unix(sudo:session): session closed for user root Nov 04 11:01:44 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-f679f6ef-07a4-46d5-b621-05fa55db3dd9 tempest-VolumesListTestJSON-1678922499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-fa6bc330-4fde-4ec6-9a2a-1d3009e2978c 1073741824" returned: 0 in 0.522s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:01:44 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-f679f6ef-07a4-46d5-b621-05fa55db3dd9 tempest-VolumesListTestJSON-1678922499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-fa6bc330-4fde-4ec6-9a2a-1d3009e2978c {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:01:44 devstack sudo[100896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-fa6bc330-4fde-4ec6-9a2a-1d3009e2978c Nov 04 11:01:44 devstack sudo[100896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:01:45 devstack sudo[100896]: pam_unix(sudo:session): session closed for user root Nov 04 11:01:45 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-f679f6ef-07a4-46d5-b621-05fa55db3dd9 tempest-VolumesListTestJSON-1678922499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-fa6bc330-4fde-4ec6-9a2a-1d3009e2978c" returned: 0 in 0.312s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:01:45 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-f679f6ef-07a4-46d5-b621-05fa55db3dd9 tempest-VolumesListTestJSON-1678922499 None] <== create_volume: return (883ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'} {{(pid=87272) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 04 11:01:45 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-f679f6ef-07a4-46d5-b621-05fa55db3dd9 tempest-VolumesListTestJSON-1678922499 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.887s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 11:01:45 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-f679f6ef-07a4-46d5-b621-05fa55db3dd9 tempest-VolumesListTestJSON-1678922499 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa6971cc-44e0-4f44-b1a1-5c905f75afa8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fa6bc330-4fde-4ec6-9a2a-1d3009e2978c', 'volume_size': 1}' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:01:45 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-f679f6ef-07a4-46d5-b621-05fa55db3dd9 tempest-VolumesListTestJSON-1678922499 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (794df4d1-631d-4620-b58d-31a1059a1dcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:01:45 devstack cinder-volume[87272]: INFO cinder.volume.flows.manager.create_volume [None req-f679f6ef-07a4-46d5-b621-05fa55db3dd9 tempest-VolumesListTestJSON-1678922499 None] Volume volume-fa6bc330-4fde-4ec6-9a2a-1d3009e2978c (fa6bc330-4fde-4ec6-9a2a-1d3009e2978c): created successfully Nov 04 11:01:45 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-f679f6ef-07a4-46d5-b621-05fa55db3dd9 tempest-VolumesListTestJSON-1678922499 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (794df4d1-631d-4620-b58d-31a1059a1dcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:01:45 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-f679f6ef-07a4-46d5-b621-05fa55db3dd9 tempest-VolumesListTestJSON-1678922499 None] Flow 'volume_create_manager' (46ccd828-02db-431a-b673-dcf2428354c6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87272) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 11:01:45 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-f679f6ef-07a4-46d5-b621-05fa55db3dd9 tempest-VolumesListTestJSON-1678922499 None] Created volume successfully. Nov 04 11:01:45 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-143e08be-13d1-4d1b-a324-f12181dda02b tempest-TestImageHashVerification-383593588 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 11:01:45 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-143e08be-13d1-4d1b-a324-f12181dda02b tempest-TestImageHashVerification-383593588 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 11:01:45 devstack cinder-volume[87272]: DEBUG oslo.privsep.daemon [-] privsep: reply[205c2365-ee8b-4491-901a-bb35efa2d5c6]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 11:01:45 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-143e08be-13d1-4d1b-a324-f12181dda02b tempest-TestImageHashVerification-383593588 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-5cab0739-c891-4a05-b972-3645568d2d5d {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:01:45 devstack sudo[100899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-5cab0739-c891-4a05-b972-3645568d2d5d Nov 04 11:01:45 devstack sudo[100899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:01:46 devstack sudo[100899]: pam_unix(sudo:session): session closed for user root Nov 04 11:01:46 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-143e08be-13d1-4d1b-a324-f12181dda02b tempest-TestImageHashVerification-383593588 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-5cab0739-c891-4a05-b972-3645568d2d5d" returned: 0 in 0.412s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:01:46 devstack cinder-volume[87272]: DEBUG oslo.privsep.daemon [-] privsep: reply[07015442-bf6b-4015-8758-5bfbc267a2b4]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 11:01:46 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-143e08be-13d1-4d1b-a324-f12181dda02b tempest-TestImageHashVerification-383593588 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-5cab0739-c891-4a05-b972-3645568d2d5d {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:01:46 devstack sudo[100904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-5cab0739-c891-4a05-b972-3645568d2d5d Nov 04 11:01:46 devstack sudo[100904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:01:46 devstack sudo[100904]: pam_unix(sudo:session): session closed for user root Nov 04 11:01:46 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-143e08be-13d1-4d1b-a324-f12181dda02b tempest-TestImageHashVerification-383593588 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-5cab0739-c891-4a05-b972-3645568d2d5d" returned: 0 in 0.455s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:01:46 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-143e08be-13d1-4d1b-a324-f12181dda02b tempest-TestImageHashVerification-383593588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-5cab0739-c891-4a05-b972-3645568d2d5d /opt/stack/data/cinder/conversion/5cab0739-c891-4a05-b972-3645568d2d5d.temp_image.6b07476b-7af2-455d-ae71-638830f80bfctu1chzu4.img {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:01:46 devstack sudo[100910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-5cab0739-c891-4a05-b972-3645568d2d5d /opt/stack/data/cinder/conversion/5cab0739-c891-4a05-b972-3645568d2d5d.temp_image.6b07476b-7af2-455d-ae71-638830f80bfctu1chzu4.img Nov 04 11:01:46 devstack sudo[100910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:01:46 devstack cinder-volume[87272]: DEBUG cinder.volume.flows.manager.create_volume [None req-8fd4ca48-186a-4ff5-800c-450edcf57ff1 tempest-VolumesListTestJSON-1678922499 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87272) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 11:01:46 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-8fd4ca48-186a-4ff5-800c-450edcf57ff1 tempest-VolumesListTestJSON-1678922499 None] Flow 'volume_create_manager' (fc394e2c-0144-464e-9f8d-5db8bd3aed06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 11:01:46 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-8fd4ca48-186a-4ff5-800c-450edcf57ff1 tempest-VolumesListTestJSON-1678922499 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (796dec6c-2b93-4f1c-af30-c8feb3a854cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:01:46 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-8fd4ca48-186a-4ff5-800c-450edcf57ff1 tempest-VolumesListTestJSON-1678922499 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (796dec6c-2b93-4f1c-af30-c8feb3a854cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T10:01:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-524487134',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8f504661-7590-4314-8d9f-a307bc8b4450,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c678337d30c14ee89e280efae6478852',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T10:01:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T10:01:47Z,use_quota=True,user_id='2ad4219112be4ac988da3466fc052d86',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8989e4f-21e3-4f0a-9584-0d818784e883),volume_type_id=f8989e4f-21e3-4f0a-9584-0d818784e883)' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:01:46 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-8fd4ca48-186a-4ff5-800c-450edcf57ff1 tempest-VolumesListTestJSON-1678922499 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (92c52f84-343c-4841-8f32-bc8404a72ac9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:01:46 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-8fd4ca48-186a-4ff5-800c-450edcf57ff1 tempest-VolumesListTestJSON-1678922499 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (92c52f84-343c-4841-8f32-bc8404a72ac9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:01:46 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-8fd4ca48-186a-4ff5-800c-450edcf57ff1 tempest-VolumesListTestJSON-1678922499 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4096cbca-6dfc-4979-9e32-50d92ec37c5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:01:46 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-8fd4ca48-186a-4ff5-800c-450edcf57ff1 tempest-VolumesListTestJSON-1678922499 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4096cbca-6dfc-4979-9e32-50d92ec37c5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8f504661-7590-4314-8d9f-a307bc8b4450', 'volume_name': 'volume-8f504661-7590-4314-8d9f-a307bc8b4450', 'volume_size': 1}' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:01:46 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-8fd4ca48-186a-4ff5-800c-450edcf57ff1 tempest-VolumesListTestJSON-1678922499 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2bccba2a-d4f7-40c2-ad17-11cc273098df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:01:46 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-8fd4ca48-186a-4ff5-800c-450edcf57ff1 tempest-VolumesListTestJSON-1678922499 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2bccba2a-d4f7-40c2-ad17-11cc273098df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:01:46 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-8fd4ca48-186a-4ff5-800c-450edcf57ff1 tempest-VolumesListTestJSON-1678922499 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fab2a551-a60e-4376-b64a-d609d0b8aba5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:01:46 devstack cinder-volume[87272]: INFO cinder.volume.flows.manager.create_volume [None req-8fd4ca48-186a-4ff5-800c-450edcf57ff1 tempest-VolumesListTestJSON-1678922499 None] Volume 8f504661-7590-4314-8d9f-a307bc8b4450: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8f504661-7590-4314-8d9f-a307bc8b4450', 'volume_size': 1} Nov 04 11:01:46 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-8fd4ca48-186a-4ff5-800c-450edcf57ff1 tempest-VolumesListTestJSON-1678922499 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 11:01:53 devstack sudo[100910]: pam_unix(sudo:session): session closed for user root Nov 04 11:01:53 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-143e08be-13d1-4d1b-a324-f12181dda02b tempest-TestImageHashVerification-383593588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-5cab0739-c891-4a05-b972-3645568d2d5d /opt/stack/data/cinder/conversion/5cab0739-c891-4a05-b972-3645568d2d5d.temp_image.6b07476b-7af2-455d-ae71-638830f80bfctu1chzu4.img" returned: 0 in 7.179s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:01:53 devstack cinder-volume[87272]: DEBUG oslo.privsep.daemon [-] privsep: reply[c89bdc3a-3a4e-489e-abae-e44839e15f6a]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 11:01:53 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-143e08be-13d1-4d1b-a324-f12181dda02b tempest-TestImageHashVerification-383593588 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-5cab0739-c891-4a05-b972-3645568d2d5d {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:01:53 devstack sudo[100924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-5cab0739-c891-4a05-b972-3645568d2d5d Nov 04 11:01:53 devstack sudo[100924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:01:54 devstack sudo[100924]: pam_unix(sudo:session): session closed for user root Nov 04 11:01:54 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-143e08be-13d1-4d1b-a324-f12181dda02b tempest-TestImageHashVerification-383593588 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-5cab0739-c891-4a05-b972-3645568d2d5d" returned: 0 in 0.616s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:01:54 devstack cinder-volume[87272]: DEBUG cinder.image.image_utils [None req-143e08be-13d1-4d1b-a324-f12181dda02b tempest-TestImageHashVerification-383593588 None] Image conversion details: src /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-5cab0739-c891-4a05-b972-3645568d2d5d, size 1024.00 MB, duration 7.18 sec, destination /opt/stack/data/cinder/conversion/5cab0739-c891-4a05-b972-3645568d2d5d.temp_image.6b07476b-7af2-455d-ae71-638830f80bfctu1chzu4.img {{(pid=87272) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Nov 04 11:01:54 devstack cinder-volume[87272]: INFO cinder.image.image_utils [None req-143e08be-13d1-4d1b-a324-f12181dda02b tempest-TestImageHashVerification-383593588 None] Converted 1024.00 MB image at 142.61 MB/s Nov 04 11:01:54 devstack cinder-volume[87272]: DEBUG dbcounter [-] [87272] Writing DB stats cinder:SELECT=121,cinder:UPDATE=151,cinder:INSERT=39,cinder:DELETE=13 {{(pid=87272) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 11:01:54 devstack cinder-volume[87272]: DEBUG cinder.image.image_utils [None req-143e08be-13d1-4d1b-a324-f12181dda02b tempest-TestImageHashVerification-383593588 None] 6b07476b-7af2-455d-ae71-638830f80bfc was raw, no need to convert to raw {{(pid=87272) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1162}} Nov 04 11:01:54 devstack cinder-volume[87272]: DEBUG cinder.volume.flows.manager.create_volume [None req-814b1b1d-cf0d-46e7-8a60-d95ee63cb0f2 tempest-VolumesImageMetadata-610578380 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87272) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 11:01:54 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-814b1b1d-cf0d-46e7-8a60-d95ee63cb0f2 tempest-VolumesImageMetadata-610578380 None] Flow 'volume_create_manager' (64fb8434-3117-4696-b11b-a9c6a0b607b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 11:01:54 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-814b1b1d-cf0d-46e7-8a60-d95ee63cb0f2 tempest-VolumesImageMetadata-610578380 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d02468d5-4f1d-4454-b226-6eea8a49db2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:01:54 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-814b1b1d-cf0d-46e7-8a60-d95ee63cb0f2 tempest-VolumesImageMetadata-610578380 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d02468d5-4f1d-4454-b226-6eea8a49db2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T10:01:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-978838318',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb027d85-a97d-45cb-951f-9082f8d6df67,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='82bdde14ec5843f9a6390a4546f1ea53',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T10:01:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T10:01:55Z,use_quota=True,user_id='d0e92c9ad0514aa2999b4ac7d3ee07d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8989e4f-21e3-4f0a-9584-0d818784e883),volume_type_id=f8989e4f-21e3-4f0a-9584-0d818784e883)' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:01:54 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-814b1b1d-cf0d-46e7-8a60-d95ee63cb0f2 tempest-VolumesImageMetadata-610578380 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (243a3aa8-2208-4a9e-a117-eec477fab4d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:01:54 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-814b1b1d-cf0d-46e7-8a60-d95ee63cb0f2 tempest-VolumesImageMetadata-610578380 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (243a3aa8-2208-4a9e-a117-eec477fab4d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:01:54 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-814b1b1d-cf0d-46e7-8a60-d95ee63cb0f2 tempest-VolumesImageMetadata-610578380 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e80d0de-a019-4859-9d1c-4b5621f83e53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:01:54 devstack cinder-volume[87272]: DEBUG cinder.image.glance [None req-814b1b1d-cf0d-46e7-8a60-d95ee63cb0f2 tempest-VolumesImageMetadata-610578380 None] Creating Keystone auth plugin from conf {{(pid=87272) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 04 11:01:54 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-814b1b1d-cf0d-46e7-8a60-d95ee63cb0f2 tempest-VolumesImageMetadata-610578380 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e80d0de-a019-4859-9d1c-4b5621f83e53) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'cb027d85-a97d-45cb-951f-9082f8d6df67', 'volume_name': 'volume-cb027d85-a97d-45cb-951f-9082f8d6df67', 'volume_size': 1, 'image_id': 'e21f1c05-a199-4b20-94c3-a13f8db1348a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e21f1c05-a199-4b20-94c3-a13f8db1348a', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'a0568d152f1945e380a1ac4afff5179c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'e21f1c05-a199-4b20-94c3-a13f8db1348a', 'created_at': datetime.datetime(2026, 11, 4, 9, 43, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 4, 9, 44, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e21f1c05-a199-4b20-94c3-a13f8db1348a/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:01:54 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-814b1b1d-cf0d-46e7-8a60-d95ee63cb0f2 tempest-VolumesImageMetadata-610578380 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (72f44463-756b-4895-b652-351a9dba032e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:01:54 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-814b1b1d-cf0d-46e7-8a60-d95ee63cb0f2 tempest-VolumesImageMetadata-610578380 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (72f44463-756b-4895-b652-351a9dba032e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:01:54 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-814b1b1d-cf0d-46e7-8a60-d95ee63cb0f2 tempest-VolumesImageMetadata-610578380 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87fd2459-f7aa-4430-8a40-667bfdc0a938) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:01:54 devstack cinder-volume[87272]: INFO cinder.volume.flows.manager.create_volume [None req-814b1b1d-cf0d-46e7-8a60-d95ee63cb0f2 tempest-VolumesImageMetadata-610578380 None] Volume cb027d85-a97d-45cb-951f-9082f8d6df67: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-cb027d85-a97d-45cb-951f-9082f8d6df67', 'volume_size': 1, 'image_id': 'e21f1c05-a199-4b20-94c3-a13f8db1348a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e21f1c05-a199-4b20-94c3-a13f8db1348a', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'a0568d152f1945e380a1ac4afff5179c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'e21f1c05-a199-4b20-94c3-a13f8db1348a', 'created_at': datetime.datetime(2026, 11, 4, 9, 43, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 4, 9, 44, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e21f1c05-a199-4b20-94c3-a13f8db1348a/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Nov 04 11:01:54 devstack cinder-volume[87272]: DEBUG cinder.volume.flows.manager.create_volume [None req-814b1b1d-cf0d-46e7-8a60-d95ee63cb0f2 tempest-VolumesImageMetadata-610578380 None] Trying to clone cb027d85-a97d-45cb-951f-9082f8d6df67 from image e21f1c05-a199-4b20-94c3-a13f8db1348a at location (None, [{'url': 'file:///opt/stack/data/glance/images/e21f1c05-a199-4b20-94c3-a13f8db1348a', 'metadata': {}}]). {{(pid=87272) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 04 11:01:55 devstack cinder-volume[87272]: DEBUG cinder.image.image_utils [None req-814b1b1d-cf0d-46e7-8a60-d95ee63cb0f2 tempest-VolumesImageMetadata-610578380 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_e21f1c05-a199-4b20-94c3-a13f8db1348a_3pc35yiudevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87272) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Nov 04 11:01:55 devstack cinder-volume[87272]: INFO cinder.image.image_utils [None req-814b1b1d-cf0d-46e7-8a60-d95ee63cb0f2 tempest-VolumesImageMetadata-610578380 None] Image download 20.69 MB at 20.69 MB/s Nov 04 11:01:55 devstack cinder-volume[87272]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4e05a38-63b7-4971-a675-a279826eb4fd]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 11:01:55 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-814b1b1d-cf0d-46e7-8a60-d95ee63cb0f2 tempest-VolumesImageMetadata-610578380 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e21f1c05-a199-4b20-94c3-a13f8db1348a_3pc35yiudevstack@QuobyteHD {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:01:55 devstack sudo[100930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e21f1c05-a199-4b20-94c3-a13f8db1348a_3pc35yiudevstack@QuobyteHD Nov 04 11:01:55 devstack sudo[100930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:01:55 devstack sudo[100930]: pam_unix(sudo:session): session closed for user root Nov 04 11:01:55 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-814b1b1d-cf0d-46e7-8a60-d95ee63cb0f2 tempest-VolumesImageMetadata-610578380 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e21f1c05-a199-4b20-94c3-a13f8db1348a_3pc35yiudevstack@QuobyteHD" returned: 0 in 0.360s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:01:55 devstack cinder-volume[87272]: DEBUG cinder.image.image_utils [None req-814b1b1d-cf0d-46e7-8a60-d95ee63cb0f2 tempest-VolumesImageMetadata-610578380 None] Temporary image e21f1c05-a199-4b20-94c3-a13f8db1348a is fetched for user d0e92c9ad0514aa2999b4ac7d3ee07d4. {{(pid=87272) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Nov 04 11:01:55 devstack cinder-volume[87272]: DEBUG oslo.privsep.daemon [-] privsep: reply[f09732db-9413-4224-9251-4a0142219b3d]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 11:01:55 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-814b1b1d-cf0d-46e7-8a60-d95ee63cb0f2 tempest-VolumesImageMetadata-610578380 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e21f1c05-a199-4b20-94c3-a13f8db1348a_3pc35yiudevstack@QuobyteHD {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:01:55 devstack sudo[100935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e21f1c05-a199-4b20-94c3-a13f8db1348a_3pc35yiudevstack@QuobyteHD Nov 04 11:01:55 devstack sudo[100935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:01:56 devstack sudo[100935]: pam_unix(sudo:session): session closed for user root Nov 04 11:01:56 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-814b1b1d-cf0d-46e7-8a60-d95ee63cb0f2 tempest-VolumesImageMetadata-610578380 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e21f1c05-a199-4b20-94c3-a13f8db1348a_3pc35yiudevstack@QuobyteHD" returned: 0 in 0.343s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:01:56 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-814b1b1d-cf0d-46e7-8a60-d95ee63cb0f2 tempest-VolumesImageMetadata-610578380 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 11:02:05 devstack cinder-volume[87272]: DEBUG dbcounter [-] [87272] Writing DB stats cinder:SELECT=2 {{(pid=87272) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 11:02:05 devstack cinder-volume[87272]: DEBUG dbcounter [-] [87272] Writing DB stats cinder:INSERT=5,cinder:UPDATE=23,cinder:SELECT=16,cinder:DELETE=1 {{(pid=87272) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 11:02:13 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-143e08be-13d1-4d1b-a324-f12181dda02b tempest-TestImageHashVerification-383593588 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 27.704s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 11:02:13 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-143e08be-13d1-4d1b-a324-f12181dda02b tempest-TestImageHashVerification-383593588 None] Uploaded volume to glance image-id: 6b07476b-7af2-455d-ae71-638830f80bfc. {{(pid=87272) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Nov 04 11:02:13 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-8fd4ca48-186a-4ff5-800c-450edcf57ff1 tempest-VolumesListTestJSON-1678922499 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 26.618s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 11:02:13 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-8fd4ca48-186a-4ff5-800c-450edcf57ff1 tempest-VolumesListTestJSON-1678922499 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T10:01:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-524487134',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8f504661-7590-4314-8d9f-a307bc8b4450,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c678337d30c14ee89e280efae6478852',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T10:01:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T10:01:47Z,use_quota=True,user_id='2ad4219112be4ac988da3466fc052d86',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8989e4f-21e3-4f0a-9584-0d818784e883),volume_type_id=f8989e4f-21e3-4f0a-9584-0d818784e883)}" {{(pid=87272) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 04 11:02:13 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.remotefs [None req-8fd4ca48-186a-4ff5-800c-450edcf57ff1 tempest-VolumesListTestJSON-1678922499 None] Creating volume 8f504661-7590-4314-8d9f-a307bc8b4450 {{(pid=87272) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 11:02:13 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-8fd4ca48-186a-4ff5-800c-450edcf57ff1 tempest-VolumesListTestJSON-1678922499 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 11:02:13 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-8fd4ca48-186a-4ff5-800c-450edcf57ff1 tempest-VolumesListTestJSON-1678922499 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 11:02:13 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-8fd4ca48-186a-4ff5-800c-450edcf57ff1 tempest-VolumesListTestJSON-1678922499 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898': None} {{(pid=87272) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 11:02:13 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-8fd4ca48-186a-4ff5-800c-450edcf57ff1 tempest-VolumesListTestJSON-1678922499 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'] {{(pid=87272) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 11:02:13 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-8fd4ca48-186a-4ff5-800c-450edcf57ff1 tempest-VolumesListTestJSON-1678922499 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 11:02:13 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-8fd4ca48-186a-4ff5-800c-450edcf57ff1 tempest-VolumesListTestJSON-1678922499 None] Selected osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898 as target Quobyte volume. {{(pid=87272) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 11:02:13 devstack cinder-volume[87272]: INFO cinder.volume.drivers.remotefs [None req-8fd4ca48-186a-4ff5-800c-450edcf57ff1 tempest-VolumesListTestJSON-1678922499 None] casted to osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898 Nov 04 11:02:13 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-8fd4ca48-186a-4ff5-800c-450edcf57ff1 tempest-VolumesListTestJSON-1678922499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-8f504661-7590-4314-8d9f-a307bc8b4450 1073741824 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:02:13 devstack sudo[100944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-8f504661-7590-4314-8d9f-a307bc8b4450 1073741824 Nov 04 11:02:13 devstack sudo[100944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:02:13 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-143e08be-13d1-4d1b-a324-f12181dda02b tempest-TestImageHashVerification-383593588 None] Copy volume to image completed successfully. Nov 04 11:02:13 devstack sudo[100944]: pam_unix(sudo:session): session closed for user root Nov 04 11:02:13 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-8fd4ca48-186a-4ff5-800c-450edcf57ff1 tempest-VolumesListTestJSON-1678922499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-8f504661-7590-4314-8d9f-a307bc8b4450 1073741824" returned: 0 in 0.446s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:02:13 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-8fd4ca48-186a-4ff5-800c-450edcf57ff1 tempest-VolumesListTestJSON-1678922499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-8f504661-7590-4314-8d9f-a307bc8b4450 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:02:13 devstack sudo[100949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-8f504661-7590-4314-8d9f-a307bc8b4450 Nov 04 11:02:13 devstack sudo[100949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:02:14 devstack cinder-volume[87272]: DEBUG oslo_service.periodic_task [None req-236af0be-7f9d-4c80-b3d7-d645a9cd0dd1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87272) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 04 11:02:14 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-236af0be-7f9d-4c80-b3d7-d645a9cd0dd1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 11:02:14 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-236af0be-7f9d-4c80-b3d7-d645a9cd0dd1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 11:02:14 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-236af0be-7f9d-4c80-b3d7-d645a9cd0dd1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898': None} {{(pid=87272) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 11:02:14 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-236af0be-7f9d-4c80-b3d7-d645a9cd0dd1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'] {{(pid=87272) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 11:02:14 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-236af0be-7f9d-4c80-b3d7-d645a9cd0dd1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 11:02:14 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-236af0be-7f9d-4c80-b3d7-d645a9cd0dd1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:02:14 devstack sudo[100952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1 Nov 04 11:02:14 devstack sudo[100952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:02:14 devstack sudo[100949]: pam_unix(sudo:session): session closed for user root Nov 04 11:02:14 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-8fd4ca48-186a-4ff5-800c-450edcf57ff1 tempest-VolumesListTestJSON-1678922499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-8f504661-7590-4314-8d9f-a307bc8b4450" returned: 0 in 0.239s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:02:14 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-8fd4ca48-186a-4ff5-800c-450edcf57ff1 tempest-VolumesListTestJSON-1678922499 None] <== create_volume: return (725ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'} {{(pid=87272) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 04 11:02:14 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-8fd4ca48-186a-4ff5-800c-450edcf57ff1 tempest-VolumesListTestJSON-1678922499 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.730s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 11:02:14 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-814b1b1d-cf0d-46e7-8a60-d95ee63cb0f2 tempest-VolumesImageMetadata-610578380 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 18.177s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 11:02:14 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-814b1b1d-cf0d-46e7-8a60-d95ee63cb0f2 tempest-VolumesImageMetadata-610578380 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T10:01:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-978838318',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb027d85-a97d-45cb-951f-9082f8d6df67,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='82bdde14ec5843f9a6390a4546f1ea53',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T10:01:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T10:01:55Z,use_quota=True,user_id='d0e92c9ad0514aa2999b4ac7d3ee07d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8989e4f-21e3-4f0a-9584-0d818784e883),volume_type_id=f8989e4f-21e3-4f0a-9584-0d818784e883)}" {{(pid=87272) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 04 11:02:14 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.remotefs [None req-814b1b1d-cf0d-46e7-8a60-d95ee63cb0f2 tempest-VolumesImageMetadata-610578380 None] Creating volume cb027d85-a97d-45cb-951f-9082f8d6df67 {{(pid=87272) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 11:02:14 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-814b1b1d-cf0d-46e7-8a60-d95ee63cb0f2 tempest-VolumesImageMetadata-610578380 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 11:02:14 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-814b1b1d-cf0d-46e7-8a60-d95ee63cb0f2 tempest-VolumesImageMetadata-610578380 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 11:02:14 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-814b1b1d-cf0d-46e7-8a60-d95ee63cb0f2 tempest-VolumesImageMetadata-610578380 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898': None} {{(pid=87272) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 11:02:14 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-814b1b1d-cf0d-46e7-8a60-d95ee63cb0f2 tempest-VolumesImageMetadata-610578380 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'] {{(pid=87272) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 11:02:14 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-814b1b1d-cf0d-46e7-8a60-d95ee63cb0f2 tempest-VolumesImageMetadata-610578380 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 11:02:14 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-814b1b1d-cf0d-46e7-8a60-d95ee63cb0f2 tempest-VolumesImageMetadata-610578380 None] Selected osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898 as target Quobyte volume. {{(pid=87272) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 11:02:14 devstack cinder-volume[87272]: INFO cinder.volume.drivers.remotefs [None req-814b1b1d-cf0d-46e7-8a60-d95ee63cb0f2 tempest-VolumesImageMetadata-610578380 None] casted to osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898 Nov 04 11:02:14 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-814b1b1d-cf0d-46e7-8a60-d95ee63cb0f2 tempest-VolumesImageMetadata-610578380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-cb027d85-a97d-45cb-951f-9082f8d6df67 1073741824 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:02:14 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-8fd4ca48-186a-4ff5-800c-450edcf57ff1 tempest-VolumesListTestJSON-1678922499 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fab2a551-a60e-4376-b64a-d609d0b8aba5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8f504661-7590-4314-8d9f-a307bc8b4450', 'volume_size': 1}' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:02:14 devstack sudo[100954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-cb027d85-a97d-45cb-951f-9082f8d6df67 1073741824 Nov 04 11:02:14 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-8fd4ca48-186a-4ff5-800c-450edcf57ff1 tempest-VolumesListTestJSON-1678922499 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b582ccd7-c2ed-4403-a0f1-92a32dbeeb2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:02:14 devstack sudo[100954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:02:14 devstack cinder-volume[87272]: INFO cinder.volume.flows.manager.create_volume [None req-8fd4ca48-186a-4ff5-800c-450edcf57ff1 tempest-VolumesListTestJSON-1678922499 None] Volume volume-8f504661-7590-4314-8d9f-a307bc8b4450 (8f504661-7590-4314-8d9f-a307bc8b4450): created successfully Nov 04 11:02:14 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-8fd4ca48-186a-4ff5-800c-450edcf57ff1 tempest-VolumesListTestJSON-1678922499 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b582ccd7-c2ed-4403-a0f1-92a32dbeeb2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:02:14 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-8fd4ca48-186a-4ff5-800c-450edcf57ff1 tempest-VolumesListTestJSON-1678922499 None] Flow 'volume_create_manager' (fc394e2c-0144-464e-9f8d-5db8bd3aed06) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87272) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 11:02:14 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-8fd4ca48-186a-4ff5-800c-450edcf57ff1 tempest-VolumesListTestJSON-1678922499 None] Created volume successfully. Nov 04 11:02:14 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-cd3242da-a1e0-4a57-bd39-65223028aaf1 tempest-TestImageHashVerification-383593588 None] Acquiring lock "cinder-5cab0739-c891-4a05-b972-3645568d2d5d-delete_volume" by "delete_volume" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 11:02:14 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-cd3242da-a1e0-4a57-bd39-65223028aaf1 tempest-TestImageHashVerification-383593588 None] Lock "cinder-5cab0739-c891-4a05-b972-3645568d2d5d-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 11:02:14 devstack sudo[100952]: pam_unix(sudo:session): session closed for user root Nov 04 11:02:14 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-236af0be-7f9d-4c80-b3d7-d645a9cd0dd1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1" returned: 0 in 0.296s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:02:14 devstack cinder-volume[87272]: DEBUG cinder.manager [None req-236af0be-7f9d-4c80-b3d7-d645a9cd0dd1 None None] Notifying Schedulers of capabilities ... {{(pid=87272) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 11:02:14 devstack cinder-volume[87272]: DEBUG oslo_service.periodic_task [None req-236af0be-7f9d-4c80-b3d7-d645a9cd0dd1 None None] Running periodic task VolumeManager._thread_info {{(pid=87272) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 04 11:02:14 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-236af0be-7f9d-4c80-b3d7-d645a9cd0dd1 None None] thread count: 28 {{(pid=87272) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 04 11:02:14 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-236af0be-7f9d-4c80-b3d7-d645a9cd0dd1 None None] thread info: [<_MainThread(MainThread, started 127085713244288)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87272) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 04 11:02:14 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-cd3242da-a1e0-4a57-bd39-65223028aaf1 tempest-TestImageHashVerification-383593588 None] Acquiring lock "cinder-quobyte-5cab0739-c891-4a05-b972-3645568d2d5d" by "delete_volume" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 11:02:14 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-cd3242da-a1e0-4a57-bd39-65223028aaf1 tempest-TestImageHashVerification-383593588 None] Lock "cinder-quobyte-5cab0739-c891-4a05-b972-3645568d2d5d" acquired by "delete_volume" :: waited 0.016s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 11:02:14 devstack cinder-volume[87272]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d55095a-a2f2-414c-80af-22bdaeefd4c1]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 11:02:14 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-cd3242da-a1e0-4a57-bd39-65223028aaf1 tempest-TestImageHashVerification-383593588 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-5cab0739-c891-4a05-b972-3645568d2d5d {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:02:14 devstack sudo[100960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-5cab0739-c891-4a05-b972-3645568d2d5d Nov 04 11:02:14 devstack sudo[100960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:02:14 devstack sudo[100954]: pam_unix(sudo:session): session closed for user root Nov 04 11:02:14 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-814b1b1d-cf0d-46e7-8a60-d95ee63cb0f2 tempest-VolumesImageMetadata-610578380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-cb027d85-a97d-45cb-951f-9082f8d6df67 1073741824" returned: 0 in 0.478s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:02:14 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-814b1b1d-cf0d-46e7-8a60-d95ee63cb0f2 tempest-VolumesImageMetadata-610578380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-cb027d85-a97d-45cb-951f-9082f8d6df67 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:02:14 devstack sudo[100962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-cb027d85-a97d-45cb-951f-9082f8d6df67 Nov 04 11:02:14 devstack sudo[100962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:02:14 devstack sudo[100960]: pam_unix(sudo:session): session closed for user root Nov 04 11:02:14 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-cd3242da-a1e0-4a57-bd39-65223028aaf1 tempest-TestImageHashVerification-383593588 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-5cab0739-c891-4a05-b972-3645568d2d5d" returned: 0 in 0.403s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:02:14 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-cd3242da-a1e0-4a57-bd39-65223028aaf1 tempest-TestImageHashVerification-383593588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-5cab0739-c891-4a05-b972-3645568d2d5d {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:02:14 devstack sudo[100967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-5cab0739-c891-4a05-b972-3645568d2d5d Nov 04 11:02:14 devstack sudo[100967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:02:14 devstack sudo[100962]: pam_unix(sudo:session): session closed for user root Nov 04 11:02:15 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-814b1b1d-cf0d-46e7-8a60-d95ee63cb0f2 tempest-VolumesImageMetadata-610578380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-cb027d85-a97d-45cb-951f-9082f8d6df67" returned: 0 in 0.277s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:02:15 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-814b1b1d-cf0d-46e7-8a60-d95ee63cb0f2 tempest-VolumesImageMetadata-610578380 None] <== create_volume: return (802ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'} {{(pid=87272) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 04 11:02:15 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-814b1b1d-cf0d-46e7-8a60-d95ee63cb0f2 tempest-VolumesImageMetadata-610578380 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.807s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 11:02:15 devstack cinder-volume[87272]: DEBUG cinder.volume.volume_utils [None req-814b1b1d-cf0d-46e7-8a60-d95ee63cb0f2 tempest-VolumesImageMetadata-610578380 None] Attempting download of e21f1c05-a199-4b20-94c3-a13f8db1348a ((None, [{'url': 'file:///opt/stack/data/glance/images/e21f1c05-a199-4b20-94c3-a13f8db1348a', 'metadata': {}}])) to volume cb027d85-a97d-45cb-951f-9082f8d6df67. {{(pid=87272) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Nov 04 11:02:15 devstack cinder-volume[87272]: DEBUG oslo.privsep.daemon [-] privsep: reply[711b3c99-044a-49c3-a2d1-e6c41d058aab]: (4, 'raw') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 11:02:15 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-814b1b1d-cf0d-46e7-8a60-d95ee63cb0f2 tempest-VolumesImageMetadata-610578380 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e21f1c05-a199-4b20-94c3-a13f8db1348a_v9llrecc {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:02:15 devstack sudo[100967]: pam_unix(sudo:session): session closed for user root Nov 04 11:02:15 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-cd3242da-a1e0-4a57-bd39-65223028aaf1 tempest-TestImageHashVerification-383593588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-5cab0739-c891-4a05-b972-3645568d2d5d" returned: 0 in 0.274s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:02:15 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-cd3242da-a1e0-4a57-bd39-65223028aaf1 tempest-TestImageHashVerification-383593588 None] Lock "cinder-quobyte-5cab0739-c891-4a05-b972-3645568d2d5d" released by "delete_volume" :: held 0.730s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 11:02:15 devstack sudo[100970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e21f1c05-a199-4b20-94c3-a13f8db1348a_v9llrecc Nov 04 11:02:15 devstack sudo[100970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:02:15 devstack cinder-volume[87272]: DEBUG cinder.quota [None req-cd3242da-a1e0-4a57-bd39-65223028aaf1 tempest-TestImageHashVerification-383593588 None] Created reservations ['5cabefef-efa8-4abd-83e6-cb82250067d5', 'f1c27b60-d638-4186-9f92-7ef334f74bc9', '49622d5e-0f6c-4a3b-aec7-547aab81a4b5', '9bde98f1-12dc-4287-b342-41f4b159266a'] {{(pid=87272) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 11:02:15 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-cd3242da-a1e0-4a57-bd39-65223028aaf1 tempest-TestImageHashVerification-383593588 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 11:02:15 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-cd3242da-a1e0-4a57-bd39-65223028aaf1 tempest-TestImageHashVerification-383593588 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 11:02:15 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-cd3242da-a1e0-4a57-bd39-65223028aaf1 tempest-TestImageHashVerification-383593588 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898': None} {{(pid=87272) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 11:02:15 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-cd3242da-a1e0-4a57-bd39-65223028aaf1 tempest-TestImageHashVerification-383593588 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'] {{(pid=87272) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 11:02:15 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-cd3242da-a1e0-4a57-bd39-65223028aaf1 tempest-TestImageHashVerification-383593588 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 11:02:15 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-cd3242da-a1e0-4a57-bd39-65223028aaf1 tempest-TestImageHashVerification-383593588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:02:15 devstack sudo[100973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1 Nov 04 11:02:15 devstack sudo[100973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:02:15 devstack sudo[100970]: pam_unix(sudo:session): session closed for user root Nov 04 11:02:15 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-814b1b1d-cf0d-46e7-8a60-d95ee63cb0f2 tempest-VolumesImageMetadata-610578380 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e21f1c05-a199-4b20-94c3-a13f8db1348a_v9llrecc" returned: 0 in 0.350s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:02:15 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-814b1b1d-cf0d-46e7-8a60-d95ee63cb0f2 tempest-VolumesImageMetadata-610578380 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e21f1c05-a199-4b20-94c3-a13f8db1348a_v9llrecc {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:02:15 devstack cinder-volume[87272]: DEBUG cinder.volume.flows.manager.create_volume [None req-ed78cdeb-ff50-4a8b-9b15-fe8544241fc0 tempest-VolumesListTestJSON-1678922499 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87272) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 11:02:15 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-ed78cdeb-ff50-4a8b-9b15-fe8544241fc0 tempest-VolumesListTestJSON-1678922499 None] Flow 'volume_create_manager' (78b11b68-b965-47cc-977b-0d490e8284c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 11:02:15 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-ed78cdeb-ff50-4a8b-9b15-fe8544241fc0 tempest-VolumesListTestJSON-1678922499 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (752fd54c-099d-463a-a3a1-0f88ffad7acc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:02:15 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-ed78cdeb-ff50-4a8b-9b15-fe8544241fc0 tempest-VolumesListTestJSON-1678922499 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (752fd54c-099d-463a-a3a1-0f88ffad7acc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T10:02:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-424875216',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc84c262-38ad-4c2e-93a2-719cb269bda7,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c678337d30c14ee89e280efae6478852',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T10:02:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T10:02:15Z,use_quota=True,user_id='2ad4219112be4ac988da3466fc052d86',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8989e4f-21e3-4f0a-9584-0d818784e883),volume_type_id=f8989e4f-21e3-4f0a-9584-0d818784e883)' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:02:15 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-ed78cdeb-ff50-4a8b-9b15-fe8544241fc0 tempest-VolumesListTestJSON-1678922499 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e4140b7f-33ce-4ec5-aa3d-d37b75c98c89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:02:15 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-ed78cdeb-ff50-4a8b-9b15-fe8544241fc0 tempest-VolumesListTestJSON-1678922499 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e4140b7f-33ce-4ec5-aa3d-d37b75c98c89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:02:15 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-ed78cdeb-ff50-4a8b-9b15-fe8544241fc0 tempest-VolumesListTestJSON-1678922499 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e458b5f5-3d48-4247-97d5-caafe94fa10f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:02:15 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-ed78cdeb-ff50-4a8b-9b15-fe8544241fc0 tempest-VolumesListTestJSON-1678922499 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e458b5f5-3d48-4247-97d5-caafe94fa10f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dc84c262-38ad-4c2e-93a2-719cb269bda7', 'volume_name': 'volume-dc84c262-38ad-4c2e-93a2-719cb269bda7', 'volume_size': 1}' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:02:15 devstack sudo[100977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e21f1c05-a199-4b20-94c3-a13f8db1348a_v9llrecc Nov 04 11:02:15 devstack sudo[100977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:02:15 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-ed78cdeb-ff50-4a8b-9b15-fe8544241fc0 tempest-VolumesListTestJSON-1678922499 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (092cb68e-5ae2-4215-b533-c444ec5d42a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:02:15 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-ed78cdeb-ff50-4a8b-9b15-fe8544241fc0 tempest-VolumesListTestJSON-1678922499 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (092cb68e-5ae2-4215-b533-c444ec5d42a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:02:15 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-ed78cdeb-ff50-4a8b-9b15-fe8544241fc0 tempest-VolumesListTestJSON-1678922499 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (607018eb-bc41-4949-9983-73f6d07512b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:02:15 devstack cinder-volume[87272]: INFO cinder.volume.flows.manager.create_volume [None req-ed78cdeb-ff50-4a8b-9b15-fe8544241fc0 tempest-VolumesListTestJSON-1678922499 None] Volume dc84c262-38ad-4c2e-93a2-719cb269bda7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dc84c262-38ad-4c2e-93a2-719cb269bda7', 'volume_size': 1} Nov 04 11:02:15 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-ed78cdeb-ff50-4a8b-9b15-fe8544241fc0 tempest-VolumesListTestJSON-1678922499 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 11:02:15 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-ed78cdeb-ff50-4a8b-9b15-fe8544241fc0 tempest-VolumesListTestJSON-1678922499 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 11:02:15 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-ed78cdeb-ff50-4a8b-9b15-fe8544241fc0 tempest-VolumesListTestJSON-1678922499 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T10:02:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-424875216',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc84c262-38ad-4c2e-93a2-719cb269bda7,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c678337d30c14ee89e280efae6478852',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T10:02:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T10:02:15Z,use_quota=True,user_id='2ad4219112be4ac988da3466fc052d86',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8989e4f-21e3-4f0a-9584-0d818784e883),volume_type_id=f8989e4f-21e3-4f0a-9584-0d818784e883)}" {{(pid=87272) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 04 11:02:15 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.remotefs [None req-ed78cdeb-ff50-4a8b-9b15-fe8544241fc0 tempest-VolumesListTestJSON-1678922499 None] Creating volume dc84c262-38ad-4c2e-93a2-719cb269bda7 {{(pid=87272) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 11:02:15 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-ed78cdeb-ff50-4a8b-9b15-fe8544241fc0 tempest-VolumesListTestJSON-1678922499 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 11:02:15 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-ed78cdeb-ff50-4a8b-9b15-fe8544241fc0 tempest-VolumesListTestJSON-1678922499 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 11:02:15 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-ed78cdeb-ff50-4a8b-9b15-fe8544241fc0 tempest-VolumesListTestJSON-1678922499 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898': None} {{(pid=87272) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 11:02:15 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-ed78cdeb-ff50-4a8b-9b15-fe8544241fc0 tempest-VolumesListTestJSON-1678922499 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'] {{(pid=87272) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 11:02:15 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-ed78cdeb-ff50-4a8b-9b15-fe8544241fc0 tempest-VolumesListTestJSON-1678922499 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 11:02:15 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-ed78cdeb-ff50-4a8b-9b15-fe8544241fc0 tempest-VolumesListTestJSON-1678922499 None] Selected osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898 as target Quobyte volume. {{(pid=87272) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 11:02:15 devstack cinder-volume[87272]: INFO cinder.volume.drivers.remotefs [None req-ed78cdeb-ff50-4a8b-9b15-fe8544241fc0 tempest-VolumesListTestJSON-1678922499 None] casted to osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898 Nov 04 11:02:15 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-ed78cdeb-ff50-4a8b-9b15-fe8544241fc0 tempest-VolumesListTestJSON-1678922499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-dc84c262-38ad-4c2e-93a2-719cb269bda7 1073741824 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:02:15 devstack sudo[100973]: pam_unix(sudo:session): session closed for user root Nov 04 11:02:15 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-cd3242da-a1e0-4a57-bd39-65223028aaf1 tempest-TestImageHashVerification-383593588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1" returned: 0 in 0.262s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:02:15 devstack cinder-volume[87272]: DEBUG cinder.manager [None req-cd3242da-a1e0-4a57-bd39-65223028aaf1 tempest-TestImageHashVerification-383593588 None] Notifying Schedulers of capabilities ... {{(pid=87272) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 11:02:15 devstack sudo[100980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-dc84c262-38ad-4c2e-93a2-719cb269bda7 1073741824 Nov 04 11:02:15 devstack sudo[100980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:02:15 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-cd3242da-a1e0-4a57-bd39-65223028aaf1 tempest-TestImageHashVerification-383593588 None] Deleted volume successfully. Nov 04 11:02:15 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-cd3242da-a1e0-4a57-bd39-65223028aaf1 tempest-TestImageHashVerification-383593588 None] Lock "cinder-5cab0739-c891-4a05-b972-3645568d2d5d-delete_volume" released by "delete_volume" :: held 1.257s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 11:02:15 devstack sudo[100977]: pam_unix(sudo:session): session closed for user root Nov 04 11:02:15 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-814b1b1d-cf0d-46e7-8a60-d95ee63cb0f2 tempest-VolumesImageMetadata-610578380 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e21f1c05-a199-4b20-94c3-a13f8db1348a_v9llrecc" returned: 1 in 0.367s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:02:15 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-814b1b1d-cf0d-46e7-8a60-d95ee63cb0f2 tempest-VolumesImageMetadata-610578380 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e21f1c05-a199-4b20-94c3-a13f8db1348a_v9llrecc' failed. Not Retrying. {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 04 11:02:15 devstack cinder-volume[87272]: DEBUG oslo.privsep.daemon [-] privsep: reply[39cc0219-738b-43bc-9dc3-fb7168c2541c]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 11:02:15 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-814b1b1d-cf0d-46e7-8a60-d95ee63cb0f2 tempest-VolumesImageMetadata-610578380 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e21f1c05-a199-4b20-94c3-a13f8db1348a_3pc35yiudevstack@QuobyteHD {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:02:15 devstack sudo[100984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e21f1c05-a199-4b20-94c3-a13f8db1348a_3pc35yiudevstack@QuobyteHD Nov 04 11:02:15 devstack sudo[100984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:02:16 devstack sudo[100980]: pam_unix(sudo:session): session closed for user root Nov 04 11:02:16 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-ed78cdeb-ff50-4a8b-9b15-fe8544241fc0 tempest-VolumesListTestJSON-1678922499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-dc84c262-38ad-4c2e-93a2-719cb269bda7 1073741824" returned: 0 in 0.490s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:02:16 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-ed78cdeb-ff50-4a8b-9b15-fe8544241fc0 tempest-VolumesListTestJSON-1678922499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-dc84c262-38ad-4c2e-93a2-719cb269bda7 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:02:16 devstack sudo[100991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-dc84c262-38ad-4c2e-93a2-719cb269bda7 Nov 04 11:02:16 devstack sudo[100991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:02:16 devstack sudo[100984]: pam_unix(sudo:session): session closed for user root Nov 04 11:02:16 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-814b1b1d-cf0d-46e7-8a60-d95ee63cb0f2 tempest-VolumesImageMetadata-610578380 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e21f1c05-a199-4b20-94c3-a13f8db1348a_3pc35yiudevstack@QuobyteHD" returned: 0 in 0.365s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:02:16 devstack cinder-volume[87272]: DEBUG cinder.image.image_utils [None req-814b1b1d-cf0d-46e7-8a60-d95ee63cb0f2 tempest-VolumesImageMetadata-610578380 None] e21f1c05-a199-4b20-94c3-a13f8db1348a was qcow2, converting to qcow2 {{(pid=87272) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Nov 04 11:02:16 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-814b1b1d-cf0d-46e7-8a60-d95ee63cb0f2 tempest-VolumesImageMetadata-610578380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_e21f1c05-a199-4b20-94c3-a13f8db1348a_3pc35yiudevstack@QuobyteHD /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-cb027d85-a97d-45cb-951f-9082f8d6df67 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:02:16 devstack sudo[100995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_e21f1c05-a199-4b20-94c3-a13f8db1348a_3pc35yiudevstack@QuobyteHD /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-cb027d85-a97d-45cb-951f-9082f8d6df67 Nov 04 11:02:16 devstack sudo[100995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:02:16 devstack sudo[100991]: pam_unix(sudo:session): session closed for user root Nov 04 11:02:16 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-ed78cdeb-ff50-4a8b-9b15-fe8544241fc0 tempest-VolumesListTestJSON-1678922499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-dc84c262-38ad-4c2e-93a2-719cb269bda7" returned: 0 in 0.309s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:02:16 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-ed78cdeb-ff50-4a8b-9b15-fe8544241fc0 tempest-VolumesListTestJSON-1678922499 None] <== create_volume: return (848ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'} {{(pid=87272) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 04 11:02:16 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-ed78cdeb-ff50-4a8b-9b15-fe8544241fc0 tempest-VolumesListTestJSON-1678922499 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.852s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 11:02:16 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-ed78cdeb-ff50-4a8b-9b15-fe8544241fc0 tempest-VolumesListTestJSON-1678922499 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (607018eb-bc41-4949-9983-73f6d07512b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dc84c262-38ad-4c2e-93a2-719cb269bda7', 'volume_size': 1}' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:02:16 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-ed78cdeb-ff50-4a8b-9b15-fe8544241fc0 tempest-VolumesListTestJSON-1678922499 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e66e5f77-42a6-4e90-9a55-cae1cd8e817b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:02:16 devstack cinder-volume[87272]: INFO cinder.volume.flows.manager.create_volume [None req-ed78cdeb-ff50-4a8b-9b15-fe8544241fc0 tempest-VolumesListTestJSON-1678922499 None] Volume volume-dc84c262-38ad-4c2e-93a2-719cb269bda7 (dc84c262-38ad-4c2e-93a2-719cb269bda7): created successfully Nov 04 11:02:16 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-ed78cdeb-ff50-4a8b-9b15-fe8544241fc0 tempest-VolumesListTestJSON-1678922499 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e66e5f77-42a6-4e90-9a55-cae1cd8e817b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:02:16 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-ed78cdeb-ff50-4a8b-9b15-fe8544241fc0 tempest-VolumesListTestJSON-1678922499 None] Flow 'volume_create_manager' (78b11b68-b965-47cc-977b-0d490e8284c6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87272) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 11:02:16 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-ed78cdeb-ff50-4a8b-9b15-fe8544241fc0 tempest-VolumesListTestJSON-1678922499 None] Created volume successfully. Nov 04 11:02:18 devstack sudo[100995]: pam_unix(sudo:session): session closed for user root Nov 04 11:02:18 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-814b1b1d-cf0d-46e7-8a60-d95ee63cb0f2 tempest-VolumesImageMetadata-610578380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_e21f1c05-a199-4b20-94c3-a13f8db1348a_3pc35yiudevstack@QuobyteHD /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-cb027d85-a97d-45cb-951f-9082f8d6df67" returned: 0 in 2.028s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:02:18 devstack cinder-volume[87272]: DEBUG cinder.image.image_utils [None req-814b1b1d-cf0d-46e7-8a60-d95ee63cb0f2 tempest-VolumesImageMetadata-610578380 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_e21f1c05-a199-4b20-94c3-a13f8db1348a_3pc35yiudevstack@QuobyteHD, size 112.00 MB, duration 2.03 sec, destination /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-cb027d85-a97d-45cb-951f-9082f8d6df67 {{(pid=87272) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Nov 04 11:02:18 devstack cinder-volume[87272]: INFO cinder.image.image_utils [None req-814b1b1d-cf0d-46e7-8a60-d95ee63cb0f2 tempest-VolumesImageMetadata-610578380 None] Converted 112.00 MB image at 55.20 MB/s Nov 04 11:02:18 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-814b1b1d-cf0d-46e7-8a60-d95ee63cb0f2 tempest-VolumesImageMetadata-610578380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-cb027d85-a97d-45cb-951f-9082f8d6df67 1G {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:02:18 devstack sudo[101007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-cb027d85-a97d-45cb-951f-9082f8d6df67 1G Nov 04 11:02:18 devstack sudo[101007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:02:18 devstack sudo[101007]: pam_unix(sudo:session): session closed for user root Nov 04 11:02:18 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-814b1b1d-cf0d-46e7-8a60-d95ee63cb0f2 tempest-VolumesImageMetadata-610578380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-cb027d85-a97d-45cb-951f-9082f8d6df67 1G" returned: 0 in 0.333s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:02:18 devstack cinder-volume[87272]: DEBUG cinder.volume.volume_utils [None req-814b1b1d-cf0d-46e7-8a60-d95ee63cb0f2 tempest-VolumesImageMetadata-610578380 None] Downloaded image e21f1c05-a199-4b20-94c3-a13f8db1348a ((None, [{'url': 'file:///opt/stack/data/glance/images/e21f1c05-a199-4b20-94c3-a13f8db1348a', 'metadata': {}}])) to volume cb027d85-a97d-45cb-951f-9082f8d6df67 successfully. {{(pid=87272) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Nov 04 11:02:18 devstack cinder-volume[87272]: DEBUG cinder.image.image_utils [None req-814b1b1d-cf0d-46e7-8a60-d95ee63cb0f2 tempest-VolumesImageMetadata-610578380 None] Temporary image e21f1c05-a199-4b20-94c3-a13f8db1348a for user d0e92c9ad0514aa2999b4ac7d3ee07d4 is deleted. {{(pid=87272) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Nov 04 11:02:18 devstack cinder-volume[87272]: DEBUG cinder.volume.volume_utils [None req-814b1b1d-cf0d-46e7-8a60-d95ee63cb0f2 tempest-VolumesImageMetadata-610578380 None] Marking volume cb027d85-a97d-45cb-951f-9082f8d6df67 as bootable. {{(pid=87272) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Nov 04 11:02:18 devstack cinder-volume[87272]: DEBUG cinder.volume.flows.manager.create_volume [None req-814b1b1d-cf0d-46e7-8a60-d95ee63cb0f2 tempest-VolumesImageMetadata-610578380 None] Copying metadata from image e21f1c05-a199-4b20-94c3-a13f8db1348a to cb027d85-a97d-45cb-951f-9082f8d6df67. {{(pid=87272) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 04 11:02:18 devstack cinder-volume[87272]: DEBUG cinder.volume.flows.manager.create_volume [None req-814b1b1d-cf0d-46e7-8a60-d95ee63cb0f2 tempest-VolumesImageMetadata-610578380 None] Creating volume glance metadata for volume cb027d85-a97d-45cb-951f-9082f8d6df67 backed by image e21f1c05-a199-4b20-94c3-a13f8db1348a with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'e21f1c05-a199-4b20-94c3-a13f8db1348a', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87272) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 04 11:02:18 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-814b1b1d-cf0d-46e7-8a60-d95ee63cb0f2 tempest-VolumesImageMetadata-610578380 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87fd2459-f7aa-4430-8a40-667bfdc0a938) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cb027d85-a97d-45cb-951f-9082f8d6df67', 'volume_size': 1, 'image_id': 'e21f1c05-a199-4b20-94c3-a13f8db1348a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e21f1c05-a199-4b20-94c3-a13f8db1348a', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'a0568d152f1945e380a1ac4afff5179c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'e21f1c05-a199-4b20-94c3-a13f8db1348a', 'created_at': datetime.datetime(2026, 11, 4, 9, 43, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 4, 9, 44, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e21f1c05-a199-4b20-94c3-a13f8db1348a/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:02:18 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-814b1b1d-cf0d-46e7-8a60-d95ee63cb0f2 tempest-VolumesImageMetadata-610578380 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb937892-4e16-4e24-bf35-d046e3a474f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:02:18 devstack cinder-volume[87272]: INFO cinder.volume.flows.manager.create_volume [None req-814b1b1d-cf0d-46e7-8a60-d95ee63cb0f2 tempest-VolumesImageMetadata-610578380 None] Volume volume-cb027d85-a97d-45cb-951f-9082f8d6df67 (cb027d85-a97d-45cb-951f-9082f8d6df67): created successfully Nov 04 11:02:18 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-814b1b1d-cf0d-46e7-8a60-d95ee63cb0f2 tempest-VolumesImageMetadata-610578380 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb937892-4e16-4e24-bf35-d046e3a474f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:02:18 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-814b1b1d-cf0d-46e7-8a60-d95ee63cb0f2 tempest-VolumesImageMetadata-610578380 None] Flow 'volume_create_manager' (64fb8434-3117-4696-b11b-a9c6a0b607b3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87272) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 11:02:18 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-814b1b1d-cf0d-46e7-8a60-d95ee63cb0f2 tempest-VolumesImageMetadata-610578380 None] Created volume successfully. Nov 04 11:02:19 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-b9def891-5375-4e6a-b53f-798e7adb9060 tempest-VolumesImageMetadata-610578380 None] Acquiring lock "cinder-cb027d85-a97d-45cb-951f-9082f8d6df67-delete_volume" by "delete_volume" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 11:02:19 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-b9def891-5375-4e6a-b53f-798e7adb9060 tempest-VolumesImageMetadata-610578380 None] Lock "cinder-cb027d85-a97d-45cb-951f-9082f8d6df67-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 11:02:19 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-b9def891-5375-4e6a-b53f-798e7adb9060 tempest-VolumesImageMetadata-610578380 None] Acquiring lock "cinder-quobyte-cb027d85-a97d-45cb-951f-9082f8d6df67" by "delete_volume" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 11:02:19 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-b9def891-5375-4e6a-b53f-798e7adb9060 tempest-VolumesImageMetadata-610578380 None] Lock "cinder-quobyte-cb027d85-a97d-45cb-951f-9082f8d6df67" acquired by "delete_volume" :: waited 0.016s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 11:02:19 devstack cinder-volume[87272]: DEBUG oslo.privsep.daemon [-] privsep: reply[e69ce02e-8772-44ea-ba41-934f2cce7250]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 11:02:19 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-b9def891-5375-4e6a-b53f-798e7adb9060 tempest-VolumesImageMetadata-610578380 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-cb027d85-a97d-45cb-951f-9082f8d6df67 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:02:19 devstack sudo[101013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-cb027d85-a97d-45cb-951f-9082f8d6df67 Nov 04 11:02:19 devstack sudo[101013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:02:20 devstack sudo[101013]: pam_unix(sudo:session): session closed for user root Nov 04 11:02:20 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-b9def891-5375-4e6a-b53f-798e7adb9060 tempest-VolumesImageMetadata-610578380 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-cb027d85-a97d-45cb-951f-9082f8d6df67" returned: 0 in 0.450s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:02:20 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-b9def891-5375-4e6a-b53f-798e7adb9060 tempest-VolumesImageMetadata-610578380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-cb027d85-a97d-45cb-951f-9082f8d6df67 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:02:20 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-25043bfa-5460-47e8-9eae-dd5cc9b3c236 tempest-VolumesListTestJSON-1678922499 None] Acquiring lock "cinder-dc84c262-38ad-4c2e-93a2-719cb269bda7-delete_volume" by "delete_volume" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 11:02:20 devstack sudo[101019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-cb027d85-a97d-45cb-951f-9082f8d6df67 Nov 04 11:02:20 devstack sudo[101019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:02:20 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-25043bfa-5460-47e8-9eae-dd5cc9b3c236 tempest-VolumesListTestJSON-1678922499 None] Lock "cinder-dc84c262-38ad-4c2e-93a2-719cb269bda7-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 11:02:20 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-25043bfa-5460-47e8-9eae-dd5cc9b3c236 tempest-VolumesListTestJSON-1678922499 None] Acquiring lock "cinder-quobyte-dc84c262-38ad-4c2e-93a2-719cb269bda7" by "delete_volume" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 11:02:20 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-25043bfa-5460-47e8-9eae-dd5cc9b3c236 tempest-VolumesListTestJSON-1678922499 None] Lock "cinder-quobyte-dc84c262-38ad-4c2e-93a2-719cb269bda7" acquired by "delete_volume" :: waited 0.030s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 11:02:20 devstack cinder-volume[87272]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f4af07f-cd16-49fd-87c5-27aeb81ba678]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 11:02:20 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-25043bfa-5460-47e8-9eae-dd5cc9b3c236 tempest-VolumesListTestJSON-1678922499 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-dc84c262-38ad-4c2e-93a2-719cb269bda7 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:02:20 devstack sudo[101021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-dc84c262-38ad-4c2e-93a2-719cb269bda7 Nov 04 11:02:20 devstack sudo[101021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:02:20 devstack sudo[101019]: pam_unix(sudo:session): session closed for user root Nov 04 11:02:20 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-b9def891-5375-4e6a-b53f-798e7adb9060 tempest-VolumesImageMetadata-610578380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-cb027d85-a97d-45cb-951f-9082f8d6df67" returned: 0 in 0.286s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:02:20 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-b9def891-5375-4e6a-b53f-798e7adb9060 tempest-VolumesImageMetadata-610578380 None] Lock "cinder-quobyte-cb027d85-a97d-45cb-951f-9082f8d6df67" released by "delete_volume" :: held 0.785s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 11:02:20 devstack cinder-volume[87272]: DEBUG cinder.quota [None req-b9def891-5375-4e6a-b53f-798e7adb9060 tempest-VolumesImageMetadata-610578380 None] Created reservations ['8fe5ec01-bf68-4e3f-b0a3-f3f755e7406d', '4633022d-a03d-4cb8-a54a-a0024ddceca5', '9a461488-bcf3-42a4-8381-84b12b480af6', '5ebc57fb-8f39-4991-9124-82dd8379ada7'] {{(pid=87272) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 11:02:20 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-b9def891-5375-4e6a-b53f-798e7adb9060 tempest-VolumesImageMetadata-610578380 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 11:02:20 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-b9def891-5375-4e6a-b53f-798e7adb9060 tempest-VolumesImageMetadata-610578380 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 11:02:20 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-b9def891-5375-4e6a-b53f-798e7adb9060 tempest-VolumesImageMetadata-610578380 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898': None} {{(pid=87272) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 11:02:20 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-b9def891-5375-4e6a-b53f-798e7adb9060 tempest-VolumesImageMetadata-610578380 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'] {{(pid=87272) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 11:02:20 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-b9def891-5375-4e6a-b53f-798e7adb9060 tempest-VolumesImageMetadata-610578380 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 11:02:20 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-b9def891-5375-4e6a-b53f-798e7adb9060 tempest-VolumesImageMetadata-610578380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:02:20 devstack sudo[101024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1 Nov 04 11:02:20 devstack sudo[101024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:02:20 devstack sudo[101021]: pam_unix(sudo:session): session closed for user root Nov 04 11:02:20 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-25043bfa-5460-47e8-9eae-dd5cc9b3c236 tempest-VolumesListTestJSON-1678922499 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-dc84c262-38ad-4c2e-93a2-719cb269bda7" returned: 0 in 0.444s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:02:20 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-25043bfa-5460-47e8-9eae-dd5cc9b3c236 tempest-VolumesListTestJSON-1678922499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-dc84c262-38ad-4c2e-93a2-719cb269bda7 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:02:20 devstack sudo[101029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-dc84c262-38ad-4c2e-93a2-719cb269bda7 Nov 04 11:02:20 devstack sudo[101029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:02:21 devstack sudo[101024]: pam_unix(sudo:session): session closed for user root Nov 04 11:02:21 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-b9def891-5375-4e6a-b53f-798e7adb9060 tempest-VolumesImageMetadata-610578380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1" returned: 0 in 0.287s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:02:21 devstack cinder-volume[87272]: DEBUG cinder.manager [None req-b9def891-5375-4e6a-b53f-798e7adb9060 tempest-VolumesImageMetadata-610578380 None] Notifying Schedulers of capabilities ... {{(pid=87272) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 11:02:21 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-b9def891-5375-4e6a-b53f-798e7adb9060 tempest-VolumesImageMetadata-610578380 None] Deleted volume successfully. Nov 04 11:02:21 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-b9def891-5375-4e6a-b53f-798e7adb9060 tempest-VolumesImageMetadata-610578380 None] Lock "cinder-cb027d85-a97d-45cb-951f-9082f8d6df67-delete_volume" released by "delete_volume" :: held 1.372s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 11:02:21 devstack sudo[101029]: pam_unix(sudo:session): session closed for user root Nov 04 11:02:21 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-25043bfa-5460-47e8-9eae-dd5cc9b3c236 tempest-VolumesListTestJSON-1678922499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-dc84c262-38ad-4c2e-93a2-719cb269bda7" returned: 0 in 0.381s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:02:21 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-25043bfa-5460-47e8-9eae-dd5cc9b3c236 tempest-VolumesListTestJSON-1678922499 None] Lock "cinder-quobyte-dc84c262-38ad-4c2e-93a2-719cb269bda7" released by "delete_volume" :: held 0.871s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 11:02:21 devstack cinder-volume[87272]: DEBUG cinder.quota [None req-25043bfa-5460-47e8-9eae-dd5cc9b3c236 tempest-VolumesListTestJSON-1678922499 None] Created reservations ['89b3528e-d059-4e6d-84a5-01913c310247', 'cdb2f1d2-62a6-43bc-af64-b95e6d3b22d7', '36f4924c-4f05-4a55-90b1-919edff3f79a', 'cf1b7485-0973-489d-8880-5bec64035876'] {{(pid=87272) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 11:02:21 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-25043bfa-5460-47e8-9eae-dd5cc9b3c236 tempest-VolumesListTestJSON-1678922499 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 11:02:21 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-25043bfa-5460-47e8-9eae-dd5cc9b3c236 tempest-VolumesListTestJSON-1678922499 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 11:02:21 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-25043bfa-5460-47e8-9eae-dd5cc9b3c236 tempest-VolumesListTestJSON-1678922499 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898': None} {{(pid=87272) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 11:02:21 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-25043bfa-5460-47e8-9eae-dd5cc9b3c236 tempest-VolumesListTestJSON-1678922499 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'] {{(pid=87272) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 11:02:21 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-25043bfa-5460-47e8-9eae-dd5cc9b3c236 tempest-VolumesListTestJSON-1678922499 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 11:02:21 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-25043bfa-5460-47e8-9eae-dd5cc9b3c236 tempest-VolumesListTestJSON-1678922499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:02:21 devstack sudo[101039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1 Nov 04 11:02:21 devstack sudo[101039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:02:21 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-eb74d14a-ec5a-4f66-84fc-02a34d38ee9c tempest-VolumesListTestJSON-1678922499 None] Acquiring lock "cinder-8f504661-7590-4314-8d9f-a307bc8b4450-delete_volume" by "delete_volume" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 11:02:21 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-eb74d14a-ec5a-4f66-84fc-02a34d38ee9c tempest-VolumesListTestJSON-1678922499 None] Lock "cinder-8f504661-7590-4314-8d9f-a307bc8b4450-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 11:02:21 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-eb74d14a-ec5a-4f66-84fc-02a34d38ee9c tempest-VolumesListTestJSON-1678922499 None] Acquiring lock "cinder-quobyte-8f504661-7590-4314-8d9f-a307bc8b4450" by "delete_volume" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 11:02:21 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-eb74d14a-ec5a-4f66-84fc-02a34d38ee9c tempest-VolumesListTestJSON-1678922499 None] Lock "cinder-quobyte-8f504661-7590-4314-8d9f-a307bc8b4450" acquired by "delete_volume" :: waited 0.024s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 11:02:21 devstack cinder-volume[87272]: DEBUG oslo.privsep.daemon [-] privsep: reply[68870353-9855-4288-8b3e-f98b2a94fa42]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 11:02:21 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-eb74d14a-ec5a-4f66-84fc-02a34d38ee9c tempest-VolumesListTestJSON-1678922499 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-8f504661-7590-4314-8d9f-a307bc8b4450 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:02:21 devstack sudo[101039]: pam_unix(sudo:session): session closed for user root Nov 04 11:02:21 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-25043bfa-5460-47e8-9eae-dd5cc9b3c236 tempest-VolumesListTestJSON-1678922499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1" returned: 0 in 0.376s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:02:21 devstack cinder-volume[87272]: DEBUG cinder.manager [None req-25043bfa-5460-47e8-9eae-dd5cc9b3c236 tempest-VolumesListTestJSON-1678922499 None] Notifying Schedulers of capabilities ... {{(pid=87272) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 11:02:21 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-25043bfa-5460-47e8-9eae-dd5cc9b3c236 tempest-VolumesListTestJSON-1678922499 None] Deleted volume successfully. Nov 04 11:02:21 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-25043bfa-5460-47e8-9eae-dd5cc9b3c236 tempest-VolumesListTestJSON-1678922499 None] Lock "cinder-dc84c262-38ad-4c2e-93a2-719cb269bda7-delete_volume" released by "delete_volume" :: held 1.510s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 11:02:21 devstack sudo[101042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-8f504661-7590-4314-8d9f-a307bc8b4450 Nov 04 11:02:21 devstack sudo[101042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:02:22 devstack sudo[101042]: pam_unix(sudo:session): session closed for user root Nov 04 11:02:22 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-eb74d14a-ec5a-4f66-84fc-02a34d38ee9c tempest-VolumesListTestJSON-1678922499 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-8f504661-7590-4314-8d9f-a307bc8b4450" returned: 0 in 0.452s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:02:22 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-eb74d14a-ec5a-4f66-84fc-02a34d38ee9c tempest-VolumesListTestJSON-1678922499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-8f504661-7590-4314-8d9f-a307bc8b4450 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:02:22 devstack sudo[101050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-8f504661-7590-4314-8d9f-a307bc8b4450 Nov 04 11:02:22 devstack sudo[101050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:02:22 devstack sudo[101050]: pam_unix(sudo:session): session closed for user root Nov 04 11:02:22 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-eb74d14a-ec5a-4f66-84fc-02a34d38ee9c tempest-VolumesListTestJSON-1678922499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-8f504661-7590-4314-8d9f-a307bc8b4450" returned: 0 in 0.273s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:02:22 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-eb74d14a-ec5a-4f66-84fc-02a34d38ee9c tempest-VolumesListTestJSON-1678922499 None] Lock "cinder-quobyte-8f504661-7590-4314-8d9f-a307bc8b4450" released by "delete_volume" :: held 0.789s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 11:02:22 devstack cinder-volume[87272]: DEBUG cinder.quota [None req-eb74d14a-ec5a-4f66-84fc-02a34d38ee9c tempest-VolumesListTestJSON-1678922499 None] Created reservations ['c67fd961-8999-4020-859b-df025da99c98', '2d712088-9928-4dd3-8314-8de594cd3718', '2e6a7cc4-6afb-47e5-a22a-4950fcdd9116', '5904801b-e77b-4bce-8ac9-22aadcfbcfc2'] {{(pid=87272) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 11:02:22 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-eb74d14a-ec5a-4f66-84fc-02a34d38ee9c tempest-VolumesListTestJSON-1678922499 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 11:02:22 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-eb74d14a-ec5a-4f66-84fc-02a34d38ee9c tempest-VolumesListTestJSON-1678922499 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 11:02:22 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-eb74d14a-ec5a-4f66-84fc-02a34d38ee9c tempest-VolumesListTestJSON-1678922499 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898': None} {{(pid=87272) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 11:02:22 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-eb74d14a-ec5a-4f66-84fc-02a34d38ee9c tempest-VolumesListTestJSON-1678922499 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'] {{(pid=87272) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 11:02:22 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-eb74d14a-ec5a-4f66-84fc-02a34d38ee9c tempest-VolumesListTestJSON-1678922499 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 11:02:22 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-eb74d14a-ec5a-4f66-84fc-02a34d38ee9c tempest-VolumesListTestJSON-1678922499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:02:22 devstack sudo[101053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1 Nov 04 11:02:22 devstack sudo[101053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:02:22 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-c5b50545-52b3-452a-ab14-9f12e6df2c15 tempest-VolumesListTestJSON-1678922499 None] Acquiring lock "cinder-fa6bc330-4fde-4ec6-9a2a-1d3009e2978c-delete_volume" by "delete_volume" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 11:02:22 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-c5b50545-52b3-452a-ab14-9f12e6df2c15 tempest-VolumesListTestJSON-1678922499 None] Lock "cinder-fa6bc330-4fde-4ec6-9a2a-1d3009e2978c-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 11:02:22 devstack sudo[101053]: pam_unix(sudo:session): session closed for user root Nov 04 11:02:22 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-eb74d14a-ec5a-4f66-84fc-02a34d38ee9c tempest-VolumesListTestJSON-1678922499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1" returned: 0 in 0.283s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:02:22 devstack cinder-volume[87272]: DEBUG cinder.manager [None req-eb74d14a-ec5a-4f66-84fc-02a34d38ee9c tempest-VolumesListTestJSON-1678922499 None] Notifying Schedulers of capabilities ... {{(pid=87272) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 11:02:22 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-eb74d14a-ec5a-4f66-84fc-02a34d38ee9c tempest-VolumesListTestJSON-1678922499 None] Deleted volume successfully. Nov 04 11:02:22 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-c5b50545-52b3-452a-ab14-9f12e6df2c15 tempest-VolumesListTestJSON-1678922499 None] Acquiring lock "cinder-quobyte-fa6bc330-4fde-4ec6-9a2a-1d3009e2978c" by "delete_volume" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 11:02:22 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-eb74d14a-ec5a-4f66-84fc-02a34d38ee9c tempest-VolumesListTestJSON-1678922499 None] Lock "cinder-8f504661-7590-4314-8d9f-a307bc8b4450-delete_volume" released by "delete_volume" :: held 1.341s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 11:02:22 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-c5b50545-52b3-452a-ab14-9f12e6df2c15 tempest-VolumesListTestJSON-1678922499 None] Lock "cinder-quobyte-fa6bc330-4fde-4ec6-9a2a-1d3009e2978c" acquired by "delete_volume" :: waited 0.020s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 11:02:22 devstack cinder-volume[87272]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d854cf0-8e81-4865-bfe0-94fdf3b1db8a]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 11:02:22 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-c5b50545-52b3-452a-ab14-9f12e6df2c15 tempest-VolumesListTestJSON-1678922499 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-fa6bc330-4fde-4ec6-9a2a-1d3009e2978c {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:02:23 devstack sudo[101057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-fa6bc330-4fde-4ec6-9a2a-1d3009e2978c Nov 04 11:02:23 devstack sudo[101057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:02:23 devstack sudo[101057]: pam_unix(sudo:session): session closed for user root Nov 04 11:02:23 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-c5b50545-52b3-452a-ab14-9f12e6df2c15 tempest-VolumesListTestJSON-1678922499 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-fa6bc330-4fde-4ec6-9a2a-1d3009e2978c" returned: 0 in 0.389s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:02:23 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-c5b50545-52b3-452a-ab14-9f12e6df2c15 tempest-VolumesListTestJSON-1678922499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-fa6bc330-4fde-4ec6-9a2a-1d3009e2978c {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:02:23 devstack sudo[101062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-fa6bc330-4fde-4ec6-9a2a-1d3009e2978c Nov 04 11:02:23 devstack sudo[101062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:02:23 devstack sudo[101062]: pam_unix(sudo:session): session closed for user root Nov 04 11:02:23 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-c5b50545-52b3-452a-ab14-9f12e6df2c15 tempest-VolumesListTestJSON-1678922499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-fa6bc330-4fde-4ec6-9a2a-1d3009e2978c" returned: 0 in 0.251s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:02:23 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-c5b50545-52b3-452a-ab14-9f12e6df2c15 tempest-VolumesListTestJSON-1678922499 None] Lock "cinder-quobyte-fa6bc330-4fde-4ec6-9a2a-1d3009e2978c" released by "delete_volume" :: held 0.691s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 11:02:23 devstack cinder-volume[87272]: DEBUG cinder.quota [None req-c5b50545-52b3-452a-ab14-9f12e6df2c15 tempest-VolumesListTestJSON-1678922499 None] Created reservations ['5353e6ab-e187-4601-8ef4-373524cefec6', '65601f79-6f48-4f93-81c4-f9d5dea4ce9c', 'faea6312-a95a-4266-81fd-784466bdbc9b', 'bff9ba78-f4ec-4204-9082-d0c4b75121ee'] {{(pid=87272) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 11:02:23 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-c5b50545-52b3-452a-ab14-9f12e6df2c15 tempest-VolumesListTestJSON-1678922499 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 11:02:23 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-c5b50545-52b3-452a-ab14-9f12e6df2c15 tempest-VolumesListTestJSON-1678922499 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 11:02:23 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-c5b50545-52b3-452a-ab14-9f12e6df2c15 tempest-VolumesListTestJSON-1678922499 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898': None} {{(pid=87272) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 11:02:23 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-c5b50545-52b3-452a-ab14-9f12e6df2c15 tempest-VolumesListTestJSON-1678922499 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'] {{(pid=87272) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 11:02:23 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-c5b50545-52b3-452a-ab14-9f12e6df2c15 tempest-VolumesListTestJSON-1678922499 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 11:02:23 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-c5b50545-52b3-452a-ab14-9f12e6df2c15 tempest-VolumesListTestJSON-1678922499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:02:23 devstack sudo[101065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1 Nov 04 11:02:23 devstack sudo[101065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:02:24 devstack sudo[101065]: pam_unix(sudo:session): session closed for user root Nov 04 11:02:24 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-c5b50545-52b3-452a-ab14-9f12e6df2c15 tempest-VolumesListTestJSON-1678922499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1" returned: 0 in 0.277s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:02:24 devstack cinder-volume[87272]: DEBUG cinder.manager [None req-c5b50545-52b3-452a-ab14-9f12e6df2c15 tempest-VolumesListTestJSON-1678922499 None] Notifying Schedulers of capabilities ... {{(pid=87272) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 11:02:24 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-c5b50545-52b3-452a-ab14-9f12e6df2c15 tempest-VolumesListTestJSON-1678922499 None] Deleted volume successfully. Nov 04 11:02:24 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-c5b50545-52b3-452a-ab14-9f12e6df2c15 tempest-VolumesListTestJSON-1678922499 None] Lock "cinder-fa6bc330-4fde-4ec6-9a2a-1d3009e2978c-delete_volume" released by "delete_volume" :: held 1.228s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 11:02:29 devstack cinder-volume[87272]: DEBUG cinder.volume.flows.manager.create_volume [None req-83733141-8755-4aca-a562-fce092c151dd tempest-VolumesCloneTest-1152148718 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87272) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 11:02:29 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-83733141-8755-4aca-a562-fce092c151dd tempest-VolumesCloneTest-1152148718 None] Flow 'volume_create_manager' (cd0d0358-b859-450b-a1a0-207490a5a6ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 11:02:29 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-83733141-8755-4aca-a562-fce092c151dd tempest-VolumesCloneTest-1152148718 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17b3dedb-e656-41ca-b426-85d4e9c36170) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:02:29 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-83733141-8755-4aca-a562-fce092c151dd tempest-VolumesCloneTest-1152148718 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17b3dedb-e656-41ca-b426-85d4e9c36170) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T10:02:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1577761580',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9fa7e631-b108-41cd-bc80-d5a3e4b3ff18,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='adcc28cdbe3f460cb792d7d951587dbc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T10:02:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T10:02:30Z,use_quota=True,user_id='864289474ca149919c334709bb628f28',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8989e4f-21e3-4f0a-9584-0d818784e883),volume_type_id=f8989e4f-21e3-4f0a-9584-0d818784e883)' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:02:29 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-83733141-8755-4aca-a562-fce092c151dd tempest-VolumesCloneTest-1152148718 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3bf06bd3-43ae-43af-8d96-4cb02d92c739) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:02:29 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-83733141-8755-4aca-a562-fce092c151dd tempest-VolumesCloneTest-1152148718 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3bf06bd3-43ae-43af-8d96-4cb02d92c739) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:02:29 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-83733141-8755-4aca-a562-fce092c151dd tempest-VolumesCloneTest-1152148718 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18f30c1b-b2c0-49a1-9c16-0ca37f60bc27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:02:29 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-83733141-8755-4aca-a562-fce092c151dd tempest-VolumesCloneTest-1152148718 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18f30c1b-b2c0-49a1-9c16-0ca37f60bc27) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9fa7e631-b108-41cd-bc80-d5a3e4b3ff18', 'volume_name': 'volume-9fa7e631-b108-41cd-bc80-d5a3e4b3ff18', 'volume_size': 1}' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:02:29 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-83733141-8755-4aca-a562-fce092c151dd tempest-VolumesCloneTest-1152148718 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f58f9ce2-0fef-4068-9956-d10236840d87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:02:29 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-83733141-8755-4aca-a562-fce092c151dd tempest-VolumesCloneTest-1152148718 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f58f9ce2-0fef-4068-9956-d10236840d87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:02:29 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-83733141-8755-4aca-a562-fce092c151dd tempest-VolumesCloneTest-1152148718 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07f9e52d-2525-4b63-be6b-7cad62b4e599) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:02:29 devstack cinder-volume[87272]: INFO cinder.volume.flows.manager.create_volume [None req-83733141-8755-4aca-a562-fce092c151dd tempest-VolumesCloneTest-1152148718 None] Volume 9fa7e631-b108-41cd-bc80-d5a3e4b3ff18: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9fa7e631-b108-41cd-bc80-d5a3e4b3ff18', 'volume_size': 1} Nov 04 11:02:29 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-83733141-8755-4aca-a562-fce092c151dd tempest-VolumesCloneTest-1152148718 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 11:02:29 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-83733141-8755-4aca-a562-fce092c151dd tempest-VolumesCloneTest-1152148718 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 11:02:29 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-83733141-8755-4aca-a562-fce092c151dd tempest-VolumesCloneTest-1152148718 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T10:02:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1577761580',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9fa7e631-b108-41cd-bc80-d5a3e4b3ff18,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='adcc28cdbe3f460cb792d7d951587dbc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T10:02:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T10:02:30Z,use_quota=True,user_id='864289474ca149919c334709bb628f28',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8989e4f-21e3-4f0a-9584-0d818784e883),volume_type_id=f8989e4f-21e3-4f0a-9584-0d818784e883)}" {{(pid=87272) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 04 11:02:29 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.remotefs [None req-83733141-8755-4aca-a562-fce092c151dd tempest-VolumesCloneTest-1152148718 None] Creating volume 9fa7e631-b108-41cd-bc80-d5a3e4b3ff18 {{(pid=87272) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 11:02:29 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-83733141-8755-4aca-a562-fce092c151dd tempest-VolumesCloneTest-1152148718 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 11:02:29 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-83733141-8755-4aca-a562-fce092c151dd tempest-VolumesCloneTest-1152148718 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 11:02:29 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-83733141-8755-4aca-a562-fce092c151dd tempest-VolumesCloneTest-1152148718 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898': None} {{(pid=87272) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 11:02:29 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-83733141-8755-4aca-a562-fce092c151dd tempest-VolumesCloneTest-1152148718 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'] {{(pid=87272) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 11:02:29 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-83733141-8755-4aca-a562-fce092c151dd tempest-VolumesCloneTest-1152148718 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 11:02:29 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-83733141-8755-4aca-a562-fce092c151dd tempest-VolumesCloneTest-1152148718 None] Selected osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898 as target Quobyte volume. {{(pid=87272) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 11:02:29 devstack cinder-volume[87272]: INFO cinder.volume.drivers.remotefs [None req-83733141-8755-4aca-a562-fce092c151dd tempest-VolumesCloneTest-1152148718 None] casted to osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898 Nov 04 11:02:29 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-83733141-8755-4aca-a562-fce092c151dd tempest-VolumesCloneTest-1152148718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-9fa7e631-b108-41cd-bc80-d5a3e4b3ff18 1073741824 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:02:29 devstack sudo[101111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-9fa7e631-b108-41cd-bc80-d5a3e4b3ff18 1073741824 Nov 04 11:02:29 devstack sudo[101111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:02:30 devstack sudo[101111]: pam_unix(sudo:session): session closed for user root Nov 04 11:02:30 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-83733141-8755-4aca-a562-fce092c151dd tempest-VolumesCloneTest-1152148718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-9fa7e631-b108-41cd-bc80-d5a3e4b3ff18 1073741824" returned: 0 in 0.511s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:02:30 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-83733141-8755-4aca-a562-fce092c151dd tempest-VolumesCloneTest-1152148718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-9fa7e631-b108-41cd-bc80-d5a3e4b3ff18 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:02:30 devstack sudo[101117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-9fa7e631-b108-41cd-bc80-d5a3e4b3ff18 Nov 04 11:02:30 devstack sudo[101117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:02:30 devstack sudo[101117]: pam_unix(sudo:session): session closed for user root Nov 04 11:02:30 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-83733141-8755-4aca-a562-fce092c151dd tempest-VolumesCloneTest-1152148718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-9fa7e631-b108-41cd-bc80-d5a3e4b3ff18" returned: 0 in 0.281s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:02:30 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-83733141-8755-4aca-a562-fce092c151dd tempest-VolumesCloneTest-1152148718 None] <== create_volume: return (843ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'} {{(pid=87272) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 04 11:02:30 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-83733141-8755-4aca-a562-fce092c151dd tempest-VolumesCloneTest-1152148718 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.846s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 11:02:30 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-83733141-8755-4aca-a562-fce092c151dd tempest-VolumesCloneTest-1152148718 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07f9e52d-2525-4b63-be6b-7cad62b4e599) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9fa7e631-b108-41cd-bc80-d5a3e4b3ff18', 'volume_size': 1}' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:02:30 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-83733141-8755-4aca-a562-fce092c151dd tempest-VolumesCloneTest-1152148718 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c1850e7a-c4e1-4d49-a624-3ff67286e241) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:02:30 devstack cinder-volume[87272]: INFO cinder.volume.flows.manager.create_volume [None req-83733141-8755-4aca-a562-fce092c151dd tempest-VolumesCloneTest-1152148718 None] Volume volume-9fa7e631-b108-41cd-bc80-d5a3e4b3ff18 (9fa7e631-b108-41cd-bc80-d5a3e4b3ff18): created successfully Nov 04 11:02:30 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-83733141-8755-4aca-a562-fce092c151dd tempest-VolumesCloneTest-1152148718 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c1850e7a-c4e1-4d49-a624-3ff67286e241) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:02:30 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-83733141-8755-4aca-a562-fce092c151dd tempest-VolumesCloneTest-1152148718 None] Flow 'volume_create_manager' (cd0d0358-b859-450b-a1a0-207490a5a6ad) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87272) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 11:02:30 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-83733141-8755-4aca-a562-fce092c151dd tempest-VolumesCloneTest-1152148718 None] Created volume successfully. Nov 04 11:02:32 devstack cinder-volume[87272]: DEBUG cinder.volume.flows.manager.create_volume [None req-8dc7420f-4798-4021-8b17-6881c9e76aeb tempest-VolumesCloneTest-1152148718 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87272) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 11:02:32 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-8dc7420f-4798-4021-8b17-6881c9e76aeb tempest-VolumesCloneTest-1152148718 None] Flow 'volume_create_manager' (b25fbd27-70d8-4f32-8b7f-cb4d81351be5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 11:02:32 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-8dc7420f-4798-4021-8b17-6881c9e76aeb tempest-VolumesCloneTest-1152148718 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3cf529a6-6774-42aa-b1ca-06a84879461e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:02:32 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-8dc7420f-4798-4021-8b17-6881c9e76aeb tempest-VolumesCloneTest-1152148718 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3cf529a6-6774-42aa-b1ca-06a84879461e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T10:02:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-713899183',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=14e3765d-88c7-4ab4-b3a1-4b358211f4bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='adcc28cdbe3f460cb792d7d951587dbc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T10:02:32Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=9fa7e631-b108-41cd-bc80-d5a3e4b3ff18,status='creating',terminated_at=None,updated_at=2026-11-04T10:02:32Z,use_quota=True,user_id='864289474ca149919c334709bb628f28',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8989e4f-21e3-4f0a-9584-0d818784e883),volume_type_id=f8989e4f-21e3-4f0a-9584-0d818784e883)' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:02:32 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-8dc7420f-4798-4021-8b17-6881c9e76aeb tempest-VolumesCloneTest-1152148718 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (137a9ca3-a30d-49a4-b0f2-a4191474d329) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:02:32 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-8dc7420f-4798-4021-8b17-6881c9e76aeb tempest-VolumesCloneTest-1152148718 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (137a9ca3-a30d-49a4-b0f2-a4191474d329) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:02:32 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-8dc7420f-4798-4021-8b17-6881c9e76aeb tempest-VolumesCloneTest-1152148718 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1985370-0b27-4946-8bc2-d249ac6d833e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:02:32 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-8dc7420f-4798-4021-8b17-6881c9e76aeb tempest-VolumesCloneTest-1152148718 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1985370-0b27-4946-8bc2-d249ac6d833e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '14e3765d-88c7-4ab4-b3a1-4b358211f4bd', 'volume_name': 'volume-14e3765d-88c7-4ab4-b3a1-4b358211f4bd', 'volume_size': 2, 'source_volid': '9fa7e631-b108-41cd-bc80-d5a3e4b3ff18', 'source_volstatus': 'available'}' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:02:32 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-8dc7420f-4798-4021-8b17-6881c9e76aeb tempest-VolumesCloneTest-1152148718 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (97bb8414-5ad8-4158-aac7-fdd4db29e61e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:02:32 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-8dc7420f-4798-4021-8b17-6881c9e76aeb tempest-VolumesCloneTest-1152148718 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (97bb8414-5ad8-4158-aac7-fdd4db29e61e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:02:32 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-8dc7420f-4798-4021-8b17-6881c9e76aeb tempest-VolumesCloneTest-1152148718 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d10b5a75-f900-45c8-a5e1-b23d70e33596) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:02:32 devstack cinder-volume[87272]: INFO cinder.volume.flows.manager.create_volume [None req-8dc7420f-4798-4021-8b17-6881c9e76aeb tempest-VolumesCloneTest-1152148718 None] Volume 14e3765d-88c7-4ab4-b3a1-4b358211f4bd: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-14e3765d-88c7-4ab4-b3a1-4b358211f4bd', 'volume_size': 2, 'source_volid': '9fa7e631-b108-41cd-bc80-d5a3e4b3ff18', 'source_volstatus': 'available'} Nov 04 11:02:32 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-8dc7420f-4798-4021-8b17-6881c9e76aeb tempest-VolumesCloneTest-1152148718 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 11:02:32 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-8dc7420f-4798-4021-8b17-6881c9e76aeb tempest-VolumesCloneTest-1152148718 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 11:02:32 devstack cinder-volume[87272]: INFO cinder.volume.drivers.remotefs [None req-8dc7420f-4798-4021-8b17-6881c9e76aeb tempest-VolumesCloneTest-1152148718 None] Cloning volume 9fa7e631-b108-41cd-bc80-d5a3e4b3ff18 to volume 14e3765d-88c7-4ab4-b3a1-4b358211f4bd Nov 04 11:02:32 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.remotefs [None req-8dc7420f-4798-4021-8b17-6881c9e76aeb tempest-VolumesCloneTest-1152148718 None] Creating offline snapshot 6262a852-144b-4081-a615-072d94ab1fd4 of volume 9fa7e631-b108-41cd-bc80-d5a3e4b3ff18 {{(pid=87272) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 04 11:02:32 devstack cinder-volume[87272]: DEBUG oslo.privsep.daemon [-] privsep: reply[d295bc14-eadf-4892-99d5-5a11c56f51bd]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 11:02:32 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-8dc7420f-4798-4021-8b17-6881c9e76aeb tempest-VolumesCloneTest-1152148718 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-9fa7e631-b108-41cd-bc80-d5a3e4b3ff18 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:02:32 devstack sudo[101120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-9fa7e631-b108-41cd-bc80-d5a3e4b3ff18 Nov 04 11:02:32 devstack sudo[101120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:02:33 devstack sudo[101120]: pam_unix(sudo:session): session closed for user root Nov 04 11:02:33 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-8dc7420f-4798-4021-8b17-6881c9e76aeb tempest-VolumesCloneTest-1152148718 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-9fa7e631-b108-41cd-bc80-d5a3e4b3ff18" returned: 0 in 0.520s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:02:33 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-8dc7420f-4798-4021-8b17-6881c9e76aeb tempest-VolumesCloneTest-1152148718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-9fa7e631-b108-41cd-bc80-d5a3e4b3ff18,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-9fa7e631-b108-41cd-bc80-d5a3e4b3ff18.6262a852-144b-4081-a615-072d94ab1fd4 1G {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:02:33 devstack sudo[101125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-9fa7e631-b108-41cd-bc80-d5a3e4b3ff18,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-9fa7e631-b108-41cd-bc80-d5a3e4b3ff18.6262a852-144b-4081-a615-072d94ab1fd4 1G Nov 04 11:02:33 devstack sudo[101125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:02:33 devstack sudo[101125]: pam_unix(sudo:session): session closed for user root Nov 04 11:02:33 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-8dc7420f-4798-4021-8b17-6881c9e76aeb tempest-VolumesCloneTest-1152148718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-9fa7e631-b108-41cd-bc80-d5a3e4b3ff18,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-9fa7e631-b108-41cd-bc80-d5a3e4b3ff18.6262a852-144b-4081-a615-072d94ab1fd4 1G" returned: 0 in 0.499s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:02:33 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-8dc7420f-4798-4021-8b17-6881c9e76aeb tempest-VolumesCloneTest-1152148718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9fa7e631-b108-41cd-bc80-d5a3e4b3ff18 -F qcow2 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-9fa7e631-b108-41cd-bc80-d5a3e4b3ff18.6262a852-144b-4081-a615-072d94ab1fd4 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:02:33 devstack sudo[101130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9fa7e631-b108-41cd-bc80-d5a3e4b3ff18 -F qcow2 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-9fa7e631-b108-41cd-bc80-d5a3e4b3ff18.6262a852-144b-4081-a615-072d94ab1fd4 Nov 04 11:02:33 devstack sudo[101130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:02:33 devstack cinder-volume[87272]: DEBUG cinder.volume.flows.manager.create_volume [None req-a19190ce-f293-4e2a-abb6-d538c0af2588 tempest-VolumeAndVolumeTypeFromImageTest-166070770 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87272) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 11:02:33 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-a19190ce-f293-4e2a-abb6-d538c0af2588 tempest-VolumeAndVolumeTypeFromImageTest-166070770 None] Flow 'volume_create_manager' (f5a2154a-9244-4244-a2cf-66770b865209) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 11:02:33 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-a19190ce-f293-4e2a-abb6-d538c0af2588 tempest-VolumeAndVolumeTypeFromImageTest-166070770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (121c69e6-af2c-49eb-b251-dfa5e10b9e33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:02:33 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-a19190ce-f293-4e2a-abb6-d538c0af2588 tempest-VolumeAndVolumeTypeFromImageTest-166070770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (121c69e6-af2c-49eb-b251-dfa5e10b9e33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T10:02:33Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb5bbf9f-18fc-47d9-8685-2586c55f3e37,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a8286f40b95d4ad19333d56cd8983066',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T10:02:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T10:02:34Z,use_quota=True,user_id='9a2acf430e654ce28311a2e464a9e2a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f4c6e37-b6d5-4faa-a946-e7c710ba7846),volume_type_id=8f4c6e37-b6d5-4faa-a946-e7c710ba7846)' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:02:33 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-a19190ce-f293-4e2a-abb6-d538c0af2588 tempest-VolumeAndVolumeTypeFromImageTest-166070770 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a5cf1a39-6e35-4b64-88d6-12e660c685e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:02:33 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-a19190ce-f293-4e2a-abb6-d538c0af2588 tempest-VolumeAndVolumeTypeFromImageTest-166070770 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a5cf1a39-6e35-4b64-88d6-12e660c685e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:02:33 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-a19190ce-f293-4e2a-abb6-d538c0af2588 tempest-VolumeAndVolumeTypeFromImageTest-166070770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (efa51121-2dfb-4e6d-b72a-1bda4cdff27f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:02:33 devstack cinder-volume[87272]: DEBUG cinder.image.glance [None req-a19190ce-f293-4e2a-abb6-d538c0af2588 tempest-VolumeAndVolumeTypeFromImageTest-166070770 None] Creating Keystone auth plugin from conf {{(pid=87272) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 04 11:02:34 devstack sudo[101130]: pam_unix(sudo:session): session closed for user root Nov 04 11:02:34 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-8dc7420f-4798-4021-8b17-6881c9e76aeb tempest-VolumesCloneTest-1152148718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9fa7e631-b108-41cd-bc80-d5a3e4b3ff18 -F qcow2 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-9fa7e631-b108-41cd-bc80-d5a3e4b3ff18.6262a852-144b-4081-a615-072d94ab1fd4" returned: 0 in 0.355s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:02:34 devstack cinder-volume[87272]: WARNING cinder.volume.drivers.remotefs [None req-8dc7420f-4798-4021-8b17-6881c9e76aeb tempest-VolumesCloneTest-1152148718 None] /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-9fa7e631-b108-41cd-bc80-d5a3e4b3ff18.6262a852-144b-4081-a615-072d94ab1fd4 is being set with open permissions: ugo+rw Nov 04 11:02:34 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-8dc7420f-4798-4021-8b17-6881c9e76aeb tempest-VolumesCloneTest-1152148718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-9fa7e631-b108-41cd-bc80-d5a3e4b3ff18.6262a852-144b-4081-a615-072d94ab1fd4 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:02:34 devstack sudo[101136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-9fa7e631-b108-41cd-bc80-d5a3e4b3ff18.6262a852-144b-4081-a615-072d94ab1fd4 Nov 04 11:02:34 devstack sudo[101136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:02:34 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-a19190ce-f293-4e2a-abb6-d538c0af2588 tempest-VolumeAndVolumeTypeFromImageTest-166070770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (efa51121-2dfb-4e6d-b72a-1bda4cdff27f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'cb5bbf9f-18fc-47d9-8685-2586c55f3e37', 'volume_name': 'volume-cb5bbf9f-18fc-47d9-8685-2586c55f3e37', 'volume_size': 1, 'image_id': 'b2a3576b-8b53-4457-8b68-7fa25affe173', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b2a3576b-8b53-4457-8b68-7fa25affe173', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'ebee5c78434ec5d74117b6a4c071fc77', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'a8286f40b95d4ad19333d56cd8983066', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1db0415a7df334fe082c2488b053447094a7e84b9c007884e0f5a267e9590d2264650b07ac14f78e7a0a5fd05dea1f1671c536d298a692391ba7279ac220bcd3', 'id': 'b2a3576b-8b53-4457-8b68-7fa25affe173', 'created_at': datetime.datetime(2026, 11, 4, 10, 2, 31, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 4, 10, 2, 33, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b2a3576b-8b53-4457-8b68-7fa25affe173/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:02:34 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-a19190ce-f293-4e2a-abb6-d538c0af2588 tempest-VolumeAndVolumeTypeFromImageTest-166070770 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (204b11aa-0931-475b-a60b-a258d6763ff8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:02:34 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-a19190ce-f293-4e2a-abb6-d538c0af2588 tempest-VolumeAndVolumeTypeFromImageTest-166070770 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (204b11aa-0931-475b-a60b-a258d6763ff8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:02:34 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-a19190ce-f293-4e2a-abb6-d538c0af2588 tempest-VolumeAndVolumeTypeFromImageTest-166070770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66124c32-0cb4-419f-8ad2-0e18b53aa53a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:02:34 devstack cinder-volume[87272]: INFO cinder.volume.flows.manager.create_volume [None req-a19190ce-f293-4e2a-abb6-d538c0af2588 tempest-VolumeAndVolumeTypeFromImageTest-166070770 None] Volume cb5bbf9f-18fc-47d9-8685-2586c55f3e37: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-cb5bbf9f-18fc-47d9-8685-2586c55f3e37', 'volume_size': 1, 'image_id': 'b2a3576b-8b53-4457-8b68-7fa25affe173', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b2a3576b-8b53-4457-8b68-7fa25affe173', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'ebee5c78434ec5d74117b6a4c071fc77', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'a8286f40b95d4ad19333d56cd8983066', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1db0415a7df334fe082c2488b053447094a7e84b9c007884e0f5a267e9590d2264650b07ac14f78e7a0a5fd05dea1f1671c536d298a692391ba7279ac220bcd3', 'id': 'b2a3576b-8b53-4457-8b68-7fa25affe173', 'created_at': datetime.datetime(2026, 11, 4, 10, 2, 31, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 4, 10, 2, 33, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b2a3576b-8b53-4457-8b68-7fa25affe173/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Nov 04 11:02:34 devstack cinder-volume[87272]: DEBUG cinder.volume.flows.manager.create_volume [None req-a19190ce-f293-4e2a-abb6-d538c0af2588 tempest-VolumeAndVolumeTypeFromImageTest-166070770 None] Trying to clone cb5bbf9f-18fc-47d9-8685-2586c55f3e37 from image b2a3576b-8b53-4457-8b68-7fa25affe173 at location (None, [{'url': 'file:///opt/stack/data/glance/images/b2a3576b-8b53-4457-8b68-7fa25affe173', 'metadata': {}}]). {{(pid=87272) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 04 11:02:34 devstack cinder-volume[87272]: DEBUG cinder.image.image_utils [None req-a19190ce-f293-4e2a-abb6-d538c0af2588 tempest-VolumeAndVolumeTypeFromImageTest-166070770 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_b2a3576b-8b53-4457-8b68-7fa25affe173_zblsqn7udevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87272) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Nov 04 11:02:34 devstack cinder-volume[87272]: INFO cinder.image.image_utils [None req-a19190ce-f293-4e2a-abb6-d538c0af2588 tempest-VolumeAndVolumeTypeFromImageTest-166070770 None] Image download 0.00 MB at 0.00 MB/s Nov 04 11:02:34 devstack cinder-volume[87272]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3da4307-b4e0-43e8-a75e-dd94dbffa1d8]: (4, 'raw') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 11:02:34 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-a19190ce-f293-4e2a-abb6-d538c0af2588 tempest-VolumeAndVolumeTypeFromImageTest-166070770 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b2a3576b-8b53-4457-8b68-7fa25affe173_zblsqn7udevstack@QuobyteHD {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:02:34 devstack sudo[101136]: pam_unix(sudo:session): session closed for user root Nov 04 11:02:34 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-8dc7420f-4798-4021-8b17-6881c9e76aeb tempest-VolumesCloneTest-1152148718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-9fa7e631-b108-41cd-bc80-d5a3e4b3ff18.6262a852-144b-4081-a615-072d94ab1fd4" returned: 0 in 0.345s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:02:34 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-8dc7420f-4798-4021-8b17-6881c9e76aeb tempest-VolumesCloneTest-1152148718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-9fa7e631-b108-41cd-bc80-d5a3e4b3ff18.info {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:02:34 devstack sudo[101139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b2a3576b-8b53-4457-8b68-7fa25affe173_zblsqn7udevstack@QuobyteHD Nov 04 11:02:34 devstack sudo[101139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:02:34 devstack sudo[101140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-9fa7e631-b108-41cd-bc80-d5a3e4b3ff18.info Nov 04 11:02:34 devstack sudo[101140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:02:34 devstack sudo[101139]: pam_unix(sudo:session): session closed for user root Nov 04 11:02:34 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-a19190ce-f293-4e2a-abb6-d538c0af2588 tempest-VolumeAndVolumeTypeFromImageTest-166070770 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b2a3576b-8b53-4457-8b68-7fa25affe173_zblsqn7udevstack@QuobyteHD" returned: 0 in 0.401s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:02:34 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-a19190ce-f293-4e2a-abb6-d538c0af2588 tempest-VolumeAndVolumeTypeFromImageTest-166070770 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b2a3576b-8b53-4457-8b68-7fa25affe173_zblsqn7udevstack@QuobyteHD {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:02:34 devstack sudo[101140]: pam_unix(sudo:session): session closed for user root Nov 04 11:02:34 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-8dc7420f-4798-4021-8b17-6881c9e76aeb tempest-VolumesCloneTest-1152148718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-9fa7e631-b108-41cd-bc80-d5a3e4b3ff18.info" returned: 0 in 0.374s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:02:34 devstack cinder-volume[87272]: WARNING cinder.volume.drivers.remotefs [None req-8dc7420f-4798-4021-8b17-6881c9e76aeb tempest-VolumesCloneTest-1152148718 None] /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-9fa7e631-b108-41cd-bc80-d5a3e4b3ff18.info is being set with open permissions: ugo+rw Nov 04 11:02:34 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-8dc7420f-4798-4021-8b17-6881c9e76aeb tempest-VolumesCloneTest-1152148718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-9fa7e631-b108-41cd-bc80-d5a3e4b3ff18.info {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:02:34 devstack sudo[101147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-9fa7e631-b108-41cd-bc80-d5a3e4b3ff18.info Nov 04 11:02:34 devstack sudo[101147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:02:34 devstack sudo[101146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b2a3576b-8b53-4457-8b68-7fa25affe173_zblsqn7udevstack@QuobyteHD Nov 04 11:02:34 devstack sudo[101146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:02:35 devstack sudo[101147]: pam_unix(sudo:session): session closed for user root Nov 04 11:02:35 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-8dc7420f-4798-4021-8b17-6881c9e76aeb tempest-VolumesCloneTest-1152148718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-9fa7e631-b108-41cd-bc80-d5a3e4b3ff18.info" returned: 0 in 0.319s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:02:35 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-8dc7420f-4798-4021-8b17-6881c9e76aeb tempest-VolumesCloneTest-1152148718 None] Acquiring lock "cinder-quobyte-14e3765d-88c7-4ab4-b3a1-4b358211f4bd" by "_copy_volume_from_snapshot" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 11:02:35 devstack sudo[101146]: pam_unix(sudo:session): session closed for user root Nov 04 11:02:35 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-a19190ce-f293-4e2a-abb6-d538c0af2588 tempest-VolumeAndVolumeTypeFromImageTest-166070770 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b2a3576b-8b53-4457-8b68-7fa25affe173_zblsqn7udevstack@QuobyteHD" returned: 1 in 0.424s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:02:35 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-a19190ce-f293-4e2a-abb6-d538c0af2588 tempest-VolumeAndVolumeTypeFromImageTest-166070770 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b2a3576b-8b53-4457-8b68-7fa25affe173_zblsqn7udevstack@QuobyteHD' failed. Not Retrying. {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 04 11:02:35 devstack cinder-volume[87272]: DEBUG cinder.image.image_utils [None req-a19190ce-f293-4e2a-abb6-d538c0af2588 tempest-VolumeAndVolumeTypeFromImageTest-166070770 None] Temporary image b2a3576b-8b53-4457-8b68-7fa25affe173 is fetched for user 9a2acf430e654ce28311a2e464a9e2a5. {{(pid=87272) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Nov 04 11:02:35 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-8dc7420f-4798-4021-8b17-6881c9e76aeb tempest-VolumesCloneTest-1152148718 None] Lock "cinder-quobyte-14e3765d-88c7-4ab4-b3a1-4b358211f4bd" acquired by "_copy_volume_from_snapshot" :: waited 0.026s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 11:02:35 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-8dc7420f-4798-4021-8b17-6881c9e76aeb tempest-VolumesCloneTest-1152148718 None] snapshot: 6262a852-144b-4081-a615-072d94ab1fd4, volume: 14e3765d-88c7-4ab4-b3a1-4b358211f4bd, {{(pid=87272) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 04 11:02:35 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-8dc7420f-4798-4021-8b17-6881c9e76aeb tempest-VolumesCloneTest-1152148718 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 11:02:35 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-8dc7420f-4798-4021-8b17-6881c9e76aeb tempest-VolumesCloneTest-1152148718 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 11:02:35 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-8dc7420f-4798-4021-8b17-6881c9e76aeb tempest-VolumesCloneTest-1152148718 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898': None} {{(pid=87272) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 11:02:35 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-8dc7420f-4798-4021-8b17-6881c9e76aeb tempest-VolumesCloneTest-1152148718 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'] {{(pid=87272) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 11:02:35 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-8dc7420f-4798-4021-8b17-6881c9e76aeb tempest-VolumesCloneTest-1152148718 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 11:02:35 devstack cinder-volume[87272]: DEBUG oslo.privsep.daemon [-] privsep: reply[50cf1acf-0493-48dd-8832-309d1366191b]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 11:02:35 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-8dc7420f-4798-4021-8b17-6881c9e76aeb tempest-VolumesCloneTest-1152148718 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-9fa7e631-b108-41cd-bc80-d5a3e4b3ff18.6262a852-144b-4081-a615-072d94ab1fd4 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:02:35 devstack cinder-volume[87272]: DEBUG oslo.privsep.daemon [-] privsep: reply[f60b8f38-c40b-46ec-9099-55921eca2696]: (4, 'raw') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 11:02:35 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-a19190ce-f293-4e2a-abb6-d538c0af2588 tempest-VolumeAndVolumeTypeFromImageTest-166070770 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b2a3576b-8b53-4457-8b68-7fa25affe173_zblsqn7udevstack@QuobyteHD {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:02:35 devstack sudo[101154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-9fa7e631-b108-41cd-bc80-d5a3e4b3ff18.6262a852-144b-4081-a615-072d94ab1fd4 Nov 04 11:02:35 devstack sudo[101154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:02:35 devstack sudo[101155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b2a3576b-8b53-4457-8b68-7fa25affe173_zblsqn7udevstack@QuobyteHD Nov 04 11:02:35 devstack sudo[101155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:02:35 devstack sudo[101155]: pam_unix(sudo:session): session closed for user root Nov 04 11:02:35 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-a19190ce-f293-4e2a-abb6-d538c0af2588 tempest-VolumeAndVolumeTypeFromImageTest-166070770 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b2a3576b-8b53-4457-8b68-7fa25affe173_zblsqn7udevstack@QuobyteHD" returned: 0 in 0.385s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:02:35 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-a19190ce-f293-4e2a-abb6-d538c0af2588 tempest-VolumeAndVolumeTypeFromImageTest-166070770 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b2a3576b-8b53-4457-8b68-7fa25affe173_zblsqn7udevstack@QuobyteHD {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:02:35 devstack sudo[101154]: pam_unix(sudo:session): session closed for user root Nov 04 11:02:35 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-8dc7420f-4798-4021-8b17-6881c9e76aeb tempest-VolumesCloneTest-1152148718 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-9fa7e631-b108-41cd-bc80-d5a3e4b3ff18.6262a852-144b-4081-a615-072d94ab1fd4" returned: 0 in 0.463s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:02:35 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.remotefs [None req-8dc7420f-4798-4021-8b17-6881c9e76aeb tempest-VolumesCloneTest-1152148718 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9fa7e631-b108-41cd-bc80-d5a3e4b3ff18(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87272) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 11:02:35 devstack cinder-volume[87272]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5e416c9-bbf5-4cb5-90a2-75652c6b9d93]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 11:02:35 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-8dc7420f-4798-4021-8b17-6881c9e76aeb tempest-VolumesCloneTest-1152148718 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-9fa7e631-b108-41cd-bc80-d5a3e4b3ff18 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:02:35 devstack sudo[101164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b2a3576b-8b53-4457-8b68-7fa25affe173_zblsqn7udevstack@QuobyteHD Nov 04 11:02:35 devstack sudo[101164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:02:35 devstack sudo[101165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-9fa7e631-b108-41cd-bc80-d5a3e4b3ff18 Nov 04 11:02:35 devstack sudo[101165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:02:36 devstack sudo[101164]: pam_unix(sudo:session): session closed for user root Nov 04 11:02:36 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-a19190ce-f293-4e2a-abb6-d538c0af2588 tempest-VolumeAndVolumeTypeFromImageTest-166070770 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b2a3576b-8b53-4457-8b68-7fa25affe173_zblsqn7udevstack@QuobyteHD" returned: 1 in 0.358s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:02:36 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-a19190ce-f293-4e2a-abb6-d538c0af2588 tempest-VolumeAndVolumeTypeFromImageTest-166070770 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b2a3576b-8b53-4457-8b68-7fa25affe173_zblsqn7udevstack@QuobyteHD' failed. Not Retrying. {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 04 11:02:36 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-a19190ce-f293-4e2a-abb6-d538c0af2588 tempest-VolumeAndVolumeTypeFromImageTest-166070770 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 11:02:36 devstack sudo[101165]: pam_unix(sudo:session): session closed for user root Nov 04 11:02:36 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-8dc7420f-4798-4021-8b17-6881c9e76aeb tempest-VolumesCloneTest-1152148718 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-9fa7e631-b108-41cd-bc80-d5a3e4b3ff18" returned: 0 in 0.386s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:02:36 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-8dc7420f-4798-4021-8b17-6881c9e76aeb tempest-VolumesCloneTest-1152148718 None] will copy from snapshot at /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-9fa7e631-b108-41cd-bc80-d5a3e4b3ff18 {{(pid=87272) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 04 11:02:36 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-8dc7420f-4798-4021-8b17-6881c9e76aeb tempest-VolumesCloneTest-1152148718 None] Creating direct copy from snapshot {{(pid=87272) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 04 11:02:36 devstack cinder-volume[87272]: DEBUG cinder.utils [None req-8dc7420f-4798-4021-8b17-6881c9e76aeb tempest-VolumesCloneTest-1152148718 None] Path /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-14e3765d-88c7-4ab4-b3a1-4b358211f4bd not found in is_blk_device check {{(pid=87272) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Nov 04 11:02:36 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-8dc7420f-4798-4021-8b17-6881c9e76aeb tempest-VolumesCloneTest-1152148718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-9fa7e631-b108-41cd-bc80-d5a3e4b3ff18 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-14e3765d-88c7-4ab4-b3a1-4b358211f4bd {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:02:36 devstack sudo[101174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-9fa7e631-b108-41cd-bc80-d5a3e4b3ff18 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-14e3765d-88c7-4ab4-b3a1-4b358211f4bd Nov 04 11:02:36 devstack sudo[101174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:02:40 devstack cinder-volume[87272]: DEBUG cinder.volume.flows.manager.create_volume [None req-c7ed6f32-dd36-4dde-95d5-435128c06d6f tempest-VolumesSnapshotTestJSON-1399894899 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87272) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 11:02:40 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-c7ed6f32-dd36-4dde-95d5-435128c06d6f tempest-VolumesSnapshotTestJSON-1399894899 None] Flow 'volume_create_manager' (02fab3c2-b114-4e12-a89b-cffd69bc5807) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 11:02:40 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-c7ed6f32-dd36-4dde-95d5-435128c06d6f tempest-VolumesSnapshotTestJSON-1399894899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ca310f5-7a10-4a72-a9c4-483fdc49bbaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:02:40 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-c7ed6f32-dd36-4dde-95d5-435128c06d6f tempest-VolumesSnapshotTestJSON-1399894899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ca310f5-7a10-4a72-a9c4-483fdc49bbaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T10:02:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-47515280',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ca2c72a0-f9e3-43e0-a5da-6c65737c50ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef099de5b8794b308a0c8f182ca0fca1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T10:02:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T10:02:41Z,use_quota=True,user_id='73239b009fea418ba15cb75342ef934d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8989e4f-21e3-4f0a-9584-0d818784e883),volume_type_id=f8989e4f-21e3-4f0a-9584-0d818784e883)' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:02:40 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-c7ed6f32-dd36-4dde-95d5-435128c06d6f tempest-VolumesSnapshotTestJSON-1399894899 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (484a2932-3e39-46ae-82d5-b9e72ff52c8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:02:40 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-c7ed6f32-dd36-4dde-95d5-435128c06d6f tempest-VolumesSnapshotTestJSON-1399894899 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (484a2932-3e39-46ae-82d5-b9e72ff52c8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:02:41 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-c7ed6f32-dd36-4dde-95d5-435128c06d6f tempest-VolumesSnapshotTestJSON-1399894899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d32421d3-2492-425f-b9c5-9428f9b267a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:02:41 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-c7ed6f32-dd36-4dde-95d5-435128c06d6f tempest-VolumesSnapshotTestJSON-1399894899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d32421d3-2492-425f-b9c5-9428f9b267a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ca2c72a0-f9e3-43e0-a5da-6c65737c50ee', 'volume_name': 'volume-ca2c72a0-f9e3-43e0-a5da-6c65737c50ee', 'volume_size': 1}' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:02:41 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-c7ed6f32-dd36-4dde-95d5-435128c06d6f tempest-VolumesSnapshotTestJSON-1399894899 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a83ca373-dc1f-4d7d-8558-86cb8f3ab76a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:02:41 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-c7ed6f32-dd36-4dde-95d5-435128c06d6f tempest-VolumesSnapshotTestJSON-1399894899 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a83ca373-dc1f-4d7d-8558-86cb8f3ab76a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:02:41 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-c7ed6f32-dd36-4dde-95d5-435128c06d6f tempest-VolumesSnapshotTestJSON-1399894899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (850626a3-4e2c-42b5-989c-a407295f8400) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:02:41 devstack cinder-volume[87272]: INFO cinder.volume.flows.manager.create_volume [None req-c7ed6f32-dd36-4dde-95d5-435128c06d6f tempest-VolumesSnapshotTestJSON-1399894899 None] Volume ca2c72a0-f9e3-43e0-a5da-6c65737c50ee: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ca2c72a0-f9e3-43e0-a5da-6c65737c50ee', 'volume_size': 1} Nov 04 11:02:41 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-c7ed6f32-dd36-4dde-95d5-435128c06d6f tempest-VolumesSnapshotTestJSON-1399894899 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 11:02:42 devstack sudo[101174]: pam_unix(sudo:session): session closed for user root Nov 04 11:02:42 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-8dc7420f-4798-4021-8b17-6881c9e76aeb tempest-VolumesCloneTest-1152148718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-9fa7e631-b108-41cd-bc80-d5a3e4b3ff18 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-14e3765d-88c7-4ab4-b3a1-4b358211f4bd" returned: 0 in 6.525s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:02:42 devstack cinder-volume[87272]: DEBUG cinder.image.image_utils [None req-8dc7420f-4798-4021-8b17-6881c9e76aeb tempest-VolumesCloneTest-1152148718 None] Image conversion details: src /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-9fa7e631-b108-41cd-bc80-d5a3e4b3ff18, size 1024.00 MB, duration 6.53 sec, destination /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-14e3765d-88c7-4ab4-b3a1-4b358211f4bd {{(pid=87272) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Nov 04 11:02:42 devstack cinder-volume[87272]: INFO cinder.image.image_utils [None req-8dc7420f-4798-4021-8b17-6881c9e76aeb tempest-VolumesCloneTest-1152148718 None] Converted 1024.00 MB image at 156.90 MB/s Nov 04 11:02:42 devstack cinder-volume[87272]: WARNING cinder.volume.drivers.remotefs [None req-8dc7420f-4798-4021-8b17-6881c9e76aeb tempest-VolumesCloneTest-1152148718 None] /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-14e3765d-88c7-4ab4-b3a1-4b358211f4bd is being set with open permissions: ugo+rw Nov 04 11:02:42 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-8dc7420f-4798-4021-8b17-6881c9e76aeb tempest-VolumesCloneTest-1152148718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-14e3765d-88c7-4ab4-b3a1-4b358211f4bd {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:02:42 devstack sudo[101188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-14e3765d-88c7-4ab4-b3a1-4b358211f4bd Nov 04 11:02:42 devstack sudo[101188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:02:42 devstack sudo[101188]: pam_unix(sudo:session): session closed for user root Nov 04 11:02:42 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-8dc7420f-4798-4021-8b17-6881c9e76aeb tempest-VolumesCloneTest-1152148718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-14e3765d-88c7-4ab4-b3a1-4b358211f4bd" returned: 0 in 0.234s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:02:42 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-8dc7420f-4798-4021-8b17-6881c9e76aeb tempest-VolumesCloneTest-1152148718 None] Lock "cinder-quobyte-14e3765d-88c7-4ab4-b3a1-4b358211f4bd" released by "_copy_volume_from_snapshot" :: held 7.709s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 11:02:42 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-8dc7420f-4798-4021-8b17-6881c9e76aeb tempest-VolumesCloneTest-1152148718 None] Acquiring lock "cinder-quobyte-6262a852-144b-4081-a615-072d94ab1fd4" by "_delete_snapshot" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 11:02:42 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-8dc7420f-4798-4021-8b17-6881c9e76aeb tempest-VolumesCloneTest-1152148718 None] Lock "cinder-quobyte-6262a852-144b-4081-a615-072d94ab1fd4" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 11:02:42 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.remotefs [None req-8dc7420f-4798-4021-8b17-6881c9e76aeb tempest-VolumesCloneTest-1152148718 None] Deleting offline snapshot 6262a852-144b-4081-a615-072d94ab1fd4 of volume 9fa7e631-b108-41cd-bc80-d5a3e4b3ff18 {{(pid=87272) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 04 11:02:42 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.remotefs [None req-8dc7420f-4798-4021-8b17-6881c9e76aeb tempest-VolumesCloneTest-1152148718 None] snapshot_file for this snap is: volume-9fa7e631-b108-41cd-bc80-d5a3e4b3ff18.6262a852-144b-4081-a615-072d94ab1fd4 {{(pid=87272) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 04 11:02:42 devstack cinder-volume[87272]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ecef1db-d313-428c-a70d-8ca92ae377e2]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 11:02:42 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-8dc7420f-4798-4021-8b17-6881c9e76aeb tempest-VolumesCloneTest-1152148718 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-9fa7e631-b108-41cd-bc80-d5a3e4b3ff18.6262a852-144b-4081-a615-072d94ab1fd4 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:02:43 devstack sudo[101191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-9fa7e631-b108-41cd-bc80-d5a3e4b3ff18.6262a852-144b-4081-a615-072d94ab1fd4 Nov 04 11:02:43 devstack sudo[101191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:02:43 devstack sudo[101191]: pam_unix(sudo:session): session closed for user root Nov 04 11:02:43 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-8dc7420f-4798-4021-8b17-6881c9e76aeb tempest-VolumesCloneTest-1152148718 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-9fa7e631-b108-41cd-bc80-d5a3e4b3ff18.6262a852-144b-4081-a615-072d94ab1fd4" returned: 0 in 0.360s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:02:43 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.remotefs [None req-8dc7420f-4798-4021-8b17-6881c9e76aeb tempest-VolumesCloneTest-1152148718 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9fa7e631-b108-41cd-bc80-d5a3e4b3ff18(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87272) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 11:02:43 devstack cinder-volume[87272]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d962493-51f1-4dc2-b7a9-e322c9fb7293]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 11:02:43 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-8dc7420f-4798-4021-8b17-6881c9e76aeb tempest-VolumesCloneTest-1152148718 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-9fa7e631-b108-41cd-bc80-d5a3e4b3ff18 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:02:43 devstack sudo[101196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-9fa7e631-b108-41cd-bc80-d5a3e4b3ff18 Nov 04 11:02:43 devstack sudo[101196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:02:43 devstack sudo[101196]: pam_unix(sudo:session): session closed for user root Nov 04 11:02:43 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-8dc7420f-4798-4021-8b17-6881c9e76aeb tempest-VolumesCloneTest-1152148718 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-9fa7e631-b108-41cd-bc80-d5a3e4b3ff18" returned: 0 in 0.512s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:02:43 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-8dc7420f-4798-4021-8b17-6881c9e76aeb tempest-VolumesCloneTest-1152148718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-9fa7e631-b108-41cd-bc80-d5a3e4b3ff18.6262a852-144b-4081-a615-072d94ab1fd4 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:02:43 devstack sudo[101201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-9fa7e631-b108-41cd-bc80-d5a3e4b3ff18.6262a852-144b-4081-a615-072d94ab1fd4 Nov 04 11:02:43 devstack sudo[101201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:02:44 devstack sudo[101201]: pam_unix(sudo:session): session closed for user root Nov 04 11:02:44 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-8dc7420f-4798-4021-8b17-6881c9e76aeb tempest-VolumesCloneTest-1152148718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-9fa7e631-b108-41cd-bc80-d5a3e4b3ff18.6262a852-144b-4081-a615-072d94ab1fd4" returned: 0 in 0.318s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:02:44 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-8dc7420f-4798-4021-8b17-6881c9e76aeb tempest-VolumesCloneTest-1152148718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-9fa7e631-b108-41cd-bc80-d5a3e4b3ff18.6262a852-144b-4081-a615-072d94ab1fd4 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:02:44 devstack sudo[101206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-9fa7e631-b108-41cd-bc80-d5a3e4b3ff18.6262a852-144b-4081-a615-072d94ab1fd4 Nov 04 11:02:44 devstack sudo[101206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:02:44 devstack sudo[101206]: pam_unix(sudo:session): session closed for user root Nov 04 11:02:44 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-8dc7420f-4798-4021-8b17-6881c9e76aeb tempest-VolumesCloneTest-1152148718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-9fa7e631-b108-41cd-bc80-d5a3e4b3ff18.6262a852-144b-4081-a615-072d94ab1fd4" returned: 0 in 0.253s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:02:44 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-8dc7420f-4798-4021-8b17-6881c9e76aeb tempest-VolumesCloneTest-1152148718 None] Lock "cinder-quobyte-6262a852-144b-4081-a615-072d94ab1fd4" released by "_delete_snapshot" :: held 1.543s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 11:02:44 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-8dc7420f-4798-4021-8b17-6881c9e76aeb tempest-VolumesCloneTest-1152148718 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 11.889s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 11:02:44 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-a19190ce-f293-4e2a-abb6-d538c0af2588 tempest-VolumeAndVolumeTypeFromImageTest-166070770 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.459s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 11:02:44 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-a19190ce-f293-4e2a-abb6-d538c0af2588 tempest-VolumeAndVolumeTypeFromImageTest-166070770 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T10:02:33Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb5bbf9f-18fc-47d9-8685-2586c55f3e37,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a8286f40b95d4ad19333d56cd8983066',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T10:02:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T10:02:34Z,use_quota=True,user_id='9a2acf430e654ce28311a2e464a9e2a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f4c6e37-b6d5-4faa-a946-e7c710ba7846),volume_type_id=8f4c6e37-b6d5-4faa-a946-e7c710ba7846)}" {{(pid=87272) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 04 11:02:44 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.remotefs [None req-a19190ce-f293-4e2a-abb6-d538c0af2588 tempest-VolumeAndVolumeTypeFromImageTest-166070770 None] Creating volume cb5bbf9f-18fc-47d9-8685-2586c55f3e37 {{(pid=87272) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 11:02:44 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-a19190ce-f293-4e2a-abb6-d538c0af2588 tempest-VolumeAndVolumeTypeFromImageTest-166070770 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 11:02:44 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-a19190ce-f293-4e2a-abb6-d538c0af2588 tempest-VolumeAndVolumeTypeFromImageTest-166070770 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 11:02:44 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-a19190ce-f293-4e2a-abb6-d538c0af2588 tempest-VolumeAndVolumeTypeFromImageTest-166070770 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898': None} {{(pid=87272) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 11:02:44 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-a19190ce-f293-4e2a-abb6-d538c0af2588 tempest-VolumeAndVolumeTypeFromImageTest-166070770 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'] {{(pid=87272) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 11:02:44 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-a19190ce-f293-4e2a-abb6-d538c0af2588 tempest-VolumeAndVolumeTypeFromImageTest-166070770 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 11:02:44 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-a19190ce-f293-4e2a-abb6-d538c0af2588 tempest-VolumeAndVolumeTypeFromImageTest-166070770 None] Selected osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898 as target Quobyte volume. {{(pid=87272) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 11:02:44 devstack cinder-volume[87272]: INFO cinder.volume.drivers.remotefs [None req-a19190ce-f293-4e2a-abb6-d538c0af2588 tempest-VolumeAndVolumeTypeFromImageTest-166070770 None] casted to osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898 Nov 04 11:02:44 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-a19190ce-f293-4e2a-abb6-d538c0af2588 tempest-VolumeAndVolumeTypeFromImageTest-166070770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-cb5bbf9f-18fc-47d9-8685-2586c55f3e37 1073741824 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:02:44 devstack sudo[101209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-cb5bbf9f-18fc-47d9-8685-2586c55f3e37 1073741824 Nov 04 11:02:44 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-8dc7420f-4798-4021-8b17-6881c9e76aeb tempest-VolumesCloneTest-1152148718 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d10b5a75-f900-45c8-a5e1-b23d70e33596) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-14e3765d-88c7-4ab4-b3a1-4b358211f4bd', 'volume_size': 2, 'source_volid': '9fa7e631-b108-41cd-bc80-d5a3e4b3ff18', 'source_volstatus': 'available'}' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:02:44 devstack sudo[101209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:02:44 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-8dc7420f-4798-4021-8b17-6881c9e76aeb tempest-VolumesCloneTest-1152148718 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33fa94b3-9048-4317-860b-8a3036ce797d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:02:44 devstack cinder-volume[87272]: INFO cinder.volume.flows.manager.create_volume [None req-8dc7420f-4798-4021-8b17-6881c9e76aeb tempest-VolumesCloneTest-1152148718 None] Volume volume-14e3765d-88c7-4ab4-b3a1-4b358211f4bd (14e3765d-88c7-4ab4-b3a1-4b358211f4bd): created successfully Nov 04 11:02:44 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-8dc7420f-4798-4021-8b17-6881c9e76aeb tempest-VolumesCloneTest-1152148718 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33fa94b3-9048-4317-860b-8a3036ce797d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:02:44 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-8dc7420f-4798-4021-8b17-6881c9e76aeb tempest-VolumesCloneTest-1152148718 None] Flow 'volume_create_manager' (b25fbd27-70d8-4f32-8b7f-cb4d81351be5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87272) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 11:02:44 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-8dc7420f-4798-4021-8b17-6881c9e76aeb tempest-VolumesCloneTest-1152148718 None] Created volume successfully. Nov 04 11:02:44 devstack sudo[101209]: pam_unix(sudo:session): session closed for user root Nov 04 11:02:44 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-a19190ce-f293-4e2a-abb6-d538c0af2588 tempest-VolumeAndVolumeTypeFromImageTest-166070770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-cb5bbf9f-18fc-47d9-8685-2586c55f3e37 1073741824" returned: 0 in 0.418s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:02:44 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-a19190ce-f293-4e2a-abb6-d538c0af2588 tempest-VolumeAndVolumeTypeFromImageTest-166070770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-cb5bbf9f-18fc-47d9-8685-2586c55f3e37 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:02:45 devstack sudo[101215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-cb5bbf9f-18fc-47d9-8685-2586c55f3e37 Nov 04 11:02:45 devstack sudo[101215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:02:45 devstack sudo[101215]: pam_unix(sudo:session): session closed for user root Nov 04 11:02:45 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-a19190ce-f293-4e2a-abb6-d538c0af2588 tempest-VolumeAndVolumeTypeFromImageTest-166070770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-cb5bbf9f-18fc-47d9-8685-2586c55f3e37" returned: 0 in 0.238s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:02:45 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-a19190ce-f293-4e2a-abb6-d538c0af2588 tempest-VolumeAndVolumeTypeFromImageTest-166070770 None] <== create_volume: return (707ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'} {{(pid=87272) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 04 11:02:45 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-a19190ce-f293-4e2a-abb6-d538c0af2588 tempest-VolumeAndVolumeTypeFromImageTest-166070770 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.712s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 11:02:45 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-c7ed6f32-dd36-4dde-95d5-435128c06d6f tempest-VolumesSnapshotTestJSON-1399894899 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.193s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 11:02:45 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-c7ed6f32-dd36-4dde-95d5-435128c06d6f tempest-VolumesSnapshotTestJSON-1399894899 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T10:02:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-47515280',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ca2c72a0-f9e3-43e0-a5da-6c65737c50ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef099de5b8794b308a0c8f182ca0fca1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T10:02:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T10:02:41Z,use_quota=True,user_id='73239b009fea418ba15cb75342ef934d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8989e4f-21e3-4f0a-9584-0d818784e883),volume_type_id=f8989e4f-21e3-4f0a-9584-0d818784e883)}" {{(pid=87272) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 04 11:02:45 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.remotefs [None req-c7ed6f32-dd36-4dde-95d5-435128c06d6f tempest-VolumesSnapshotTestJSON-1399894899 None] Creating volume ca2c72a0-f9e3-43e0-a5da-6c65737c50ee {{(pid=87272) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 11:02:45 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-c7ed6f32-dd36-4dde-95d5-435128c06d6f tempest-VolumesSnapshotTestJSON-1399894899 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 11:02:45 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-c7ed6f32-dd36-4dde-95d5-435128c06d6f tempest-VolumesSnapshotTestJSON-1399894899 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 11:02:45 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-c7ed6f32-dd36-4dde-95d5-435128c06d6f tempest-VolumesSnapshotTestJSON-1399894899 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898': None} {{(pid=87272) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 11:02:45 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-c7ed6f32-dd36-4dde-95d5-435128c06d6f tempest-VolumesSnapshotTestJSON-1399894899 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'] {{(pid=87272) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 11:02:45 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-c7ed6f32-dd36-4dde-95d5-435128c06d6f tempest-VolumesSnapshotTestJSON-1399894899 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 11:02:45 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-c7ed6f32-dd36-4dde-95d5-435128c06d6f tempest-VolumesSnapshotTestJSON-1399894899 None] Selected osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898 as target Quobyte volume. {{(pid=87272) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 11:02:45 devstack cinder-volume[87272]: INFO cinder.volume.drivers.remotefs [None req-c7ed6f32-dd36-4dde-95d5-435128c06d6f tempest-VolumesSnapshotTestJSON-1399894899 None] casted to osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898 Nov 04 11:02:45 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-c7ed6f32-dd36-4dde-95d5-435128c06d6f tempest-VolumesSnapshotTestJSON-1399894899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-ca2c72a0-f9e3-43e0-a5da-6c65737c50ee 1073741824 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:02:45 devstack sudo[101218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-ca2c72a0-f9e3-43e0-a5da-6c65737c50ee 1073741824 Nov 04 11:02:45 devstack sudo[101218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:02:45 devstack cinder-volume[87272]: DEBUG cinder.volume.volume_utils [None req-a19190ce-f293-4e2a-abb6-d538c0af2588 tempest-VolumeAndVolumeTypeFromImageTest-166070770 None] Attempting download of b2a3576b-8b53-4457-8b68-7fa25affe173 ((None, [{'url': 'file:///opt/stack/data/glance/images/b2a3576b-8b53-4457-8b68-7fa25affe173', 'metadata': {}}])) to volume cb5bbf9f-18fc-47d9-8685-2586c55f3e37. {{(pid=87272) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Nov 04 11:02:45 devstack cinder-volume[87272]: DEBUG oslo.privsep.daemon [-] privsep: reply[82090481-0885-42e2-b6be-169f7a0c7e2d]: (4, 'raw') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 11:02:45 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-a19190ce-f293-4e2a-abb6-d538c0af2588 tempest-VolumeAndVolumeTypeFromImageTest-166070770 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b2a3576b-8b53-4457-8b68-7fa25affe173_wrl809g6 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:02:45 devstack sudo[101220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b2a3576b-8b53-4457-8b68-7fa25affe173_wrl809g6 Nov 04 11:02:45 devstack sudo[101220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:02:45 devstack sudo[101220]: pam_unix(sudo:session): session closed for user root Nov 04 11:02:45 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-a19190ce-f293-4e2a-abb6-d538c0af2588 tempest-VolumeAndVolumeTypeFromImageTest-166070770 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b2a3576b-8b53-4457-8b68-7fa25affe173_wrl809g6" returned: 0 in 0.347s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:02:45 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-a19190ce-f293-4e2a-abb6-d538c0af2588 tempest-VolumeAndVolumeTypeFromImageTest-166070770 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b2a3576b-8b53-4457-8b68-7fa25affe173_wrl809g6 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:02:45 devstack sudo[101218]: pam_unix(sudo:session): session closed for user root Nov 04 11:02:45 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-c7ed6f32-dd36-4dde-95d5-435128c06d6f tempest-VolumesSnapshotTestJSON-1399894899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-ca2c72a0-f9e3-43e0-a5da-6c65737c50ee 1073741824" returned: 0 in 0.504s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:02:45 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-c7ed6f32-dd36-4dde-95d5-435128c06d6f tempest-VolumesSnapshotTestJSON-1399894899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-ca2c72a0-f9e3-43e0-a5da-6c65737c50ee {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:02:45 devstack sudo[101228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b2a3576b-8b53-4457-8b68-7fa25affe173_wrl809g6 Nov 04 11:02:45 devstack sudo[101228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:02:45 devstack sudo[101230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-ca2c72a0-f9e3-43e0-a5da-6c65737c50ee Nov 04 11:02:45 devstack sudo[101230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:02:45 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-fa8be4e5-282b-4830-b226-b1b6e2348acf tempest-VolumesCloneTest-1152148718 None] Acquiring lock "cinder-14e3765d-88c7-4ab4-b3a1-4b358211f4bd-delete_volume" by "delete_volume" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 11:02:45 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-fa8be4e5-282b-4830-b226-b1b6e2348acf tempest-VolumesCloneTest-1152148718 None] Lock "cinder-14e3765d-88c7-4ab4-b3a1-4b358211f4bd-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 11:02:45 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-fa8be4e5-282b-4830-b226-b1b6e2348acf tempest-VolumesCloneTest-1152148718 None] Acquiring lock "cinder-quobyte-14e3765d-88c7-4ab4-b3a1-4b358211f4bd" by "delete_volume" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 11:02:45 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-fa8be4e5-282b-4830-b226-b1b6e2348acf tempest-VolumesCloneTest-1152148718 None] Lock "cinder-quobyte-14e3765d-88c7-4ab4-b3a1-4b358211f4bd" acquired by "delete_volume" :: waited 0.015s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 11:02:45 devstack cinder-volume[87272]: DEBUG oslo.privsep.daemon [-] privsep: reply[4debda32-aeb7-4986-94c6-1748d4880014]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 11:02:45 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-fa8be4e5-282b-4830-b226-b1b6e2348acf tempest-VolumesCloneTest-1152148718 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-14e3765d-88c7-4ab4-b3a1-4b358211f4bd {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:02:46 devstack sudo[101228]: pam_unix(sudo:session): session closed for user root Nov 04 11:02:46 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-a19190ce-f293-4e2a-abb6-d538c0af2588 tempest-VolumeAndVolumeTypeFromImageTest-166070770 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b2a3576b-8b53-4457-8b68-7fa25affe173_wrl809g6" returned: 1 in 0.364s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:02:46 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-a19190ce-f293-4e2a-abb6-d538c0af2588 tempest-VolumeAndVolumeTypeFromImageTest-166070770 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b2a3576b-8b53-4457-8b68-7fa25affe173_wrl809g6' failed. Not Retrying. {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 04 11:02:46 devstack cinder-volume[87272]: DEBUG oslo.privsep.daemon [-] privsep: reply[eab97a84-edd7-402f-bc67-edca75ed0710]: (4, 'raw') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 11:02:46 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-a19190ce-f293-4e2a-abb6-d538c0af2588 tempest-VolumeAndVolumeTypeFromImageTest-166070770 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b2a3576b-8b53-4457-8b68-7fa25affe173_zblsqn7udevstack@QuobyteHD {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:02:46 devstack sudo[101230]: pam_unix(sudo:session): session closed for user root Nov 04 11:02:46 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-c7ed6f32-dd36-4dde-95d5-435128c06d6f tempest-VolumesSnapshotTestJSON-1399894899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-ca2c72a0-f9e3-43e0-a5da-6c65737c50ee" returned: 0 in 0.307s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:02:46 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-c7ed6f32-dd36-4dde-95d5-435128c06d6f tempest-VolumesSnapshotTestJSON-1399894899 None] <== create_volume: return (866ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'} {{(pid=87272) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 04 11:02:46 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-c7ed6f32-dd36-4dde-95d5-435128c06d6f tempest-VolumesSnapshotTestJSON-1399894899 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.870s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 11:02:46 devstack sudo[101233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-14e3765d-88c7-4ab4-b3a1-4b358211f4bd Nov 04 11:02:46 devstack sudo[101233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:02:46 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-c7ed6f32-dd36-4dde-95d5-435128c06d6f tempest-VolumesSnapshotTestJSON-1399894899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (850626a3-4e2c-42b5-989c-a407295f8400) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ca2c72a0-f9e3-43e0-a5da-6c65737c50ee', 'volume_size': 1}' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:02:46 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-c7ed6f32-dd36-4dde-95d5-435128c06d6f tempest-VolumesSnapshotTestJSON-1399894899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f8aa6ddd-b02b-4aa0-b063-f6070489b9fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:02:46 devstack cinder-volume[87272]: INFO cinder.volume.flows.manager.create_volume [None req-c7ed6f32-dd36-4dde-95d5-435128c06d6f tempest-VolumesSnapshotTestJSON-1399894899 None] Volume volume-ca2c72a0-f9e3-43e0-a5da-6c65737c50ee (ca2c72a0-f9e3-43e0-a5da-6c65737c50ee): created successfully Nov 04 11:02:46 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-c7ed6f32-dd36-4dde-95d5-435128c06d6f tempest-VolumesSnapshotTestJSON-1399894899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f8aa6ddd-b02b-4aa0-b063-f6070489b9fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:02:46 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-c7ed6f32-dd36-4dde-95d5-435128c06d6f tempest-VolumesSnapshotTestJSON-1399894899 None] Flow 'volume_create_manager' (02fab3c2-b114-4e12-a89b-cffd69bc5807) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87272) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 11:02:46 devstack sudo[101236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b2a3576b-8b53-4457-8b68-7fa25affe173_zblsqn7udevstack@QuobyteHD Nov 04 11:02:46 devstack sudo[101236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:02:46 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-c7ed6f32-dd36-4dde-95d5-435128c06d6f tempest-VolumesSnapshotTestJSON-1399894899 None] Created volume successfully. Nov 04 11:02:46 devstack sudo[101233]: pam_unix(sudo:session): session closed for user root Nov 04 11:02:46 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-fa8be4e5-282b-4830-b226-b1b6e2348acf tempest-VolumesCloneTest-1152148718 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-14e3765d-88c7-4ab4-b3a1-4b358211f4bd" returned: 0 in 0.385s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:02:46 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-fa8be4e5-282b-4830-b226-b1b6e2348acf tempest-VolumesCloneTest-1152148718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-14e3765d-88c7-4ab4-b3a1-4b358211f4bd {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:02:46 devstack sudo[101236]: pam_unix(sudo:session): session closed for user root Nov 04 11:02:46 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-a19190ce-f293-4e2a-abb6-d538c0af2588 tempest-VolumeAndVolumeTypeFromImageTest-166070770 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b2a3576b-8b53-4457-8b68-7fa25affe173_zblsqn7udevstack@QuobyteHD" returned: 0 in 0.341s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:02:46 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-a19190ce-f293-4e2a-abb6-d538c0af2588 tempest-VolumeAndVolumeTypeFromImageTest-166070770 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b2a3576b-8b53-4457-8b68-7fa25affe173_zblsqn7udevstack@QuobyteHD {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:02:46 devstack sudo[101245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-14e3765d-88c7-4ab4-b3a1-4b358211f4bd Nov 04 11:02:46 devstack sudo[101245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:02:46 devstack sudo[101246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b2a3576b-8b53-4457-8b68-7fa25affe173_zblsqn7udevstack@QuobyteHD Nov 04 11:02:46 devstack sudo[101246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:02:46 devstack sudo[101245]: pam_unix(sudo:session): session closed for user root Nov 04 11:02:46 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-fa8be4e5-282b-4830-b226-b1b6e2348acf tempest-VolumesCloneTest-1152148718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-14e3765d-88c7-4ab4-b3a1-4b358211f4bd" returned: 0 in 0.264s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:02:46 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-fa8be4e5-282b-4830-b226-b1b6e2348acf tempest-VolumesCloneTest-1152148718 None] Lock "cinder-quobyte-14e3765d-88c7-4ab4-b3a1-4b358211f4bd" released by "delete_volume" :: held 0.697s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 11:02:46 devstack cinder-volume[87272]: DEBUG cinder.quota [None req-fa8be4e5-282b-4830-b226-b1b6e2348acf tempest-VolumesCloneTest-1152148718 None] Created reservations ['792180a5-3a2f-4f28-b942-72eb940898d1', '28072d34-796d-40fc-acf3-61435037e269', 'ce33d4a2-0d70-4667-aec8-da8327bb4cdf', '88dcc6da-bec3-4f6a-bdf8-1255184121eb'] {{(pid=87272) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 11:02:46 devstack sudo[101246]: pam_unix(sudo:session): session closed for user root Nov 04 11:02:46 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-a19190ce-f293-4e2a-abb6-d538c0af2588 tempest-VolumeAndVolumeTypeFromImageTest-166070770 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b2a3576b-8b53-4457-8b68-7fa25affe173_zblsqn7udevstack@QuobyteHD" returned: 1 in 0.330s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:02:46 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-a19190ce-f293-4e2a-abb6-d538c0af2588 tempest-VolumeAndVolumeTypeFromImageTest-166070770 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b2a3576b-8b53-4457-8b68-7fa25affe173_zblsqn7udevstack@QuobyteHD' failed. Not Retrying. {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 04 11:02:46 devstack cinder-volume[87272]: DEBUG cinder.image.image_utils [None req-a19190ce-f293-4e2a-abb6-d538c0af2588 tempest-VolumeAndVolumeTypeFromImageTest-166070770 None] b2a3576b-8b53-4457-8b68-7fa25affe173 was raw, converting to qcow2 {{(pid=87272) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Nov 04 11:02:46 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-a19190ce-f293-4e2a-abb6-d538c0af2588 tempest-VolumeAndVolumeTypeFromImageTest-166070770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_b2a3576b-8b53-4457-8b68-7fa25affe173_zblsqn7udevstack@QuobyteHD /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-cb5bbf9f-18fc-47d9-8685-2586c55f3e37 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:02:46 devstack sudo[101253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_b2a3576b-8b53-4457-8b68-7fa25affe173_zblsqn7udevstack@QuobyteHD /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-cb5bbf9f-18fc-47d9-8685-2586c55f3e37 Nov 04 11:02:46 devstack sudo[101253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:02:46 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-fa8be4e5-282b-4830-b226-b1b6e2348acf tempest-VolumesCloneTest-1152148718 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 11:02:46 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-fa8be4e5-282b-4830-b226-b1b6e2348acf tempest-VolumesCloneTest-1152148718 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 11:02:46 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-fa8be4e5-282b-4830-b226-b1b6e2348acf tempest-VolumesCloneTest-1152148718 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898': None} {{(pid=87272) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 11:02:46 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-fa8be4e5-282b-4830-b226-b1b6e2348acf tempest-VolumesCloneTest-1152148718 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'] {{(pid=87272) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 11:02:46 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-fa8be4e5-282b-4830-b226-b1b6e2348acf tempest-VolumesCloneTest-1152148718 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 11:02:46 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-fa8be4e5-282b-4830-b226-b1b6e2348acf tempest-VolumesCloneTest-1152148718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:02:46 devstack sudo[101255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1 Nov 04 11:02:46 devstack sudo[101255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:02:47 devstack sudo[101255]: pam_unix(sudo:session): session closed for user root Nov 04 11:02:47 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-fa8be4e5-282b-4830-b226-b1b6e2348acf tempest-VolumesCloneTest-1152148718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1" returned: 0 in 0.262s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:02:47 devstack cinder-volume[87272]: DEBUG cinder.manager [None req-fa8be4e5-282b-4830-b226-b1b6e2348acf tempest-VolumesCloneTest-1152148718 None] Notifying Schedulers of capabilities ... {{(pid=87272) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 11:02:47 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-fa8be4e5-282b-4830-b226-b1b6e2348acf tempest-VolumesCloneTest-1152148718 None] Deleted volume successfully. Nov 04 11:02:47 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-fa8be4e5-282b-4830-b226-b1b6e2348acf tempest-VolumesCloneTest-1152148718 None] Lock "cinder-14e3765d-88c7-4ab4-b3a1-4b358211f4bd-delete_volume" released by "delete_volume" :: held 1.190s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 11:02:47 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-e658a0df-53af-4bc2-8ca0-13e481526f77 tempest-VolumesCloneTest-1152148718 None] Acquiring lock "cinder-9fa7e631-b108-41cd-bc80-d5a3e4b3ff18-delete_volume" by "delete_volume" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 11:02:47 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-e658a0df-53af-4bc2-8ca0-13e481526f77 tempest-VolumesCloneTest-1152148718 None] Lock "cinder-9fa7e631-b108-41cd-bc80-d5a3e4b3ff18-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 11:02:47 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-e658a0df-53af-4bc2-8ca0-13e481526f77 tempest-VolumesCloneTest-1152148718 None] Acquiring lock "cinder-quobyte-9fa7e631-b108-41cd-bc80-d5a3e4b3ff18" by "delete_volume" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 11:02:47 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-e658a0df-53af-4bc2-8ca0-13e481526f77 tempest-VolumesCloneTest-1152148718 None] Lock "cinder-quobyte-9fa7e631-b108-41cd-bc80-d5a3e4b3ff18" acquired by "delete_volume" :: waited 0.018s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 11:02:47 devstack cinder-volume[87272]: DEBUG oslo.privsep.daemon [-] privsep: reply[b78d0fda-4d6e-41f7-a7ca-cd0e9ee148d9]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 11:02:47 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-e658a0df-53af-4bc2-8ca0-13e481526f77 tempest-VolumesCloneTest-1152148718 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-9fa7e631-b108-41cd-bc80-d5a3e4b3ff18 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:02:47 devstack sudo[101253]: pam_unix(sudo:session): session closed for user root Nov 04 11:02:47 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-a19190ce-f293-4e2a-abb6-d538c0af2588 tempest-VolumeAndVolumeTypeFromImageTest-166070770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_b2a3576b-8b53-4457-8b68-7fa25affe173_zblsqn7udevstack@QuobyteHD /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-cb5bbf9f-18fc-47d9-8685-2586c55f3e37" returned: 0 in 0.597s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:02:47 devstack cinder-volume[87272]: DEBUG cinder.image.image_utils [None req-a19190ce-f293-4e2a-abb6-d538c0af2588 tempest-VolumeAndVolumeTypeFromImageTest-166070770 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_b2a3576b-8b53-4457-8b68-7fa25affe173_zblsqn7udevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-cb5bbf9f-18fc-47d9-8685-2586c55f3e37 {{(pid=87272) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Nov 04 11:02:47 devstack cinder-volume[87272]: INFO cinder.image.image_utils [None req-a19190ce-f293-4e2a-abb6-d538c0af2588 tempest-VolumeAndVolumeTypeFromImageTest-166070770 None] Converted 0.00 MB image at 0.00 MB/s Nov 04 11:02:47 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-a19190ce-f293-4e2a-abb6-d538c0af2588 tempest-VolumeAndVolumeTypeFromImageTest-166070770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-cb5bbf9f-18fc-47d9-8685-2586c55f3e37 1G {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:02:47 devstack sudo[101263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-cb5bbf9f-18fc-47d9-8685-2586c55f3e37 1G Nov 04 11:02:47 devstack sudo[101263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:02:47 devstack sudo[101262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-9fa7e631-b108-41cd-bc80-d5a3e4b3ff18 Nov 04 11:02:47 devstack sudo[101262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:02:47 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-acc44b1d-7f04-4347-8702-96719e2e24b7 tempest-VolumesSnapshotTestJSON-1399894899 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 11:02:47 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-acc44b1d-7f04-4347-8702-96719e2e24b7 tempest-VolumesSnapshotTestJSON-1399894899 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 11:02:47 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.remotefs [None req-acc44b1d-7f04-4347-8702-96719e2e24b7 tempest-VolumesSnapshotTestJSON-1399894899 None] Creating offline snapshot 1b29af9a-4fd9-41ae-9df9-9fcebf351ac6 of volume ca2c72a0-f9e3-43e0-a5da-6c65737c50ee {{(pid=87272) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 04 11:02:47 devstack cinder-volume[87272]: DEBUG oslo.privsep.daemon [-] privsep: reply[c72b4b64-1d7a-442e-8a54-a0590bcfd979]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 11:02:47 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-acc44b1d-7f04-4347-8702-96719e2e24b7 tempest-VolumesSnapshotTestJSON-1399894899 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-ca2c72a0-f9e3-43e0-a5da-6c65737c50ee {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:02:47 devstack sudo[101262]: pam_unix(sudo:session): session closed for user root Nov 04 11:02:47 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-e658a0df-53af-4bc2-8ca0-13e481526f77 tempest-VolumesCloneTest-1152148718 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-9fa7e631-b108-41cd-bc80-d5a3e4b3ff18" returned: 0 in 0.406s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:02:47 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-e658a0df-53af-4bc2-8ca0-13e481526f77 tempest-VolumesCloneTest-1152148718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-9fa7e631-b108-41cd-bc80-d5a3e4b3ff18 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:02:47 devstack sudo[101263]: pam_unix(sudo:session): session closed for user root Nov 04 11:02:47 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-a19190ce-f293-4e2a-abb6-d538c0af2588 tempest-VolumeAndVolumeTypeFromImageTest-166070770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-cb5bbf9f-18fc-47d9-8685-2586c55f3e37 1G" returned: 0 in 0.400s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:02:47 devstack cinder-volume[87272]: DEBUG cinder.volume.volume_utils [None req-a19190ce-f293-4e2a-abb6-d538c0af2588 tempest-VolumeAndVolumeTypeFromImageTest-166070770 None] Downloaded image b2a3576b-8b53-4457-8b68-7fa25affe173 ((None, [{'url': 'file:///opt/stack/data/glance/images/b2a3576b-8b53-4457-8b68-7fa25affe173', 'metadata': {}}])) to volume cb5bbf9f-18fc-47d9-8685-2586c55f3e37 successfully. {{(pid=87272) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Nov 04 11:02:47 devstack cinder-volume[87272]: DEBUG cinder.image.image_utils [None req-a19190ce-f293-4e2a-abb6-d538c0af2588 tempest-VolumeAndVolumeTypeFromImageTest-166070770 None] Temporary image b2a3576b-8b53-4457-8b68-7fa25affe173 for user 9a2acf430e654ce28311a2e464a9e2a5 is deleted. {{(pid=87272) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Nov 04 11:02:47 devstack cinder-volume[87272]: DEBUG cinder.volume.volume_utils [None req-a19190ce-f293-4e2a-abb6-d538c0af2588 tempest-VolumeAndVolumeTypeFromImageTest-166070770 None] Marking volume cb5bbf9f-18fc-47d9-8685-2586c55f3e37 as bootable. {{(pid=87272) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Nov 04 11:02:47 devstack sudo[101275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-9fa7e631-b108-41cd-bc80-d5a3e4b3ff18 Nov 04 11:02:47 devstack sudo[101275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:02:47 devstack cinder-volume[87272]: DEBUG cinder.volume.flows.manager.create_volume [None req-a19190ce-f293-4e2a-abb6-d538c0af2588 tempest-VolumeAndVolumeTypeFromImageTest-166070770 None] Copying metadata from image b2a3576b-8b53-4457-8b68-7fa25affe173 to cb5bbf9f-18fc-47d9-8685-2586c55f3e37. {{(pid=87272) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 04 11:02:47 devstack cinder-volume[87272]: DEBUG cinder.volume.flows.manager.create_volume [None req-a19190ce-f293-4e2a-abb6-d538c0af2588 tempest-VolumeAndVolumeTypeFromImageTest-166070770 None] Creating volume glance metadata for volume cb5bbf9f-18fc-47d9-8685-2586c55f3e37 backed by image b2a3576b-8b53-4457-8b68-7fa25affe173 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': 'b2a3576b-8b53-4457-8b68-7fa25affe173', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': 'ebee5c78434ec5d74117b6a4c071fc77', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87272) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 04 11:02:47 devstack sudo[101274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-ca2c72a0-f9e3-43e0-a5da-6c65737c50ee Nov 04 11:02:47 devstack sudo[101274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:02:47 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-a19190ce-f293-4e2a-abb6-d538c0af2588 tempest-VolumeAndVolumeTypeFromImageTest-166070770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66124c32-0cb4-419f-8ad2-0e18b53aa53a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cb5bbf9f-18fc-47d9-8685-2586c55f3e37', 'volume_size': 1, 'image_id': 'b2a3576b-8b53-4457-8b68-7fa25affe173', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b2a3576b-8b53-4457-8b68-7fa25affe173', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'ebee5c78434ec5d74117b6a4c071fc77', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'a8286f40b95d4ad19333d56cd8983066', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1db0415a7df334fe082c2488b053447094a7e84b9c007884e0f5a267e9590d2264650b07ac14f78e7a0a5fd05dea1f1671c536d298a692391ba7279ac220bcd3', 'id': 'b2a3576b-8b53-4457-8b68-7fa25affe173', 'created_at': datetime.datetime(2026, 11, 4, 10, 2, 31, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 4, 10, 2, 33, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b2a3576b-8b53-4457-8b68-7fa25affe173/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:02:47 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-a19190ce-f293-4e2a-abb6-d538c0af2588 tempest-VolumeAndVolumeTypeFromImageTest-166070770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d8693870-2d2b-4b16-811e-bf0804f61645) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:02:47 devstack cinder-volume[87272]: INFO cinder.volume.flows.manager.create_volume [None req-a19190ce-f293-4e2a-abb6-d538c0af2588 tempest-VolumeAndVolumeTypeFromImageTest-166070770 None] Volume volume-cb5bbf9f-18fc-47d9-8685-2586c55f3e37 (cb5bbf9f-18fc-47d9-8685-2586c55f3e37): created successfully Nov 04 11:02:47 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-a19190ce-f293-4e2a-abb6-d538c0af2588 tempest-VolumeAndVolumeTypeFromImageTest-166070770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d8693870-2d2b-4b16-811e-bf0804f61645) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:02:47 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-a19190ce-f293-4e2a-abb6-d538c0af2588 tempest-VolumeAndVolumeTypeFromImageTest-166070770 None] Flow 'volume_create_manager' (f5a2154a-9244-4244-a2cf-66770b865209) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87272) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 11:02:47 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-a19190ce-f293-4e2a-abb6-d538c0af2588 tempest-VolumeAndVolumeTypeFromImageTest-166070770 None] Created volume successfully. Nov 04 11:02:47 devstack sudo[101275]: pam_unix(sudo:session): session closed for user root Nov 04 11:02:47 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-e658a0df-53af-4bc2-8ca0-13e481526f77 tempest-VolumesCloneTest-1152148718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-9fa7e631-b108-41cd-bc80-d5a3e4b3ff18" returned: 0 in 0.263s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:02:48 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-e658a0df-53af-4bc2-8ca0-13e481526f77 tempest-VolumesCloneTest-1152148718 None] Lock "cinder-quobyte-9fa7e631-b108-41cd-bc80-d5a3e4b3ff18" released by "delete_volume" :: held 0.769s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 11:02:48 devstack cinder-volume[87272]: DEBUG cinder.quota [None req-e658a0df-53af-4bc2-8ca0-13e481526f77 tempest-VolumesCloneTest-1152148718 None] Created reservations ['03f0c21c-940a-4551-80d8-f2b94b3c01ac', '3873a9a5-eb32-424c-80b7-2cfc0b82625a', '86fe2ae8-eaef-4084-9967-c3d0c21a9c52', '514772f4-e6cc-4b09-9bec-8ba44af229b5'] {{(pid=87272) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 11:02:48 devstack sudo[101274]: pam_unix(sudo:session): session closed for user root Nov 04 11:02:48 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-acc44b1d-7f04-4347-8702-96719e2e24b7 tempest-VolumesSnapshotTestJSON-1399894899 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-ca2c72a0-f9e3-43e0-a5da-6c65737c50ee" returned: 0 in 0.417s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:02:48 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-acc44b1d-7f04-4347-8702-96719e2e24b7 tempest-VolumesSnapshotTestJSON-1399894899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-ca2c72a0-f9e3-43e0-a5da-6c65737c50ee,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-ca2c72a0-f9e3-43e0-a5da-6c65737c50ee.1b29af9a-4fd9-41ae-9df9-9fcebf351ac6 1G {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:02:48 devstack sudo[101283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-ca2c72a0-f9e3-43e0-a5da-6c65737c50ee,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-ca2c72a0-f9e3-43e0-a5da-6c65737c50ee.1b29af9a-4fd9-41ae-9df9-9fcebf351ac6 1G Nov 04 11:02:48 devstack sudo[101283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:02:48 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-e658a0df-53af-4bc2-8ca0-13e481526f77 tempest-VolumesCloneTest-1152148718 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 11:02:48 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-e658a0df-53af-4bc2-8ca0-13e481526f77 tempest-VolumesCloneTest-1152148718 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 11:02:48 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-e658a0df-53af-4bc2-8ca0-13e481526f77 tempest-VolumesCloneTest-1152148718 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898': None} {{(pid=87272) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 11:02:48 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-e658a0df-53af-4bc2-8ca0-13e481526f77 tempest-VolumesCloneTest-1152148718 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'] {{(pid=87272) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 11:02:48 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-e658a0df-53af-4bc2-8ca0-13e481526f77 tempest-VolumesCloneTest-1152148718 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 11:02:48 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-e658a0df-53af-4bc2-8ca0-13e481526f77 tempest-VolumesCloneTest-1152148718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:02:48 devstack sudo[101285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1 Nov 04 11:02:48 devstack sudo[101285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:02:48 devstack sudo[101285]: pam_unix(sudo:session): session closed for user root Nov 04 11:02:48 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-e658a0df-53af-4bc2-8ca0-13e481526f77 tempest-VolumesCloneTest-1152148718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1" returned: 0 in 0.263s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:02:48 devstack cinder-volume[87272]: DEBUG cinder.manager [None req-e658a0df-53af-4bc2-8ca0-13e481526f77 tempest-VolumesCloneTest-1152148718 None] Notifying Schedulers of capabilities ... {{(pid=87272) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 11:02:48 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-e658a0df-53af-4bc2-8ca0-13e481526f77 tempest-VolumesCloneTest-1152148718 None] Deleted volume successfully. Nov 04 11:02:48 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-e658a0df-53af-4bc2-8ca0-13e481526f77 tempest-VolumesCloneTest-1152148718 None] Lock "cinder-9fa7e631-b108-41cd-bc80-d5a3e4b3ff18-delete_volume" released by "delete_volume" :: held 1.276s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 11:02:48 devstack sudo[101283]: pam_unix(sudo:session): session closed for user root Nov 04 11:02:48 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-acc44b1d-7f04-4347-8702-96719e2e24b7 tempest-VolumesSnapshotTestJSON-1399894899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-ca2c72a0-f9e3-43e0-a5da-6c65737c50ee,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-ca2c72a0-f9e3-43e0-a5da-6c65737c50ee.1b29af9a-4fd9-41ae-9df9-9fcebf351ac6 1G" returned: 0 in 0.414s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:02:48 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-acc44b1d-7f04-4347-8702-96719e2e24b7 tempest-VolumesSnapshotTestJSON-1399894899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ca2c72a0-f9e3-43e0-a5da-6c65737c50ee -F qcow2 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-ca2c72a0-f9e3-43e0-a5da-6c65737c50ee.1b29af9a-4fd9-41ae-9df9-9fcebf351ac6 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:02:48 devstack sudo[101291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ca2c72a0-f9e3-43e0-a5da-6c65737c50ee -F qcow2 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-ca2c72a0-f9e3-43e0-a5da-6c65737c50ee.1b29af9a-4fd9-41ae-9df9-9fcebf351ac6 Nov 04 11:02:48 devstack sudo[101291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:02:48 devstack sudo[101291]: pam_unix(sudo:session): session closed for user root Nov 04 11:02:48 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-acc44b1d-7f04-4347-8702-96719e2e24b7 tempest-VolumesSnapshotTestJSON-1399894899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ca2c72a0-f9e3-43e0-a5da-6c65737c50ee -F qcow2 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-ca2c72a0-f9e3-43e0-a5da-6c65737c50ee.1b29af9a-4fd9-41ae-9df9-9fcebf351ac6" returned: 0 in 0.300s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:02:48 devstack cinder-volume[87272]: WARNING cinder.volume.drivers.remotefs [None req-acc44b1d-7f04-4347-8702-96719e2e24b7 tempest-VolumesSnapshotTestJSON-1399894899 None] /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-ca2c72a0-f9e3-43e0-a5da-6c65737c50ee.1b29af9a-4fd9-41ae-9df9-9fcebf351ac6 is being set with open permissions: ugo+rw Nov 04 11:02:48 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-acc44b1d-7f04-4347-8702-96719e2e24b7 tempest-VolumesSnapshotTestJSON-1399894899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-ca2c72a0-f9e3-43e0-a5da-6c65737c50ee.1b29af9a-4fd9-41ae-9df9-9fcebf351ac6 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:02:48 devstack sudo[101296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-ca2c72a0-f9e3-43e0-a5da-6c65737c50ee.1b29af9a-4fd9-41ae-9df9-9fcebf351ac6 Nov 04 11:02:48 devstack sudo[101296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:02:48 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-aeb2506d-c079-4a7f-a897-a6a8eacb1432 tempest-VolumeAndVolumeTypeFromImageTest-166070770 None] Acquiring lock "cinder-cb5bbf9f-18fc-47d9-8685-2586c55f3e37-delete_volume" by "delete_volume" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 11:02:48 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-aeb2506d-c079-4a7f-a897-a6a8eacb1432 tempest-VolumeAndVolumeTypeFromImageTest-166070770 None] Lock "cinder-cb5bbf9f-18fc-47d9-8685-2586c55f3e37-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 11:02:48 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-aeb2506d-c079-4a7f-a897-a6a8eacb1432 tempest-VolumeAndVolumeTypeFromImageTest-166070770 None] Acquiring lock "cinder-quobyte-cb5bbf9f-18fc-47d9-8685-2586c55f3e37" by "delete_volume" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 11:02:48 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-aeb2506d-c079-4a7f-a897-a6a8eacb1432 tempest-VolumeAndVolumeTypeFromImageTest-166070770 None] Lock "cinder-quobyte-cb5bbf9f-18fc-47d9-8685-2586c55f3e37" acquired by "delete_volume" :: waited 0.022s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 11:02:49 devstack cinder-volume[87272]: DEBUG oslo.privsep.daemon [-] privsep: reply[05769b22-e574-45b7-adac-b19a63352ce1]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 11:02:49 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-aeb2506d-c079-4a7f-a897-a6a8eacb1432 tempest-VolumeAndVolumeTypeFromImageTest-166070770 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-cb5bbf9f-18fc-47d9-8685-2586c55f3e37 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:02:49 devstack sudo[101296]: pam_unix(sudo:session): session closed for user root Nov 04 11:02:49 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-acc44b1d-7f04-4347-8702-96719e2e24b7 tempest-VolumesSnapshotTestJSON-1399894899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-ca2c72a0-f9e3-43e0-a5da-6c65737c50ee.1b29af9a-4fd9-41ae-9df9-9fcebf351ac6" returned: 0 in 0.268s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:02:49 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-acc44b1d-7f04-4347-8702-96719e2e24b7 tempest-VolumesSnapshotTestJSON-1399894899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-ca2c72a0-f9e3-43e0-a5da-6c65737c50ee.info {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:02:49 devstack sudo[101300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-ca2c72a0-f9e3-43e0-a5da-6c65737c50ee.info Nov 04 11:02:49 devstack sudo[101300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:02:49 devstack sudo[101299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-cb5bbf9f-18fc-47d9-8685-2586c55f3e37 Nov 04 11:02:49 devstack sudo[101299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:02:49 devstack sudo[101300]: pam_unix(sudo:session): session closed for user root Nov 04 11:02:49 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-acc44b1d-7f04-4347-8702-96719e2e24b7 tempest-VolumesSnapshotTestJSON-1399894899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-ca2c72a0-f9e3-43e0-a5da-6c65737c50ee.info" returned: 0 in 0.255s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:02:49 devstack cinder-volume[87272]: WARNING cinder.volume.drivers.remotefs [None req-acc44b1d-7f04-4347-8702-96719e2e24b7 tempest-VolumesSnapshotTestJSON-1399894899 None] /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-ca2c72a0-f9e3-43e0-a5da-6c65737c50ee.info is being set with open permissions: ugo+rw Nov 04 11:02:49 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-acc44b1d-7f04-4347-8702-96719e2e24b7 tempest-VolumesSnapshotTestJSON-1399894899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-ca2c72a0-f9e3-43e0-a5da-6c65737c50ee.info {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:02:49 devstack sudo[101306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-ca2c72a0-f9e3-43e0-a5da-6c65737c50ee.info Nov 04 11:02:49 devstack sudo[101306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:02:49 devstack sudo[101299]: pam_unix(sudo:session): session closed for user root Nov 04 11:02:49 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-aeb2506d-c079-4a7f-a897-a6a8eacb1432 tempest-VolumeAndVolumeTypeFromImageTest-166070770 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-cb5bbf9f-18fc-47d9-8685-2586c55f3e37" returned: 0 in 0.433s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:02:49 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-aeb2506d-c079-4a7f-a897-a6a8eacb1432 tempest-VolumeAndVolumeTypeFromImageTest-166070770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-cb5bbf9f-18fc-47d9-8685-2586c55f3e37 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:02:49 devstack sudo[101309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-cb5bbf9f-18fc-47d9-8685-2586c55f3e37 Nov 04 11:02:49 devstack sudo[101309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:02:49 devstack sudo[101306]: pam_unix(sudo:session): session closed for user root Nov 04 11:02:49 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-acc44b1d-7f04-4347-8702-96719e2e24b7 tempest-VolumesSnapshotTestJSON-1399894899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-ca2c72a0-f9e3-43e0-a5da-6c65737c50ee.info" returned: 0 in 0.283s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:02:49 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-acc44b1d-7f04-4347-8702-96719e2e24b7 tempest-VolumesSnapshotTestJSON-1399894899 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.047s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 11:02:49 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-acc44b1d-7f04-4347-8702-96719e2e24b7 tempest-VolumesSnapshotTestJSON-1399894899 None] Create snapshot completed successfully Nov 04 11:02:49 devstack sudo[101309]: pam_unix(sudo:session): session closed for user root Nov 04 11:02:49 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-aeb2506d-c079-4a7f-a897-a6a8eacb1432 tempest-VolumeAndVolumeTypeFromImageTest-166070770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-cb5bbf9f-18fc-47d9-8685-2586c55f3e37" returned: 0 in 0.283s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:02:49 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-aeb2506d-c079-4a7f-a897-a6a8eacb1432 tempest-VolumeAndVolumeTypeFromImageTest-166070770 None] Lock "cinder-quobyte-cb5bbf9f-18fc-47d9-8685-2586c55f3e37" released by "delete_volume" :: held 0.771s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 11:02:49 devstack cinder-volume[87272]: WARNING cinder.quota [None req-aeb2506d-c079-4a7f-a897-a6a8eacb1432 tempest-VolumeAndVolumeTypeFromImageTest-166070770 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Nov 04 11:02:49 devstack cinder-volume[87272]: WARNING cinder.quota [None req-aeb2506d-c079-4a7f-a897-a6a8eacb1432 tempest-VolumeAndVolumeTypeFromImageTest-166070770 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Nov 04 11:02:49 devstack cinder-volume[87272]: DEBUG cinder.quota [None req-aeb2506d-c079-4a7f-a897-a6a8eacb1432 tempest-VolumeAndVolumeTypeFromImageTest-166070770 None] Created reservations ['f12dd398-8d89-454b-b6d6-31fa1e6e2b9a', '7035ef8a-9767-4f11-9878-ffeefe2b9ef3', 'fe8cb8e0-b49b-4dbb-a9e5-e5a4833a7240', 'a939dea2-1caa-4089-b324-d7b244fe633d'] {{(pid=87272) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 11:02:49 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-aeb2506d-c079-4a7f-a897-a6a8eacb1432 tempest-VolumeAndVolumeTypeFromImageTest-166070770 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 11:02:49 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-aeb2506d-c079-4a7f-a897-a6a8eacb1432 tempest-VolumeAndVolumeTypeFromImageTest-166070770 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 11:02:49 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-aeb2506d-c079-4a7f-a897-a6a8eacb1432 tempest-VolumeAndVolumeTypeFromImageTest-166070770 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898': None} {{(pid=87272) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 11:02:49 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-aeb2506d-c079-4a7f-a897-a6a8eacb1432 tempest-VolumeAndVolumeTypeFromImageTest-166070770 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'] {{(pid=87272) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 11:02:49 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-aeb2506d-c079-4a7f-a897-a6a8eacb1432 tempest-VolumeAndVolumeTypeFromImageTest-166070770 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 11:02:49 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-aeb2506d-c079-4a7f-a897-a6a8eacb1432 tempest-VolumeAndVolumeTypeFromImageTest-166070770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:02:49 devstack sudo[101313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1 Nov 04 11:02:49 devstack sudo[101313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:02:50 devstack sudo[101313]: pam_unix(sudo:session): session closed for user root Nov 04 11:02:50 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-aeb2506d-c079-4a7f-a897-a6a8eacb1432 tempest-VolumeAndVolumeTypeFromImageTest-166070770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1" returned: 0 in 0.254s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:02:50 devstack cinder-volume[87272]: DEBUG cinder.manager [None req-aeb2506d-c079-4a7f-a897-a6a8eacb1432 tempest-VolumeAndVolumeTypeFromImageTest-166070770 None] Notifying Schedulers of capabilities ... {{(pid=87272) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 11:02:50 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-aeb2506d-c079-4a7f-a897-a6a8eacb1432 tempest-VolumeAndVolumeTypeFromImageTest-166070770 None] Deleted volume successfully. Nov 04 11:02:50 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-aeb2506d-c079-4a7f-a897-a6a8eacb1432 tempest-VolumeAndVolumeTypeFromImageTest-166070770 None] Lock "cinder-cb5bbf9f-18fc-47d9-8685-2586c55f3e37-delete_volume" released by "delete_volume" :: held 1.261s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 11:02:50 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-e258fa11-87fa-476d-bf3d-eb6c8af0daeb tempest-VolumesSnapshotTestJSON-1399894899 None] Acquiring lock "cinder-1b29af9a-4fd9-41ae-9df9-9fcebf351ac6-delete_snapshot" by "delete_snapshot" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 11:02:50 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-e258fa11-87fa-476d-bf3d-eb6c8af0daeb tempest-VolumesSnapshotTestJSON-1399894899 None] Lock "cinder-1b29af9a-4fd9-41ae-9df9-9fcebf351ac6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 11:02:50 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-e258fa11-87fa-476d-bf3d-eb6c8af0daeb tempest-VolumesSnapshotTestJSON-1399894899 None] Acquiring lock "cinder-quobyte-ca2c72a0-f9e3-43e0-a5da-6c65737c50ee" by "delete_snapshot" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 11:02:51 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-e258fa11-87fa-476d-bf3d-eb6c8af0daeb tempest-VolumesSnapshotTestJSON-1399894899 None] Lock "cinder-quobyte-ca2c72a0-f9e3-43e0-a5da-6c65737c50ee" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 11:02:51 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-e258fa11-87fa-476d-bf3d-eb6c8af0daeb tempest-VolumesSnapshotTestJSON-1399894899 None] Acquiring lock "cinder-quobyte-1b29af9a-4fd9-41ae-9df9-9fcebf351ac6" by "_delete_snapshot" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 11:02:51 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-e258fa11-87fa-476d-bf3d-eb6c8af0daeb tempest-VolumesSnapshotTestJSON-1399894899 None] Lock "cinder-quobyte-1b29af9a-4fd9-41ae-9df9-9fcebf351ac6" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 11:02:51 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.remotefs [None req-e258fa11-87fa-476d-bf3d-eb6c8af0daeb tempest-VolumesSnapshotTestJSON-1399894899 None] Deleting offline snapshot 1b29af9a-4fd9-41ae-9df9-9fcebf351ac6 of volume ca2c72a0-f9e3-43e0-a5da-6c65737c50ee {{(pid=87272) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 04 11:02:51 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.remotefs [None req-e258fa11-87fa-476d-bf3d-eb6c8af0daeb tempest-VolumesSnapshotTestJSON-1399894899 None] snapshot_file for this snap is: volume-ca2c72a0-f9e3-43e0-a5da-6c65737c50ee.1b29af9a-4fd9-41ae-9df9-9fcebf351ac6 {{(pid=87272) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 04 11:02:51 devstack cinder-volume[87272]: DEBUG oslo.privsep.daemon [-] privsep: reply[6974fa01-24f8-4645-a341-b394ab0ad5c9]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 11:02:51 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-e258fa11-87fa-476d-bf3d-eb6c8af0daeb tempest-VolumesSnapshotTestJSON-1399894899 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-ca2c72a0-f9e3-43e0-a5da-6c65737c50ee.1b29af9a-4fd9-41ae-9df9-9fcebf351ac6 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:02:51 devstack sudo[101316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-ca2c72a0-f9e3-43e0-a5da-6c65737c50ee.1b29af9a-4fd9-41ae-9df9-9fcebf351ac6 Nov 04 11:02:51 devstack sudo[101316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:02:51 devstack sudo[101316]: pam_unix(sudo:session): session closed for user root Nov 04 11:02:51 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-e258fa11-87fa-476d-bf3d-eb6c8af0daeb tempest-VolumesSnapshotTestJSON-1399894899 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-ca2c72a0-f9e3-43e0-a5da-6c65737c50ee.1b29af9a-4fd9-41ae-9df9-9fcebf351ac6" returned: 0 in 0.394s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:02:51 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.remotefs [None req-e258fa11-87fa-476d-bf3d-eb6c8af0daeb tempest-VolumesSnapshotTestJSON-1399894899 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ca2c72a0-f9e3-43e0-a5da-6c65737c50ee(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87272) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 11:02:51 devstack cinder-volume[87272]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1746703-f29e-4f27-9569-4e33f903d9cd]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 11:02:51 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-e258fa11-87fa-476d-bf3d-eb6c8af0daeb tempest-VolumesSnapshotTestJSON-1399894899 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-ca2c72a0-f9e3-43e0-a5da-6c65737c50ee {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:02:51 devstack sudo[101322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-ca2c72a0-f9e3-43e0-a5da-6c65737c50ee Nov 04 11:02:51 devstack sudo[101322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:02:51 devstack sudo[101322]: pam_unix(sudo:session): session closed for user root Nov 04 11:02:51 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-e258fa11-87fa-476d-bf3d-eb6c8af0daeb tempest-VolumesSnapshotTestJSON-1399894899 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-ca2c72a0-f9e3-43e0-a5da-6c65737c50ee" returned: 0 in 0.423s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:02:51 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-e258fa11-87fa-476d-bf3d-eb6c8af0daeb tempest-VolumesSnapshotTestJSON-1399894899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-ca2c72a0-f9e3-43e0-a5da-6c65737c50ee.1b29af9a-4fd9-41ae-9df9-9fcebf351ac6 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:02:51 devstack sudo[101327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-ca2c72a0-f9e3-43e0-a5da-6c65737c50ee.1b29af9a-4fd9-41ae-9df9-9fcebf351ac6 Nov 04 11:02:51 devstack sudo[101327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:02:52 devstack sudo[101327]: pam_unix(sudo:session): session closed for user root Nov 04 11:02:52 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-e258fa11-87fa-476d-bf3d-eb6c8af0daeb tempest-VolumesSnapshotTestJSON-1399894899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-ca2c72a0-f9e3-43e0-a5da-6c65737c50ee.1b29af9a-4fd9-41ae-9df9-9fcebf351ac6" returned: 0 in 0.392s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:02:52 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-e258fa11-87fa-476d-bf3d-eb6c8af0daeb tempest-VolumesSnapshotTestJSON-1399894899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-ca2c72a0-f9e3-43e0-a5da-6c65737c50ee.1b29af9a-4fd9-41ae-9df9-9fcebf351ac6 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:02:52 devstack sudo[101333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-ca2c72a0-f9e3-43e0-a5da-6c65737c50ee.1b29af9a-4fd9-41ae-9df9-9fcebf351ac6 Nov 04 11:02:52 devstack sudo[101333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:02:52 devstack sudo[101333]: pam_unix(sudo:session): session closed for user root Nov 04 11:02:52 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-e258fa11-87fa-476d-bf3d-eb6c8af0daeb tempest-VolumesSnapshotTestJSON-1399894899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-ca2c72a0-f9e3-43e0-a5da-6c65737c50ee.1b29af9a-4fd9-41ae-9df9-9fcebf351ac6" returned: 0 in 0.279s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:02:52 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-e258fa11-87fa-476d-bf3d-eb6c8af0daeb tempest-VolumesSnapshotTestJSON-1399894899 None] Lock "cinder-quobyte-1b29af9a-4fd9-41ae-9df9-9fcebf351ac6" released by "_delete_snapshot" :: held 1.629s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 11:02:52 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-e258fa11-87fa-476d-bf3d-eb6c8af0daeb tempest-VolumesSnapshotTestJSON-1399894899 None] Lock "cinder-quobyte-ca2c72a0-f9e3-43e0-a5da-6c65737c50ee" released by "delete_snapshot" :: held 1.663s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 11:02:52 devstack cinder-volume[87272]: DEBUG cinder.quota [None req-e258fa11-87fa-476d-bf3d-eb6c8af0daeb tempest-VolumesSnapshotTestJSON-1399894899 None] Created reservations ['2f5569c1-6a81-494e-ad41-992d6d0a71ec', 'f9a9d09d-ffca-4b88-9c60-da4c8d664903', 'd7ee7858-631c-4655-997f-0973fac1239f', 'cc680bcb-971f-4bb5-bda9-c69eed872bb1'] {{(pid=87272) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 11:02:52 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-e258fa11-87fa-476d-bf3d-eb6c8af0daeb tempest-VolumesSnapshotTestJSON-1399894899 None] Delete snapshot completed successfully. Nov 04 11:02:52 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-e258fa11-87fa-476d-bf3d-eb6c8af0daeb tempest-VolumesSnapshotTestJSON-1399894899 None] Lock "cinder-1b29af9a-4fd9-41ae-9df9-9fcebf351ac6-delete_snapshot" released by "delete_snapshot" :: held 1.874s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 11:02:53 devstack cinder-volume[87272]: DEBUG cinder.volume.flows.manager.create_volume [None req-1b2133df-1f8f-4cfe-aaa3-85788f6bf379 tempest-VolumesExtendTest-1917483396 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87272) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 11:02:53 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-1b2133df-1f8f-4cfe-aaa3-85788f6bf379 tempest-VolumesExtendTest-1917483396 None] Flow 'volume_create_manager' (33ca6e43-6058-471b-9b01-266102428771) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 11:02:53 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-1b2133df-1f8f-4cfe-aaa3-85788f6bf379 tempest-VolumesExtendTest-1917483396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f823be35-96dd-48ab-96cf-a4cfba557c8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:02:53 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-1b2133df-1f8f-4cfe-aaa3-85788f6bf379 tempest-VolumesExtendTest-1917483396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f823be35-96dd-48ab-96cf-a4cfba557c8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T10:02:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1698784124',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4a2b5896-7377-4c47-94aa-81f36c71ded3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dfc5fbd20fdc49d58f5fe9ee671c20b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T10:02:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T10:02:53Z,use_quota=True,user_id='4a8097cabbf54e0c9b37a3d456c62743',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8989e4f-21e3-4f0a-9584-0d818784e883),volume_type_id=f8989e4f-21e3-4f0a-9584-0d818784e883)' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:02:53 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-1b2133df-1f8f-4cfe-aaa3-85788f6bf379 tempest-VolumesExtendTest-1917483396 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e9404c4-df24-43b6-84ba-8db988223988) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:02:53 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-1b2133df-1f8f-4cfe-aaa3-85788f6bf379 tempest-VolumesExtendTest-1917483396 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e9404c4-df24-43b6-84ba-8db988223988) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:02:53 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-1b2133df-1f8f-4cfe-aaa3-85788f6bf379 tempest-VolumesExtendTest-1917483396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f112cfc8-36c9-4f63-8477-f37d52a5b22f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:02:53 devstack cinder-volume[87272]: DEBUG cinder.image.glance [None req-1b2133df-1f8f-4cfe-aaa3-85788f6bf379 tempest-VolumesExtendTest-1917483396 None] Creating Keystone auth plugin from conf {{(pid=87272) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 04 11:02:53 devstack cinder-volume[87272]: DEBUG cinder.volume.flows.manager.create_volume [None req-cfd08ccb-84e8-421e-ba56-97c9559d1129 tempest-VolumesSnapshotTestJSON-1399894899 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87272) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 11:02:53 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-cfd08ccb-84e8-421e-ba56-97c9559d1129 tempest-VolumesSnapshotTestJSON-1399894899 None] Flow 'volume_create_manager' (02c68c03-9d12-46ba-9594-815888a90925) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 11:02:53 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-cfd08ccb-84e8-421e-ba56-97c9559d1129 tempest-VolumesSnapshotTestJSON-1399894899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (15f73016-bbec-42d0-9fa0-108357a83bb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:02:53 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-cfd08ccb-84e8-421e-ba56-97c9559d1129 tempest-VolumesSnapshotTestJSON-1399894899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (15f73016-bbec-42d0-9fa0-108357a83bb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T10:02:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1801288371',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b97bf6eb-69d3-4ba1-ba94-8a004078ecf5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef099de5b8794b308a0c8f182ca0fca1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T10:02:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T10:02:54Z,use_quota=True,user_id='73239b009fea418ba15cb75342ef934d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8989e4f-21e3-4f0a-9584-0d818784e883),volume_type_id=f8989e4f-21e3-4f0a-9584-0d818784e883)' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:02:53 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-cfd08ccb-84e8-421e-ba56-97c9559d1129 tempest-VolumesSnapshotTestJSON-1399894899 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7758ac21-8a46-483e-94b4-4d9aeba5a980) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:02:53 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-cfd08ccb-84e8-421e-ba56-97c9559d1129 tempest-VolumesSnapshotTestJSON-1399894899 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7758ac21-8a46-483e-94b4-4d9aeba5a980) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:02:53 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-cfd08ccb-84e8-421e-ba56-97c9559d1129 tempest-VolumesSnapshotTestJSON-1399894899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45fa77f1-f9e0-41ed-a957-8fe439b1e277) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:02:53 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-cfd08ccb-84e8-421e-ba56-97c9559d1129 tempest-VolumesSnapshotTestJSON-1399894899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45fa77f1-f9e0-41ed-a957-8fe439b1e277) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b97bf6eb-69d3-4ba1-ba94-8a004078ecf5', 'volume_name': 'volume-b97bf6eb-69d3-4ba1-ba94-8a004078ecf5', 'volume_size': 1}' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:02:53 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-cfd08ccb-84e8-421e-ba56-97c9559d1129 tempest-VolumesSnapshotTestJSON-1399894899 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2092ce3e-84af-4da1-83de-30313cc7fb64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:02:53 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-cfd08ccb-84e8-421e-ba56-97c9559d1129 tempest-VolumesSnapshotTestJSON-1399894899 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2092ce3e-84af-4da1-83de-30313cc7fb64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:02:53 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-cfd08ccb-84e8-421e-ba56-97c9559d1129 tempest-VolumesSnapshotTestJSON-1399894899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0a30720-8b34-4e26-8ed5-9a82a2ba0a88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:02:53 devstack cinder-volume[87272]: INFO cinder.volume.flows.manager.create_volume [None req-cfd08ccb-84e8-421e-ba56-97c9559d1129 tempest-VolumesSnapshotTestJSON-1399894899 None] Volume b97bf6eb-69d3-4ba1-ba94-8a004078ecf5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b97bf6eb-69d3-4ba1-ba94-8a004078ecf5', 'volume_size': 1} Nov 04 11:02:53 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-cfd08ccb-84e8-421e-ba56-97c9559d1129 tempest-VolumesSnapshotTestJSON-1399894899 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 11:02:53 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-cfd08ccb-84e8-421e-ba56-97c9559d1129 tempest-VolumesSnapshotTestJSON-1399894899 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 11:02:53 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-cfd08ccb-84e8-421e-ba56-97c9559d1129 tempest-VolumesSnapshotTestJSON-1399894899 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T10:02:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1801288371',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b97bf6eb-69d3-4ba1-ba94-8a004078ecf5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef099de5b8794b308a0c8f182ca0fca1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T10:02:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T10:02:54Z,use_quota=True,user_id='73239b009fea418ba15cb75342ef934d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8989e4f-21e3-4f0a-9584-0d818784e883),volume_type_id=f8989e4f-21e3-4f0a-9584-0d818784e883)}" {{(pid=87272) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 04 11:02:53 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.remotefs [None req-cfd08ccb-84e8-421e-ba56-97c9559d1129 tempest-VolumesSnapshotTestJSON-1399894899 None] Creating volume b97bf6eb-69d3-4ba1-ba94-8a004078ecf5 {{(pid=87272) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 11:02:53 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-cfd08ccb-84e8-421e-ba56-97c9559d1129 tempest-VolumesSnapshotTestJSON-1399894899 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 11:02:53 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-cfd08ccb-84e8-421e-ba56-97c9559d1129 tempest-VolumesSnapshotTestJSON-1399894899 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 11:02:53 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-cfd08ccb-84e8-421e-ba56-97c9559d1129 tempest-VolumesSnapshotTestJSON-1399894899 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898': None} {{(pid=87272) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 11:02:53 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-cfd08ccb-84e8-421e-ba56-97c9559d1129 tempest-VolumesSnapshotTestJSON-1399894899 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'] {{(pid=87272) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 11:02:53 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-cfd08ccb-84e8-421e-ba56-97c9559d1129 tempest-VolumesSnapshotTestJSON-1399894899 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 11:02:53 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-cfd08ccb-84e8-421e-ba56-97c9559d1129 tempest-VolumesSnapshotTestJSON-1399894899 None] Selected osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898 as target Quobyte volume. {{(pid=87272) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 11:02:53 devstack cinder-volume[87272]: INFO cinder.volume.drivers.remotefs [None req-cfd08ccb-84e8-421e-ba56-97c9559d1129 tempest-VolumesSnapshotTestJSON-1399894899 None] casted to osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898 Nov 04 11:02:53 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-cfd08ccb-84e8-421e-ba56-97c9559d1129 tempest-VolumesSnapshotTestJSON-1399894899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-b97bf6eb-69d3-4ba1-ba94-8a004078ecf5 1073741824 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:02:53 devstack sudo[101337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-b97bf6eb-69d3-4ba1-ba94-8a004078ecf5 1073741824 Nov 04 11:02:53 devstack sudo[101337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:02:53 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-1b2133df-1f8f-4cfe-aaa3-85788f6bf379 tempest-VolumesExtendTest-1917483396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f112cfc8-36c9-4f63-8477-f37d52a5b22f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '4a2b5896-7377-4c47-94aa-81f36c71ded3', 'volume_name': 'volume-4a2b5896-7377-4c47-94aa-81f36c71ded3', 'volume_size': 1, 'image_id': 'e21f1c05-a199-4b20-94c3-a13f8db1348a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e21f1c05-a199-4b20-94c3-a13f8db1348a', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'a0568d152f1945e380a1ac4afff5179c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'e21f1c05-a199-4b20-94c3-a13f8db1348a', 'created_at': datetime.datetime(2026, 11, 4, 9, 43, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 4, 9, 44, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e21f1c05-a199-4b20-94c3-a13f8db1348a/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:02:53 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-1b2133df-1f8f-4cfe-aaa3-85788f6bf379 tempest-VolumesExtendTest-1917483396 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1b91a8f-c9b9-4c5a-9d3a-55b52a59e7f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:02:53 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-1b2133df-1f8f-4cfe-aaa3-85788f6bf379 tempest-VolumesExtendTest-1917483396 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1b91a8f-c9b9-4c5a-9d3a-55b52a59e7f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:02:53 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-1b2133df-1f8f-4cfe-aaa3-85788f6bf379 tempest-VolumesExtendTest-1917483396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f20eac0d-09f5-4658-9cd5-4a92ba258b21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:02:53 devstack cinder-volume[87272]: INFO cinder.volume.flows.manager.create_volume [None req-1b2133df-1f8f-4cfe-aaa3-85788f6bf379 tempest-VolumesExtendTest-1917483396 None] Volume 4a2b5896-7377-4c47-94aa-81f36c71ded3: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-4a2b5896-7377-4c47-94aa-81f36c71ded3', 'volume_size': 1, 'image_id': 'e21f1c05-a199-4b20-94c3-a13f8db1348a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e21f1c05-a199-4b20-94c3-a13f8db1348a', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'a0568d152f1945e380a1ac4afff5179c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'e21f1c05-a199-4b20-94c3-a13f8db1348a', 'created_at': datetime.datetime(2026, 11, 4, 9, 43, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 4, 9, 44, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e21f1c05-a199-4b20-94c3-a13f8db1348a/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Nov 04 11:02:53 devstack cinder-volume[87272]: DEBUG cinder.volume.flows.manager.create_volume [None req-1b2133df-1f8f-4cfe-aaa3-85788f6bf379 tempest-VolumesExtendTest-1917483396 None] Trying to clone 4a2b5896-7377-4c47-94aa-81f36c71ded3 from image e21f1c05-a199-4b20-94c3-a13f8db1348a at location (None, [{'url': 'file:///opt/stack/data/glance/images/e21f1c05-a199-4b20-94c3-a13f8db1348a', 'metadata': {}}]). {{(pid=87272) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 04 11:02:54 devstack cinder-volume[87272]: DEBUG cinder.image.image_utils [None req-1b2133df-1f8f-4cfe-aaa3-85788f6bf379 tempest-VolumesExtendTest-1917483396 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_e21f1c05-a199-4b20-94c3-a13f8db1348a_cbw6l24adevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87272) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Nov 04 11:02:54 devstack cinder-volume[87272]: INFO cinder.image.image_utils [None req-1b2133df-1f8f-4cfe-aaa3-85788f6bf379 tempest-VolumesExtendTest-1917483396 None] Image download 20.69 MB at 20.69 MB/s Nov 04 11:02:54 devstack sudo[101337]: pam_unix(sudo:session): session closed for user root Nov 04 11:02:54 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-cfd08ccb-84e8-421e-ba56-97c9559d1129 tempest-VolumesSnapshotTestJSON-1399894899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-b97bf6eb-69d3-4ba1-ba94-8a004078ecf5 1073741824" returned: 0 in 0.567s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:02:54 devstack cinder-volume[87272]: DEBUG oslo.privsep.daemon [-] privsep: reply[849415ab-0079-4185-a380-95b76dec2693]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 11:02:54 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-1b2133df-1f8f-4cfe-aaa3-85788f6bf379 tempest-VolumesExtendTest-1917483396 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e21f1c05-a199-4b20-94c3-a13f8db1348a_cbw6l24adevstack@QuobyteHD {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:02:54 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-cfd08ccb-84e8-421e-ba56-97c9559d1129 tempest-VolumesSnapshotTestJSON-1399894899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-b97bf6eb-69d3-4ba1-ba94-8a004078ecf5 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:02:54 devstack sudo[101345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-b97bf6eb-69d3-4ba1-ba94-8a004078ecf5 Nov 04 11:02:54 devstack sudo[101345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:02:54 devstack sudo[101344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e21f1c05-a199-4b20-94c3-a13f8db1348a_cbw6l24adevstack@QuobyteHD Nov 04 11:02:54 devstack sudo[101344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:02:54 devstack sudo[101345]: pam_unix(sudo:session): session closed for user root Nov 04 11:02:54 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-cfd08ccb-84e8-421e-ba56-97c9559d1129 tempest-VolumesSnapshotTestJSON-1399894899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-b97bf6eb-69d3-4ba1-ba94-8a004078ecf5" returned: 0 in 0.259s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:02:54 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-cfd08ccb-84e8-421e-ba56-97c9559d1129 tempest-VolumesSnapshotTestJSON-1399894899 None] <== create_volume: return (897ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'} {{(pid=87272) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 04 11:02:54 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-cfd08ccb-84e8-421e-ba56-97c9559d1129 tempest-VolumesSnapshotTestJSON-1399894899 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.899s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 11:02:54 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-cfd08ccb-84e8-421e-ba56-97c9559d1129 tempest-VolumesSnapshotTestJSON-1399894899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0a30720-8b34-4e26-8ed5-9a82a2ba0a88) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b97bf6eb-69d3-4ba1-ba94-8a004078ecf5', 'volume_size': 1}' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:02:54 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-cfd08ccb-84e8-421e-ba56-97c9559d1129 tempest-VolumesSnapshotTestJSON-1399894899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (25191c37-15b5-4017-b3c0-59c6932574bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:02:54 devstack sudo[101344]: pam_unix(sudo:session): session closed for user root Nov 04 11:02:54 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-1b2133df-1f8f-4cfe-aaa3-85788f6bf379 tempest-VolumesExtendTest-1917483396 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e21f1c05-a199-4b20-94c3-a13f8db1348a_cbw6l24adevstack@QuobyteHD" returned: 0 in 0.343s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:02:54 devstack cinder-volume[87272]: DEBUG cinder.image.image_utils [None req-1b2133df-1f8f-4cfe-aaa3-85788f6bf379 tempest-VolumesExtendTest-1917483396 None] Temporary image e21f1c05-a199-4b20-94c3-a13f8db1348a is fetched for user 4a8097cabbf54e0c9b37a3d456c62743. {{(pid=87272) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Nov 04 11:02:54 devstack cinder-volume[87272]: INFO cinder.volume.flows.manager.create_volume [None req-cfd08ccb-84e8-421e-ba56-97c9559d1129 tempest-VolumesSnapshotTestJSON-1399894899 None] Volume volume-b97bf6eb-69d3-4ba1-ba94-8a004078ecf5 (b97bf6eb-69d3-4ba1-ba94-8a004078ecf5): created successfully Nov 04 11:02:54 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-cfd08ccb-84e8-421e-ba56-97c9559d1129 tempest-VolumesSnapshotTestJSON-1399894899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (25191c37-15b5-4017-b3c0-59c6932574bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:02:54 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-cfd08ccb-84e8-421e-ba56-97c9559d1129 tempest-VolumesSnapshotTestJSON-1399894899 None] Flow 'volume_create_manager' (02c68c03-9d12-46ba-9594-815888a90925) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87272) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 11:02:54 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-cfd08ccb-84e8-421e-ba56-97c9559d1129 tempest-VolumesSnapshotTestJSON-1399894899 None] Created volume successfully. Nov 04 11:02:54 devstack cinder-volume[87272]: DEBUG oslo.privsep.daemon [-] privsep: reply[887139d7-ba4d-4fba-8aa1-a0a67e816472]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 11:02:54 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-1b2133df-1f8f-4cfe-aaa3-85788f6bf379 tempest-VolumesExtendTest-1917483396 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e21f1c05-a199-4b20-94c3-a13f8db1348a_cbw6l24adevstack@QuobyteHD {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:02:54 devstack sudo[101352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e21f1c05-a199-4b20-94c3-a13f8db1348a_cbw6l24adevstack@QuobyteHD Nov 04 11:02:54 devstack sudo[101352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:02:55 devstack cinder-volume[87272]: DEBUG cinder.volume.flows.manager.create_volume [None req-90f54321-96c4-4a6c-9d06-164d86752b6c tempest-VolumeDependencyTests-143533947 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87272) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 11:02:55 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-90f54321-96c4-4a6c-9d06-164d86752b6c tempest-VolumeDependencyTests-143533947 None] Flow 'volume_create_manager' (b53dec08-4b0d-4854-aab4-04cdcb5ccc9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 11:02:55 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-90f54321-96c4-4a6c-9d06-164d86752b6c tempest-VolumeDependencyTests-143533947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (95b39dcc-8c73-452b-8526-89356848f9c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:02:55 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-90f54321-96c4-4a6c-9d06-164d86752b6c tempest-VolumeDependencyTests-143533947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (95b39dcc-8c73-452b-8526-89356848f9c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T10:02:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1889592180',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d0924def-8711-4ff9-bf4f-7cefce60d2c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a83b55c72b045659c872c0d592d4d26',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T10:02:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T10:02:55Z,use_quota=True,user_id='16a3c67151904b5193f06022769ff570',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8989e4f-21e3-4f0a-9584-0d818784e883),volume_type_id=f8989e4f-21e3-4f0a-9584-0d818784e883)' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:02:55 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-90f54321-96c4-4a6c-9d06-164d86752b6c tempest-VolumeDependencyTests-143533947 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1bddc7b1-273f-41ad-ba42-b335a79c9ecf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:02:55 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-90f54321-96c4-4a6c-9d06-164d86752b6c tempest-VolumeDependencyTests-143533947 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1bddc7b1-273f-41ad-ba42-b335a79c9ecf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:02:55 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-90f54321-96c4-4a6c-9d06-164d86752b6c tempest-VolumeDependencyTests-143533947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb475727-4c29-4b29-a10b-c42309272b8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:02:55 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-90f54321-96c4-4a6c-9d06-164d86752b6c tempest-VolumeDependencyTests-143533947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb475727-4c29-4b29-a10b-c42309272b8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd0924def-8711-4ff9-bf4f-7cefce60d2c7', 'volume_name': 'volume-d0924def-8711-4ff9-bf4f-7cefce60d2c7', 'volume_size': 1}' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:02:55 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-90f54321-96c4-4a6c-9d06-164d86752b6c tempest-VolumeDependencyTests-143533947 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b0e4a16-826d-40c8-b3d7-2101e3babcf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:02:55 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-90f54321-96c4-4a6c-9d06-164d86752b6c tempest-VolumeDependencyTests-143533947 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b0e4a16-826d-40c8-b3d7-2101e3babcf0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:02:55 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-90f54321-96c4-4a6c-9d06-164d86752b6c tempest-VolumeDependencyTests-143533947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc23c047-8e94-4045-b2a2-448b73a04768) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:02:55 devstack cinder-volume[87272]: INFO cinder.volume.flows.manager.create_volume [None req-90f54321-96c4-4a6c-9d06-164d86752b6c tempest-VolumeDependencyTests-143533947 None] Volume d0924def-8711-4ff9-bf4f-7cefce60d2c7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d0924def-8711-4ff9-bf4f-7cefce60d2c7', 'volume_size': 1} Nov 04 11:02:55 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-90f54321-96c4-4a6c-9d06-164d86752b6c tempest-VolumeDependencyTests-143533947 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 11:02:55 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-90f54321-96c4-4a6c-9d06-164d86752b6c tempest-VolumeDependencyTests-143533947 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 11:02:55 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-90f54321-96c4-4a6c-9d06-164d86752b6c tempest-VolumeDependencyTests-143533947 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T10:02:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1889592180',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d0924def-8711-4ff9-bf4f-7cefce60d2c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a83b55c72b045659c872c0d592d4d26',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T10:02:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T10:02:55Z,use_quota=True,user_id='16a3c67151904b5193f06022769ff570',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8989e4f-21e3-4f0a-9584-0d818784e883),volume_type_id=f8989e4f-21e3-4f0a-9584-0d818784e883)}" {{(pid=87272) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 04 11:02:55 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.remotefs [None req-90f54321-96c4-4a6c-9d06-164d86752b6c tempest-VolumeDependencyTests-143533947 None] Creating volume d0924def-8711-4ff9-bf4f-7cefce60d2c7 {{(pid=87272) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 11:02:55 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-90f54321-96c4-4a6c-9d06-164d86752b6c tempest-VolumeDependencyTests-143533947 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 11:02:55 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-90f54321-96c4-4a6c-9d06-164d86752b6c tempest-VolumeDependencyTests-143533947 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 11:02:55 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-90f54321-96c4-4a6c-9d06-164d86752b6c tempest-VolumeDependencyTests-143533947 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898': None} {{(pid=87272) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 11:02:55 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-90f54321-96c4-4a6c-9d06-164d86752b6c tempest-VolumeDependencyTests-143533947 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'] {{(pid=87272) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 11:02:55 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-90f54321-96c4-4a6c-9d06-164d86752b6c tempest-VolumeDependencyTests-143533947 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 11:02:55 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-90f54321-96c4-4a6c-9d06-164d86752b6c tempest-VolumeDependencyTests-143533947 None] Selected osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898 as target Quobyte volume. {{(pid=87272) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 11:02:55 devstack cinder-volume[87272]: INFO cinder.volume.drivers.remotefs [None req-90f54321-96c4-4a6c-9d06-164d86752b6c tempest-VolumeDependencyTests-143533947 None] casted to osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898 Nov 04 11:02:55 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-90f54321-96c4-4a6c-9d06-164d86752b6c tempest-VolumeDependencyTests-143533947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-d0924def-8711-4ff9-bf4f-7cefce60d2c7 1073741824 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:02:55 devstack sudo[101352]: pam_unix(sudo:session): session closed for user root Nov 04 11:02:55 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-1b2133df-1f8f-4cfe-aaa3-85788f6bf379 tempest-VolumesExtendTest-1917483396 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e21f1c05-a199-4b20-94c3-a13f8db1348a_cbw6l24adevstack@QuobyteHD" returned: 0 in 0.340s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:02:55 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-1b2133df-1f8f-4cfe-aaa3-85788f6bf379 tempest-VolumesExtendTest-1917483396 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 11:02:55 devstack sudo[101357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-d0924def-8711-4ff9-bf4f-7cefce60d2c7 1073741824 Nov 04 11:02:55 devstack sudo[101357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:02:55 devstack sudo[101357]: pam_unix(sudo:session): session closed for user root Nov 04 11:02:55 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-90f54321-96c4-4a6c-9d06-164d86752b6c tempest-VolumeDependencyTests-143533947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-d0924def-8711-4ff9-bf4f-7cefce60d2c7 1073741824" returned: 0 in 0.407s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:02:55 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-90f54321-96c4-4a6c-9d06-164d86752b6c tempest-VolumeDependencyTests-143533947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-d0924def-8711-4ff9-bf4f-7cefce60d2c7 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:02:55 devstack sudo[101363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-d0924def-8711-4ff9-bf4f-7cefce60d2c7 Nov 04 11:02:55 devstack sudo[101363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:02:55 devstack sudo[101363]: pam_unix(sudo:session): session closed for user root Nov 04 11:02:55 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-90f54321-96c4-4a6c-9d06-164d86752b6c tempest-VolumeDependencyTests-143533947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-d0924def-8711-4ff9-bf4f-7cefce60d2c7" returned: 0 in 0.285s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:02:55 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-90f54321-96c4-4a6c-9d06-164d86752b6c tempest-VolumeDependencyTests-143533947 None] <== create_volume: return (731ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'} {{(pid=87272) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 04 11:02:55 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-90f54321-96c4-4a6c-9d06-164d86752b6c tempest-VolumeDependencyTests-143533947 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.734s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 11:02:55 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-1b2133df-1f8f-4cfe-aaa3-85788f6bf379 tempest-VolumesExtendTest-1917483396 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.716s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 11:02:55 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-1b2133df-1f8f-4cfe-aaa3-85788f6bf379 tempest-VolumesExtendTest-1917483396 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T10:02:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1698784124',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4a2b5896-7377-4c47-94aa-81f36c71ded3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dfc5fbd20fdc49d58f5fe9ee671c20b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T10:02:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T10:02:53Z,use_quota=True,user_id='4a8097cabbf54e0c9b37a3d456c62743',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8989e4f-21e3-4f0a-9584-0d818784e883),volume_type_id=f8989e4f-21e3-4f0a-9584-0d818784e883)}" {{(pid=87272) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 04 11:02:55 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.remotefs [None req-1b2133df-1f8f-4cfe-aaa3-85788f6bf379 tempest-VolumesExtendTest-1917483396 None] Creating volume 4a2b5896-7377-4c47-94aa-81f36c71ded3 {{(pid=87272) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 11:02:55 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-1b2133df-1f8f-4cfe-aaa3-85788f6bf379 tempest-VolumesExtendTest-1917483396 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 11:02:55 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-1b2133df-1f8f-4cfe-aaa3-85788f6bf379 tempest-VolumesExtendTest-1917483396 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 11:02:55 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-1b2133df-1f8f-4cfe-aaa3-85788f6bf379 tempest-VolumesExtendTest-1917483396 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898': None} {{(pid=87272) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 11:02:55 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-1b2133df-1f8f-4cfe-aaa3-85788f6bf379 tempest-VolumesExtendTest-1917483396 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'] {{(pid=87272) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 11:02:55 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-1b2133df-1f8f-4cfe-aaa3-85788f6bf379 tempest-VolumesExtendTest-1917483396 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 11:02:55 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-1b2133df-1f8f-4cfe-aaa3-85788f6bf379 tempest-VolumesExtendTest-1917483396 None] Selected osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898 as target Quobyte volume. {{(pid=87272) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 11:02:55 devstack cinder-volume[87272]: INFO cinder.volume.drivers.remotefs [None req-1b2133df-1f8f-4cfe-aaa3-85788f6bf379 tempest-VolumesExtendTest-1917483396 None] casted to osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898 Nov 04 11:02:55 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-1b2133df-1f8f-4cfe-aaa3-85788f6bf379 tempest-VolumesExtendTest-1917483396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-4a2b5896-7377-4c47-94aa-81f36c71ded3 1073741824 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:02:55 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-90f54321-96c4-4a6c-9d06-164d86752b6c tempest-VolumeDependencyTests-143533947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc23c047-8e94-4045-b2a2-448b73a04768) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d0924def-8711-4ff9-bf4f-7cefce60d2c7', 'volume_size': 1}' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:02:55 devstack sudo[101366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-4a2b5896-7377-4c47-94aa-81f36c71ded3 1073741824 Nov 04 11:02:55 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-90f54321-96c4-4a6c-9d06-164d86752b6c tempest-VolumeDependencyTests-143533947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a7552a42-7edd-4e57-a8b5-7042b70011de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:02:55 devstack sudo[101366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:02:56 devstack cinder-volume[87272]: INFO cinder.volume.flows.manager.create_volume [None req-90f54321-96c4-4a6c-9d06-164d86752b6c tempest-VolumeDependencyTests-143533947 None] Volume volume-d0924def-8711-4ff9-bf4f-7cefce60d2c7 (d0924def-8711-4ff9-bf4f-7cefce60d2c7): created successfully Nov 04 11:02:56 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-90f54321-96c4-4a6c-9d06-164d86752b6c tempest-VolumeDependencyTests-143533947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a7552a42-7edd-4e57-a8b5-7042b70011de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:02:56 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-90f54321-96c4-4a6c-9d06-164d86752b6c tempest-VolumeDependencyTests-143533947 None] Flow 'volume_create_manager' (b53dec08-4b0d-4854-aab4-04cdcb5ccc9f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87272) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 11:02:56 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-90f54321-96c4-4a6c-9d06-164d86752b6c tempest-VolumeDependencyTests-143533947 None] Created volume successfully. Nov 04 11:02:56 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-3a48974d-40c0-4b7d-beb0-bd4c4ded6500 tempest-VolumesSnapshotTestJSON-1399894899 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 11:02:56 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-ed3387ee-6a46-4c20-b8d1-5f0206d57790 tempest-VolumeDependencyTests-143533947 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 11:02:56 devstack sudo[101366]: pam_unix(sudo:session): session closed for user root Nov 04 11:02:56 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-1b2133df-1f8f-4cfe-aaa3-85788f6bf379 tempest-VolumesExtendTest-1917483396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-4a2b5896-7377-4c47-94aa-81f36c71ded3 1073741824" returned: 0 in 0.523s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:02:56 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-1b2133df-1f8f-4cfe-aaa3-85788f6bf379 tempest-VolumesExtendTest-1917483396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-4a2b5896-7377-4c47-94aa-81f36c71ded3 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:02:56 devstack sudo[101373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-4a2b5896-7377-4c47-94aa-81f36c71ded3 Nov 04 11:02:56 devstack sudo[101373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:02:56 devstack sudo[101373]: pam_unix(sudo:session): session closed for user root Nov 04 11:02:56 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-1b2133df-1f8f-4cfe-aaa3-85788f6bf379 tempest-VolumesExtendTest-1917483396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-4a2b5896-7377-4c47-94aa-81f36c71ded3" returned: 0 in 0.240s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:02:56 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-1b2133df-1f8f-4cfe-aaa3-85788f6bf379 tempest-VolumesExtendTest-1917483396 None] <== create_volume: return (802ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'} {{(pid=87272) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 04 11:02:56 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-1b2133df-1f8f-4cfe-aaa3-85788f6bf379 tempest-VolumesExtendTest-1917483396 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.805s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 11:02:56 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-3a48974d-40c0-4b7d-beb0-bd4c4ded6500 tempest-VolumesSnapshotTestJSON-1399894899 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.658s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 11:02:56 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.remotefs [None req-3a48974d-40c0-4b7d-beb0-bd4c4ded6500 tempest-VolumesSnapshotTestJSON-1399894899 None] Creating offline snapshot b0fe283b-e840-4aed-b2f7-c2987ce67a8c of volume b97bf6eb-69d3-4ba1-ba94-8a004078ecf5 {{(pid=87272) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 04 11:02:56 devstack cinder-volume[87272]: DEBUG cinder.volume.volume_utils [None req-1b2133df-1f8f-4cfe-aaa3-85788f6bf379 tempest-VolumesExtendTest-1917483396 None] Attempting download of e21f1c05-a199-4b20-94c3-a13f8db1348a ((None, [{'url': 'file:///opt/stack/data/glance/images/e21f1c05-a199-4b20-94c3-a13f8db1348a', 'metadata': {}}])) to volume 4a2b5896-7377-4c47-94aa-81f36c71ded3. {{(pid=87272) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Nov 04 11:02:56 devstack cinder-volume[87272]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca861953-6af4-42ff-b8d9-c6f5711972c9]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 11:02:56 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-3a48974d-40c0-4b7d-beb0-bd4c4ded6500 tempest-VolumesSnapshotTestJSON-1399894899 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-b97bf6eb-69d3-4ba1-ba94-8a004078ecf5 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:02:56 devstack cinder-volume[87272]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd06e55b-6607-4d12-b506-b8ce6d395866]: (4, 'raw') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 11:02:56 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-1b2133df-1f8f-4cfe-aaa3-85788f6bf379 tempest-VolumesExtendTest-1917483396 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e21f1c05-a199-4b20-94c3-a13f8db1348a_vtlivau4 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:02:56 devstack sudo[101376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-b97bf6eb-69d3-4ba1-ba94-8a004078ecf5 Nov 04 11:02:56 devstack sudo[101376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:02:56 devstack sudo[101377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e21f1c05-a199-4b20-94c3-a13f8db1348a_vtlivau4 Nov 04 11:02:56 devstack sudo[101377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:02:57 devstack sudo[101376]: pam_unix(sudo:session): session closed for user root Nov 04 11:02:57 devstack sudo[101377]: pam_unix(sudo:session): session closed for user root Nov 04 11:02:57 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-3a48974d-40c0-4b7d-beb0-bd4c4ded6500 tempest-VolumesSnapshotTestJSON-1399894899 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-b97bf6eb-69d3-4ba1-ba94-8a004078ecf5" returned: 0 in 0.369s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:02:57 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-3a48974d-40c0-4b7d-beb0-bd4c4ded6500 tempest-VolumesSnapshotTestJSON-1399894899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-b97bf6eb-69d3-4ba1-ba94-8a004078ecf5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-b97bf6eb-69d3-4ba1-ba94-8a004078ecf5.b0fe283b-e840-4aed-b2f7-c2987ce67a8c 1G {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:02:57 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-1b2133df-1f8f-4cfe-aaa3-85788f6bf379 tempest-VolumesExtendTest-1917483396 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e21f1c05-a199-4b20-94c3-a13f8db1348a_vtlivau4" returned: 0 in 0.336s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:02:57 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-1b2133df-1f8f-4cfe-aaa3-85788f6bf379 tempest-VolumesExtendTest-1917483396 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e21f1c05-a199-4b20-94c3-a13f8db1348a_vtlivau4 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:02:57 devstack sudo[101385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-b97bf6eb-69d3-4ba1-ba94-8a004078ecf5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-b97bf6eb-69d3-4ba1-ba94-8a004078ecf5.b0fe283b-e840-4aed-b2f7-c2987ce67a8c 1G Nov 04 11:02:57 devstack sudo[101385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:02:57 devstack sudo[101386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e21f1c05-a199-4b20-94c3-a13f8db1348a_vtlivau4 Nov 04 11:02:57 devstack sudo[101386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:02:57 devstack sudo[101386]: pam_unix(sudo:session): session closed for user root Nov 04 11:02:57 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-1b2133df-1f8f-4cfe-aaa3-85788f6bf379 tempest-VolumesExtendTest-1917483396 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e21f1c05-a199-4b20-94c3-a13f8db1348a_vtlivau4" returned: 1 in 0.338s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:02:57 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-1b2133df-1f8f-4cfe-aaa3-85788f6bf379 tempest-VolumesExtendTest-1917483396 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e21f1c05-a199-4b20-94c3-a13f8db1348a_vtlivau4' failed. Not Retrying. {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 04 11:02:57 devstack cinder-volume[87272]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c1064d0-bd5a-4830-b998-d110cb8b0992]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 11:02:57 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-1b2133df-1f8f-4cfe-aaa3-85788f6bf379 tempest-VolumesExtendTest-1917483396 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e21f1c05-a199-4b20-94c3-a13f8db1348a_cbw6l24adevstack@QuobyteHD {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:02:57 devstack sudo[101385]: pam_unix(sudo:session): session closed for user root Nov 04 11:02:57 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-3a48974d-40c0-4b7d-beb0-bd4c4ded6500 tempest-VolumesSnapshotTestJSON-1399894899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-b97bf6eb-69d3-4ba1-ba94-8a004078ecf5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-b97bf6eb-69d3-4ba1-ba94-8a004078ecf5.b0fe283b-e840-4aed-b2f7-c2987ce67a8c 1G" returned: 0 in 0.437s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:02:57 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-3a48974d-40c0-4b7d-beb0-bd4c4ded6500 tempest-VolumesSnapshotTestJSON-1399894899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b97bf6eb-69d3-4ba1-ba94-8a004078ecf5 -F qcow2 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-b97bf6eb-69d3-4ba1-ba94-8a004078ecf5.b0fe283b-e840-4aed-b2f7-c2987ce67a8c {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:02:57 devstack sudo[101394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e21f1c05-a199-4b20-94c3-a13f8db1348a_cbw6l24adevstack@QuobyteHD Nov 04 11:02:57 devstack sudo[101394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:02:57 devstack sudo[101395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b97bf6eb-69d3-4ba1-ba94-8a004078ecf5 -F qcow2 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-b97bf6eb-69d3-4ba1-ba94-8a004078ecf5.b0fe283b-e840-4aed-b2f7-c2987ce67a8c Nov 04 11:02:57 devstack sudo[101395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:02:57 devstack sudo[101394]: pam_unix(sudo:session): session closed for user root Nov 04 11:02:57 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-1b2133df-1f8f-4cfe-aaa3-85788f6bf379 tempest-VolumesExtendTest-1917483396 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e21f1c05-a199-4b20-94c3-a13f8db1348a_cbw6l24adevstack@QuobyteHD" returned: 0 in 0.338s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:02:57 devstack cinder-volume[87272]: DEBUG cinder.image.image_utils [None req-1b2133df-1f8f-4cfe-aaa3-85788f6bf379 tempest-VolumesExtendTest-1917483396 None] e21f1c05-a199-4b20-94c3-a13f8db1348a was qcow2, converting to qcow2 {{(pid=87272) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Nov 04 11:02:57 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-1b2133df-1f8f-4cfe-aaa3-85788f6bf379 tempest-VolumesExtendTest-1917483396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_e21f1c05-a199-4b20-94c3-a13f8db1348a_cbw6l24adevstack@QuobyteHD /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-4a2b5896-7377-4c47-94aa-81f36c71ded3 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:02:57 devstack sudo[101404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_e21f1c05-a199-4b20-94c3-a13f8db1348a_cbw6l24adevstack@QuobyteHD /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-4a2b5896-7377-4c47-94aa-81f36c71ded3 Nov 04 11:02:57 devstack sudo[101404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:02:57 devstack sudo[101395]: pam_unix(sudo:session): session closed for user root Nov 04 11:02:57 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-3a48974d-40c0-4b7d-beb0-bd4c4ded6500 tempest-VolumesSnapshotTestJSON-1399894899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b97bf6eb-69d3-4ba1-ba94-8a004078ecf5 -F qcow2 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-b97bf6eb-69d3-4ba1-ba94-8a004078ecf5.b0fe283b-e840-4aed-b2f7-c2987ce67a8c" returned: 0 in 0.299s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:02:57 devstack cinder-volume[87272]: WARNING cinder.volume.drivers.remotefs [None req-3a48974d-40c0-4b7d-beb0-bd4c4ded6500 tempest-VolumesSnapshotTestJSON-1399894899 None] /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-b97bf6eb-69d3-4ba1-ba94-8a004078ecf5.b0fe283b-e840-4aed-b2f7-c2987ce67a8c is being set with open permissions: ugo+rw Nov 04 11:02:57 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-3a48974d-40c0-4b7d-beb0-bd4c4ded6500 tempest-VolumesSnapshotTestJSON-1399894899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-b97bf6eb-69d3-4ba1-ba94-8a004078ecf5.b0fe283b-e840-4aed-b2f7-c2987ce67a8c {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:02:57 devstack sudo[101406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-b97bf6eb-69d3-4ba1-ba94-8a004078ecf5.b0fe283b-e840-4aed-b2f7-c2987ce67a8c Nov 04 11:02:57 devstack sudo[101406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:02:58 devstack sudo[101406]: pam_unix(sudo:session): session closed for user root Nov 04 11:02:58 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-3a48974d-40c0-4b7d-beb0-bd4c4ded6500 tempest-VolumesSnapshotTestJSON-1399894899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-b97bf6eb-69d3-4ba1-ba94-8a004078ecf5.b0fe283b-e840-4aed-b2f7-c2987ce67a8c" returned: 0 in 0.262s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:02:58 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-3a48974d-40c0-4b7d-beb0-bd4c4ded6500 tempest-VolumesSnapshotTestJSON-1399894899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-b97bf6eb-69d3-4ba1-ba94-8a004078ecf5.info {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:02:58 devstack sudo[101412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-b97bf6eb-69d3-4ba1-ba94-8a004078ecf5.info Nov 04 11:02:58 devstack sudo[101412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:02:58 devstack sudo[101412]: pam_unix(sudo:session): session closed for user root Nov 04 11:02:58 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-3a48974d-40c0-4b7d-beb0-bd4c4ded6500 tempest-VolumesSnapshotTestJSON-1399894899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-b97bf6eb-69d3-4ba1-ba94-8a004078ecf5.info" returned: 0 in 0.308s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:02:58 devstack cinder-volume[87272]: WARNING cinder.volume.drivers.remotefs [None req-3a48974d-40c0-4b7d-beb0-bd4c4ded6500 tempest-VolumesSnapshotTestJSON-1399894899 None] /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-b97bf6eb-69d3-4ba1-ba94-8a004078ecf5.info is being set with open permissions: ugo+rw Nov 04 11:02:58 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-3a48974d-40c0-4b7d-beb0-bd4c4ded6500 tempest-VolumesSnapshotTestJSON-1399894899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-b97bf6eb-69d3-4ba1-ba94-8a004078ecf5.info {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:02:58 devstack sudo[101416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-b97bf6eb-69d3-4ba1-ba94-8a004078ecf5.info Nov 04 11:02:58 devstack sudo[101416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:02:58 devstack sudo[101416]: pam_unix(sudo:session): session closed for user root Nov 04 11:02:58 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-3a48974d-40c0-4b7d-beb0-bd4c4ded6500 tempest-VolumesSnapshotTestJSON-1399894899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-b97bf6eb-69d3-4ba1-ba94-8a004078ecf5.info" returned: 0 in 0.296s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:02:58 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-3a48974d-40c0-4b7d-beb0-bd4c4ded6500 tempest-VolumesSnapshotTestJSON-1399894899 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.080s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 11:02:58 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-ed3387ee-6a46-4c20-b8d1-5f0206d57790 tempest-VolumeDependencyTests-143533947 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.415s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 11:02:58 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.remotefs [None req-ed3387ee-6a46-4c20-b8d1-5f0206d57790 tempest-VolumeDependencyTests-143533947 None] Creating offline snapshot fd9695c9-9848-447b-bc8e-22e94a04e547 of volume d0924def-8711-4ff9-bf4f-7cefce60d2c7 {{(pid=87272) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 04 11:02:58 devstack cinder-volume[87272]: DEBUG oslo.privsep.daemon [-] privsep: reply[33639184-9360-4106-bcc4-76f26112a4ef]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 11:02:58 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-3a48974d-40c0-4b7d-beb0-bd4c4ded6500 tempest-VolumesSnapshotTestJSON-1399894899 None] Create snapshot completed successfully Nov 04 11:02:58 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-ed3387ee-6a46-4c20-b8d1-5f0206d57790 tempest-VolumeDependencyTests-143533947 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-d0924def-8711-4ff9-bf4f-7cefce60d2c7 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:02:59 devstack sudo[101420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-d0924def-8711-4ff9-bf4f-7cefce60d2c7 Nov 04 11:02:59 devstack sudo[101420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:02:59 devstack sudo[101420]: pam_unix(sudo:session): session closed for user root Nov 04 11:02:59 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-ed3387ee-6a46-4c20-b8d1-5f0206d57790 tempest-VolumeDependencyTests-143533947 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-d0924def-8711-4ff9-bf4f-7cefce60d2c7" returned: 0 in 0.419s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:02:59 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-ed3387ee-6a46-4c20-b8d1-5f0206d57790 tempest-VolumeDependencyTests-143533947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-d0924def-8711-4ff9-bf4f-7cefce60d2c7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-d0924def-8711-4ff9-bf4f-7cefce60d2c7.fd9695c9-9848-447b-bc8e-22e94a04e547 1G {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:02:59 devstack sudo[101425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-d0924def-8711-4ff9-bf4f-7cefce60d2c7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-d0924def-8711-4ff9-bf4f-7cefce60d2c7.fd9695c9-9848-447b-bc8e-22e94a04e547 1G Nov 04 11:02:59 devstack sudo[101425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:02:59 devstack cinder-volume[87272]: DEBUG cinder.volume.flows.manager.create_volume [None req-ee4f8360-2077-4f7c-89f6-1ce5d752843a tempest-VolumesSnapshotTestJSON-1399894899 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87272) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 11:02:59 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-ee4f8360-2077-4f7c-89f6-1ce5d752843a tempest-VolumesSnapshotTestJSON-1399894899 None] Flow 'volume_create_manager' (f08f5171-4439-4cd7-ad5c-4fee6f027213) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 11:02:59 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-ee4f8360-2077-4f7c-89f6-1ce5d752843a tempest-VolumesSnapshotTestJSON-1399894899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc64dc85-a52c-4de9-8453-a6f98d0950d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:02:59 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-ee4f8360-2077-4f7c-89f6-1ce5d752843a tempest-VolumesSnapshotTestJSON-1399894899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc64dc85-a52c-4de9-8453-a6f98d0950d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T10:02:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-753090568',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fefdccd3-7d50-4b82-a670-a1a6535c5e02,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef099de5b8794b308a0c8f182ca0fca1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T10:03:00Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=b0fe283b-e840-4aed-b2f7-c2987ce67a8c,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T10:03:00Z,use_quota=True,user_id='73239b009fea418ba15cb75342ef934d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8989e4f-21e3-4f0a-9584-0d818784e883),volume_type_id=f8989e4f-21e3-4f0a-9584-0d818784e883)' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:02:59 devstack sudo[101425]: pam_unix(sudo:session): session closed for user root Nov 04 11:02:59 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-ee4f8360-2077-4f7c-89f6-1ce5d752843a tempest-VolumesSnapshotTestJSON-1399894899 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc977fbf-7430-4de5-9a16-92cd4db5617e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:02:59 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-ee4f8360-2077-4f7c-89f6-1ce5d752843a tempest-VolumesSnapshotTestJSON-1399894899 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc977fbf-7430-4de5-9a16-92cd4db5617e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:02:59 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-ee4f8360-2077-4f7c-89f6-1ce5d752843a tempest-VolumesSnapshotTestJSON-1399894899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ceb666d1-879e-4b1b-9fd7-3cbe087fff0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:02:59 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-ee4f8360-2077-4f7c-89f6-1ce5d752843a tempest-VolumesSnapshotTestJSON-1399894899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ceb666d1-879e-4b1b-9fd7-3cbe087fff0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'fefdccd3-7d50-4b82-a670-a1a6535c5e02', 'volume_name': 'volume-fefdccd3-7d50-4b82-a670-a1a6535c5e02', 'volume_size': 2, 'snapshot_id': 'b0fe283b-e840-4aed-b2f7-c2987ce67a8c'}' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:02:59 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-ee4f8360-2077-4f7c-89f6-1ce5d752843a tempest-VolumesSnapshotTestJSON-1399894899 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c8fee11-d538-43e2-bd82-100974c0da5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:02:59 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-ee4f8360-2077-4f7c-89f6-1ce5d752843a tempest-VolumesSnapshotTestJSON-1399894899 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c8fee11-d538-43e2-bd82-100974c0da5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:02:59 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-ee4f8360-2077-4f7c-89f6-1ce5d752843a tempest-VolumesSnapshotTestJSON-1399894899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (45f8793c-dd6a-4fb8-8943-148f2ad4ead0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:02:59 devstack cinder-volume[87272]: INFO cinder.volume.flows.manager.create_volume [None req-ee4f8360-2077-4f7c-89f6-1ce5d752843a tempest-VolumesSnapshotTestJSON-1399894899 None] Volume fefdccd3-7d50-4b82-a670-a1a6535c5e02: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-fefdccd3-7d50-4b82-a670-a1a6535c5e02', 'volume_size': 2, 'snapshot_id': 'b0fe283b-e840-4aed-b2f7-c2987ce67a8c'} Nov 04 11:02:59 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-ed3387ee-6a46-4c20-b8d1-5f0206d57790 tempest-VolumeDependencyTests-143533947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-d0924def-8711-4ff9-bf4f-7cefce60d2c7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-d0924def-8711-4ff9-bf4f-7cefce60d2c7.fd9695c9-9848-447b-bc8e-22e94a04e547 1G" returned: 0 in 0.650s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:02:59 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-ed3387ee-6a46-4c20-b8d1-5f0206d57790 tempest-VolumeDependencyTests-143533947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d0924def-8711-4ff9-bf4f-7cefce60d2c7 -F qcow2 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-d0924def-8711-4ff9-bf4f-7cefce60d2c7.fd9695c9-9848-447b-bc8e-22e94a04e547 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:02:59 devstack sudo[101404]: pam_unix(sudo:session): session closed for user root Nov 04 11:02:59 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-ee4f8360-2077-4f7c-89f6-1ce5d752843a tempest-VolumesSnapshotTestJSON-1399894899 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 11:02:59 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-1b2133df-1f8f-4cfe-aaa3-85788f6bf379 tempest-VolumesExtendTest-1917483396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_e21f1c05-a199-4b20-94c3-a13f8db1348a_cbw6l24adevstack@QuobyteHD /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-4a2b5896-7377-4c47-94aa-81f36c71ded3" returned: 0 in 2.120s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:02:59 devstack cinder-volume[87272]: DEBUG cinder.image.image_utils [None req-1b2133df-1f8f-4cfe-aaa3-85788f6bf379 tempest-VolumesExtendTest-1917483396 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_e21f1c05-a199-4b20-94c3-a13f8db1348a_cbw6l24adevstack@QuobyteHD, size 112.00 MB, duration 2.12 sec, destination /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-4a2b5896-7377-4c47-94aa-81f36c71ded3 {{(pid=87272) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Nov 04 11:02:59 devstack cinder-volume[87272]: INFO cinder.image.image_utils [None req-1b2133df-1f8f-4cfe-aaa3-85788f6bf379 tempest-VolumesExtendTest-1917483396 None] Converted 112.00 MB image at 52.82 MB/s Nov 04 11:02:59 devstack sudo[101430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d0924def-8711-4ff9-bf4f-7cefce60d2c7 -F qcow2 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-d0924def-8711-4ff9-bf4f-7cefce60d2c7.fd9695c9-9848-447b-bc8e-22e94a04e547 Nov 04 11:02:59 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-1b2133df-1f8f-4cfe-aaa3-85788f6bf379 tempest-VolumesExtendTest-1917483396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-4a2b5896-7377-4c47-94aa-81f36c71ded3 1G {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:02:59 devstack sudo[101430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:03:00 devstack sudo[101432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-4a2b5896-7377-4c47-94aa-81f36c71ded3 1G Nov 04 11:03:00 devstack sudo[101432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:03:00 devstack sudo[101430]: pam_unix(sudo:session): session closed for user root Nov 04 11:03:00 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-ed3387ee-6a46-4c20-b8d1-5f0206d57790 tempest-VolumeDependencyTests-143533947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d0924def-8711-4ff9-bf4f-7cefce60d2c7 -F qcow2 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-d0924def-8711-4ff9-bf4f-7cefce60d2c7.fd9695c9-9848-447b-bc8e-22e94a04e547" returned: 0 in 0.299s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:03:00 devstack cinder-volume[87272]: WARNING cinder.volume.drivers.remotefs [None req-ed3387ee-6a46-4c20-b8d1-5f0206d57790 tempest-VolumeDependencyTests-143533947 None] /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-d0924def-8711-4ff9-bf4f-7cefce60d2c7.fd9695c9-9848-447b-bc8e-22e94a04e547 is being set with open permissions: ugo+rw Nov 04 11:03:00 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-ed3387ee-6a46-4c20-b8d1-5f0206d57790 tempest-VolumeDependencyTests-143533947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-d0924def-8711-4ff9-bf4f-7cefce60d2c7.fd9695c9-9848-447b-bc8e-22e94a04e547 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:03:00 devstack sudo[101441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-d0924def-8711-4ff9-bf4f-7cefce60d2c7.fd9695c9-9848-447b-bc8e-22e94a04e547 Nov 04 11:03:00 devstack sudo[101441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:03:00 devstack sudo[101432]: pam_unix(sudo:session): session closed for user root Nov 04 11:03:00 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-1b2133df-1f8f-4cfe-aaa3-85788f6bf379 tempest-VolumesExtendTest-1917483396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-4a2b5896-7377-4c47-94aa-81f36c71ded3 1G" returned: 0 in 0.320s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:03:00 devstack cinder-volume[87272]: DEBUG cinder.volume.volume_utils [None req-1b2133df-1f8f-4cfe-aaa3-85788f6bf379 tempest-VolumesExtendTest-1917483396 None] Downloaded image e21f1c05-a199-4b20-94c3-a13f8db1348a ((None, [{'url': 'file:///opt/stack/data/glance/images/e21f1c05-a199-4b20-94c3-a13f8db1348a', 'metadata': {}}])) to volume 4a2b5896-7377-4c47-94aa-81f36c71ded3 successfully. {{(pid=87272) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Nov 04 11:03:00 devstack cinder-volume[87272]: DEBUG cinder.image.image_utils [None req-1b2133df-1f8f-4cfe-aaa3-85788f6bf379 tempest-VolumesExtendTest-1917483396 None] Temporary image e21f1c05-a199-4b20-94c3-a13f8db1348a for user 4a8097cabbf54e0c9b37a3d456c62743 is deleted. {{(pid=87272) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Nov 04 11:03:00 devstack cinder-volume[87272]: DEBUG cinder.volume.volume_utils [None req-1b2133df-1f8f-4cfe-aaa3-85788f6bf379 tempest-VolumesExtendTest-1917483396 None] Marking volume 4a2b5896-7377-4c47-94aa-81f36c71ded3 as bootable. {{(pid=87272) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Nov 04 11:03:00 devstack cinder-volume[87272]: DEBUG cinder.volume.flows.manager.create_volume [None req-1b2133df-1f8f-4cfe-aaa3-85788f6bf379 tempest-VolumesExtendTest-1917483396 None] Copying metadata from image e21f1c05-a199-4b20-94c3-a13f8db1348a to 4a2b5896-7377-4c47-94aa-81f36c71ded3. {{(pid=87272) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 04 11:03:00 devstack cinder-volume[87272]: DEBUG cinder.volume.flows.manager.create_volume [None req-1b2133df-1f8f-4cfe-aaa3-85788f6bf379 tempest-VolumesExtendTest-1917483396 None] Creating volume glance metadata for volume 4a2b5896-7377-4c47-94aa-81f36c71ded3 backed by image e21f1c05-a199-4b20-94c3-a13f8db1348a with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'e21f1c05-a199-4b20-94c3-a13f8db1348a', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87272) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 04 11:03:00 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-1b2133df-1f8f-4cfe-aaa3-85788f6bf379 tempest-VolumesExtendTest-1917483396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f20eac0d-09f5-4658-9cd5-4a92ba258b21) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4a2b5896-7377-4c47-94aa-81f36c71ded3', 'volume_size': 1, 'image_id': 'e21f1c05-a199-4b20-94c3-a13f8db1348a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e21f1c05-a199-4b20-94c3-a13f8db1348a', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'a0568d152f1945e380a1ac4afff5179c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'e21f1c05-a199-4b20-94c3-a13f8db1348a', 'created_at': datetime.datetime(2026, 11, 4, 9, 43, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 4, 9, 44, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e21f1c05-a199-4b20-94c3-a13f8db1348a/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:03:00 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-1b2133df-1f8f-4cfe-aaa3-85788f6bf379 tempest-VolumesExtendTest-1917483396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (847867d0-ec5e-4c60-b86b-68ddc94ea249) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:03:00 devstack cinder-volume[87272]: INFO cinder.volume.flows.manager.create_volume [None req-1b2133df-1f8f-4cfe-aaa3-85788f6bf379 tempest-VolumesExtendTest-1917483396 None] Volume volume-4a2b5896-7377-4c47-94aa-81f36c71ded3 (4a2b5896-7377-4c47-94aa-81f36c71ded3): created successfully Nov 04 11:03:00 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-1b2133df-1f8f-4cfe-aaa3-85788f6bf379 tempest-VolumesExtendTest-1917483396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (847867d0-ec5e-4c60-b86b-68ddc94ea249) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:03:00 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-1b2133df-1f8f-4cfe-aaa3-85788f6bf379 tempest-VolumesExtendTest-1917483396 None] Flow 'volume_create_manager' (33ca6e43-6058-471b-9b01-266102428771) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87272) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 11:03:00 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-1b2133df-1f8f-4cfe-aaa3-85788f6bf379 tempest-VolumesExtendTest-1917483396 None] Created volume successfully. Nov 04 11:03:00 devstack sudo[101441]: pam_unix(sudo:session): session closed for user root Nov 04 11:03:00 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-ed3387ee-6a46-4c20-b8d1-5f0206d57790 tempest-VolumeDependencyTests-143533947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-d0924def-8711-4ff9-bf4f-7cefce60d2c7.fd9695c9-9848-447b-bc8e-22e94a04e547" returned: 0 in 0.261s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:03:00 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-ed3387ee-6a46-4c20-b8d1-5f0206d57790 tempest-VolumeDependencyTests-143533947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-d0924def-8711-4ff9-bf4f-7cefce60d2c7.info {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:03:00 devstack sudo[101444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-d0924def-8711-4ff9-bf4f-7cefce60d2c7.info Nov 04 11:03:00 devstack sudo[101444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:03:00 devstack sudo[101444]: pam_unix(sudo:session): session closed for user root Nov 04 11:03:00 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-ed3387ee-6a46-4c20-b8d1-5f0206d57790 tempest-VolumeDependencyTests-143533947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-d0924def-8711-4ff9-bf4f-7cefce60d2c7.info" returned: 0 in 0.236s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:03:00 devstack cinder-volume[87272]: WARNING cinder.volume.drivers.remotefs [None req-ed3387ee-6a46-4c20-b8d1-5f0206d57790 tempest-VolumeDependencyTests-143533947 None] /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-d0924def-8711-4ff9-bf4f-7cefce60d2c7.info is being set with open permissions: ugo+rw Nov 04 11:03:00 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-ed3387ee-6a46-4c20-b8d1-5f0206d57790 tempest-VolumeDependencyTests-143533947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-d0924def-8711-4ff9-bf4f-7cefce60d2c7.info {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:03:00 devstack sudo[101447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-d0924def-8711-4ff9-bf4f-7cefce60d2c7.info Nov 04 11:03:00 devstack sudo[101447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:03:01 devstack sudo[101447]: pam_unix(sudo:session): session closed for user root Nov 04 11:03:01 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-ed3387ee-6a46-4c20-b8d1-5f0206d57790 tempest-VolumeDependencyTests-143533947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-d0924def-8711-4ff9-bf4f-7cefce60d2c7.info" returned: 0 in 0.260s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:03:01 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-ed3387ee-6a46-4c20-b8d1-5f0206d57790 tempest-VolumeDependencyTests-143533947 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.231s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 11:03:01 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-ee4f8360-2077-4f7c-89f6-1ce5d752843a tempest-VolumesSnapshotTestJSON-1399894899 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 1.097s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 11:03:01 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-ee4f8360-2077-4f7c-89f6-1ce5d752843a tempest-VolumesSnapshotTestJSON-1399894899 None] Acquiring lock "cinder-quobyte-b0fe283b-e840-4aed-b2f7-c2987ce67a8c-fefdccd3-7d50-4b82-a670-a1a6535c5e02" by "_create_volume_from_snapshot" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 11:03:01 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-d2378309-2f8b-4961-b1bd-ceb4591d3559 tempest-VolumesExtendTest-1917483396 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 11:03:01 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-ed3387ee-6a46-4c20-b8d1-5f0206d57790 tempest-VolumeDependencyTests-143533947 None] Create snapshot completed successfully Nov 04 11:03:01 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-ee4f8360-2077-4f7c-89f6-1ce5d752843a tempest-VolumesSnapshotTestJSON-1399894899 None] Lock "cinder-quobyte-b0fe283b-e840-4aed-b2f7-c2987ce67a8c-fefdccd3-7d50-4b82-a670-a1a6535c5e02" acquired by "_create_volume_from_snapshot" :: waited 0.029s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 11:03:01 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-ee4f8360-2077-4f7c-89f6-1ce5d752843a tempest-VolumesSnapshotTestJSON-1399894899 None] Creating volume fefdccd3-7d50-4b82-a670-a1a6535c5e02 from snapshot b0fe283b-e840-4aed-b2f7-c2987ce67a8c {{(pid=87272) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 04 11:03:01 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-ee4f8360-2077-4f7c-89f6-1ce5d752843a tempest-VolumesSnapshotTestJSON-1399894899 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 11:03:01 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-ee4f8360-2077-4f7c-89f6-1ce5d752843a tempest-VolumesSnapshotTestJSON-1399894899 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 11:03:01 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-ee4f8360-2077-4f7c-89f6-1ce5d752843a tempest-VolumesSnapshotTestJSON-1399894899 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898': None} {{(pid=87272) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 11:03:01 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-ee4f8360-2077-4f7c-89f6-1ce5d752843a tempest-VolumesSnapshotTestJSON-1399894899 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'] {{(pid=87272) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 11:03:01 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-ee4f8360-2077-4f7c-89f6-1ce5d752843a tempest-VolumesSnapshotTestJSON-1399894899 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 11:03:01 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-ee4f8360-2077-4f7c-89f6-1ce5d752843a tempest-VolumesSnapshotTestJSON-1399894899 None] Selected osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898 as target Quobyte volume. {{(pid=87272) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 11:03:01 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-ee4f8360-2077-4f7c-89f6-1ce5d752843a tempest-VolumesSnapshotTestJSON-1399894899 None] Acquiring lock "cinder-quobyte-fefdccd3-7d50-4b82-a670-a1a6535c5e02" by "_copy_volume_from_snapshot" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 11:03:01 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-ee4f8360-2077-4f7c-89f6-1ce5d752843a tempest-VolumesSnapshotTestJSON-1399894899 None] Lock "cinder-quobyte-fefdccd3-7d50-4b82-a670-a1a6535c5e02" acquired by "_copy_volume_from_snapshot" :: waited 0.016s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 11:03:01 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-ee4f8360-2077-4f7c-89f6-1ce5d752843a tempest-VolumesSnapshotTestJSON-1399894899 None] snapshot: b0fe283b-e840-4aed-b2f7-c2987ce67a8c, volume: fefdccd3-7d50-4b82-a670-a1a6535c5e02, {{(pid=87272) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 04 11:03:01 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-ee4f8360-2077-4f7c-89f6-1ce5d752843a tempest-VolumesSnapshotTestJSON-1399894899 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 11:03:01 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-ee4f8360-2077-4f7c-89f6-1ce5d752843a tempest-VolumesSnapshotTestJSON-1399894899 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 11:03:01 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-ee4f8360-2077-4f7c-89f6-1ce5d752843a tempest-VolumesSnapshotTestJSON-1399894899 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898': None} {{(pid=87272) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 11:03:01 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-ee4f8360-2077-4f7c-89f6-1ce5d752843a tempest-VolumesSnapshotTestJSON-1399894899 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'] {{(pid=87272) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 11:03:01 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-ee4f8360-2077-4f7c-89f6-1ce5d752843a tempest-VolumesSnapshotTestJSON-1399894899 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 11:03:01 devstack cinder-volume[87272]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3d99307-6122-415f-83a7-d93050ef372c]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 11:03:01 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-ee4f8360-2077-4f7c-89f6-1ce5d752843a tempest-VolumesSnapshotTestJSON-1399894899 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-b97bf6eb-69d3-4ba1-ba94-8a004078ecf5.b0fe283b-e840-4aed-b2f7-c2987ce67a8c {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:03:01 devstack sudo[101450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-b97bf6eb-69d3-4ba1-ba94-8a004078ecf5.b0fe283b-e840-4aed-b2f7-c2987ce67a8c Nov 04 11:03:01 devstack sudo[101450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:03:01 devstack sudo[101450]: pam_unix(sudo:session): session closed for user root Nov 04 11:03:01 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-ee4f8360-2077-4f7c-89f6-1ce5d752843a tempest-VolumesSnapshotTestJSON-1399894899 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-b97bf6eb-69d3-4ba1-ba94-8a004078ecf5.b0fe283b-e840-4aed-b2f7-c2987ce67a8c" returned: 0 in 0.376s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:03:01 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.remotefs [None req-ee4f8360-2077-4f7c-89f6-1ce5d752843a tempest-VolumesSnapshotTestJSON-1399894899 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b97bf6eb-69d3-4ba1-ba94-8a004078ecf5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87272) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 11:03:01 devstack cinder-volume[87272]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d7d15c4-50bd-4c67-aa07-b6ec8bc04b3f]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 11:03:01 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-ee4f8360-2077-4f7c-89f6-1ce5d752843a tempest-VolumesSnapshotTestJSON-1399894899 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-b97bf6eb-69d3-4ba1-ba94-8a004078ecf5 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:03:01 devstack sudo[101455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-b97bf6eb-69d3-4ba1-ba94-8a004078ecf5 Nov 04 11:03:01 devstack sudo[101455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:03:01 devstack sudo[101455]: pam_unix(sudo:session): session closed for user root Nov 04 11:03:01 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-ee4f8360-2077-4f7c-89f6-1ce5d752843a tempest-VolumesSnapshotTestJSON-1399894899 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-b97bf6eb-69d3-4ba1-ba94-8a004078ecf5" returned: 0 in 0.374s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:03:01 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-ee4f8360-2077-4f7c-89f6-1ce5d752843a tempest-VolumesSnapshotTestJSON-1399894899 None] will copy from snapshot at /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-b97bf6eb-69d3-4ba1-ba94-8a004078ecf5 {{(pid=87272) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 04 11:03:01 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-ee4f8360-2077-4f7c-89f6-1ce5d752843a tempest-VolumesSnapshotTestJSON-1399894899 None] Creating direct copy from snapshot {{(pid=87272) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 04 11:03:01 devstack cinder-volume[87272]: DEBUG cinder.utils [None req-ee4f8360-2077-4f7c-89f6-1ce5d752843a tempest-VolumesSnapshotTestJSON-1399894899 None] Path /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-fefdccd3-7d50-4b82-a670-a1a6535c5e02 not found in is_blk_device check {{(pid=87272) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Nov 04 11:03:01 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-ee4f8360-2077-4f7c-89f6-1ce5d752843a tempest-VolumesSnapshotTestJSON-1399894899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-b97bf6eb-69d3-4ba1-ba94-8a004078ecf5 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-fefdccd3-7d50-4b82-a670-a1a6535c5e02 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:03:01 devstack sudo[101460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-b97bf6eb-69d3-4ba1-ba94-8a004078ecf5 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-fefdccd3-7d50-4b82-a670-a1a6535c5e02 Nov 04 11:03:01 devstack sudo[101460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:03:02 devstack cinder-volume[87272]: DEBUG cinder.volume.flows.manager.create_volume [None req-8b8cb5ba-1a02-45b1-aa75-b1d7cfe379bc tempest-VolumeDependencyTests-143533947 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87272) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 11:03:02 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-8b8cb5ba-1a02-45b1-aa75-b1d7cfe379bc tempest-VolumeDependencyTests-143533947 None] Flow 'volume_create_manager' (55a0f147-9a4d-492a-8996-6de99f26ec79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 11:03:02 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-8b8cb5ba-1a02-45b1-aa75-b1d7cfe379bc tempest-VolumeDependencyTests-143533947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b89bcc3d-4870-4dcf-94ae-fcdee4b3ef00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:03:02 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-8b8cb5ba-1a02-45b1-aa75-b1d7cfe379bc tempest-VolumeDependencyTests-143533947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b89bcc3d-4870-4dcf-94ae-fcdee4b3ef00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T10:03:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-737593201',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=67c3098d-f1f4-4419-9257-8640a32c6f3a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a83b55c72b045659c872c0d592d4d26',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T10:03:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=fd9695c9-9848-447b-bc8e-22e94a04e547,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T10:03:02Z,use_quota=True,user_id='16a3c67151904b5193f06022769ff570',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8989e4f-21e3-4f0a-9584-0d818784e883),volume_type_id=f8989e4f-21e3-4f0a-9584-0d818784e883)' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:03:02 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-8b8cb5ba-1a02-45b1-aa75-b1d7cfe379bc tempest-VolumeDependencyTests-143533947 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01da4cec-bfce-4595-bf88-dd10319258e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:03:02 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-8b8cb5ba-1a02-45b1-aa75-b1d7cfe379bc tempest-VolumeDependencyTests-143533947 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01da4cec-bfce-4595-bf88-dd10319258e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:03:02 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-8b8cb5ba-1a02-45b1-aa75-b1d7cfe379bc tempest-VolumeDependencyTests-143533947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ea50354-d7c8-4781-8b9d-11db193f76b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:03:02 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-8b8cb5ba-1a02-45b1-aa75-b1d7cfe379bc tempest-VolumeDependencyTests-143533947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ea50354-d7c8-4781-8b9d-11db193f76b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '67c3098d-f1f4-4419-9257-8640a32c6f3a', 'volume_name': 'volume-67c3098d-f1f4-4419-9257-8640a32c6f3a', 'volume_size': 1, 'snapshot_id': 'fd9695c9-9848-447b-bc8e-22e94a04e547'}' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:03:02 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-8b8cb5ba-1a02-45b1-aa75-b1d7cfe379bc tempest-VolumeDependencyTests-143533947 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9767f02a-6bd2-4689-943a-bdef46d60b07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:03:02 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-8b8cb5ba-1a02-45b1-aa75-b1d7cfe379bc tempest-VolumeDependencyTests-143533947 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9767f02a-6bd2-4689-943a-bdef46d60b07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:03:02 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-8b8cb5ba-1a02-45b1-aa75-b1d7cfe379bc tempest-VolumeDependencyTests-143533947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f8adc01-7796-4a97-8c6d-87c19ff9df04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:03:02 devstack cinder-volume[87272]: INFO cinder.volume.flows.manager.create_volume [None req-8b8cb5ba-1a02-45b1-aa75-b1d7cfe379bc tempest-VolumeDependencyTests-143533947 None] Volume 67c3098d-f1f4-4419-9257-8640a32c6f3a: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-67c3098d-f1f4-4419-9257-8640a32c6f3a', 'volume_size': 1, 'snapshot_id': 'fd9695c9-9848-447b-bc8e-22e94a04e547'} Nov 04 11:03:02 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-8b8cb5ba-1a02-45b1-aa75-b1d7cfe379bc tempest-VolumeDependencyTests-143533947 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 11:03:07 devstack sudo[101460]: pam_unix(sudo:session): session closed for user root Nov 04 11:03:07 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-ee4f8360-2077-4f7c-89f6-1ce5d752843a tempest-VolumesSnapshotTestJSON-1399894899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-b97bf6eb-69d3-4ba1-ba94-8a004078ecf5 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-fefdccd3-7d50-4b82-a670-a1a6535c5e02" returned: 0 in 5.763s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:03:07 devstack cinder-volume[87272]: DEBUG cinder.image.image_utils [None req-ee4f8360-2077-4f7c-89f6-1ce5d752843a tempest-VolumesSnapshotTestJSON-1399894899 None] Image conversion details: src /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-b97bf6eb-69d3-4ba1-ba94-8a004078ecf5, size 1024.00 MB, duration 5.76 sec, destination /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-fefdccd3-7d50-4b82-a670-a1a6535c5e02 {{(pid=87272) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Nov 04 11:03:07 devstack cinder-volume[87272]: INFO cinder.image.image_utils [None req-ee4f8360-2077-4f7c-89f6-1ce5d752843a tempest-VolumesSnapshotTestJSON-1399894899 None] Converted 1024.00 MB image at 177.66 MB/s Nov 04 11:03:07 devstack cinder-volume[87272]: WARNING cinder.volume.drivers.remotefs [None req-ee4f8360-2077-4f7c-89f6-1ce5d752843a tempest-VolumesSnapshotTestJSON-1399894899 None] /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-fefdccd3-7d50-4b82-a670-a1a6535c5e02 is being set with open permissions: ugo+rw Nov 04 11:03:07 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-ee4f8360-2077-4f7c-89f6-1ce5d752843a tempest-VolumesSnapshotTestJSON-1399894899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-fefdccd3-7d50-4b82-a670-a1a6535c5e02 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:03:07 devstack sudo[101475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-fefdccd3-7d50-4b82-a670-a1a6535c5e02 Nov 04 11:03:07 devstack sudo[101475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:03:07 devstack sudo[101475]: pam_unix(sudo:session): session closed for user root Nov 04 11:03:07 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-ee4f8360-2077-4f7c-89f6-1ce5d752843a tempest-VolumesSnapshotTestJSON-1399894899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-fefdccd3-7d50-4b82-a670-a1a6535c5e02" returned: 0 in 0.231s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:03:07 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-ee4f8360-2077-4f7c-89f6-1ce5d752843a tempest-VolumesSnapshotTestJSON-1399894899 None] Lock "cinder-quobyte-fefdccd3-7d50-4b82-a670-a1a6535c5e02" released by "_copy_volume_from_snapshot" :: held 6.841s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 11:03:07 devstack cinder-volume[87272]: DEBUG dbcounter [-] [87272] Writing DB stats cinder:UPDATE=112,cinder:SELECT=104,cinder:DELETE=12,cinder:INSERT=44 {{(pid=87272) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 11:03:07 devstack cinder-volume[87272]: DEBUG dbcounter [-] [87272] Writing DB stats cinder:SELECT=112,cinder:UPDATE=112,cinder:INSERT=42,cinder:DELETE=9 {{(pid=87272) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 11:03:08 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-ee4f8360-2077-4f7c-89f6-1ce5d752843a tempest-VolumesSnapshotTestJSON-1399894899 None] Lock "cinder-quobyte-b0fe283b-e840-4aed-b2f7-c2987ce67a8c-fefdccd3-7d50-4b82-a670-a1a6535c5e02" released by "_create_volume_from_snapshot" :: held 6.918s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 11:03:08 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-ee4f8360-2077-4f7c-89f6-1ce5d752843a tempest-VolumesSnapshotTestJSON-1399894899 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.949s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 11:03:08 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-d2378309-2f8b-4961-b1bd-ceb4591d3559 tempest-VolumesExtendTest-1917483396 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 6.946s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 11:03:08 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-ee4f8360-2077-4f7c-89f6-1ce5d752843a tempest-VolumesSnapshotTestJSON-1399894899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (45f8793c-dd6a-4fb8-8943-148f2ad4ead0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fefdccd3-7d50-4b82-a670-a1a6535c5e02', 'volume_size': 2, 'snapshot_id': 'b0fe283b-e840-4aed-b2f7-c2987ce67a8c'}' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:03:08 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-ee4f8360-2077-4f7c-89f6-1ce5d752843a tempest-VolumesSnapshotTestJSON-1399894899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7504742b-f923-43c0-b1b7-7aaca84bb1bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:03:08 devstack cinder-volume[87272]: DEBUG oslo.privsep.daemon [-] privsep: reply[b16332b4-679b-4ca9-9663-1d619a207188]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 11:03:08 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-d2378309-2f8b-4961-b1bd-ceb4591d3559 tempest-VolumesExtendTest-1917483396 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-4a2b5896-7377-4c47-94aa-81f36c71ded3 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:03:08 devstack cinder-volume[87272]: INFO cinder.volume.flows.manager.create_volume [None req-ee4f8360-2077-4f7c-89f6-1ce5d752843a tempest-VolumesSnapshotTestJSON-1399894899 None] Volume volume-fefdccd3-7d50-4b82-a670-a1a6535c5e02 (fefdccd3-7d50-4b82-a670-a1a6535c5e02): created successfully Nov 04 11:03:08 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-ee4f8360-2077-4f7c-89f6-1ce5d752843a tempest-VolumesSnapshotTestJSON-1399894899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7504742b-f923-43c0-b1b7-7aaca84bb1bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:03:08 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-ee4f8360-2077-4f7c-89f6-1ce5d752843a tempest-VolumesSnapshotTestJSON-1399894899 None] Flow 'volume_create_manager' (f08f5171-4439-4cd7-ad5c-4fee6f027213) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87272) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 11:03:08 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-ee4f8360-2077-4f7c-89f6-1ce5d752843a tempest-VolumesSnapshotTestJSON-1399894899 None] Created volume successfully. Nov 04 11:03:08 devstack sudo[101478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-4a2b5896-7377-4c47-94aa-81f36c71ded3 Nov 04 11:03:08 devstack sudo[101478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:03:08 devstack sudo[101478]: pam_unix(sudo:session): session closed for user root Nov 04 11:03:08 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-d2378309-2f8b-4961-b1bd-ceb4591d3559 tempest-VolumesExtendTest-1917483396 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-4a2b5896-7377-4c47-94aa-81f36c71ded3" returned: 0 in 0.369s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:03:08 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-d2378309-2f8b-4961-b1bd-ceb4591d3559 tempest-VolumesExtendTest-1917483396 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-4a2b5896-7377-4c47-94aa-81f36c71ded3 2G {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:03:08 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-e50da949-c01c-43ee-b9f4-b0a42fc3d98d tempest-VolumesSnapshotTestJSON-1399894899 None] Acquiring lock "cinder-fefdccd3-7d50-4b82-a670-a1a6535c5e02-delete_volume" by "delete_volume" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 11:03:08 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-e50da949-c01c-43ee-b9f4-b0a42fc3d98d tempest-VolumesSnapshotTestJSON-1399894899 None] Lock "cinder-fefdccd3-7d50-4b82-a670-a1a6535c5e02-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 11:03:08 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-e50da949-c01c-43ee-b9f4-b0a42fc3d98d tempest-VolumesSnapshotTestJSON-1399894899 None] Acquiring lock "cinder-quobyte-fefdccd3-7d50-4b82-a670-a1a6535c5e02" by "delete_volume" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 11:03:08 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-e50da949-c01c-43ee-b9f4-b0a42fc3d98d tempest-VolumesSnapshotTestJSON-1399894899 None] Lock "cinder-quobyte-fefdccd3-7d50-4b82-a670-a1a6535c5e02" acquired by "delete_volume" :: waited 0.017s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 11:03:08 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-d2378309-2f8b-4961-b1bd-ceb4591d3559 tempest-VolumesExtendTest-1917483396 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-4a2b5896-7377-4c47-94aa-81f36c71ded3 2G" returned: 0 in 0.142s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:03:08 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-d2378309-2f8b-4961-b1bd-ceb4591d3559 tempest-VolumesExtendTest-1917483396 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.549s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 11:03:08 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-8b8cb5ba-1a02-45b1-aa75-b1d7cfe379bc tempest-VolumeDependencyTests-143533947 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 6.242s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 11:03:08 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-8b8cb5ba-1a02-45b1-aa75-b1d7cfe379bc tempest-VolumeDependencyTests-143533947 None] Acquiring lock "cinder-quobyte-fd9695c9-9848-447b-bc8e-22e94a04e547-67c3098d-f1f4-4419-9257-8640a32c6f3a" by "_create_volume_from_snapshot" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 11:03:08 devstack cinder-volume[87272]: DEBUG oslo.privsep.daemon [-] privsep: reply[8920418b-6176-4262-8d05-a9bcb14d953d]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 11:03:08 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-e50da949-c01c-43ee-b9f4-b0a42fc3d98d tempest-VolumesSnapshotTestJSON-1399894899 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-fefdccd3-7d50-4b82-a670-a1a6535c5e02 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:03:08 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-8b8cb5ba-1a02-45b1-aa75-b1d7cfe379bc tempest-VolumeDependencyTests-143533947 None] Lock "cinder-quobyte-fd9695c9-9848-447b-bc8e-22e94a04e547-67c3098d-f1f4-4419-9257-8640a32c6f3a" acquired by "_create_volume_from_snapshot" :: waited 0.034s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 11:03:08 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-8b8cb5ba-1a02-45b1-aa75-b1d7cfe379bc tempest-VolumeDependencyTests-143533947 None] Creating volume 67c3098d-f1f4-4419-9257-8640a32c6f3a from snapshot fd9695c9-9848-447b-bc8e-22e94a04e547 {{(pid=87272) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 04 11:03:08 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-8b8cb5ba-1a02-45b1-aa75-b1d7cfe379bc tempest-VolumeDependencyTests-143533947 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 11:03:08 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-8b8cb5ba-1a02-45b1-aa75-b1d7cfe379bc tempest-VolumeDependencyTests-143533947 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 11:03:08 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-8b8cb5ba-1a02-45b1-aa75-b1d7cfe379bc tempest-VolumeDependencyTests-143533947 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898': None} {{(pid=87272) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 11:03:08 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-8b8cb5ba-1a02-45b1-aa75-b1d7cfe379bc tempest-VolumeDependencyTests-143533947 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'] {{(pid=87272) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 11:03:08 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-8b8cb5ba-1a02-45b1-aa75-b1d7cfe379bc tempest-VolumeDependencyTests-143533947 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 11:03:08 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-8b8cb5ba-1a02-45b1-aa75-b1d7cfe379bc tempest-VolumeDependencyTests-143533947 None] Selected osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898 as target Quobyte volume. {{(pid=87272) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 11:03:08 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-8b8cb5ba-1a02-45b1-aa75-b1d7cfe379bc tempest-VolumeDependencyTests-143533947 None] Acquiring lock "cinder-quobyte-67c3098d-f1f4-4419-9257-8640a32c6f3a" by "_copy_volume_from_snapshot" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 11:03:08 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-d2378309-2f8b-4961-b1bd-ceb4591d3559 tempest-VolumesExtendTest-1917483396 None] Extend volume completed successfully. Nov 04 11:03:08 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-8b8cb5ba-1a02-45b1-aa75-b1d7cfe379bc tempest-VolumeDependencyTests-143533947 None] Lock "cinder-quobyte-67c3098d-f1f4-4419-9257-8640a32c6f3a" acquired by "_copy_volume_from_snapshot" :: waited 0.038s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 11:03:08 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-8b8cb5ba-1a02-45b1-aa75-b1d7cfe379bc tempest-VolumeDependencyTests-143533947 None] snapshot: fd9695c9-9848-447b-bc8e-22e94a04e547, volume: 67c3098d-f1f4-4419-9257-8640a32c6f3a, {{(pid=87272) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 04 11:03:08 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-8b8cb5ba-1a02-45b1-aa75-b1d7cfe379bc tempest-VolumeDependencyTests-143533947 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 11:03:08 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-8b8cb5ba-1a02-45b1-aa75-b1d7cfe379bc tempest-VolumeDependencyTests-143533947 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 11:03:08 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-8b8cb5ba-1a02-45b1-aa75-b1d7cfe379bc tempest-VolumeDependencyTests-143533947 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898': None} {{(pid=87272) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 11:03:08 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-8b8cb5ba-1a02-45b1-aa75-b1d7cfe379bc tempest-VolumeDependencyTests-143533947 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'] {{(pid=87272) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 11:03:08 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-8b8cb5ba-1a02-45b1-aa75-b1d7cfe379bc tempest-VolumeDependencyTests-143533947 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 11:03:08 devstack cinder-volume[87272]: DEBUG oslo.privsep.daemon [-] privsep: reply[f47f1a86-ecd9-4a25-98ca-4471b199e9d2]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 11:03:08 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-8b8cb5ba-1a02-45b1-aa75-b1d7cfe379bc tempest-VolumeDependencyTests-143533947 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-d0924def-8711-4ff9-bf4f-7cefce60d2c7.fd9695c9-9848-447b-bc8e-22e94a04e547 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:03:08 devstack sudo[101486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-fefdccd3-7d50-4b82-a670-a1a6535c5e02 Nov 04 11:03:08 devstack sudo[101486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:03:08 devstack sudo[101488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-d0924def-8711-4ff9-bf4f-7cefce60d2c7.fd9695c9-9848-447b-bc8e-22e94a04e547 Nov 04 11:03:08 devstack sudo[101488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:03:09 devstack sudo[101486]: pam_unix(sudo:session): session closed for user root Nov 04 11:03:09 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-e50da949-c01c-43ee-b9f4-b0a42fc3d98d tempest-VolumesSnapshotTestJSON-1399894899 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-fefdccd3-7d50-4b82-a670-a1a6535c5e02" returned: 0 in 0.416s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:03:09 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-e50da949-c01c-43ee-b9f4-b0a42fc3d98d tempest-VolumesSnapshotTestJSON-1399894899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-fefdccd3-7d50-4b82-a670-a1a6535c5e02 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:03:09 devstack sudo[101495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-fefdccd3-7d50-4b82-a670-a1a6535c5e02 Nov 04 11:03:09 devstack sudo[101495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:03:09 devstack sudo[101488]: pam_unix(sudo:session): session closed for user root Nov 04 11:03:09 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-8b8cb5ba-1a02-45b1-aa75-b1d7cfe379bc tempest-VolumeDependencyTests-143533947 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-d0924def-8711-4ff9-bf4f-7cefce60d2c7.fd9695c9-9848-447b-bc8e-22e94a04e547" returned: 0 in 0.378s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:03:09 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.remotefs [None req-8b8cb5ba-1a02-45b1-aa75-b1d7cfe379bc tempest-VolumeDependencyTests-143533947 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d0924def-8711-4ff9-bf4f-7cefce60d2c7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87272) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 11:03:09 devstack cinder-volume[87272]: DEBUG oslo.privsep.daemon [-] privsep: reply[35c8d97a-9ba8-4fe0-a08e-c4efaf0d2c42]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 11:03:09 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-8b8cb5ba-1a02-45b1-aa75-b1d7cfe379bc tempest-VolumeDependencyTests-143533947 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-d0924def-8711-4ff9-bf4f-7cefce60d2c7 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:03:09 devstack sudo[101498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-d0924def-8711-4ff9-bf4f-7cefce60d2c7 Nov 04 11:03:09 devstack sudo[101498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:03:09 devstack sudo[101495]: pam_unix(sudo:session): session closed for user root Nov 04 11:03:09 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-e50da949-c01c-43ee-b9f4-b0a42fc3d98d tempest-VolumesSnapshotTestJSON-1399894899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-fefdccd3-7d50-4b82-a670-a1a6535c5e02" returned: 0 in 0.248s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:03:09 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-e50da949-c01c-43ee-b9f4-b0a42fc3d98d tempest-VolumesSnapshotTestJSON-1399894899 None] Lock "cinder-quobyte-fefdccd3-7d50-4b82-a670-a1a6535c5e02" released by "delete_volume" :: held 0.730s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 11:03:09 devstack cinder-volume[87272]: DEBUG cinder.quota [None req-e50da949-c01c-43ee-b9f4-b0a42fc3d98d tempest-VolumesSnapshotTestJSON-1399894899 None] Created reservations ['02520b87-dd0e-4630-aa65-763c5d9fc3b5', '273fb261-73ad-4756-bb48-279bb0f80859', 'da3f679d-0bd7-44dc-a246-0597605a2ad5', 'afb18bdb-e6a7-49d4-a5bf-e56e5c62c8a7'] {{(pid=87272) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 11:03:09 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-e50da949-c01c-43ee-b9f4-b0a42fc3d98d tempest-VolumesSnapshotTestJSON-1399894899 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 11:03:09 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-e50da949-c01c-43ee-b9f4-b0a42fc3d98d tempest-VolumesSnapshotTestJSON-1399894899 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 11:03:09 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-e50da949-c01c-43ee-b9f4-b0a42fc3d98d tempest-VolumesSnapshotTestJSON-1399894899 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898': None} {{(pid=87272) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 11:03:09 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-e50da949-c01c-43ee-b9f4-b0a42fc3d98d tempest-VolumesSnapshotTestJSON-1399894899 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'] {{(pid=87272) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 11:03:09 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-e50da949-c01c-43ee-b9f4-b0a42fc3d98d tempest-VolumesSnapshotTestJSON-1399894899 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 11:03:09 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-e50da949-c01c-43ee-b9f4-b0a42fc3d98d tempest-VolumesSnapshotTestJSON-1399894899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:03:09 devstack sudo[101503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1 Nov 04 11:03:09 devstack sudo[101503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:03:09 devstack sudo[101498]: pam_unix(sudo:session): session closed for user root Nov 04 11:03:09 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-8b8cb5ba-1a02-45b1-aa75-b1d7cfe379bc tempest-VolumeDependencyTests-143533947 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-d0924def-8711-4ff9-bf4f-7cefce60d2c7" returned: 0 in 0.382s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:03:09 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-8b8cb5ba-1a02-45b1-aa75-b1d7cfe379bc tempest-VolumeDependencyTests-143533947 None] will copy from snapshot at /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-d0924def-8711-4ff9-bf4f-7cefce60d2c7 {{(pid=87272) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 04 11:03:09 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-8b8cb5ba-1a02-45b1-aa75-b1d7cfe379bc tempest-VolumeDependencyTests-143533947 None] Creating direct copy from snapshot {{(pid=87272) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 04 11:03:09 devstack cinder-volume[87272]: DEBUG cinder.utils [None req-8b8cb5ba-1a02-45b1-aa75-b1d7cfe379bc tempest-VolumeDependencyTests-143533947 None] Path /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-67c3098d-f1f4-4419-9257-8640a32c6f3a not found in is_blk_device check {{(pid=87272) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Nov 04 11:03:09 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-8b8cb5ba-1a02-45b1-aa75-b1d7cfe379bc tempest-VolumeDependencyTests-143533947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-d0924def-8711-4ff9-bf4f-7cefce60d2c7 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-67c3098d-f1f4-4419-9257-8640a32c6f3a {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:03:09 devstack sudo[101507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-d0924def-8711-4ff9-bf4f-7cefce60d2c7 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-67c3098d-f1f4-4419-9257-8640a32c6f3a Nov 04 11:03:09 devstack sudo[101507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:03:09 devstack sudo[101503]: pam_unix(sudo:session): session closed for user root Nov 04 11:03:09 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-e50da949-c01c-43ee-b9f4-b0a42fc3d98d tempest-VolumesSnapshotTestJSON-1399894899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1" returned: 0 in 0.281s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:03:09 devstack cinder-volume[87272]: DEBUG cinder.manager [None req-e50da949-c01c-43ee-b9f4-b0a42fc3d98d tempest-VolumesSnapshotTestJSON-1399894899 None] Notifying Schedulers of capabilities ... {{(pid=87272) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 11:03:09 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-d34062b8-682a-4b83-91e9-8d0936a69008 tempest-VolumesSnapshotTestJSON-1399894899 None] Acquiring lock "cinder-b0fe283b-e840-4aed-b2f7-c2987ce67a8c-delete_snapshot" by "delete_snapshot" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 11:03:09 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-e50da949-c01c-43ee-b9f4-b0a42fc3d98d tempest-VolumesSnapshotTestJSON-1399894899 None] Deleted volume successfully. Nov 04 11:03:09 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-d34062b8-682a-4b83-91e9-8d0936a69008 tempest-VolumesSnapshotTestJSON-1399894899 None] Lock "cinder-b0fe283b-e840-4aed-b2f7-c2987ce67a8c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.054s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 11:03:09 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-d34062b8-682a-4b83-91e9-8d0936a69008 tempest-VolumesSnapshotTestJSON-1399894899 None] Acquiring lock "cinder-quobyte-b97bf6eb-69d3-4ba1-ba94-8a004078ecf5" by "delete_snapshot" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 11:03:09 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-e50da949-c01c-43ee-b9f4-b0a42fc3d98d tempest-VolumesSnapshotTestJSON-1399894899 None] Lock "cinder-fefdccd3-7d50-4b82-a670-a1a6535c5e02-delete_volume" released by "delete_volume" :: held 1.314s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 11:03:09 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-d34062b8-682a-4b83-91e9-8d0936a69008 tempest-VolumesSnapshotTestJSON-1399894899 None] Lock "cinder-quobyte-b97bf6eb-69d3-4ba1-ba94-8a004078ecf5" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 11:03:09 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-d34062b8-682a-4b83-91e9-8d0936a69008 tempest-VolumesSnapshotTestJSON-1399894899 None] Acquiring lock "cinder-quobyte-b0fe283b-e840-4aed-b2f7-c2987ce67a8c" by "_delete_snapshot" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 11:03:09 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-d34062b8-682a-4b83-91e9-8d0936a69008 tempest-VolumesSnapshotTestJSON-1399894899 None] Lock "cinder-quobyte-b0fe283b-e840-4aed-b2f7-c2987ce67a8c" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 11:03:09 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.remotefs [None req-d34062b8-682a-4b83-91e9-8d0936a69008 tempest-VolumesSnapshotTestJSON-1399894899 None] Deleting offline snapshot b0fe283b-e840-4aed-b2f7-c2987ce67a8c of volume b97bf6eb-69d3-4ba1-ba94-8a004078ecf5 {{(pid=87272) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 04 11:03:09 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.remotefs [None req-d34062b8-682a-4b83-91e9-8d0936a69008 tempest-VolumesSnapshotTestJSON-1399894899 None] snapshot_file for this snap is: volume-b97bf6eb-69d3-4ba1-ba94-8a004078ecf5.b0fe283b-e840-4aed-b2f7-c2987ce67a8c {{(pid=87272) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 04 11:03:09 devstack cinder-volume[87272]: DEBUG oslo.privsep.daemon [-] privsep: reply[e47b8095-5e25-4361-9044-25519515b399]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 11:03:09 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-d34062b8-682a-4b83-91e9-8d0936a69008 tempest-VolumesSnapshotTestJSON-1399894899 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-b97bf6eb-69d3-4ba1-ba94-8a004078ecf5.b0fe283b-e840-4aed-b2f7-c2987ce67a8c {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:03:09 devstack sudo[101513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-b97bf6eb-69d3-4ba1-ba94-8a004078ecf5.b0fe283b-e840-4aed-b2f7-c2987ce67a8c Nov 04 11:03:09 devstack sudo[101513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:03:10 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-3af55df7-b6d0-4a5b-a317-590956dcbc7b tempest-VolumesExtendTest-1917483396 None] Acquiring lock "cinder-4a2b5896-7377-4c47-94aa-81f36c71ded3-delete_volume" by "delete_volume" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 11:03:10 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-3af55df7-b6d0-4a5b-a317-590956dcbc7b tempest-VolumesExtendTest-1917483396 None] Lock "cinder-4a2b5896-7377-4c47-94aa-81f36c71ded3-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 11:03:10 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-3af55df7-b6d0-4a5b-a317-590956dcbc7b tempest-VolumesExtendTest-1917483396 None] Acquiring lock "cinder-quobyte-4a2b5896-7377-4c47-94aa-81f36c71ded3" by "delete_volume" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 11:03:10 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-3af55df7-b6d0-4a5b-a317-590956dcbc7b tempest-VolumesExtendTest-1917483396 None] Lock "cinder-quobyte-4a2b5896-7377-4c47-94aa-81f36c71ded3" acquired by "delete_volume" :: waited 0.036s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 11:03:10 devstack sudo[101513]: pam_unix(sudo:session): session closed for user root Nov 04 11:03:10 devstack cinder-volume[87272]: DEBUG oslo.privsep.daemon [-] privsep: reply[24f71113-5ffa-40d5-bb2c-616ad669b060]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 11:03:10 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-3af55df7-b6d0-4a5b-a317-590956dcbc7b tempest-VolumesExtendTest-1917483396 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-4a2b5896-7377-4c47-94aa-81f36c71ded3 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:03:10 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-d34062b8-682a-4b83-91e9-8d0936a69008 tempest-VolumesSnapshotTestJSON-1399894899 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-b97bf6eb-69d3-4ba1-ba94-8a004078ecf5.b0fe283b-e840-4aed-b2f7-c2987ce67a8c" returned: 0 in 0.658s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:03:10 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.remotefs [None req-d34062b8-682a-4b83-91e9-8d0936a69008 tempest-VolumesSnapshotTestJSON-1399894899 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b97bf6eb-69d3-4ba1-ba94-8a004078ecf5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87272) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 11:03:10 devstack cinder-volume[87272]: DEBUG oslo.privsep.daemon [-] privsep: reply[f297541a-c003-4d57-bbce-dd8f9b265237]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 11:03:10 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-d34062b8-682a-4b83-91e9-8d0936a69008 tempest-VolumesSnapshotTestJSON-1399894899 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-b97bf6eb-69d3-4ba1-ba94-8a004078ecf5 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:03:10 devstack sudo[101525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-4a2b5896-7377-4c47-94aa-81f36c71ded3 Nov 04 11:03:10 devstack sudo[101525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:03:10 devstack sudo[101526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-b97bf6eb-69d3-4ba1-ba94-8a004078ecf5 Nov 04 11:03:10 devstack sudo[101526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:03:11 devstack sudo[101525]: pam_unix(sudo:session): session closed for user root Nov 04 11:03:11 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-3af55df7-b6d0-4a5b-a317-590956dcbc7b tempest-VolumesExtendTest-1917483396 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-4a2b5896-7377-4c47-94aa-81f36c71ded3" returned: 0 in 0.621s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:03:11 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-3af55df7-b6d0-4a5b-a317-590956dcbc7b tempest-VolumesExtendTest-1917483396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-4a2b5896-7377-4c47-94aa-81f36c71ded3 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:03:11 devstack sudo[101534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-4a2b5896-7377-4c47-94aa-81f36c71ded3 Nov 04 11:03:11 devstack sudo[101534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:03:11 devstack sudo[101526]: pam_unix(sudo:session): session closed for user root Nov 04 11:03:11 devstack sudo[101534]: pam_unix(sudo:session): session closed for user root Nov 04 11:03:11 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-3af55df7-b6d0-4a5b-a317-590956dcbc7b tempest-VolumesExtendTest-1917483396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-4a2b5896-7377-4c47-94aa-81f36c71ded3" returned: 0 in 0.503s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:03:11 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-d34062b8-682a-4b83-91e9-8d0936a69008 tempest-VolumesSnapshotTestJSON-1399894899 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-b97bf6eb-69d3-4ba1-ba94-8a004078ecf5" returned: 0 in 1.035s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:03:11 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-d34062b8-682a-4b83-91e9-8d0936a69008 tempest-VolumesSnapshotTestJSON-1399894899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-b97bf6eb-69d3-4ba1-ba94-8a004078ecf5.b0fe283b-e840-4aed-b2f7-c2987ce67a8c {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:03:11 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-3af55df7-b6d0-4a5b-a317-590956dcbc7b tempest-VolumesExtendTest-1917483396 None] Lock "cinder-quobyte-4a2b5896-7377-4c47-94aa-81f36c71ded3" released by "delete_volume" :: held 1.234s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 11:03:11 devstack sudo[101539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-b97bf6eb-69d3-4ba1-ba94-8a004078ecf5.b0fe283b-e840-4aed-b2f7-c2987ce67a8c Nov 04 11:03:11 devstack sudo[101539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:03:11 devstack cinder-volume[87272]: DEBUG cinder.quota [None req-3af55df7-b6d0-4a5b-a317-590956dcbc7b tempest-VolumesExtendTest-1917483396 None] Created reservations ['adfa71fa-04e3-4215-a3b3-a533c5b7f82a', 'a8707488-974b-4fcf-9279-56d30d215dda', '49b372b2-c529-49e8-ba24-1bc759cc110c', '89259f38-2920-44d8-b7ca-dec41b26479d'] {{(pid=87272) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 11:03:11 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-3af55df7-b6d0-4a5b-a317-590956dcbc7b tempest-VolumesExtendTest-1917483396 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 11:03:11 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-3af55df7-b6d0-4a5b-a317-590956dcbc7b tempest-VolumesExtendTest-1917483396 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 11:03:11 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-3af55df7-b6d0-4a5b-a317-590956dcbc7b tempest-VolumesExtendTest-1917483396 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898': None} {{(pid=87272) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 11:03:11 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-3af55df7-b6d0-4a5b-a317-590956dcbc7b tempest-VolumesExtendTest-1917483396 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'] {{(pid=87272) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 11:03:11 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-3af55df7-b6d0-4a5b-a317-590956dcbc7b tempest-VolumesExtendTest-1917483396 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 11:03:11 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-3af55df7-b6d0-4a5b-a317-590956dcbc7b tempest-VolumesExtendTest-1917483396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:03:12 devstack sudo[101542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1 Nov 04 11:03:12 devstack sudo[101542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:03:12 devstack sudo[101542]: pam_unix(sudo:session): session closed for user root Nov 04 11:03:12 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-3af55df7-b6d0-4a5b-a317-590956dcbc7b tempest-VolumesExtendTest-1917483396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1" returned: 0 in 0.357s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:03:12 devstack cinder-volume[87272]: DEBUG cinder.manager [None req-3af55df7-b6d0-4a5b-a317-590956dcbc7b tempest-VolumesExtendTest-1917483396 None] Notifying Schedulers of capabilities ... {{(pid=87272) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 11:03:12 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-3af55df7-b6d0-4a5b-a317-590956dcbc7b tempest-VolumesExtendTest-1917483396 None] Deleted volume successfully. Nov 04 11:03:12 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-3af55df7-b6d0-4a5b-a317-590956dcbc7b tempest-VolumesExtendTest-1917483396 None] Lock "cinder-4a2b5896-7377-4c47-94aa-81f36c71ded3-delete_volume" released by "delete_volume" :: held 2.063s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 11:03:12 devstack sudo[101539]: pam_unix(sudo:session): session closed for user root Nov 04 11:03:12 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-d34062b8-682a-4b83-91e9-8d0936a69008 tempest-VolumesSnapshotTestJSON-1399894899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-b97bf6eb-69d3-4ba1-ba94-8a004078ecf5.b0fe283b-e840-4aed-b2f7-c2987ce67a8c" returned: 0 in 0.773s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:03:12 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-d34062b8-682a-4b83-91e9-8d0936a69008 tempest-VolumesSnapshotTestJSON-1399894899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-b97bf6eb-69d3-4ba1-ba94-8a004078ecf5.b0fe283b-e840-4aed-b2f7-c2987ce67a8c {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:03:12 devstack sudo[101548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-b97bf6eb-69d3-4ba1-ba94-8a004078ecf5.b0fe283b-e840-4aed-b2f7-c2987ce67a8c Nov 04 11:03:12 devstack sudo[101548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:03:12 devstack sudo[101548]: pam_unix(sudo:session): session closed for user root Nov 04 11:03:12 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-d34062b8-682a-4b83-91e9-8d0936a69008 tempest-VolumesSnapshotTestJSON-1399894899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-b97bf6eb-69d3-4ba1-ba94-8a004078ecf5.b0fe283b-e840-4aed-b2f7-c2987ce67a8c" returned: 0 in 0.458s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:03:13 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-d34062b8-682a-4b83-91e9-8d0936a69008 tempest-VolumesSnapshotTestJSON-1399894899 None] Lock "cinder-quobyte-b0fe283b-e840-4aed-b2f7-c2987ce67a8c" released by "_delete_snapshot" :: held 3.172s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 11:03:13 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-d34062b8-682a-4b83-91e9-8d0936a69008 tempest-VolumesSnapshotTestJSON-1399894899 None] Lock "cinder-quobyte-b97bf6eb-69d3-4ba1-ba94-8a004078ecf5" released by "delete_snapshot" :: held 3.210s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 11:03:13 devstack cinder-volume[87272]: DEBUG cinder.quota [None req-d34062b8-682a-4b83-91e9-8d0936a69008 tempest-VolumesSnapshotTestJSON-1399894899 None] Created reservations ['c188e6af-c0ec-4049-96c1-e94999a5611c', '9e7c4862-ae81-4b94-bbba-1b11f6273ffd', 'fc990a7a-a7c5-4d48-86d9-adb259d519c1', '3ca07f1c-551e-49c6-b91c-00dc514c1ca0'] {{(pid=87272) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 11:03:13 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-d34062b8-682a-4b83-91e9-8d0936a69008 tempest-VolumesSnapshotTestJSON-1399894899 None] Delete snapshot completed successfully. Nov 04 11:03:13 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-d34062b8-682a-4b83-91e9-8d0936a69008 tempest-VolumesSnapshotTestJSON-1399894899 None] Lock "cinder-b0fe283b-e840-4aed-b2f7-c2987ce67a8c-delete_snapshot" released by "delete_snapshot" :: held 3.519s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 11:03:13 devstack cinder-volume[87272]: DEBUG cinder.volume.flows.manager.create_volume [None req-92db8ed4-a16a-468d-ad91-8b29b76ca1bc tempest-VolumesExtendTest-1917483396 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87272) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 11:03:13 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-92db8ed4-a16a-468d-ad91-8b29b76ca1bc tempest-VolumesExtendTest-1917483396 None] Flow 'volume_create_manager' (a39075a2-ce0b-4230-92a3-78339742fa14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 11:03:13 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-92db8ed4-a16a-468d-ad91-8b29b76ca1bc tempest-VolumesExtendTest-1917483396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ed29c46-e6bd-42a7-a4e4-0212ce4124b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:03:13 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-92db8ed4-a16a-468d-ad91-8b29b76ca1bc tempest-VolumesExtendTest-1917483396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ed29c46-e6bd-42a7-a4e4-0212ce4124b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T10:03:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-348331232',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8d23d54e-1736-4966-ba9c-65a4e60c7d7c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dfc5fbd20fdc49d58f5fe9ee671c20b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T10:03:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T10:03:13Z,use_quota=True,user_id='4a8097cabbf54e0c9b37a3d456c62743',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8989e4f-21e3-4f0a-9584-0d818784e883),volume_type_id=f8989e4f-21e3-4f0a-9584-0d818784e883)' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:03:13 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-92db8ed4-a16a-468d-ad91-8b29b76ca1bc tempest-VolumesExtendTest-1917483396 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (49b806d6-0734-4527-9641-dd38259a83bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:03:13 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-92db8ed4-a16a-468d-ad91-8b29b76ca1bc tempest-VolumesExtendTest-1917483396 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (49b806d6-0734-4527-9641-dd38259a83bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:03:13 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-92db8ed4-a16a-468d-ad91-8b29b76ca1bc tempest-VolumesExtendTest-1917483396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc5b3279-8435-4e9b-8366-ab4fc0733cd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:03:13 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-92db8ed4-a16a-468d-ad91-8b29b76ca1bc tempest-VolumesExtendTest-1917483396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc5b3279-8435-4e9b-8366-ab4fc0733cd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8d23d54e-1736-4966-ba9c-65a4e60c7d7c', 'volume_name': 'volume-8d23d54e-1736-4966-ba9c-65a4e60c7d7c', 'volume_size': 1}' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:03:13 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-92db8ed4-a16a-468d-ad91-8b29b76ca1bc tempest-VolumesExtendTest-1917483396 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e9c20d7c-eba0-4d99-bbfc-28fcf3a865dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:03:13 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-92db8ed4-a16a-468d-ad91-8b29b76ca1bc tempest-VolumesExtendTest-1917483396 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e9c20d7c-eba0-4d99-bbfc-28fcf3a865dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:03:13 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-92db8ed4-a16a-468d-ad91-8b29b76ca1bc tempest-VolumesExtendTest-1917483396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c5e7f2b1-dc9a-4368-989a-99d49044f335) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:03:13 devstack cinder-volume[87272]: INFO cinder.volume.flows.manager.create_volume [None req-92db8ed4-a16a-468d-ad91-8b29b76ca1bc tempest-VolumesExtendTest-1917483396 None] Volume 8d23d54e-1736-4966-ba9c-65a4e60c7d7c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8d23d54e-1736-4966-ba9c-65a4e60c7d7c', 'volume_size': 1} Nov 04 11:03:13 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-92db8ed4-a16a-468d-ad91-8b29b76ca1bc tempest-VolumesExtendTest-1917483396 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 11:03:14 devstack cinder-volume[87272]: DEBUG oslo_service.periodic_task [None req-236af0be-7f9d-4c80-b3d7-d645a9cd0dd1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87272) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 04 11:03:14 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-236af0be-7f9d-4c80-b3d7-d645a9cd0dd1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 11:03:14 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-236af0be-7f9d-4c80-b3d7-d645a9cd0dd1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 11:03:14 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-236af0be-7f9d-4c80-b3d7-d645a9cd0dd1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898': None} {{(pid=87272) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 11:03:14 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-236af0be-7f9d-4c80-b3d7-d645a9cd0dd1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'] {{(pid=87272) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 11:03:14 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-236af0be-7f9d-4c80-b3d7-d645a9cd0dd1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 11:03:14 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-236af0be-7f9d-4c80-b3d7-d645a9cd0dd1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:03:14 devstack sudo[101551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1 Nov 04 11:03:14 devstack sudo[101551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:03:14 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-d22ba67f-558e-4908-969a-264d98d77026 tempest-VolumesSnapshotTestJSON-1399894899 None] Acquiring lock "cinder-b97bf6eb-69d3-4ba1-ba94-8a004078ecf5-delete_volume" by "delete_volume" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 11:03:14 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-d22ba67f-558e-4908-969a-264d98d77026 tempest-VolumesSnapshotTestJSON-1399894899 None] Lock "cinder-b97bf6eb-69d3-4ba1-ba94-8a004078ecf5-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 11:03:14 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-d22ba67f-558e-4908-969a-264d98d77026 tempest-VolumesSnapshotTestJSON-1399894899 None] Acquiring lock "cinder-quobyte-b97bf6eb-69d3-4ba1-ba94-8a004078ecf5" by "delete_volume" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 11:03:14 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-d22ba67f-558e-4908-969a-264d98d77026 tempest-VolumesSnapshotTestJSON-1399894899 None] Lock "cinder-quobyte-b97bf6eb-69d3-4ba1-ba94-8a004078ecf5" acquired by "delete_volume" :: waited 0.037s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 11:03:14 devstack sudo[101551]: pam_unix(sudo:session): session closed for user root Nov 04 11:03:14 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-236af0be-7f9d-4c80-b3d7-d645a9cd0dd1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1" returned: 0 in 0.427s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:03:14 devstack cinder-volume[87272]: DEBUG cinder.manager [None req-236af0be-7f9d-4c80-b3d7-d645a9cd0dd1 None None] Notifying Schedulers of capabilities ... {{(pid=87272) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 11:03:14 devstack cinder-volume[87272]: DEBUG oslo_service.periodic_task [None req-236af0be-7f9d-4c80-b3d7-d645a9cd0dd1 None None] Running periodic task VolumeManager._thread_info {{(pid=87272) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 04 11:03:14 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-236af0be-7f9d-4c80-b3d7-d645a9cd0dd1 None None] thread count: 28 {{(pid=87272) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 04 11:03:14 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-236af0be-7f9d-4c80-b3d7-d645a9cd0dd1 None None] thread info: [<_MainThread(MainThread, started 127085713244288)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87272) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 04 11:03:14 devstack cinder-volume[87272]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4ecd816-bd49-4770-b352-4eb4a51368a3]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 11:03:14 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-d22ba67f-558e-4908-969a-264d98d77026 tempest-VolumesSnapshotTestJSON-1399894899 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-b97bf6eb-69d3-4ba1-ba94-8a004078ecf5 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:03:14 devstack sudo[101554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-b97bf6eb-69d3-4ba1-ba94-8a004078ecf5 Nov 04 11:03:14 devstack sudo[101554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:03:15 devstack sudo[101554]: pam_unix(sudo:session): session closed for user root Nov 04 11:03:15 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-d22ba67f-558e-4908-969a-264d98d77026 tempest-VolumesSnapshotTestJSON-1399894899 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-b97bf6eb-69d3-4ba1-ba94-8a004078ecf5" returned: 0 in 0.472s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:03:15 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-d22ba67f-558e-4908-969a-264d98d77026 tempest-VolumesSnapshotTestJSON-1399894899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-b97bf6eb-69d3-4ba1-ba94-8a004078ecf5 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:03:15 devstack sudo[101560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-b97bf6eb-69d3-4ba1-ba94-8a004078ecf5 Nov 04 11:03:15 devstack sudo[101560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:03:15 devstack sudo[101560]: pam_unix(sudo:session): session closed for user root Nov 04 11:03:15 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-d22ba67f-558e-4908-969a-264d98d77026 tempest-VolumesSnapshotTestJSON-1399894899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-b97bf6eb-69d3-4ba1-ba94-8a004078ecf5" returned: 0 in 0.309s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:03:15 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-d22ba67f-558e-4908-969a-264d98d77026 tempest-VolumesSnapshotTestJSON-1399894899 None] Lock "cinder-quobyte-b97bf6eb-69d3-4ba1-ba94-8a004078ecf5" released by "delete_volume" :: held 0.924s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 11:03:15 devstack cinder-volume[87272]: DEBUG cinder.quota [None req-d22ba67f-558e-4908-969a-264d98d77026 tempest-VolumesSnapshotTestJSON-1399894899 None] Created reservations ['756d8444-4136-4020-841a-3a4df96149b7', 'a38cd521-44c5-437f-af01-5c07d3ec4d54', 'd3e80574-5b14-49f1-9925-a29a4cb3bb37', '19de17aa-269b-4710-87d2-ea825bb8d6dd'] {{(pid=87272) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 11:03:15 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-d22ba67f-558e-4908-969a-264d98d77026 tempest-VolumesSnapshotTestJSON-1399894899 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 11:03:15 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-d22ba67f-558e-4908-969a-264d98d77026 tempest-VolumesSnapshotTestJSON-1399894899 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 11:03:15 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-d22ba67f-558e-4908-969a-264d98d77026 tempest-VolumesSnapshotTestJSON-1399894899 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898': None} {{(pid=87272) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 11:03:15 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-d22ba67f-558e-4908-969a-264d98d77026 tempest-VolumesSnapshotTestJSON-1399894899 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'] {{(pid=87272) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 11:03:15 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-d22ba67f-558e-4908-969a-264d98d77026 tempest-VolumesSnapshotTestJSON-1399894899 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 11:03:15 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-d22ba67f-558e-4908-969a-264d98d77026 tempest-VolumesSnapshotTestJSON-1399894899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:03:15 devstack sudo[101563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1 Nov 04 11:03:15 devstack sudo[101563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:03:16 devstack sudo[101563]: pam_unix(sudo:session): session closed for user root Nov 04 11:03:16 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-d22ba67f-558e-4908-969a-264d98d77026 tempest-VolumesSnapshotTestJSON-1399894899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1" returned: 0 in 0.369s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:03:16 devstack cinder-volume[87272]: DEBUG cinder.manager [None req-d22ba67f-558e-4908-969a-264d98d77026 tempest-VolumesSnapshotTestJSON-1399894899 None] Notifying Schedulers of capabilities ... {{(pid=87272) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 11:03:16 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-d22ba67f-558e-4908-969a-264d98d77026 tempest-VolumesSnapshotTestJSON-1399894899 None] Deleted volume successfully. Nov 04 11:03:16 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-d22ba67f-558e-4908-969a-264d98d77026 tempest-VolumesSnapshotTestJSON-1399894899 None] Lock "cinder-b97bf6eb-69d3-4ba1-ba94-8a004078ecf5-delete_volume" released by "delete_volume" :: held 1.704s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 11:03:16 devstack cinder-volume[87272]: DEBUG cinder.volume.flows.manager.create_volume [None req-c38250b2-5096-4487-8e63-b8707219c390 tempest-VolumesSnapshotTestJSON-1399894899 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87272) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 11:03:16 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-c38250b2-5096-4487-8e63-b8707219c390 tempest-VolumesSnapshotTestJSON-1399894899 None] Flow 'volume_create_manager' (4ed654cd-461a-4974-9427-dbfe81e64a0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 11:03:16 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-c38250b2-5096-4487-8e63-b8707219c390 tempest-VolumesSnapshotTestJSON-1399894899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b69bb8fa-c0e7-4d2e-9fc4-58c24a65d17b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:03:16 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-c38250b2-5096-4487-8e63-b8707219c390 tempest-VolumesSnapshotTestJSON-1399894899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b69bb8fa-c0e7-4d2e-9fc4-58c24a65d17b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T10:03:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-2080470553',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1369a9e1-a06f-49c1-9ae0-4c63dd864c53,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef099de5b8794b308a0c8f182ca0fca1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T10:03:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T10:03:16Z,use_quota=True,user_id='73239b009fea418ba15cb75342ef934d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8989e4f-21e3-4f0a-9584-0d818784e883),volume_type_id=f8989e4f-21e3-4f0a-9584-0d818784e883)' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:03:16 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-c38250b2-5096-4487-8e63-b8707219c390 tempest-VolumesSnapshotTestJSON-1399894899 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (348f616f-6359-471c-9199-69e2605775ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:03:16 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-c38250b2-5096-4487-8e63-b8707219c390 tempest-VolumesSnapshotTestJSON-1399894899 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (348f616f-6359-471c-9199-69e2605775ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:03:16 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-c38250b2-5096-4487-8e63-b8707219c390 tempest-VolumesSnapshotTestJSON-1399894899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b1e1687a-2475-411f-ba00-32551283140b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:03:16 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-c38250b2-5096-4487-8e63-b8707219c390 tempest-VolumesSnapshotTestJSON-1399894899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b1e1687a-2475-411f-ba00-32551283140b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1369a9e1-a06f-49c1-9ae0-4c63dd864c53', 'volume_name': 'volume-1369a9e1-a06f-49c1-9ae0-4c63dd864c53', 'volume_size': 1}' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:03:16 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-c38250b2-5096-4487-8e63-b8707219c390 tempest-VolumesSnapshotTestJSON-1399894899 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1479dd38-241f-400f-aeb4-9ddbdc5c6939) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:03:16 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-c38250b2-5096-4487-8e63-b8707219c390 tempest-VolumesSnapshotTestJSON-1399894899 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1479dd38-241f-400f-aeb4-9ddbdc5c6939) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:03:16 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-c38250b2-5096-4487-8e63-b8707219c390 tempest-VolumesSnapshotTestJSON-1399894899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d84f7c6-92ae-4d4e-9d01-b285bbff87f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:03:16 devstack cinder-volume[87272]: INFO cinder.volume.flows.manager.create_volume [None req-c38250b2-5096-4487-8e63-b8707219c390 tempest-VolumesSnapshotTestJSON-1399894899 None] Volume 1369a9e1-a06f-49c1-9ae0-4c63dd864c53: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1369a9e1-a06f-49c1-9ae0-4c63dd864c53', 'volume_size': 1} Nov 04 11:03:16 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-c38250b2-5096-4487-8e63-b8707219c390 tempest-VolumesSnapshotTestJSON-1399894899 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 11:03:17 devstack sudo[101507]: pam_unix(sudo:session): session closed for user root Nov 04 11:03:17 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-8b8cb5ba-1a02-45b1-aa75-b1d7cfe379bc tempest-VolumeDependencyTests-143533947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-d0924def-8711-4ff9-bf4f-7cefce60d2c7 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-67c3098d-f1f4-4419-9257-8640a32c6f3a" returned: 0 in 7.553s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:03:17 devstack cinder-volume[87272]: DEBUG cinder.image.image_utils [None req-8b8cb5ba-1a02-45b1-aa75-b1d7cfe379bc tempest-VolumeDependencyTests-143533947 None] Image conversion details: src /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-d0924def-8711-4ff9-bf4f-7cefce60d2c7, size 1024.00 MB, duration 7.55 sec, destination /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-67c3098d-f1f4-4419-9257-8640a32c6f3a {{(pid=87272) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Nov 04 11:03:17 devstack cinder-volume[87272]: INFO cinder.image.image_utils [None req-8b8cb5ba-1a02-45b1-aa75-b1d7cfe379bc tempest-VolumeDependencyTests-143533947 None] Converted 1024.00 MB image at 135.55 MB/s Nov 04 11:03:17 devstack cinder-volume[87272]: WARNING cinder.volume.drivers.remotefs [None req-8b8cb5ba-1a02-45b1-aa75-b1d7cfe379bc tempest-VolumeDependencyTests-143533947 None] /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-67c3098d-f1f4-4419-9257-8640a32c6f3a is being set with open permissions: ugo+rw Nov 04 11:03:17 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-8b8cb5ba-1a02-45b1-aa75-b1d7cfe379bc tempest-VolumeDependencyTests-143533947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-67c3098d-f1f4-4419-9257-8640a32c6f3a {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:03:17 devstack sudo[101567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-67c3098d-f1f4-4419-9257-8640a32c6f3a Nov 04 11:03:17 devstack sudo[101567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:03:17 devstack sudo[101567]: pam_unix(sudo:session): session closed for user root Nov 04 11:03:17 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-8b8cb5ba-1a02-45b1-aa75-b1d7cfe379bc tempest-VolumeDependencyTests-143533947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-67c3098d-f1f4-4419-9257-8640a32c6f3a" returned: 0 in 0.241s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:03:17 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-8b8cb5ba-1a02-45b1-aa75-b1d7cfe379bc tempest-VolumeDependencyTests-143533947 None] Lock "cinder-quobyte-67c3098d-f1f4-4419-9257-8640a32c6f3a" released by "_copy_volume_from_snapshot" :: held 8.641s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 11:03:17 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-8b8cb5ba-1a02-45b1-aa75-b1d7cfe379bc tempest-VolumeDependencyTests-143533947 None] Lock "cinder-quobyte-fd9695c9-9848-447b-bc8e-22e94a04e547-67c3098d-f1f4-4419-9257-8640a32c6f3a" released by "_create_volume_from_snapshot" :: held 8.735s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 11:03:17 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-8b8cb5ba-1a02-45b1-aa75-b1d7cfe379bc tempest-VolumeDependencyTests-143533947 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.771s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 11:03:17 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-92db8ed4-a16a-468d-ad91-8b29b76ca1bc tempest-VolumesExtendTest-1917483396 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.785s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 11:03:17 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-92db8ed4-a16a-468d-ad91-8b29b76ca1bc tempest-VolumesExtendTest-1917483396 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T10:03:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-348331232',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8d23d54e-1736-4966-ba9c-65a4e60c7d7c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dfc5fbd20fdc49d58f5fe9ee671c20b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T10:03:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T10:03:13Z,use_quota=True,user_id='4a8097cabbf54e0c9b37a3d456c62743',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8989e4f-21e3-4f0a-9584-0d818784e883),volume_type_id=f8989e4f-21e3-4f0a-9584-0d818784e883)}" {{(pid=87272) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 04 11:03:17 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.remotefs [None req-92db8ed4-a16a-468d-ad91-8b29b76ca1bc tempest-VolumesExtendTest-1917483396 None] Creating volume 8d23d54e-1736-4966-ba9c-65a4e60c7d7c {{(pid=87272) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 11:03:17 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-92db8ed4-a16a-468d-ad91-8b29b76ca1bc tempest-VolumesExtendTest-1917483396 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 11:03:17 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-92db8ed4-a16a-468d-ad91-8b29b76ca1bc tempest-VolumesExtendTest-1917483396 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 11:03:17 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-92db8ed4-a16a-468d-ad91-8b29b76ca1bc tempest-VolumesExtendTest-1917483396 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898': None} {{(pid=87272) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 11:03:17 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-92db8ed4-a16a-468d-ad91-8b29b76ca1bc tempest-VolumesExtendTest-1917483396 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'] {{(pid=87272) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 11:03:17 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-92db8ed4-a16a-468d-ad91-8b29b76ca1bc tempest-VolumesExtendTest-1917483396 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 11:03:17 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-92db8ed4-a16a-468d-ad91-8b29b76ca1bc tempest-VolumesExtendTest-1917483396 None] Selected osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898 as target Quobyte volume. {{(pid=87272) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 11:03:17 devstack cinder-volume[87272]: INFO cinder.volume.drivers.remotefs [None req-92db8ed4-a16a-468d-ad91-8b29b76ca1bc tempest-VolumesExtendTest-1917483396 None] casted to osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898 Nov 04 11:03:17 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-92db8ed4-a16a-468d-ad91-8b29b76ca1bc tempest-VolumesExtendTest-1917483396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-8d23d54e-1736-4966-ba9c-65a4e60c7d7c 1073741824 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:03:17 devstack sudo[101570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-8d23d54e-1736-4966-ba9c-65a4e60c7d7c 1073741824 Nov 04 11:03:17 devstack sudo[101570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:03:17 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-8b8cb5ba-1a02-45b1-aa75-b1d7cfe379bc tempest-VolumeDependencyTests-143533947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f8adc01-7796-4a97-8c6d-87c19ff9df04) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-67c3098d-f1f4-4419-9257-8640a32c6f3a', 'volume_size': 1, 'snapshot_id': 'fd9695c9-9848-447b-bc8e-22e94a04e547'}' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:03:17 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-8b8cb5ba-1a02-45b1-aa75-b1d7cfe379bc tempest-VolumeDependencyTests-143533947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2f23e687-3ab0-4d6e-9ee2-82be98866796) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:03:17 devstack cinder-volume[87272]: INFO cinder.volume.flows.manager.create_volume [None req-8b8cb5ba-1a02-45b1-aa75-b1d7cfe379bc tempest-VolumeDependencyTests-143533947 None] Volume volume-67c3098d-f1f4-4419-9257-8640a32c6f3a (67c3098d-f1f4-4419-9257-8640a32c6f3a): created successfully Nov 04 11:03:17 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-8b8cb5ba-1a02-45b1-aa75-b1d7cfe379bc tempest-VolumeDependencyTests-143533947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2f23e687-3ab0-4d6e-9ee2-82be98866796) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:03:17 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-8b8cb5ba-1a02-45b1-aa75-b1d7cfe379bc tempest-VolumeDependencyTests-143533947 None] Flow 'volume_create_manager' (55a0f147-9a4d-492a-8996-6de99f26ec79) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87272) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 11:03:17 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-8b8cb5ba-1a02-45b1-aa75-b1d7cfe379bc tempest-VolumeDependencyTests-143533947 None] Created volume successfully. Nov 04 11:03:17 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-c5a9d27d-0e39-4c58-910b-51161ce657e8 tempest-VolumeDependencyTests-143533947 None] Acquiring lock "cinder-fd9695c9-9848-447b-bc8e-22e94a04e547-delete_snapshot" by "delete_snapshot" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 11:03:17 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-c5a9d27d-0e39-4c58-910b-51161ce657e8 tempest-VolumeDependencyTests-143533947 None] Lock "cinder-fd9695c9-9848-447b-bc8e-22e94a04e547-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 11:03:17 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-c5a9d27d-0e39-4c58-910b-51161ce657e8 tempest-VolumeDependencyTests-143533947 None] Acquiring lock "cinder-quobyte-d0924def-8711-4ff9-bf4f-7cefce60d2c7" by "delete_snapshot" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 11:03:17 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-c5a9d27d-0e39-4c58-910b-51161ce657e8 tempest-VolumeDependencyTests-143533947 None] Lock "cinder-quobyte-d0924def-8711-4ff9-bf4f-7cefce60d2c7" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 11:03:17 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-c5a9d27d-0e39-4c58-910b-51161ce657e8 tempest-VolumeDependencyTests-143533947 None] Acquiring lock "cinder-quobyte-fd9695c9-9848-447b-bc8e-22e94a04e547" by "_delete_snapshot" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 11:03:17 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-c5a9d27d-0e39-4c58-910b-51161ce657e8 tempest-VolumeDependencyTests-143533947 None] Lock "cinder-quobyte-fd9695c9-9848-447b-bc8e-22e94a04e547" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 11:03:17 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.remotefs [None req-c5a9d27d-0e39-4c58-910b-51161ce657e8 tempest-VolumeDependencyTests-143533947 None] Deleting offline snapshot fd9695c9-9848-447b-bc8e-22e94a04e547 of volume d0924def-8711-4ff9-bf4f-7cefce60d2c7 {{(pid=87272) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 04 11:03:17 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.remotefs [None req-c5a9d27d-0e39-4c58-910b-51161ce657e8 tempest-VolumeDependencyTests-143533947 None] snapshot_file for this snap is: volume-d0924def-8711-4ff9-bf4f-7cefce60d2c7.fd9695c9-9848-447b-bc8e-22e94a04e547 {{(pid=87272) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 04 11:03:17 devstack cinder-volume[87272]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1ed9c07-b575-4981-80be-76da3c9a3dcc]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 11:03:17 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-c5a9d27d-0e39-4c58-910b-51161ce657e8 tempest-VolumeDependencyTests-143533947 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-d0924def-8711-4ff9-bf4f-7cefce60d2c7.fd9695c9-9848-447b-bc8e-22e94a04e547 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:03:17 devstack sudo[101575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-d0924def-8711-4ff9-bf4f-7cefce60d2c7.fd9695c9-9848-447b-bc8e-22e94a04e547 Nov 04 11:03:17 devstack sudo[101575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:03:17 devstack sudo[101570]: pam_unix(sudo:session): session closed for user root Nov 04 11:03:17 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-92db8ed4-a16a-468d-ad91-8b29b76ca1bc tempest-VolumesExtendTest-1917483396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-8d23d54e-1736-4966-ba9c-65a4e60c7d7c 1073741824" returned: 0 in 0.445s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:03:17 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-92db8ed4-a16a-468d-ad91-8b29b76ca1bc tempest-VolumesExtendTest-1917483396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-8d23d54e-1736-4966-ba9c-65a4e60c7d7c {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:03:17 devstack sudo[101578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-8d23d54e-1736-4966-ba9c-65a4e60c7d7c Nov 04 11:03:17 devstack sudo[101578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:03:18 devstack sudo[101575]: pam_unix(sudo:session): session closed for user root Nov 04 11:03:18 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-c5a9d27d-0e39-4c58-910b-51161ce657e8 tempest-VolumeDependencyTests-143533947 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-d0924def-8711-4ff9-bf4f-7cefce60d2c7.fd9695c9-9848-447b-bc8e-22e94a04e547" returned: 0 in 0.375s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:03:18 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.remotefs [None req-c5a9d27d-0e39-4c58-910b-51161ce657e8 tempest-VolumeDependencyTests-143533947 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d0924def-8711-4ff9-bf4f-7cefce60d2c7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87272) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 11:03:18 devstack cinder-volume[87272]: DEBUG oslo.privsep.daemon [-] privsep: reply[c14fbde7-9146-4e36-8168-c141198df6ab]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 11:03:18 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-c5a9d27d-0e39-4c58-910b-51161ce657e8 tempest-VolumeDependencyTests-143533947 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-d0924def-8711-4ff9-bf4f-7cefce60d2c7 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:03:18 devstack sudo[101578]: pam_unix(sudo:session): session closed for user root Nov 04 11:03:18 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-92db8ed4-a16a-468d-ad91-8b29b76ca1bc tempest-VolumesExtendTest-1917483396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-8d23d54e-1736-4966-ba9c-65a4e60c7d7c" returned: 0 in 0.242s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:03:18 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-92db8ed4-a16a-468d-ad91-8b29b76ca1bc tempest-VolumesExtendTest-1917483396 None] <== create_volume: return (730ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'} {{(pid=87272) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 04 11:03:18 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-92db8ed4-a16a-468d-ad91-8b29b76ca1bc tempest-VolumesExtendTest-1917483396 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.734s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 11:03:18 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-c38250b2-5096-4487-8e63-b8707219c390 tempest-VolumesSnapshotTestJSON-1399894899 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.390s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 11:03:18 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-c38250b2-5096-4487-8e63-b8707219c390 tempest-VolumesSnapshotTestJSON-1399894899 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T10:03:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-2080470553',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1369a9e1-a06f-49c1-9ae0-4c63dd864c53,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef099de5b8794b308a0c8f182ca0fca1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T10:03:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T10:03:16Z,use_quota=True,user_id='73239b009fea418ba15cb75342ef934d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8989e4f-21e3-4f0a-9584-0d818784e883),volume_type_id=f8989e4f-21e3-4f0a-9584-0d818784e883)}" {{(pid=87272) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 04 11:03:18 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.remotefs [None req-c38250b2-5096-4487-8e63-b8707219c390 tempest-VolumesSnapshotTestJSON-1399894899 None] Creating volume 1369a9e1-a06f-49c1-9ae0-4c63dd864c53 {{(pid=87272) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 11:03:18 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-c38250b2-5096-4487-8e63-b8707219c390 tempest-VolumesSnapshotTestJSON-1399894899 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 11:03:18 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-c38250b2-5096-4487-8e63-b8707219c390 tempest-VolumesSnapshotTestJSON-1399894899 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 11:03:18 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-c38250b2-5096-4487-8e63-b8707219c390 tempest-VolumesSnapshotTestJSON-1399894899 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898': None} {{(pid=87272) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 11:03:18 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-c38250b2-5096-4487-8e63-b8707219c390 tempest-VolumesSnapshotTestJSON-1399894899 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'] {{(pid=87272) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 11:03:18 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-c38250b2-5096-4487-8e63-b8707219c390 tempest-VolumesSnapshotTestJSON-1399894899 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 11:03:18 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-c38250b2-5096-4487-8e63-b8707219c390 tempest-VolumesSnapshotTestJSON-1399894899 None] Selected osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898 as target Quobyte volume. {{(pid=87272) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 11:03:18 devstack cinder-volume[87272]: INFO cinder.volume.drivers.remotefs [None req-c38250b2-5096-4487-8e63-b8707219c390 tempest-VolumesSnapshotTestJSON-1399894899 None] casted to osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898 Nov 04 11:03:18 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-c38250b2-5096-4487-8e63-b8707219c390 tempest-VolumesSnapshotTestJSON-1399894899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-1369a9e1-a06f-49c1-9ae0-4c63dd864c53 1073741824 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:03:18 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-92db8ed4-a16a-468d-ad91-8b29b76ca1bc tempest-VolumesExtendTest-1917483396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c5e7f2b1-dc9a-4368-989a-99d49044f335) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8d23d54e-1736-4966-ba9c-65a4e60c7d7c', 'volume_size': 1}' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:03:18 devstack sudo[101585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-1369a9e1-a06f-49c1-9ae0-4c63dd864c53 1073741824 Nov 04 11:03:18 devstack sudo[101585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:03:18 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-92db8ed4-a16a-468d-ad91-8b29b76ca1bc tempest-VolumesExtendTest-1917483396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (468d8638-7214-4717-9043-6a3af49be9d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:03:18 devstack cinder-volume[87272]: INFO cinder.volume.flows.manager.create_volume [None req-92db8ed4-a16a-468d-ad91-8b29b76ca1bc tempest-VolumesExtendTest-1917483396 None] Volume volume-8d23d54e-1736-4966-ba9c-65a4e60c7d7c (8d23d54e-1736-4966-ba9c-65a4e60c7d7c): created successfully Nov 04 11:03:18 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-92db8ed4-a16a-468d-ad91-8b29b76ca1bc tempest-VolumesExtendTest-1917483396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (468d8638-7214-4717-9043-6a3af49be9d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:03:18 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-92db8ed4-a16a-468d-ad91-8b29b76ca1bc tempest-VolumesExtendTest-1917483396 None] Flow 'volume_create_manager' (a39075a2-ce0b-4230-92a3-78339742fa14) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87272) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 11:03:18 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-92db8ed4-a16a-468d-ad91-8b29b76ca1bc tempest-VolumesExtendTest-1917483396 None] Created volume successfully. Nov 04 11:03:18 devstack sudo[101584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-d0924def-8711-4ff9-bf4f-7cefce60d2c7 Nov 04 11:03:18 devstack sudo[101584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:03:18 devstack sudo[101585]: pam_unix(sudo:session): session closed for user root Nov 04 11:03:18 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-c38250b2-5096-4487-8e63-b8707219c390 tempest-VolumesSnapshotTestJSON-1399894899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-1369a9e1-a06f-49c1-9ae0-4c63dd864c53 1073741824" returned: 0 in 0.439s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:03:18 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-c38250b2-5096-4487-8e63-b8707219c390 tempest-VolumesSnapshotTestJSON-1399894899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-1369a9e1-a06f-49c1-9ae0-4c63dd864c53 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:03:18 devstack sudo[101594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-1369a9e1-a06f-49c1-9ae0-4c63dd864c53 Nov 04 11:03:18 devstack sudo[101594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:03:18 devstack sudo[101584]: pam_unix(sudo:session): session closed for user root Nov 04 11:03:18 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-c5a9d27d-0e39-4c58-910b-51161ce657e8 tempest-VolumeDependencyTests-143533947 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-d0924def-8711-4ff9-bf4f-7cefce60d2c7" returned: 0 in 0.530s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:03:18 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-c5a9d27d-0e39-4c58-910b-51161ce657e8 tempest-VolumeDependencyTests-143533947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-d0924def-8711-4ff9-bf4f-7cefce60d2c7.fd9695c9-9848-447b-bc8e-22e94a04e547 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:03:18 devstack sudo[101596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-d0924def-8711-4ff9-bf4f-7cefce60d2c7.fd9695c9-9848-447b-bc8e-22e94a04e547 Nov 04 11:03:18 devstack sudo[101596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:03:18 devstack sudo[101594]: pam_unix(sudo:session): session closed for user root Nov 04 11:03:18 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-c38250b2-5096-4487-8e63-b8707219c390 tempest-VolumesSnapshotTestJSON-1399894899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-1369a9e1-a06f-49c1-9ae0-4c63dd864c53" returned: 0 in 0.246s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:03:18 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-c38250b2-5096-4487-8e63-b8707219c390 tempest-VolumesSnapshotTestJSON-1399894899 None] <== create_volume: return (730ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'} {{(pid=87272) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 04 11:03:18 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-c38250b2-5096-4487-8e63-b8707219c390 tempest-VolumesSnapshotTestJSON-1399894899 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.732s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 11:03:18 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-c38250b2-5096-4487-8e63-b8707219c390 tempest-VolumesSnapshotTestJSON-1399894899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d84f7c6-92ae-4d4e-9d01-b285bbff87f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1369a9e1-a06f-49c1-9ae0-4c63dd864c53', 'volume_size': 1}' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:03:18 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-c38250b2-5096-4487-8e63-b8707219c390 tempest-VolumesSnapshotTestJSON-1399894899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (39d5977b-30c2-48b8-996f-cc6a605c2cbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:03:18 devstack cinder-volume[87272]: INFO cinder.volume.flows.manager.create_volume [None req-c38250b2-5096-4487-8e63-b8707219c390 tempest-VolumesSnapshotTestJSON-1399894899 None] Volume volume-1369a9e1-a06f-49c1-9ae0-4c63dd864c53 (1369a9e1-a06f-49c1-9ae0-4c63dd864c53): created successfully Nov 04 11:03:18 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-c38250b2-5096-4487-8e63-b8707219c390 tempest-VolumesSnapshotTestJSON-1399894899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (39d5977b-30c2-48b8-996f-cc6a605c2cbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:03:18 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-c38250b2-5096-4487-8e63-b8707219c390 tempest-VolumesSnapshotTestJSON-1399894899 None] Flow 'volume_create_manager' (4ed654cd-461a-4974-9427-dbfe81e64a0f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87272) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 11:03:18 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-c38250b2-5096-4487-8e63-b8707219c390 tempest-VolumesSnapshotTestJSON-1399894899 None] Created volume successfully. Nov 04 11:03:18 devstack sudo[101596]: pam_unix(sudo:session): session closed for user root Nov 04 11:03:18 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-c5a9d27d-0e39-4c58-910b-51161ce657e8 tempest-VolumeDependencyTests-143533947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-d0924def-8711-4ff9-bf4f-7cefce60d2c7.fd9695c9-9848-447b-bc8e-22e94a04e547" returned: 0 in 0.356s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:03:18 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-c5a9d27d-0e39-4c58-910b-51161ce657e8 tempest-VolumeDependencyTests-143533947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-d0924def-8711-4ff9-bf4f-7cefce60d2c7.fd9695c9-9848-447b-bc8e-22e94a04e547 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:03:18 devstack sudo[101603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-d0924def-8711-4ff9-bf4f-7cefce60d2c7.fd9695c9-9848-447b-bc8e-22e94a04e547 Nov 04 11:03:18 devstack sudo[101603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:03:19 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-aa663b62-ef83-448f-8cfa-1eac5296d62b tempest-VolumesExtendTest-1917483396 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 11:03:19 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-aa663b62-ef83-448f-8cfa-1eac5296d62b tempest-VolumesExtendTest-1917483396 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 11:03:19 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.remotefs [None req-aa663b62-ef83-448f-8cfa-1eac5296d62b tempest-VolumesExtendTest-1917483396 None] Creating offline snapshot 30fdadd9-cf18-470d-9cad-8b062aad57d8 of volume 8d23d54e-1736-4966-ba9c-65a4e60c7d7c {{(pid=87272) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 04 11:03:19 devstack cinder-volume[87272]: DEBUG oslo.privsep.daemon [-] privsep: reply[438fd42d-8366-46e6-91dc-36a70d84c5bb]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 11:03:19 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-aa663b62-ef83-448f-8cfa-1eac5296d62b tempest-VolumesExtendTest-1917483396 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-8d23d54e-1736-4966-ba9c-65a4e60c7d7c {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:03:19 devstack sudo[101605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-8d23d54e-1736-4966-ba9c-65a4e60c7d7c Nov 04 11:03:19 devstack sudo[101605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:03:19 devstack sudo[101603]: pam_unix(sudo:session): session closed for user root Nov 04 11:03:19 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-c5a9d27d-0e39-4c58-910b-51161ce657e8 tempest-VolumeDependencyTests-143533947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-d0924def-8711-4ff9-bf4f-7cefce60d2c7.fd9695c9-9848-447b-bc8e-22e94a04e547" returned: 0 in 0.260s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:03:19 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-c5a9d27d-0e39-4c58-910b-51161ce657e8 tempest-VolumeDependencyTests-143533947 None] Lock "cinder-quobyte-fd9695c9-9848-447b-bc8e-22e94a04e547" released by "_delete_snapshot" :: held 1.632s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 11:03:19 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-c5a9d27d-0e39-4c58-910b-51161ce657e8 tempest-VolumeDependencyTests-143533947 None] Lock "cinder-quobyte-d0924def-8711-4ff9-bf4f-7cefce60d2c7" released by "delete_snapshot" :: held 1.658s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 11:03:19 devstack cinder-volume[87272]: DEBUG cinder.quota [None req-c5a9d27d-0e39-4c58-910b-51161ce657e8 tempest-VolumeDependencyTests-143533947 None] Created reservations ['c8ff10ef-a1f0-47fb-bede-44e3fe60d199', '86399fa1-e6c2-49d1-8b2c-027ca379f9fb', '96b212db-b29d-491f-a02a-d43e951a083f', '6278a66c-e7ce-433a-b88d-18a6d0d01685'] {{(pid=87272) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 11:03:19 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-c5a9d27d-0e39-4c58-910b-51161ce657e8 tempest-VolumeDependencyTests-143533947 None] Delete snapshot completed successfully. Nov 04 11:03:19 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-c5a9d27d-0e39-4c58-910b-51161ce657e8 tempest-VolumeDependencyTests-143533947 None] Lock "cinder-fd9695c9-9848-447b-bc8e-22e94a04e547-delete_snapshot" released by "delete_snapshot" :: held 1.810s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 11:03:19 devstack sudo[101605]: pam_unix(sudo:session): session closed for user root Nov 04 11:03:19 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-aa663b62-ef83-448f-8cfa-1eac5296d62b tempest-VolumesExtendTest-1917483396 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-8d23d54e-1736-4966-ba9c-65a4e60c7d7c" returned: 0 in 0.385s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:03:19 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-aa663b62-ef83-448f-8cfa-1eac5296d62b tempest-VolumesExtendTest-1917483396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-8d23d54e-1736-4966-ba9c-65a4e60c7d7c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-8d23d54e-1736-4966-ba9c-65a4e60c7d7c.30fdadd9-cf18-470d-9cad-8b062aad57d8 1G {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:03:19 devstack sudo[101611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-8d23d54e-1736-4966-ba9c-65a4e60c7d7c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-8d23d54e-1736-4966-ba9c-65a4e60c7d7c.30fdadd9-cf18-470d-9cad-8b062aad57d8 1G Nov 04 11:03:19 devstack sudo[101611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:03:19 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-4281284a-afd7-4ec3-84a3-d7b3fa573ad7 tempest-VolumeDependencyTests-143533947 None] Acquiring lock "cinder-d0924def-8711-4ff9-bf4f-7cefce60d2c7-delete_volume" by "delete_volume" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 11:03:19 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-4281284a-afd7-4ec3-84a3-d7b3fa573ad7 tempest-VolumeDependencyTests-143533947 None] Lock "cinder-d0924def-8711-4ff9-bf4f-7cefce60d2c7-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 11:03:19 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-ac29108f-9694-48a9-9f56-e277d4683a87 tempest-VolumesSnapshotTestJSON-1399894899 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 11:03:19 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-4281284a-afd7-4ec3-84a3-d7b3fa573ad7 tempest-VolumeDependencyTests-143533947 None] Acquiring lock "cinder-quobyte-d0924def-8711-4ff9-bf4f-7cefce60d2c7" by "delete_volume" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 11:03:19 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-4281284a-afd7-4ec3-84a3-d7b3fa573ad7 tempest-VolumeDependencyTests-143533947 None] Lock "cinder-quobyte-d0924def-8711-4ff9-bf4f-7cefce60d2c7" acquired by "delete_volume" :: waited 0.014s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 11:03:19 devstack cinder-volume[87272]: DEBUG oslo.privsep.daemon [-] privsep: reply[38b65c2e-de92-4b8e-8671-63d8c29d666b]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 11:03:19 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-4281284a-afd7-4ec3-84a3-d7b3fa573ad7 tempest-VolumeDependencyTests-143533947 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-d0924def-8711-4ff9-bf4f-7cefce60d2c7 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:03:19 devstack sudo[101611]: pam_unix(sudo:session): session closed for user root Nov 04 11:03:19 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-aa663b62-ef83-448f-8cfa-1eac5296d62b tempest-VolumesExtendTest-1917483396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-8d23d54e-1736-4966-ba9c-65a4e60c7d7c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-8d23d54e-1736-4966-ba9c-65a4e60c7d7c.30fdadd9-cf18-470d-9cad-8b062aad57d8 1G" returned: 0 in 0.464s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:03:19 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-aa663b62-ef83-448f-8cfa-1eac5296d62b tempest-VolumesExtendTest-1917483396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8d23d54e-1736-4966-ba9c-65a4e60c7d7c -F qcow2 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-8d23d54e-1736-4966-ba9c-65a4e60c7d7c.30fdadd9-cf18-470d-9cad-8b062aad57d8 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:03:19 devstack sudo[101617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8d23d54e-1736-4966-ba9c-65a4e60c7d7c -F qcow2 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-8d23d54e-1736-4966-ba9c-65a4e60c7d7c.30fdadd9-cf18-470d-9cad-8b062aad57d8 Nov 04 11:03:19 devstack sudo[101617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:03:20 devstack sudo[101616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-d0924def-8711-4ff9-bf4f-7cefce60d2c7 Nov 04 11:03:20 devstack sudo[101616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:03:20 devstack sudo[101617]: pam_unix(sudo:session): session closed for user root Nov 04 11:03:20 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-aa663b62-ef83-448f-8cfa-1eac5296d62b tempest-VolumesExtendTest-1917483396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8d23d54e-1736-4966-ba9c-65a4e60c7d7c -F qcow2 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-8d23d54e-1736-4966-ba9c-65a4e60c7d7c.30fdadd9-cf18-470d-9cad-8b062aad57d8" returned: 0 in 0.292s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:03:20 devstack cinder-volume[87272]: WARNING cinder.volume.drivers.remotefs [None req-aa663b62-ef83-448f-8cfa-1eac5296d62b tempest-VolumesExtendTest-1917483396 None] /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-8d23d54e-1736-4966-ba9c-65a4e60c7d7c.30fdadd9-cf18-470d-9cad-8b062aad57d8 is being set with open permissions: ugo+rw Nov 04 11:03:20 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-aa663b62-ef83-448f-8cfa-1eac5296d62b tempest-VolumesExtendTest-1917483396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-8d23d54e-1736-4966-ba9c-65a4e60c7d7c.30fdadd9-cf18-470d-9cad-8b062aad57d8 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:03:20 devstack sudo[101623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-8d23d54e-1736-4966-ba9c-65a4e60c7d7c.30fdadd9-cf18-470d-9cad-8b062aad57d8 Nov 04 11:03:20 devstack sudo[101623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:03:20 devstack sudo[101616]: pam_unix(sudo:session): session closed for user root Nov 04 11:03:20 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-4281284a-afd7-4ec3-84a3-d7b3fa573ad7 tempest-VolumeDependencyTests-143533947 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-d0924def-8711-4ff9-bf4f-7cefce60d2c7" returned: 0 in 0.393s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:03:20 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-4281284a-afd7-4ec3-84a3-d7b3fa573ad7 tempest-VolumeDependencyTests-143533947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-d0924def-8711-4ff9-bf4f-7cefce60d2c7 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:03:20 devstack sudo[101628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-d0924def-8711-4ff9-bf4f-7cefce60d2c7 Nov 04 11:03:20 devstack sudo[101628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:03:20 devstack sudo[101623]: pam_unix(sudo:session): session closed for user root Nov 04 11:03:20 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-aa663b62-ef83-448f-8cfa-1eac5296d62b tempest-VolumesExtendTest-1917483396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-8d23d54e-1736-4966-ba9c-65a4e60c7d7c.30fdadd9-cf18-470d-9cad-8b062aad57d8" returned: 0 in 0.246s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:03:20 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-aa663b62-ef83-448f-8cfa-1eac5296d62b tempest-VolumesExtendTest-1917483396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-8d23d54e-1736-4966-ba9c-65a4e60c7d7c.info {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:03:20 devstack sudo[101632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-8d23d54e-1736-4966-ba9c-65a4e60c7d7c.info Nov 04 11:03:20 devstack sudo[101632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:03:20 devstack sudo[101628]: pam_unix(sudo:session): session closed for user root Nov 04 11:03:20 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-4281284a-afd7-4ec3-84a3-d7b3fa573ad7 tempest-VolumeDependencyTests-143533947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-d0924def-8711-4ff9-bf4f-7cefce60d2c7" returned: 0 in 0.240s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:03:20 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-4281284a-afd7-4ec3-84a3-d7b3fa573ad7 tempest-VolumeDependencyTests-143533947 None] Lock "cinder-quobyte-d0924def-8711-4ff9-bf4f-7cefce60d2c7" released by "delete_volume" :: held 0.705s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 11:03:20 devstack cinder-volume[87272]: DEBUG cinder.quota [None req-4281284a-afd7-4ec3-84a3-d7b3fa573ad7 tempest-VolumeDependencyTests-143533947 None] Created reservations ['1af58d78-affb-406f-9489-efcbe029a481', '5ac501e9-9571-4fd7-bad6-592320337a9e', 'd496352d-3c49-4830-83b6-ff74ac762a87', '86531ff9-995a-4c18-8f58-44728daa1e02'] {{(pid=87272) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 11:03:20 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-4281284a-afd7-4ec3-84a3-d7b3fa573ad7 tempest-VolumeDependencyTests-143533947 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 11:03:20 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-4281284a-afd7-4ec3-84a3-d7b3fa573ad7 tempest-VolumeDependencyTests-143533947 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 11:03:20 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-4281284a-afd7-4ec3-84a3-d7b3fa573ad7 tempest-VolumeDependencyTests-143533947 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898': None} {{(pid=87272) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 11:03:20 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-4281284a-afd7-4ec3-84a3-d7b3fa573ad7 tempest-VolumeDependencyTests-143533947 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'] {{(pid=87272) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 11:03:20 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-4281284a-afd7-4ec3-84a3-d7b3fa573ad7 tempest-VolumeDependencyTests-143533947 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 11:03:20 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-4281284a-afd7-4ec3-84a3-d7b3fa573ad7 tempest-VolumeDependencyTests-143533947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:03:20 devstack sudo[101635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1 Nov 04 11:03:20 devstack sudo[101635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:03:20 devstack sudo[101632]: pam_unix(sudo:session): session closed for user root Nov 04 11:03:20 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-aa663b62-ef83-448f-8cfa-1eac5296d62b tempest-VolumesExtendTest-1917483396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-8d23d54e-1736-4966-ba9c-65a4e60c7d7c.info" returned: 0 in 0.252s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:03:20 devstack cinder-volume[87272]: WARNING cinder.volume.drivers.remotefs [None req-aa663b62-ef83-448f-8cfa-1eac5296d62b tempest-VolumesExtendTest-1917483396 None] /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-8d23d54e-1736-4966-ba9c-65a4e60c7d7c.info is being set with open permissions: ugo+rw Nov 04 11:03:20 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-aa663b62-ef83-448f-8cfa-1eac5296d62b tempest-VolumesExtendTest-1917483396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-8d23d54e-1736-4966-ba9c-65a4e60c7d7c.info {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:03:20 devstack sudo[101637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-8d23d54e-1736-4966-ba9c-65a4e60c7d7c.info Nov 04 11:03:20 devstack sudo[101637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:03:20 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-f48ac703-5c3f-4fde-9051-2f2d2923d6c4 tempest-VolumeDependencyTests-143533947 None] Acquiring lock "cinder-67c3098d-f1f4-4419-9257-8640a32c6f3a-delete_volume" by "delete_volume" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 11:03:20 devstack sudo[101635]: pam_unix(sudo:session): session closed for user root Nov 04 11:03:20 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-4281284a-afd7-4ec3-84a3-d7b3fa573ad7 tempest-VolumeDependencyTests-143533947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1" returned: 0 in 0.282s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:03:20 devstack cinder-volume[87272]: DEBUG cinder.manager [None req-4281284a-afd7-4ec3-84a3-d7b3fa573ad7 tempest-VolumeDependencyTests-143533947 None] Notifying Schedulers of capabilities ... {{(pid=87272) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 11:03:20 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-f48ac703-5c3f-4fde-9051-2f2d2923d6c4 tempest-VolumeDependencyTests-143533947 None] Lock "cinder-67c3098d-f1f4-4419-9257-8640a32c6f3a-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 11:03:20 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-4281284a-afd7-4ec3-84a3-d7b3fa573ad7 tempest-VolumeDependencyTests-143533947 None] Deleted volume successfully. Nov 04 11:03:21 devstack sudo[101637]: pam_unix(sudo:session): session closed for user root Nov 04 11:03:21 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-4281284a-afd7-4ec3-84a3-d7b3fa573ad7 tempest-VolumeDependencyTests-143533947 None] Lock "cinder-d0924def-8711-4ff9-bf4f-7cefce60d2c7-delete_volume" released by "delete_volume" :: held 1.229s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 11:03:21 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-aa663b62-ef83-448f-8cfa-1eac5296d62b tempest-VolumesExtendTest-1917483396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-8d23d54e-1736-4966-ba9c-65a4e60c7d7c.info" returned: 0 in 0.285s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:03:21 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-aa663b62-ef83-448f-8cfa-1eac5296d62b tempest-VolumesExtendTest-1917483396 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.016s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 11:03:21 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-ac29108f-9694-48a9-9f56-e277d4683a87 tempest-VolumesSnapshotTestJSON-1399894899 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.223s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 11:03:21 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-f48ac703-5c3f-4fde-9051-2f2d2923d6c4 tempest-VolumeDependencyTests-143533947 None] Acquiring lock "cinder-quobyte-67c3098d-f1f4-4419-9257-8640a32c6f3a" by "delete_volume" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 11:03:21 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.remotefs [None req-ac29108f-9694-48a9-9f56-e277d4683a87 tempest-VolumesSnapshotTestJSON-1399894899 None] Creating offline snapshot 947a69b5-3620-401b-94b9-509a00a0f288 of volume 1369a9e1-a06f-49c1-9ae0-4c63dd864c53 {{(pid=87272) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 04 11:03:21 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-f48ac703-5c3f-4fde-9051-2f2d2923d6c4 tempest-VolumeDependencyTests-143533947 None] Lock "cinder-quobyte-67c3098d-f1f4-4419-9257-8640a32c6f3a" acquired by "delete_volume" :: waited 0.029s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 11:03:21 devstack cinder-volume[87272]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1caa3d9-8ac2-471b-b417-6c163f26271b]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 11:03:21 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-ac29108f-9694-48a9-9f56-e277d4683a87 tempest-VolumesSnapshotTestJSON-1399894899 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-1369a9e1-a06f-49c1-9ae0-4c63dd864c53 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:03:21 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-aa663b62-ef83-448f-8cfa-1eac5296d62b tempest-VolumesExtendTest-1917483396 None] Create snapshot completed successfully Nov 04 11:03:21 devstack cinder-volume[87272]: DEBUG oslo.privsep.daemon [-] privsep: reply[59cc7631-d779-4ef3-ab10-3cb3d88a706c]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 11:03:21 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-f48ac703-5c3f-4fde-9051-2f2d2923d6c4 tempest-VolumeDependencyTests-143533947 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-67c3098d-f1f4-4419-9257-8640a32c6f3a {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:03:21 devstack sudo[101644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-1369a9e1-a06f-49c1-9ae0-4c63dd864c53 Nov 04 11:03:21 devstack sudo[101644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:03:21 devstack sudo[101645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-67c3098d-f1f4-4419-9257-8640a32c6f3a Nov 04 11:03:21 devstack sudo[101645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:03:21 devstack sudo[101644]: pam_unix(sudo:session): session closed for user root Nov 04 11:03:21 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-ac29108f-9694-48a9-9f56-e277d4683a87 tempest-VolumesSnapshotTestJSON-1399894899 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-1369a9e1-a06f-49c1-9ae0-4c63dd864c53" returned: 0 in 0.361s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:03:21 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-ac29108f-9694-48a9-9f56-e277d4683a87 tempest-VolumesSnapshotTestJSON-1399894899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-1369a9e1-a06f-49c1-9ae0-4c63dd864c53,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-1369a9e1-a06f-49c1-9ae0-4c63dd864c53.947a69b5-3620-401b-94b9-509a00a0f288 1G {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:03:21 devstack sudo[101645]: pam_unix(sudo:session): session closed for user root Nov 04 11:03:21 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-f48ac703-5c3f-4fde-9051-2f2d2923d6c4 tempest-VolumeDependencyTests-143533947 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-67c3098d-f1f4-4419-9257-8640a32c6f3a" returned: 0 in 0.360s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:03:21 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-f48ac703-5c3f-4fde-9051-2f2d2923d6c4 tempest-VolumeDependencyTests-143533947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-67c3098d-f1f4-4419-9257-8640a32c6f3a {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:03:21 devstack sudo[101657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-1369a9e1-a06f-49c1-9ae0-4c63dd864c53,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-1369a9e1-a06f-49c1-9ae0-4c63dd864c53.947a69b5-3620-401b-94b9-509a00a0f288 1G Nov 04 11:03:21 devstack sudo[101657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:03:21 devstack sudo[101659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-67c3098d-f1f4-4419-9257-8640a32c6f3a Nov 04 11:03:21 devstack sudo[101659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:03:21 devstack sudo[101659]: pam_unix(sudo:session): session closed for user root Nov 04 11:03:21 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-f48ac703-5c3f-4fde-9051-2f2d2923d6c4 tempest-VolumeDependencyTests-143533947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-67c3098d-f1f4-4419-9257-8640a32c6f3a" returned: 0 in 0.238s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:03:21 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-f48ac703-5c3f-4fde-9051-2f2d2923d6c4 tempest-VolumeDependencyTests-143533947 None] Lock "cinder-quobyte-67c3098d-f1f4-4419-9257-8640a32c6f3a" released by "delete_volume" :: held 0.648s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 11:03:21 devstack cinder-volume[87272]: DEBUG cinder.quota [None req-f48ac703-5c3f-4fde-9051-2f2d2923d6c4 tempest-VolumeDependencyTests-143533947 None] Created reservations ['96c07a9d-2d6d-44df-b373-dbd5f41b61a3', 'd32d5e3f-fc17-4a21-a524-35b6aee996bb', '7d07eb82-55a2-494d-bc0f-026e52ad515d', '4172ecb9-7406-43e5-958e-02847a876494'] {{(pid=87272) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 11:03:21 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-f48ac703-5c3f-4fde-9051-2f2d2923d6c4 tempest-VolumeDependencyTests-143533947 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 11:03:21 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-f48ac703-5c3f-4fde-9051-2f2d2923d6c4 tempest-VolumeDependencyTests-143533947 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 11:03:21 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-f48ac703-5c3f-4fde-9051-2f2d2923d6c4 tempest-VolumeDependencyTests-143533947 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898': None} {{(pid=87272) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 11:03:21 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-f48ac703-5c3f-4fde-9051-2f2d2923d6c4 tempest-VolumeDependencyTests-143533947 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'] {{(pid=87272) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 11:03:21 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-f48ac703-5c3f-4fde-9051-2f2d2923d6c4 tempest-VolumeDependencyTests-143533947 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 11:03:21 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-f48ac703-5c3f-4fde-9051-2f2d2923d6c4 tempest-VolumeDependencyTests-143533947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:03:21 devstack sudo[101657]: pam_unix(sudo:session): session closed for user root Nov 04 11:03:21 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-ac29108f-9694-48a9-9f56-e277d4683a87 tempest-VolumesSnapshotTestJSON-1399894899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-1369a9e1-a06f-49c1-9ae0-4c63dd864c53,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-1369a9e1-a06f-49c1-9ae0-4c63dd864c53.947a69b5-3620-401b-94b9-509a00a0f288 1G" returned: 0 in 0.427s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:03:21 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-ac29108f-9694-48a9-9f56-e277d4683a87 tempest-VolumesSnapshotTestJSON-1399894899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1369a9e1-a06f-49c1-9ae0-4c63dd864c53 -F qcow2 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-1369a9e1-a06f-49c1-9ae0-4c63dd864c53.947a69b5-3620-401b-94b9-509a00a0f288 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:03:21 devstack sudo[101666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1 Nov 04 11:03:21 devstack sudo[101666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:03:21 devstack sudo[101668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1369a9e1-a06f-49c1-9ae0-4c63dd864c53 -F qcow2 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-1369a9e1-a06f-49c1-9ae0-4c63dd864c53.947a69b5-3620-401b-94b9-509a00a0f288 Nov 04 11:03:21 devstack sudo[101668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:03:22 devstack sudo[101666]: pam_unix(sudo:session): session closed for user root Nov 04 11:03:22 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-f48ac703-5c3f-4fde-9051-2f2d2923d6c4 tempest-VolumeDependencyTests-143533947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1" returned: 0 in 0.276s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:03:22 devstack cinder-volume[87272]: DEBUG cinder.manager [None req-f48ac703-5c3f-4fde-9051-2f2d2923d6c4 tempest-VolumeDependencyTests-143533947 None] Notifying Schedulers of capabilities ... {{(pid=87272) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 11:03:22 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-f48ac703-5c3f-4fde-9051-2f2d2923d6c4 tempest-VolumeDependencyTests-143533947 None] Deleted volume successfully. Nov 04 11:03:22 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-f48ac703-5c3f-4fde-9051-2f2d2923d6c4 tempest-VolumeDependencyTests-143533947 None] Lock "cinder-67c3098d-f1f4-4419-9257-8640a32c6f3a-delete_volume" released by "delete_volume" :: held 1.211s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 11:03:22 devstack sudo[101668]: pam_unix(sudo:session): session closed for user root Nov 04 11:03:22 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-ac29108f-9694-48a9-9f56-e277d4683a87 tempest-VolumesSnapshotTestJSON-1399894899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1369a9e1-a06f-49c1-9ae0-4c63dd864c53 -F qcow2 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-1369a9e1-a06f-49c1-9ae0-4c63dd864c53.947a69b5-3620-401b-94b9-509a00a0f288" returned: 0 in 0.328s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:03:22 devstack cinder-volume[87272]: WARNING cinder.volume.drivers.remotefs [None req-ac29108f-9694-48a9-9f56-e277d4683a87 tempest-VolumesSnapshotTestJSON-1399894899 None] /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-1369a9e1-a06f-49c1-9ae0-4c63dd864c53.947a69b5-3620-401b-94b9-509a00a0f288 is being set with open permissions: ugo+rw Nov 04 11:03:22 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-ac29108f-9694-48a9-9f56-e277d4683a87 tempest-VolumesSnapshotTestJSON-1399894899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-1369a9e1-a06f-49c1-9ae0-4c63dd864c53.947a69b5-3620-401b-94b9-509a00a0f288 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:03:22 devstack sudo[101674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-1369a9e1-a06f-49c1-9ae0-4c63dd864c53.947a69b5-3620-401b-94b9-509a00a0f288 Nov 04 11:03:22 devstack sudo[101674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:03:22 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-7e66e291-c780-42b3-afd7-42c129646d6b tempest-VolumesExtendTest-1917483396 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 11:03:22 devstack sudo[101674]: pam_unix(sudo:session): session closed for user root Nov 04 11:03:22 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-ac29108f-9694-48a9-9f56-e277d4683a87 tempest-VolumesSnapshotTestJSON-1399894899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-1369a9e1-a06f-49c1-9ae0-4c63dd864c53.947a69b5-3620-401b-94b9-509a00a0f288" returned: 0 in 0.283s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:03:22 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-ac29108f-9694-48a9-9f56-e277d4683a87 tempest-VolumesSnapshotTestJSON-1399894899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-1369a9e1-a06f-49c1-9ae0-4c63dd864c53.info {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:03:22 devstack sudo[101677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-1369a9e1-a06f-49c1-9ae0-4c63dd864c53.info Nov 04 11:03:22 devstack sudo[101677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:03:22 devstack sudo[101677]: pam_unix(sudo:session): session closed for user root Nov 04 11:03:22 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-ac29108f-9694-48a9-9f56-e277d4683a87 tempest-VolumesSnapshotTestJSON-1399894899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-1369a9e1-a06f-49c1-9ae0-4c63dd864c53.info" returned: 0 in 0.253s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:03:22 devstack cinder-volume[87272]: WARNING cinder.volume.drivers.remotefs [None req-ac29108f-9694-48a9-9f56-e277d4683a87 tempest-VolumesSnapshotTestJSON-1399894899 None] /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-1369a9e1-a06f-49c1-9ae0-4c63dd864c53.info is being set with open permissions: ugo+rw Nov 04 11:03:22 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-ac29108f-9694-48a9-9f56-e277d4683a87 tempest-VolumesSnapshotTestJSON-1399894899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-1369a9e1-a06f-49c1-9ae0-4c63dd864c53.info {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:03:22 devstack sudo[101680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-1369a9e1-a06f-49c1-9ae0-4c63dd864c53.info Nov 04 11:03:22 devstack sudo[101680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:03:23 devstack sudo[101680]: pam_unix(sudo:session): session closed for user root Nov 04 11:03:23 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-ac29108f-9694-48a9-9f56-e277d4683a87 tempest-VolumesSnapshotTestJSON-1399894899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-1369a9e1-a06f-49c1-9ae0-4c63dd864c53.info" returned: 0 in 0.275s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:03:23 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-ac29108f-9694-48a9-9f56-e277d4683a87 tempest-VolumesSnapshotTestJSON-1399894899 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.038s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 11:03:23 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-7e66e291-c780-42b3-afd7-42c129646d6b tempest-VolumesExtendTest-1917483396 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.673s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 11:03:23 devstack cinder-volume[87272]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e9f4d65-9400-489c-9532-733be0d3ba0c]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 11:03:23 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-7e66e291-c780-42b3-afd7-42c129646d6b tempest-VolumesExtendTest-1917483396 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-8d23d54e-1736-4966-ba9c-65a4e60c7d7c {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:03:23 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-ac29108f-9694-48a9-9f56-e277d4683a87 tempest-VolumesSnapshotTestJSON-1399894899 None] Create snapshot completed successfully Nov 04 11:03:23 devstack sudo[101684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-8d23d54e-1736-4966-ba9c-65a4e60c7d7c Nov 04 11:03:23 devstack sudo[101684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:03:23 devstack sudo[101684]: pam_unix(sudo:session): session closed for user root Nov 04 11:03:23 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-7e66e291-c780-42b3-afd7-42c129646d6b tempest-VolumesExtendTest-1917483396 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-8d23d54e-1736-4966-ba9c-65a4e60c7d7c" returned: 0 in 0.387s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:03:23 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-7e66e291-c780-42b3-afd7-42c129646d6b tempest-VolumesExtendTest-1917483396 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-8d23d54e-1736-4966-ba9c-65a4e60c7d7c.30fdadd9-cf18-470d-9cad-8b062aad57d8 2G {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:03:23 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-7e66e291-c780-42b3-afd7-42c129646d6b tempest-VolumesExtendTest-1917483396 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-8d23d54e-1736-4966-ba9c-65a4e60c7d7c.30fdadd9-cf18-470d-9cad-8b062aad57d8 2G" returned: 0 in 0.138s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:03:23 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-7e66e291-c780-42b3-afd7-42c129646d6b tempest-VolumesExtendTest-1917483396 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.569s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 11:03:23 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-7e66e291-c780-42b3-afd7-42c129646d6b tempest-VolumesExtendTest-1917483396 None] Extend volume completed successfully. Nov 04 11:03:24 devstack cinder-volume[87272]: DEBUG cinder.volume.flows.manager.create_volume [None req-d28ebf56-e71f-48d9-b6ba-f01b677703a0 tempest-VolumesSnapshotTestJSON-1399894899 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87272) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 11:03:24 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-d28ebf56-e71f-48d9-b6ba-f01b677703a0 tempest-VolumesSnapshotTestJSON-1399894899 None] Flow 'volume_create_manager' (93ba4c31-a3b9-49b6-8847-94bcfaad0c38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 11:03:24 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-d28ebf56-e71f-48d9-b6ba-f01b677703a0 tempest-VolumesSnapshotTestJSON-1399894899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c54bfe9-471f-48c9-a089-e714692cf030) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:03:24 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-d28ebf56-e71f-48d9-b6ba-f01b677703a0 tempest-VolumesSnapshotTestJSON-1399894899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c54bfe9-471f-48c9-a089-e714692cf030) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T10:03:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-731089781',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c9bbf086-1c57-472b-b903-f7d4ba8ecf3e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef099de5b8794b308a0c8f182ca0fca1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T10:03:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=947a69b5-3620-401b-94b9-509a00a0f288,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T10:03:24Z,use_quota=True,user_id='73239b009fea418ba15cb75342ef934d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8989e4f-21e3-4f0a-9584-0d818784e883),volume_type_id=f8989e4f-21e3-4f0a-9584-0d818784e883)' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:03:24 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-d28ebf56-e71f-48d9-b6ba-f01b677703a0 tempest-VolumesSnapshotTestJSON-1399894899 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e821a7c5-9047-46a6-9023-e9ea6278e750) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:03:24 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-d28ebf56-e71f-48d9-b6ba-f01b677703a0 tempest-VolumesSnapshotTestJSON-1399894899 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e821a7c5-9047-46a6-9023-e9ea6278e750) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:03:24 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-d28ebf56-e71f-48d9-b6ba-f01b677703a0 tempest-VolumesSnapshotTestJSON-1399894899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (89f9b361-00ea-4071-a3e1-c419ede62f68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:03:24 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-d28ebf56-e71f-48d9-b6ba-f01b677703a0 tempest-VolumesSnapshotTestJSON-1399894899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (89f9b361-00ea-4071-a3e1-c419ede62f68) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'c9bbf086-1c57-472b-b903-f7d4ba8ecf3e', 'volume_name': 'volume-c9bbf086-1c57-472b-b903-f7d4ba8ecf3e', 'volume_size': 1, 'snapshot_id': '947a69b5-3620-401b-94b9-509a00a0f288'}' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:03:24 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-d28ebf56-e71f-48d9-b6ba-f01b677703a0 tempest-VolumesSnapshotTestJSON-1399894899 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a5315c3f-3ec4-43db-aa86-e8172bb26874) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:03:24 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-d28ebf56-e71f-48d9-b6ba-f01b677703a0 tempest-VolumesSnapshotTestJSON-1399894899 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a5315c3f-3ec4-43db-aa86-e8172bb26874) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:03:24 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-d28ebf56-e71f-48d9-b6ba-f01b677703a0 tempest-VolumesSnapshotTestJSON-1399894899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d5d680a5-8b4d-4d9c-a41d-07d450b3ee6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:03:24 devstack cinder-volume[87272]: INFO cinder.volume.flows.manager.create_volume [None req-d28ebf56-e71f-48d9-b6ba-f01b677703a0 tempest-VolumesSnapshotTestJSON-1399894899 None] Volume c9bbf086-1c57-472b-b903-f7d4ba8ecf3e: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-c9bbf086-1c57-472b-b903-f7d4ba8ecf3e', 'volume_size': 1, 'snapshot_id': '947a69b5-3620-401b-94b9-509a00a0f288'} Nov 04 11:03:24 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-e8cd8723-c0bf-4b68-8fe3-79d928f691d1 tempest-VolumesExtendTest-1917483396 None] Acquiring lock "cinder-30fdadd9-cf18-470d-9cad-8b062aad57d8-delete_snapshot" by "delete_snapshot" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 11:03:24 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-d28ebf56-e71f-48d9-b6ba-f01b677703a0 tempest-VolumesSnapshotTestJSON-1399894899 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 11:03:24 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-d28ebf56-e71f-48d9-b6ba-f01b677703a0 tempest-VolumesSnapshotTestJSON-1399894899 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.000s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 11:03:24 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-d28ebf56-e71f-48d9-b6ba-f01b677703a0 tempest-VolumesSnapshotTestJSON-1399894899 None] Acquiring lock "cinder-quobyte-947a69b5-3620-401b-94b9-509a00a0f288-c9bbf086-1c57-472b-b903-f7d4ba8ecf3e" by "_create_volume_from_snapshot" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 11:03:24 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-d28ebf56-e71f-48d9-b6ba-f01b677703a0 tempest-VolumesSnapshotTestJSON-1399894899 None] Lock "cinder-quobyte-947a69b5-3620-401b-94b9-509a00a0f288-c9bbf086-1c57-472b-b903-f7d4ba8ecf3e" acquired by "_create_volume_from_snapshot" :: waited 0.023s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 11:03:24 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-d28ebf56-e71f-48d9-b6ba-f01b677703a0 tempest-VolumesSnapshotTestJSON-1399894899 None] Creating volume c9bbf086-1c57-472b-b903-f7d4ba8ecf3e from snapshot 947a69b5-3620-401b-94b9-509a00a0f288 {{(pid=87272) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 04 11:03:24 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-d28ebf56-e71f-48d9-b6ba-f01b677703a0 tempest-VolumesSnapshotTestJSON-1399894899 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 11:03:24 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-d28ebf56-e71f-48d9-b6ba-f01b677703a0 tempest-VolumesSnapshotTestJSON-1399894899 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 11:03:24 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-d28ebf56-e71f-48d9-b6ba-f01b677703a0 tempest-VolumesSnapshotTestJSON-1399894899 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898': None} {{(pid=87272) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 11:03:24 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-d28ebf56-e71f-48d9-b6ba-f01b677703a0 tempest-VolumesSnapshotTestJSON-1399894899 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'] {{(pid=87272) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 11:03:24 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-d28ebf56-e71f-48d9-b6ba-f01b677703a0 tempest-VolumesSnapshotTestJSON-1399894899 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 11:03:24 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-d28ebf56-e71f-48d9-b6ba-f01b677703a0 tempest-VolumesSnapshotTestJSON-1399894899 None] Selected osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898 as target Quobyte volume. {{(pid=87272) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 11:03:24 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-d28ebf56-e71f-48d9-b6ba-f01b677703a0 tempest-VolumesSnapshotTestJSON-1399894899 None] Acquiring lock "cinder-quobyte-c9bbf086-1c57-472b-b903-f7d4ba8ecf3e" by "_copy_volume_from_snapshot" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 11:03:24 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-e8cd8723-c0bf-4b68-8fe3-79d928f691d1 tempest-VolumesExtendTest-1917483396 None] Lock "cinder-30fdadd9-cf18-470d-9cad-8b062aad57d8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.039s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 11:03:24 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-e8cd8723-c0bf-4b68-8fe3-79d928f691d1 tempest-VolumesExtendTest-1917483396 None] Acquiring lock "cinder-quobyte-8d23d54e-1736-4966-ba9c-65a4e60c7d7c" by "delete_snapshot" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 11:03:24 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-e8cd8723-c0bf-4b68-8fe3-79d928f691d1 tempest-VolumesExtendTest-1917483396 None] Lock "cinder-quobyte-8d23d54e-1736-4966-ba9c-65a4e60c7d7c" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 11:03:24 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-e8cd8723-c0bf-4b68-8fe3-79d928f691d1 tempest-VolumesExtendTest-1917483396 None] Acquiring lock "cinder-quobyte-30fdadd9-cf18-470d-9cad-8b062aad57d8" by "_delete_snapshot" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 11:03:24 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-d28ebf56-e71f-48d9-b6ba-f01b677703a0 tempest-VolumesSnapshotTestJSON-1399894899 None] Lock "cinder-quobyte-c9bbf086-1c57-472b-b903-f7d4ba8ecf3e" acquired by "_copy_volume_from_snapshot" :: waited 0.028s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 11:03:24 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-d28ebf56-e71f-48d9-b6ba-f01b677703a0 tempest-VolumesSnapshotTestJSON-1399894899 None] snapshot: 947a69b5-3620-401b-94b9-509a00a0f288, volume: c9bbf086-1c57-472b-b903-f7d4ba8ecf3e, {{(pid=87272) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 04 11:03:24 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-d28ebf56-e71f-48d9-b6ba-f01b677703a0 tempest-VolumesSnapshotTestJSON-1399894899 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 11:03:24 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-d28ebf56-e71f-48d9-b6ba-f01b677703a0 tempest-VolumesSnapshotTestJSON-1399894899 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 11:03:24 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-d28ebf56-e71f-48d9-b6ba-f01b677703a0 tempest-VolumesSnapshotTestJSON-1399894899 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898': None} {{(pid=87272) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 11:03:24 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-d28ebf56-e71f-48d9-b6ba-f01b677703a0 tempest-VolumesSnapshotTestJSON-1399894899 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'] {{(pid=87272) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 11:03:24 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-d28ebf56-e71f-48d9-b6ba-f01b677703a0 tempest-VolumesSnapshotTestJSON-1399894899 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 11:03:24 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-e8cd8723-c0bf-4b68-8fe3-79d928f691d1 tempest-VolumesExtendTest-1917483396 None] Lock "cinder-quobyte-30fdadd9-cf18-470d-9cad-8b062aad57d8" acquired by "_delete_snapshot" :: waited 0.050s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 11:03:24 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.remotefs [None req-e8cd8723-c0bf-4b68-8fe3-79d928f691d1 tempest-VolumesExtendTest-1917483396 None] Deleting offline snapshot 30fdadd9-cf18-470d-9cad-8b062aad57d8 of volume 8d23d54e-1736-4966-ba9c-65a4e60c7d7c {{(pid=87272) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 04 11:03:24 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.remotefs [None req-e8cd8723-c0bf-4b68-8fe3-79d928f691d1 tempest-VolumesExtendTest-1917483396 None] snapshot_file for this snap is: volume-8d23d54e-1736-4966-ba9c-65a4e60c7d7c.30fdadd9-cf18-470d-9cad-8b062aad57d8 {{(pid=87272) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 04 11:03:24 devstack cinder-volume[87272]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9fdd3af-0400-4b04-a6b4-16e54945dd95]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 11:03:24 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-d28ebf56-e71f-48d9-b6ba-f01b677703a0 tempest-VolumesSnapshotTestJSON-1399894899 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-1369a9e1-a06f-49c1-9ae0-4c63dd864c53.947a69b5-3620-401b-94b9-509a00a0f288 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:03:24 devstack cinder-volume[87272]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0410333-2db9-46db-87b7-27b2d2436ab8]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 11:03:24 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-e8cd8723-c0bf-4b68-8fe3-79d928f691d1 tempest-VolumesExtendTest-1917483396 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-8d23d54e-1736-4966-ba9c-65a4e60c7d7c.30fdadd9-cf18-470d-9cad-8b062aad57d8 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:03:24 devstack sudo[101692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-1369a9e1-a06f-49c1-9ae0-4c63dd864c53.947a69b5-3620-401b-94b9-509a00a0f288 Nov 04 11:03:24 devstack sudo[101692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:03:24 devstack sudo[101693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-8d23d54e-1736-4966-ba9c-65a4e60c7d7c.30fdadd9-cf18-470d-9cad-8b062aad57d8 Nov 04 11:03:24 devstack sudo[101693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:03:25 devstack sudo[101692]: pam_unix(sudo:session): session closed for user root Nov 04 11:03:25 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-d28ebf56-e71f-48d9-b6ba-f01b677703a0 tempest-VolumesSnapshotTestJSON-1399894899 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-1369a9e1-a06f-49c1-9ae0-4c63dd864c53.947a69b5-3620-401b-94b9-509a00a0f288" returned: 0 in 0.412s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:03:25 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.remotefs [None req-d28ebf56-e71f-48d9-b6ba-f01b677703a0 tempest-VolumesSnapshotTestJSON-1399894899 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1369a9e1-a06f-49c1-9ae0-4c63dd864c53(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87272) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 11:03:25 devstack sudo[101693]: pam_unix(sudo:session): session closed for user root Nov 04 11:03:25 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-e8cd8723-c0bf-4b68-8fe3-79d928f691d1 tempest-VolumesExtendTest-1917483396 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-8d23d54e-1736-4966-ba9c-65a4e60c7d7c.30fdadd9-cf18-470d-9cad-8b062aad57d8" returned: 0 in 0.410s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:03:25 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.remotefs [None req-e8cd8723-c0bf-4b68-8fe3-79d928f691d1 tempest-VolumesExtendTest-1917483396 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8d23d54e-1736-4966-ba9c-65a4e60c7d7c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87272) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 11:03:25 devstack cinder-volume[87272]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d4b717f-668c-43a8-85ae-33d904645eb9]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 11:03:25 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-d28ebf56-e71f-48d9-b6ba-f01b677703a0 tempest-VolumesSnapshotTestJSON-1399894899 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-1369a9e1-a06f-49c1-9ae0-4c63dd864c53 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:03:25 devstack cinder-volume[87272]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b368246-36e9-4e0a-9676-af13f824d3cd]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 11:03:25 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-e8cd8723-c0bf-4b68-8fe3-79d928f691d1 tempest-VolumesExtendTest-1917483396 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-8d23d54e-1736-4966-ba9c-65a4e60c7d7c {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:03:25 devstack sudo[101703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-1369a9e1-a06f-49c1-9ae0-4c63dd864c53 Nov 04 11:03:25 devstack sudo[101703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:03:25 devstack sudo[101704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-8d23d54e-1736-4966-ba9c-65a4e60c7d7c Nov 04 11:03:25 devstack sudo[101704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:03:25 devstack sudo[101704]: pam_unix(sudo:session): session closed for user root Nov 04 11:03:25 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-e8cd8723-c0bf-4b68-8fe3-79d928f691d1 tempest-VolumesExtendTest-1917483396 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-8d23d54e-1736-4966-ba9c-65a4e60c7d7c" returned: 0 in 0.415s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:03:25 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-e8cd8723-c0bf-4b68-8fe3-79d928f691d1 tempest-VolumesExtendTest-1917483396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-8d23d54e-1736-4966-ba9c-65a4e60c7d7c.30fdadd9-cf18-470d-9cad-8b062aad57d8 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:03:25 devstack sudo[101703]: pam_unix(sudo:session): session closed for user root Nov 04 11:03:25 devstack sudo[101715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-8d23d54e-1736-4966-ba9c-65a4e60c7d7c.30fdadd9-cf18-470d-9cad-8b062aad57d8 Nov 04 11:03:25 devstack sudo[101715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:03:25 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-d28ebf56-e71f-48d9-b6ba-f01b677703a0 tempest-VolumesSnapshotTestJSON-1399894899 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-1369a9e1-a06f-49c1-9ae0-4c63dd864c53" returned: 0 in 0.467s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:03:25 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-d28ebf56-e71f-48d9-b6ba-f01b677703a0 tempest-VolumesSnapshotTestJSON-1399894899 None] will copy from snapshot at /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-1369a9e1-a06f-49c1-9ae0-4c63dd864c53 {{(pid=87272) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 04 11:03:25 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-d28ebf56-e71f-48d9-b6ba-f01b677703a0 tempest-VolumesSnapshotTestJSON-1399894899 None] Creating direct copy from snapshot {{(pid=87272) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 04 11:03:25 devstack cinder-volume[87272]: DEBUG cinder.utils [None req-d28ebf56-e71f-48d9-b6ba-f01b677703a0 tempest-VolumesSnapshotTestJSON-1399894899 None] Path /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-c9bbf086-1c57-472b-b903-f7d4ba8ecf3e not found in is_blk_device check {{(pid=87272) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Nov 04 11:03:25 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-d28ebf56-e71f-48d9-b6ba-f01b677703a0 tempest-VolumesSnapshotTestJSON-1399894899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-1369a9e1-a06f-49c1-9ae0-4c63dd864c53 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-c9bbf086-1c57-472b-b903-f7d4ba8ecf3e {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:03:25 devstack sudo[101717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-1369a9e1-a06f-49c1-9ae0-4c63dd864c53 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-c9bbf086-1c57-472b-b903-f7d4ba8ecf3e Nov 04 11:03:25 devstack sudo[101717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:03:26 devstack sudo[101715]: pam_unix(sudo:session): session closed for user root Nov 04 11:03:26 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-e8cd8723-c0bf-4b68-8fe3-79d928f691d1 tempest-VolumesExtendTest-1917483396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-8d23d54e-1736-4966-ba9c-65a4e60c7d7c.30fdadd9-cf18-470d-9cad-8b062aad57d8" returned: 0 in 0.422s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:03:26 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-e8cd8723-c0bf-4b68-8fe3-79d928f691d1 tempest-VolumesExtendTest-1917483396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-8d23d54e-1736-4966-ba9c-65a4e60c7d7c.30fdadd9-cf18-470d-9cad-8b062aad57d8 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:03:26 devstack sudo[101725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-8d23d54e-1736-4966-ba9c-65a4e60c7d7c.30fdadd9-cf18-470d-9cad-8b062aad57d8 Nov 04 11:03:26 devstack sudo[101725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:03:26 devstack sudo[101725]: pam_unix(sudo:session): session closed for user root Nov 04 11:03:26 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-e8cd8723-c0bf-4b68-8fe3-79d928f691d1 tempest-VolumesExtendTest-1917483396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-8d23d54e-1736-4966-ba9c-65a4e60c7d7c.30fdadd9-cf18-470d-9cad-8b062aad57d8" returned: 0 in 0.377s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:03:26 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-e8cd8723-c0bf-4b68-8fe3-79d928f691d1 tempest-VolumesExtendTest-1917483396 None] Lock "cinder-quobyte-30fdadd9-cf18-470d-9cad-8b062aad57d8" released by "_delete_snapshot" :: held 1.813s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 11:03:26 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-e8cd8723-c0bf-4b68-8fe3-79d928f691d1 tempest-VolumesExtendTest-1917483396 None] Lock "cinder-quobyte-8d23d54e-1736-4966-ba9c-65a4e60c7d7c" released by "delete_snapshot" :: held 1.882s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 11:03:26 devstack cinder-volume[87272]: DEBUG cinder.quota [None req-e8cd8723-c0bf-4b68-8fe3-79d928f691d1 tempest-VolumesExtendTest-1917483396 None] Created reservations ['c24b5724-c59c-4428-8d44-e0708d064f3d', '22bab6d3-f60c-4c31-88dd-4aa22a7efabf', '4bb4066a-8a33-40d2-9a48-29af90a011b1', '116227c4-60a2-4b63-b867-57d1b5de9d03'] {{(pid=87272) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 11:03:26 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-e8cd8723-c0bf-4b68-8fe3-79d928f691d1 tempest-VolumesExtendTest-1917483396 None] Delete snapshot completed successfully. Nov 04 11:03:26 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-e8cd8723-c0bf-4b68-8fe3-79d928f691d1 tempest-VolumesExtendTest-1917483396 None] Lock "cinder-30fdadd9-cf18-470d-9cad-8b062aad57d8-delete_snapshot" released by "delete_snapshot" :: held 2.207s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 11:03:28 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-e1ffe072-6a9e-4c44-8489-150292ce1bf6 tempest-VolumesExtendTest-1917483396 None] Acquiring lock "cinder-8d23d54e-1736-4966-ba9c-65a4e60c7d7c-delete_volume" by "delete_volume" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 11:03:28 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-e1ffe072-6a9e-4c44-8489-150292ce1bf6 tempest-VolumesExtendTest-1917483396 None] Lock "cinder-8d23d54e-1736-4966-ba9c-65a4e60c7d7c-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 11:03:28 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-e1ffe072-6a9e-4c44-8489-150292ce1bf6 tempest-VolumesExtendTest-1917483396 None] Acquiring lock "cinder-quobyte-8d23d54e-1736-4966-ba9c-65a4e60c7d7c" by "delete_volume" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 11:03:28 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-e1ffe072-6a9e-4c44-8489-150292ce1bf6 tempest-VolumesExtendTest-1917483396 None] Lock "cinder-quobyte-8d23d54e-1736-4966-ba9c-65a4e60c7d7c" acquired by "delete_volume" :: waited 0.015s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 11:03:28 devstack cinder-volume[87272]: DEBUG oslo.privsep.daemon [-] privsep: reply[90301bb2-c34f-4a4c-88c3-55da5c7c2878]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 11:03:28 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-e1ffe072-6a9e-4c44-8489-150292ce1bf6 tempest-VolumesExtendTest-1917483396 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-8d23d54e-1736-4966-ba9c-65a4e60c7d7c {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:03:28 devstack sudo[101736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-8d23d54e-1736-4966-ba9c-65a4e60c7d7c Nov 04 11:03:28 devstack sudo[101736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:03:28 devstack sudo[101736]: pam_unix(sudo:session): session closed for user root Nov 04 11:03:28 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-e1ffe072-6a9e-4c44-8489-150292ce1bf6 tempest-VolumesExtendTest-1917483396 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-8d23d54e-1736-4966-ba9c-65a4e60c7d7c" returned: 0 in 0.648s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:03:28 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-e1ffe072-6a9e-4c44-8489-150292ce1bf6 tempest-VolumesExtendTest-1917483396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-8d23d54e-1736-4966-ba9c-65a4e60c7d7c {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:03:29 devstack sudo[101776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-8d23d54e-1736-4966-ba9c-65a4e60c7d7c Nov 04 11:03:29 devstack sudo[101776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:03:29 devstack sudo[101776]: pam_unix(sudo:session): session closed for user root Nov 04 11:03:29 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-e1ffe072-6a9e-4c44-8489-150292ce1bf6 tempest-VolumesExtendTest-1917483396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-8d23d54e-1736-4966-ba9c-65a4e60c7d7c" returned: 0 in 0.412s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:03:29 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-e1ffe072-6a9e-4c44-8489-150292ce1bf6 tempest-VolumesExtendTest-1917483396 None] Lock "cinder-quobyte-8d23d54e-1736-4966-ba9c-65a4e60c7d7c" released by "delete_volume" :: held 1.237s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 11:03:29 devstack cinder-volume[87272]: DEBUG cinder.quota [None req-e1ffe072-6a9e-4c44-8489-150292ce1bf6 tempest-VolumesExtendTest-1917483396 None] Created reservations ['0eb92360-1aa7-4da5-b7fb-6df6e31e7b8e', '51a4b171-3637-4636-9abc-26a7e6c74343', '6522b118-5cb6-4c37-ba78-b3b85b28d099', 'fca4c6f1-773c-468f-ace3-8e9070c1eb9f'] {{(pid=87272) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 11:03:29 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-e1ffe072-6a9e-4c44-8489-150292ce1bf6 tempest-VolumesExtendTest-1917483396 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 11:03:29 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-e1ffe072-6a9e-4c44-8489-150292ce1bf6 tempest-VolumesExtendTest-1917483396 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 11:03:29 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-e1ffe072-6a9e-4c44-8489-150292ce1bf6 tempest-VolumesExtendTest-1917483396 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898': None} {{(pid=87272) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 11:03:29 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-e1ffe072-6a9e-4c44-8489-150292ce1bf6 tempest-VolumesExtendTest-1917483396 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'] {{(pid=87272) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 11:03:29 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-e1ffe072-6a9e-4c44-8489-150292ce1bf6 tempest-VolumesExtendTest-1917483396 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 11:03:29 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-e1ffe072-6a9e-4c44-8489-150292ce1bf6 tempest-VolumesExtendTest-1917483396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:03:29 devstack sudo[101781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1 Nov 04 11:03:29 devstack sudo[101781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:03:30 devstack sudo[101781]: pam_unix(sudo:session): session closed for user root Nov 04 11:03:30 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-e1ffe072-6a9e-4c44-8489-150292ce1bf6 tempest-VolumesExtendTest-1917483396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1" returned: 0 in 0.559s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:03:30 devstack cinder-volume[87272]: DEBUG cinder.manager [None req-e1ffe072-6a9e-4c44-8489-150292ce1bf6 tempest-VolumesExtendTest-1917483396 None] Notifying Schedulers of capabilities ... {{(pid=87272) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 11:03:30 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-e1ffe072-6a9e-4c44-8489-150292ce1bf6 tempest-VolumesExtendTest-1917483396 None] Deleted volume successfully. Nov 04 11:03:30 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-e1ffe072-6a9e-4c44-8489-150292ce1bf6 tempest-VolumesExtendTest-1917483396 None] Lock "cinder-8d23d54e-1736-4966-ba9c-65a4e60c7d7c-delete_volume" released by "delete_volume" :: held 2.136s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 11:03:33 devstack sudo[101717]: pam_unix(sudo:session): session closed for user root Nov 04 11:03:33 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-d28ebf56-e71f-48d9-b6ba-f01b677703a0 tempest-VolumesSnapshotTestJSON-1399894899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-1369a9e1-a06f-49c1-9ae0-4c63dd864c53 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-c9bbf086-1c57-472b-b903-f7d4ba8ecf3e" returned: 0 in 7.640s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:03:33 devstack cinder-volume[87272]: DEBUG cinder.image.image_utils [None req-d28ebf56-e71f-48d9-b6ba-f01b677703a0 tempest-VolumesSnapshotTestJSON-1399894899 None] Image conversion details: src /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-1369a9e1-a06f-49c1-9ae0-4c63dd864c53, size 1024.00 MB, duration 7.64 sec, destination /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-c9bbf086-1c57-472b-b903-f7d4ba8ecf3e {{(pid=87272) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Nov 04 11:03:33 devstack cinder-volume[87272]: INFO cinder.image.image_utils [None req-d28ebf56-e71f-48d9-b6ba-f01b677703a0 tempest-VolumesSnapshotTestJSON-1399894899 None] Converted 1024.00 MB image at 134.02 MB/s Nov 04 11:03:33 devstack cinder-volume[87272]: WARNING cinder.volume.drivers.remotefs [None req-d28ebf56-e71f-48d9-b6ba-f01b677703a0 tempest-VolumesSnapshotTestJSON-1399894899 None] /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-c9bbf086-1c57-472b-b903-f7d4ba8ecf3e is being set with open permissions: ugo+rw Nov 04 11:03:33 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-d28ebf56-e71f-48d9-b6ba-f01b677703a0 tempest-VolumesSnapshotTestJSON-1399894899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-c9bbf086-1c57-472b-b903-f7d4ba8ecf3e {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:03:33 devstack sudo[101785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-c9bbf086-1c57-472b-b903-f7d4ba8ecf3e Nov 04 11:03:33 devstack sudo[101785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:03:33 devstack sudo[101785]: pam_unix(sudo:session): session closed for user root Nov 04 11:03:33 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-d28ebf56-e71f-48d9-b6ba-f01b677703a0 tempest-VolumesSnapshotTestJSON-1399894899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-c9bbf086-1c57-472b-b903-f7d4ba8ecf3e" returned: 0 in 0.287s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:03:33 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-d28ebf56-e71f-48d9-b6ba-f01b677703a0 tempest-VolumesSnapshotTestJSON-1399894899 None] Lock "cinder-quobyte-c9bbf086-1c57-472b-b903-f7d4ba8ecf3e" released by "_copy_volume_from_snapshot" :: held 8.944s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 11:03:33 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-d28ebf56-e71f-48d9-b6ba-f01b677703a0 tempest-VolumesSnapshotTestJSON-1399894899 None] Lock "cinder-quobyte-947a69b5-3620-401b-94b9-509a00a0f288-c9bbf086-1c57-472b-b903-f7d4ba8ecf3e" released by "_create_volume_from_snapshot" :: held 9.027s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 11:03:33 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-d28ebf56-e71f-48d9-b6ba-f01b677703a0 tempest-VolumesSnapshotTestJSON-1399894899 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.052s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 11:03:33 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-d28ebf56-e71f-48d9-b6ba-f01b677703a0 tempest-VolumesSnapshotTestJSON-1399894899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d5d680a5-8b4d-4d9c-a41d-07d450b3ee6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c9bbf086-1c57-472b-b903-f7d4ba8ecf3e', 'volume_size': 1, 'snapshot_id': '947a69b5-3620-401b-94b9-509a00a0f288'}' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:03:33 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-d28ebf56-e71f-48d9-b6ba-f01b677703a0 tempest-VolumesSnapshotTestJSON-1399894899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (749bc9ab-8891-4523-8602-209ffed722fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:03:33 devstack cinder-volume[87272]: INFO cinder.volume.flows.manager.create_volume [None req-d28ebf56-e71f-48d9-b6ba-f01b677703a0 tempest-VolumesSnapshotTestJSON-1399894899 None] Volume volume-c9bbf086-1c57-472b-b903-f7d4ba8ecf3e (c9bbf086-1c57-472b-b903-f7d4ba8ecf3e): created successfully Nov 04 11:03:33 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-d28ebf56-e71f-48d9-b6ba-f01b677703a0 tempest-VolumesSnapshotTestJSON-1399894899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (749bc9ab-8891-4523-8602-209ffed722fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:03:33 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-d28ebf56-e71f-48d9-b6ba-f01b677703a0 tempest-VolumesSnapshotTestJSON-1399894899 None] Flow 'volume_create_manager' (93ba4c31-a3b9-49b6-8847-94bcfaad0c38) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87272) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 11:03:33 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-d28ebf56-e71f-48d9-b6ba-f01b677703a0 tempest-VolumesSnapshotTestJSON-1399894899 None] Created volume successfully. Nov 04 11:03:34 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-2da25f06-5d51-4a1b-a63b-b67bb85ee1f6 tempest-VolumesSnapshotTestJSON-1399894899 None] Acquiring lock "cinder-c9bbf086-1c57-472b-b903-f7d4ba8ecf3e-delete_volume" by "delete_volume" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 11:03:34 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-2da25f06-5d51-4a1b-a63b-b67bb85ee1f6 tempest-VolumesSnapshotTestJSON-1399894899 None] Lock "cinder-c9bbf086-1c57-472b-b903-f7d4ba8ecf3e-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 11:03:34 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-2da25f06-5d51-4a1b-a63b-b67bb85ee1f6 tempest-VolumesSnapshotTestJSON-1399894899 None] Acquiring lock "cinder-quobyte-c9bbf086-1c57-472b-b903-f7d4ba8ecf3e" by "delete_volume" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 11:03:34 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-2da25f06-5d51-4a1b-a63b-b67bb85ee1f6 tempest-VolumesSnapshotTestJSON-1399894899 None] Lock "cinder-quobyte-c9bbf086-1c57-472b-b903-f7d4ba8ecf3e" acquired by "delete_volume" :: waited 0.029s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 11:03:34 devstack cinder-volume[87272]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7a0371f-6e7d-424a-bfec-207bfd396829]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 11:03:34 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-2da25f06-5d51-4a1b-a63b-b67bb85ee1f6 tempest-VolumesSnapshotTestJSON-1399894899 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-c9bbf086-1c57-472b-b903-f7d4ba8ecf3e {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:03:34 devstack sudo[101788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-c9bbf086-1c57-472b-b903-f7d4ba8ecf3e Nov 04 11:03:34 devstack sudo[101788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:03:35 devstack sudo[101788]: pam_unix(sudo:session): session closed for user root Nov 04 11:03:35 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-2da25f06-5d51-4a1b-a63b-b67bb85ee1f6 tempest-VolumesSnapshotTestJSON-1399894899 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-c9bbf086-1c57-472b-b903-f7d4ba8ecf3e" returned: 0 in 0.442s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:03:35 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-2da25f06-5d51-4a1b-a63b-b67bb85ee1f6 tempest-VolumesSnapshotTestJSON-1399894899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-c9bbf086-1c57-472b-b903-f7d4ba8ecf3e {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:03:35 devstack sudo[101793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-c9bbf086-1c57-472b-b903-f7d4ba8ecf3e Nov 04 11:03:35 devstack sudo[101793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:03:35 devstack sudo[101793]: pam_unix(sudo:session): session closed for user root Nov 04 11:03:35 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-2da25f06-5d51-4a1b-a63b-b67bb85ee1f6 tempest-VolumesSnapshotTestJSON-1399894899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-c9bbf086-1c57-472b-b903-f7d4ba8ecf3e" returned: 0 in 0.265s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:03:35 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-2da25f06-5d51-4a1b-a63b-b67bb85ee1f6 tempest-VolumesSnapshotTestJSON-1399894899 None] Lock "cinder-quobyte-c9bbf086-1c57-472b-b903-f7d4ba8ecf3e" released by "delete_volume" :: held 0.769s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 11:03:35 devstack cinder-volume[87272]: DEBUG cinder.quota [None req-2da25f06-5d51-4a1b-a63b-b67bb85ee1f6 tempest-VolumesSnapshotTestJSON-1399894899 None] Created reservations ['8f8f5d06-caf1-472f-b202-5be744385209', '7e1d223a-2d5e-4ce2-8382-5593fe7dd49f', '516d8a80-5b44-4522-b90f-cdbea73f3452', '7050ffa3-6365-4213-bf7c-3dda0f445c9c'] {{(pid=87272) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 11:03:35 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-2da25f06-5d51-4a1b-a63b-b67bb85ee1f6 tempest-VolumesSnapshotTestJSON-1399894899 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 11:03:35 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-2da25f06-5d51-4a1b-a63b-b67bb85ee1f6 tempest-VolumesSnapshotTestJSON-1399894899 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 11:03:35 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-2da25f06-5d51-4a1b-a63b-b67bb85ee1f6 tempest-VolumesSnapshotTestJSON-1399894899 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898': None} {{(pid=87272) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 11:03:35 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-2da25f06-5d51-4a1b-a63b-b67bb85ee1f6 tempest-VolumesSnapshotTestJSON-1399894899 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'] {{(pid=87272) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 11:03:35 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-2da25f06-5d51-4a1b-a63b-b67bb85ee1f6 tempest-VolumesSnapshotTestJSON-1399894899 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 11:03:35 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-2da25f06-5d51-4a1b-a63b-b67bb85ee1f6 tempest-VolumesSnapshotTestJSON-1399894899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:03:35 devstack sudo[101796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1 Nov 04 11:03:35 devstack sudo[101796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:03:35 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-6deeb287-07e9-4862-a54b-75d5c0ade053 tempest-VolumesSnapshotTestJSON-1399894899 None] Acquiring lock "cinder-947a69b5-3620-401b-94b9-509a00a0f288-delete_snapshot" by "delete_snapshot" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 11:03:35 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-6deeb287-07e9-4862-a54b-75d5c0ade053 tempest-VolumesSnapshotTestJSON-1399894899 None] Lock "cinder-947a69b5-3620-401b-94b9-509a00a0f288-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 11:03:35 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-6deeb287-07e9-4862-a54b-75d5c0ade053 tempest-VolumesSnapshotTestJSON-1399894899 None] Acquiring lock "cinder-quobyte-1369a9e1-a06f-49c1-9ae0-4c63dd864c53" by "delete_snapshot" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 11:03:35 devstack sudo[101796]: pam_unix(sudo:session): session closed for user root Nov 04 11:03:35 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-2da25f06-5d51-4a1b-a63b-b67bb85ee1f6 tempest-VolumesSnapshotTestJSON-1399894899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1" returned: 0 in 0.309s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:03:35 devstack cinder-volume[87272]: DEBUG cinder.manager [None req-2da25f06-5d51-4a1b-a63b-b67bb85ee1f6 tempest-VolumesSnapshotTestJSON-1399894899 None] Notifying Schedulers of capabilities ... {{(pid=87272) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 11:03:35 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-6deeb287-07e9-4862-a54b-75d5c0ade053 tempest-VolumesSnapshotTestJSON-1399894899 None] Lock "cinder-quobyte-1369a9e1-a06f-49c1-9ae0-4c63dd864c53" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 11:03:35 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-6deeb287-07e9-4862-a54b-75d5c0ade053 tempest-VolumesSnapshotTestJSON-1399894899 None] Acquiring lock "cinder-quobyte-947a69b5-3620-401b-94b9-509a00a0f288" by "_delete_snapshot" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 11:03:35 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-2da25f06-5d51-4a1b-a63b-b67bb85ee1f6 tempest-VolumesSnapshotTestJSON-1399894899 None] Deleted volume successfully. Nov 04 11:03:35 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-6deeb287-07e9-4862-a54b-75d5c0ade053 tempest-VolumesSnapshotTestJSON-1399894899 None] Lock "cinder-quobyte-947a69b5-3620-401b-94b9-509a00a0f288" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 11:03:35 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.remotefs [None req-6deeb287-07e9-4862-a54b-75d5c0ade053 tempest-VolumesSnapshotTestJSON-1399894899 None] Deleting offline snapshot 947a69b5-3620-401b-94b9-509a00a0f288 of volume 1369a9e1-a06f-49c1-9ae0-4c63dd864c53 {{(pid=87272) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 04 11:03:35 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.remotefs [None req-6deeb287-07e9-4862-a54b-75d5c0ade053 tempest-VolumesSnapshotTestJSON-1399894899 None] snapshot_file for this snap is: volume-1369a9e1-a06f-49c1-9ae0-4c63dd864c53.947a69b5-3620-401b-94b9-509a00a0f288 {{(pid=87272) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 04 11:03:35 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-2da25f06-5d51-4a1b-a63b-b67bb85ee1f6 tempest-VolumesSnapshotTestJSON-1399894899 None] Lock "cinder-c9bbf086-1c57-472b-b903-f7d4ba8ecf3e-delete_volume" released by "delete_volume" :: held 1.365s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 11:03:35 devstack cinder-volume[87272]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b8bcbfc-dbbb-4e7d-8542-f320281a95c2]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 11:03:35 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-6deeb287-07e9-4862-a54b-75d5c0ade053 tempest-VolumesSnapshotTestJSON-1399894899 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-1369a9e1-a06f-49c1-9ae0-4c63dd864c53.947a69b5-3620-401b-94b9-509a00a0f288 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:03:36 devstack sudo[101799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-1369a9e1-a06f-49c1-9ae0-4c63dd864c53.947a69b5-3620-401b-94b9-509a00a0f288 Nov 04 11:03:36 devstack sudo[101799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:03:36 devstack cinder-volume[87272]: DEBUG cinder.volume.flows.manager.create_volume [None req-b99611e2-7da1-48fe-87ac-dff5602d7815 tempest-VolumesNegativeTest-1603017832 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87272) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 11:03:36 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-b99611e2-7da1-48fe-87ac-dff5602d7815 tempest-VolumesNegativeTest-1603017832 None] Flow 'volume_create_manager' (aac5cb59-3c37-459d-85a1-09c8939822f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 11:03:36 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-b99611e2-7da1-48fe-87ac-dff5602d7815 tempest-VolumesNegativeTest-1603017832 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (705a9103-bda9-4613-90d3-057502d5879f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:03:36 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-b99611e2-7da1-48fe-87ac-dff5602d7815 tempest-VolumesNegativeTest-1603017832 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (705a9103-bda9-4613-90d3-057502d5879f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T10:03:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-2051474276',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2eac0574-4aea-4ed4-bffa-a29bb35c6315,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9e67fc8f21ca47dcb48b25f9877fac4e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T10:03:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T10:03:36Z,use_quota=True,user_id='9f255787a91a4937ba00b3a2f8aa1e4a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8989e4f-21e3-4f0a-9584-0d818784e883),volume_type_id=f8989e4f-21e3-4f0a-9584-0d818784e883)' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:03:36 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-b99611e2-7da1-48fe-87ac-dff5602d7815 tempest-VolumesNegativeTest-1603017832 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d0168b27-8b7a-4e4b-a059-a1b9ee41f986) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:03:36 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-b99611e2-7da1-48fe-87ac-dff5602d7815 tempest-VolumesNegativeTest-1603017832 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d0168b27-8b7a-4e4b-a059-a1b9ee41f986) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:03:36 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-b99611e2-7da1-48fe-87ac-dff5602d7815 tempest-VolumesNegativeTest-1603017832 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bbf267ac-d700-420c-bf21-13bdc989bdee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:03:36 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-b99611e2-7da1-48fe-87ac-dff5602d7815 tempest-VolumesNegativeTest-1603017832 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bbf267ac-d700-420c-bf21-13bdc989bdee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2eac0574-4aea-4ed4-bffa-a29bb35c6315', 'volume_name': 'volume-2eac0574-4aea-4ed4-bffa-a29bb35c6315', 'volume_size': 1}' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:03:36 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-b99611e2-7da1-48fe-87ac-dff5602d7815 tempest-VolumesNegativeTest-1603017832 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (86de3112-544e-4a69-8c7a-2d8c9adc830e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:03:36 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-b99611e2-7da1-48fe-87ac-dff5602d7815 tempest-VolumesNegativeTest-1603017832 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (86de3112-544e-4a69-8c7a-2d8c9adc830e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:03:36 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-b99611e2-7da1-48fe-87ac-dff5602d7815 tempest-VolumesNegativeTest-1603017832 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98c32682-9f75-45b8-8fc7-aa14d170ebf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:03:36 devstack cinder-volume[87272]: INFO cinder.volume.flows.manager.create_volume [None req-b99611e2-7da1-48fe-87ac-dff5602d7815 tempest-VolumesNegativeTest-1603017832 None] Volume 2eac0574-4aea-4ed4-bffa-a29bb35c6315: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2eac0574-4aea-4ed4-bffa-a29bb35c6315', 'volume_size': 1} Nov 04 11:03:36 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-b99611e2-7da1-48fe-87ac-dff5602d7815 tempest-VolumesNegativeTest-1603017832 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 11:03:36 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-b99611e2-7da1-48fe-87ac-dff5602d7815 tempest-VolumesNegativeTest-1603017832 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 11:03:36 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-b99611e2-7da1-48fe-87ac-dff5602d7815 tempest-VolumesNegativeTest-1603017832 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T10:03:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-2051474276',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2eac0574-4aea-4ed4-bffa-a29bb35c6315,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9e67fc8f21ca47dcb48b25f9877fac4e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T10:03:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T10:03:36Z,use_quota=True,user_id='9f255787a91a4937ba00b3a2f8aa1e4a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8989e4f-21e3-4f0a-9584-0d818784e883),volume_type_id=f8989e4f-21e3-4f0a-9584-0d818784e883)}" {{(pid=87272) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 04 11:03:36 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.remotefs [None req-b99611e2-7da1-48fe-87ac-dff5602d7815 tempest-VolumesNegativeTest-1603017832 None] Creating volume 2eac0574-4aea-4ed4-bffa-a29bb35c6315 {{(pid=87272) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 11:03:36 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-b99611e2-7da1-48fe-87ac-dff5602d7815 tempest-VolumesNegativeTest-1603017832 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 11:03:36 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-b99611e2-7da1-48fe-87ac-dff5602d7815 tempest-VolumesNegativeTest-1603017832 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 11:03:36 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-b99611e2-7da1-48fe-87ac-dff5602d7815 tempest-VolumesNegativeTest-1603017832 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898': None} {{(pid=87272) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 11:03:36 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-b99611e2-7da1-48fe-87ac-dff5602d7815 tempest-VolumesNegativeTest-1603017832 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'] {{(pid=87272) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 11:03:36 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-b99611e2-7da1-48fe-87ac-dff5602d7815 tempest-VolumesNegativeTest-1603017832 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 11:03:36 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-b99611e2-7da1-48fe-87ac-dff5602d7815 tempest-VolumesNegativeTest-1603017832 None] Selected osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898 as target Quobyte volume. {{(pid=87272) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 11:03:36 devstack cinder-volume[87272]: INFO cinder.volume.drivers.remotefs [None req-b99611e2-7da1-48fe-87ac-dff5602d7815 tempest-VolumesNegativeTest-1603017832 None] casted to osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898 Nov 04 11:03:36 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-b99611e2-7da1-48fe-87ac-dff5602d7815 tempest-VolumesNegativeTest-1603017832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-2eac0574-4aea-4ed4-bffa-a29bb35c6315 1073741824 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:03:36 devstack sudo[101802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-2eac0574-4aea-4ed4-bffa-a29bb35c6315 1073741824 Nov 04 11:03:36 devstack sudo[101802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:03:36 devstack sudo[101799]: pam_unix(sudo:session): session closed for user root Nov 04 11:03:36 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-6deeb287-07e9-4862-a54b-75d5c0ade053 tempest-VolumesSnapshotTestJSON-1399894899 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-1369a9e1-a06f-49c1-9ae0-4c63dd864c53.947a69b5-3620-401b-94b9-509a00a0f288" returned: 0 in 0.373s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:03:36 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.remotefs [None req-6deeb287-07e9-4862-a54b-75d5c0ade053 tempest-VolumesSnapshotTestJSON-1399894899 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1369a9e1-a06f-49c1-9ae0-4c63dd864c53(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87272) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 11:03:36 devstack cinder-volume[87272]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e2fd25f-e499-4913-8d9c-cba06789d6be]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 11:03:36 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-6deeb287-07e9-4862-a54b-75d5c0ade053 tempest-VolumesSnapshotTestJSON-1399894899 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-1369a9e1-a06f-49c1-9ae0-4c63dd864c53 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:03:36 devstack sudo[101807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-1369a9e1-a06f-49c1-9ae0-4c63dd864c53 Nov 04 11:03:36 devstack sudo[101807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:03:36 devstack sudo[101802]: pam_unix(sudo:session): session closed for user root Nov 04 11:03:36 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-b99611e2-7da1-48fe-87ac-dff5602d7815 tempest-VolumesNegativeTest-1603017832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-2eac0574-4aea-4ed4-bffa-a29bb35c6315 1073741824" returned: 0 in 0.526s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:03:36 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-b99611e2-7da1-48fe-87ac-dff5602d7815 tempest-VolumesNegativeTest-1603017832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-2eac0574-4aea-4ed4-bffa-a29bb35c6315 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:03:36 devstack sudo[101816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-2eac0574-4aea-4ed4-bffa-a29bb35c6315 Nov 04 11:03:36 devstack sudo[101816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:03:37 devstack sudo[101807]: pam_unix(sudo:session): session closed for user root Nov 04 11:03:37 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-6deeb287-07e9-4862-a54b-75d5c0ade053 tempest-VolumesSnapshotTestJSON-1399894899 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-1369a9e1-a06f-49c1-9ae0-4c63dd864c53" returned: 0 in 0.669s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:03:37 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-6deeb287-07e9-4862-a54b-75d5c0ade053 tempest-VolumesSnapshotTestJSON-1399894899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-1369a9e1-a06f-49c1-9ae0-4c63dd864c53.947a69b5-3620-401b-94b9-509a00a0f288 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:03:37 devstack sudo[101819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-1369a9e1-a06f-49c1-9ae0-4c63dd864c53.947a69b5-3620-401b-94b9-509a00a0f288 Nov 04 11:03:37 devstack sudo[101819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:03:37 devstack sudo[101816]: pam_unix(sudo:session): session closed for user root Nov 04 11:03:37 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-b99611e2-7da1-48fe-87ac-dff5602d7815 tempest-VolumesNegativeTest-1603017832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-2eac0574-4aea-4ed4-bffa-a29bb35c6315" returned: 0 in 0.293s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:03:37 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-b99611e2-7da1-48fe-87ac-dff5602d7815 tempest-VolumesNegativeTest-1603017832 None] <== create_volume: return (910ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'} {{(pid=87272) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 04 11:03:37 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-b99611e2-7da1-48fe-87ac-dff5602d7815 tempest-VolumesNegativeTest-1603017832 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.913s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 11:03:37 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-b99611e2-7da1-48fe-87ac-dff5602d7815 tempest-VolumesNegativeTest-1603017832 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98c32682-9f75-45b8-8fc7-aa14d170ebf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2eac0574-4aea-4ed4-bffa-a29bb35c6315', 'volume_size': 1}' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:03:37 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-b99611e2-7da1-48fe-87ac-dff5602d7815 tempest-VolumesNegativeTest-1603017832 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (24b28b5f-18c4-47af-a029-850804fe4791) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:03:37 devstack cinder-volume[87272]: INFO cinder.volume.flows.manager.create_volume [None req-b99611e2-7da1-48fe-87ac-dff5602d7815 tempest-VolumesNegativeTest-1603017832 None] Volume volume-2eac0574-4aea-4ed4-bffa-a29bb35c6315 (2eac0574-4aea-4ed4-bffa-a29bb35c6315): created successfully Nov 04 11:03:37 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-b99611e2-7da1-48fe-87ac-dff5602d7815 tempest-VolumesNegativeTest-1603017832 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (24b28b5f-18c4-47af-a029-850804fe4791) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:03:37 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-b99611e2-7da1-48fe-87ac-dff5602d7815 tempest-VolumesNegativeTest-1603017832 None] Flow 'volume_create_manager' (aac5cb59-3c37-459d-85a1-09c8939822f3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87272) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 11:03:37 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-b99611e2-7da1-48fe-87ac-dff5602d7815 tempest-VolumesNegativeTest-1603017832 None] Created volume successfully. Nov 04 11:03:37 devstack sudo[101819]: pam_unix(sudo:session): session closed for user root Nov 04 11:03:37 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-6deeb287-07e9-4862-a54b-75d5c0ade053 tempest-VolumesSnapshotTestJSON-1399894899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-1369a9e1-a06f-49c1-9ae0-4c63dd864c53.947a69b5-3620-401b-94b9-509a00a0f288" returned: 0 in 0.352s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:03:37 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-6deeb287-07e9-4862-a54b-75d5c0ade053 tempest-VolumesSnapshotTestJSON-1399894899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-1369a9e1-a06f-49c1-9ae0-4c63dd864c53.947a69b5-3620-401b-94b9-509a00a0f288 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:03:37 devstack sudo[101825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-1369a9e1-a06f-49c1-9ae0-4c63dd864c53.947a69b5-3620-401b-94b9-509a00a0f288 Nov 04 11:03:37 devstack sudo[101825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:03:37 devstack sudo[101825]: pam_unix(sudo:session): session closed for user root Nov 04 11:03:37 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-6deeb287-07e9-4862-a54b-75d5c0ade053 tempest-VolumesSnapshotTestJSON-1399894899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-1369a9e1-a06f-49c1-9ae0-4c63dd864c53.947a69b5-3620-401b-94b9-509a00a0f288" returned: 0 in 0.370s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:03:37 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-6deeb287-07e9-4862-a54b-75d5c0ade053 tempest-VolumesSnapshotTestJSON-1399894899 None] Lock "cinder-quobyte-947a69b5-3620-401b-94b9-509a00a0f288" released by "_delete_snapshot" :: held 1.960s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 11:03:37 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-6deeb287-07e9-4862-a54b-75d5c0ade053 tempest-VolumesSnapshotTestJSON-1399894899 None] Lock "cinder-quobyte-1369a9e1-a06f-49c1-9ae0-4c63dd864c53" released by "delete_snapshot" :: held 1.992s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 11:03:37 devstack cinder-volume[87272]: DEBUG cinder.quota [None req-6deeb287-07e9-4862-a54b-75d5c0ade053 tempest-VolumesSnapshotTestJSON-1399894899 None] Created reservations ['5367fc9b-e152-48a9-968d-9ffc4f23ba97', 'f6f63063-97a6-4dd8-a8df-4827b6f76d75', 'd08fb8e0-beb5-4c50-8d3d-673d8b4ca056', 'ab869d88-1806-4666-a11e-af301e7d39ee'] {{(pid=87272) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 11:03:38 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-6deeb287-07e9-4862-a54b-75d5c0ade053 tempest-VolumesSnapshotTestJSON-1399894899 None] Delete snapshot completed successfully. Nov 04 11:03:38 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-6deeb287-07e9-4862-a54b-75d5c0ade053 tempest-VolumesSnapshotTestJSON-1399894899 None] Lock "cinder-947a69b5-3620-401b-94b9-509a00a0f288-delete_snapshot" released by "delete_snapshot" :: held 2.179s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 11:03:39 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-28971976-3337-416a-aeaa-770b702209e1 tempest-VolumesSnapshotTestJSON-1399894899 None] Acquiring lock "cinder-1369a9e1-a06f-49c1-9ae0-4c63dd864c53-delete_volume" by "delete_volume" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 11:03:39 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-28971976-3337-416a-aeaa-770b702209e1 tempest-VolumesSnapshotTestJSON-1399894899 None] Lock "cinder-1369a9e1-a06f-49c1-9ae0-4c63dd864c53-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 11:03:39 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-28971976-3337-416a-aeaa-770b702209e1 tempest-VolumesSnapshotTestJSON-1399894899 None] Acquiring lock "cinder-quobyte-1369a9e1-a06f-49c1-9ae0-4c63dd864c53" by "delete_volume" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 11:03:39 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-28971976-3337-416a-aeaa-770b702209e1 tempest-VolumesSnapshotTestJSON-1399894899 None] Lock "cinder-quobyte-1369a9e1-a06f-49c1-9ae0-4c63dd864c53" acquired by "delete_volume" :: waited 0.017s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 11:03:39 devstack cinder-volume[87272]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf7d8ea7-5c86-4c05-9f8e-99500e25f8f2]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 11:03:39 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-28971976-3337-416a-aeaa-770b702209e1 tempest-VolumesSnapshotTestJSON-1399894899 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-1369a9e1-a06f-49c1-9ae0-4c63dd864c53 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:03:39 devstack sudo[101831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-1369a9e1-a06f-49c1-9ae0-4c63dd864c53 Nov 04 11:03:39 devstack sudo[101831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:03:39 devstack sudo[101831]: pam_unix(sudo:session): session closed for user root Nov 04 11:03:39 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-28971976-3337-416a-aeaa-770b702209e1 tempest-VolumesSnapshotTestJSON-1399894899 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-1369a9e1-a06f-49c1-9ae0-4c63dd864c53" returned: 0 in 0.482s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:03:39 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-28971976-3337-416a-aeaa-770b702209e1 tempest-VolumesSnapshotTestJSON-1399894899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-1369a9e1-a06f-49c1-9ae0-4c63dd864c53 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:03:39 devstack sudo[101837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-1369a9e1-a06f-49c1-9ae0-4c63dd864c53 Nov 04 11:03:39 devstack sudo[101837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:03:40 devstack sudo[101837]: pam_unix(sudo:session): session closed for user root Nov 04 11:03:40 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-28971976-3337-416a-aeaa-770b702209e1 tempest-VolumesSnapshotTestJSON-1399894899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-1369a9e1-a06f-49c1-9ae0-4c63dd864c53" returned: 0 in 0.482s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:03:40 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-28971976-3337-416a-aeaa-770b702209e1 tempest-VolumesSnapshotTestJSON-1399894899 None] Lock "cinder-quobyte-1369a9e1-a06f-49c1-9ae0-4c63dd864c53" released by "delete_volume" :: held 1.093s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 11:03:40 devstack cinder-volume[87272]: DEBUG cinder.quota [None req-28971976-3337-416a-aeaa-770b702209e1 tempest-VolumesSnapshotTestJSON-1399894899 None] Created reservations ['a2705052-54dc-4409-9a48-374703fb8d5b', '7161d767-85d1-4c51-a5d2-d81d001977dc', '2c9e88c4-69db-4ff1-a355-9a4e3e93a557', '34a08c9a-77e2-4e33-b1e0-57514bd6b38f'] {{(pid=87272) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 11:03:40 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-28971976-3337-416a-aeaa-770b702209e1 tempest-VolumesSnapshotTestJSON-1399894899 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 11:03:40 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-28971976-3337-416a-aeaa-770b702209e1 tempest-VolumesSnapshotTestJSON-1399894899 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 11:03:40 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-28971976-3337-416a-aeaa-770b702209e1 tempest-VolumesSnapshotTestJSON-1399894899 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898': None} {{(pid=87272) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 11:03:40 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-28971976-3337-416a-aeaa-770b702209e1 tempest-VolumesSnapshotTestJSON-1399894899 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'] {{(pid=87272) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 11:03:40 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-28971976-3337-416a-aeaa-770b702209e1 tempest-VolumesSnapshotTestJSON-1399894899 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 11:03:40 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-28971976-3337-416a-aeaa-770b702209e1 tempest-VolumesSnapshotTestJSON-1399894899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:03:40 devstack sudo[101840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1 Nov 04 11:03:40 devstack sudo[101840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:03:40 devstack sudo[101840]: pam_unix(sudo:session): session closed for user root Nov 04 11:03:40 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-28971976-3337-416a-aeaa-770b702209e1 tempest-VolumesSnapshotTestJSON-1399894899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1" returned: 0 in 0.422s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:03:40 devstack cinder-volume[87272]: DEBUG cinder.manager [None req-28971976-3337-416a-aeaa-770b702209e1 tempest-VolumesSnapshotTestJSON-1399894899 None] Notifying Schedulers of capabilities ... {{(pid=87272) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 11:03:41 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-28971976-3337-416a-aeaa-770b702209e1 tempest-VolumesSnapshotTestJSON-1399894899 None] Deleted volume successfully. Nov 04 11:03:41 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-28971976-3337-416a-aeaa-770b702209e1 tempest-VolumesSnapshotTestJSON-1399894899 None] Lock "cinder-1369a9e1-a06f-49c1-9ae0-4c63dd864c53-delete_volume" released by "delete_volume" :: held 1.845s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 11:03:41 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-31601892-d2e3-4226-a2af-655cb5635d87 tempest-VolumesSnapshotTestJSON-1399894899 None] Acquiring lock "cinder-ca2c72a0-f9e3-43e0-a5da-6c65737c50ee-delete_volume" by "delete_volume" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 11:03:41 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-31601892-d2e3-4226-a2af-655cb5635d87 tempest-VolumesSnapshotTestJSON-1399894899 None] Lock "cinder-ca2c72a0-f9e3-43e0-a5da-6c65737c50ee-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 11:03:41 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-31601892-d2e3-4226-a2af-655cb5635d87 tempest-VolumesSnapshotTestJSON-1399894899 None] Acquiring lock "cinder-quobyte-ca2c72a0-f9e3-43e0-a5da-6c65737c50ee" by "delete_volume" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 11:03:41 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-31601892-d2e3-4226-a2af-655cb5635d87 tempest-VolumesSnapshotTestJSON-1399894899 None] Lock "cinder-quobyte-ca2c72a0-f9e3-43e0-a5da-6c65737c50ee" acquired by "delete_volume" :: waited 0.026s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 11:03:41 devstack cinder-volume[87272]: DEBUG oslo.privsep.daemon [-] privsep: reply[e26523e9-1f16-4dda-afcc-d7e5ff0cd737]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 11:03:41 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-31601892-d2e3-4226-a2af-655cb5635d87 tempest-VolumesSnapshotTestJSON-1399894899 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-ca2c72a0-f9e3-43e0-a5da-6c65737c50ee {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:03:41 devstack sudo[101859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-ca2c72a0-f9e3-43e0-a5da-6c65737c50ee Nov 04 11:03:41 devstack sudo[101859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:03:42 devstack sudo[101859]: pam_unix(sudo:session): session closed for user root Nov 04 11:03:42 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-31601892-d2e3-4226-a2af-655cb5635d87 tempest-VolumesSnapshotTestJSON-1399894899 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-ca2c72a0-f9e3-43e0-a5da-6c65737c50ee" returned: 0 in 0.528s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:03:42 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-31601892-d2e3-4226-a2af-655cb5635d87 tempest-VolumesSnapshotTestJSON-1399894899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-ca2c72a0-f9e3-43e0-a5da-6c65737c50ee {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:03:42 devstack sudo[101864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-ca2c72a0-f9e3-43e0-a5da-6c65737c50ee Nov 04 11:03:42 devstack sudo[101864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:03:42 devstack sudo[101864]: pam_unix(sudo:session): session closed for user root Nov 04 11:03:42 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-31601892-d2e3-4226-a2af-655cb5635d87 tempest-VolumesSnapshotTestJSON-1399894899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-ca2c72a0-f9e3-43e0-a5da-6c65737c50ee" returned: 0 in 0.272s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:03:42 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-31601892-d2e3-4226-a2af-655cb5635d87 tempest-VolumesSnapshotTestJSON-1399894899 None] Lock "cinder-quobyte-ca2c72a0-f9e3-43e0-a5da-6c65737c50ee" released by "delete_volume" :: held 0.889s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 11:03:42 devstack cinder-volume[87272]: DEBUG cinder.quota [None req-31601892-d2e3-4226-a2af-655cb5635d87 tempest-VolumesSnapshotTestJSON-1399894899 None] Created reservations ['b49f3fe7-39bb-4994-a2ef-1485257fb3b4', 'f2d59eb5-c818-4d05-b22a-bca967aa9fd2', 'a4fd4771-4674-4341-aa37-8b299afaf49f', 'bab6337a-8357-4070-898f-aefe4f2378d3'] {{(pid=87272) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 11:03:42 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-31601892-d2e3-4226-a2af-655cb5635d87 tempest-VolumesSnapshotTestJSON-1399894899 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 11:03:42 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-31601892-d2e3-4226-a2af-655cb5635d87 tempest-VolumesSnapshotTestJSON-1399894899 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 11:03:42 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-31601892-d2e3-4226-a2af-655cb5635d87 tempest-VolumesSnapshotTestJSON-1399894899 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898': None} {{(pid=87272) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 11:03:42 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-31601892-d2e3-4226-a2af-655cb5635d87 tempest-VolumesSnapshotTestJSON-1399894899 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'] {{(pid=87272) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 11:03:42 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-31601892-d2e3-4226-a2af-655cb5635d87 tempest-VolumesSnapshotTestJSON-1399894899 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 11:03:42 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-31601892-d2e3-4226-a2af-655cb5635d87 tempest-VolumesSnapshotTestJSON-1399894899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:03:42 devstack sudo[101867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1 Nov 04 11:03:42 devstack sudo[101867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:03:43 devstack sudo[101867]: pam_unix(sudo:session): session closed for user root Nov 04 11:03:43 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-31601892-d2e3-4226-a2af-655cb5635d87 tempest-VolumesSnapshotTestJSON-1399894899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1" returned: 0 in 0.365s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:03:43 devstack cinder-volume[87272]: DEBUG cinder.manager [None req-31601892-d2e3-4226-a2af-655cb5635d87 tempest-VolumesSnapshotTestJSON-1399894899 None] Notifying Schedulers of capabilities ... {{(pid=87272) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 11:03:43 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-31601892-d2e3-4226-a2af-655cb5635d87 tempest-VolumesSnapshotTestJSON-1399894899 None] Deleted volume successfully. Nov 04 11:03:43 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-31601892-d2e3-4226-a2af-655cb5635d87 tempest-VolumesSnapshotTestJSON-1399894899 None] Lock "cinder-ca2c72a0-f9e3-43e0-a5da-6c65737c50ee-delete_volume" released by "delete_volume" :: held 1.527s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 11:03:52 devstack cinder-volume[87272]: DEBUG dbcounter [-] [87272] Writing DB stats cinder:SELECT=91,cinder:UPDATE=116,cinder:INSERT=33,cinder:DELETE=10 {{(pid=87272) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 11:03:53 devstack cinder-volume[87272]: DEBUG dbcounter [-] [87272] Writing DB stats cinder:SELECT=88,cinder:INSERT=27,cinder:UPDATE=121,cinder:DELETE=7 {{(pid=87272) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 11:03:57 devstack cinder-volume[87272]: DEBUG cinder.volume.flows.manager.create_volume [None req-0f152045-1a51-441f-b486-7be4012946fa tempest-SnapshotDependencyTests-1831731183 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87272) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 11:03:57 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-0f152045-1a51-441f-b486-7be4012946fa tempest-SnapshotDependencyTests-1831731183 None] Flow 'volume_create_manager' (314de21a-14c2-410d-ac80-74a63cc17acb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 11:03:57 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-0f152045-1a51-441f-b486-7be4012946fa tempest-SnapshotDependencyTests-1831731183 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (10d0f5b6-af8c-4576-b2dc-c34f863144e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:03:57 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-0f152045-1a51-441f-b486-7be4012946fa tempest-SnapshotDependencyTests-1831731183 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (10d0f5b6-af8c-4576-b2dc-c34f863144e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T10:03:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-784305182',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=45d917ea-9407-414f-b382-da47398cb2cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='caaba54d10fb4d0dbb8be451b7a26614',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T10:03:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T10:03:58Z,use_quota=True,user_id='05443ff8821c4dc686095c28dc3649c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8989e4f-21e3-4f0a-9584-0d818784e883),volume_type_id=f8989e4f-21e3-4f0a-9584-0d818784e883)' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:03:57 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-0f152045-1a51-441f-b486-7be4012946fa tempest-SnapshotDependencyTests-1831731183 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (64606cd5-3474-43ad-a0ec-a8dc2e29c8d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:03:57 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-0f152045-1a51-441f-b486-7be4012946fa tempest-SnapshotDependencyTests-1831731183 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (64606cd5-3474-43ad-a0ec-a8dc2e29c8d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:03:57 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-0f152045-1a51-441f-b486-7be4012946fa tempest-SnapshotDependencyTests-1831731183 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43f20675-c9fa-44d3-9915-5b714517e994) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:03:57 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-0f152045-1a51-441f-b486-7be4012946fa tempest-SnapshotDependencyTests-1831731183 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43f20675-c9fa-44d3-9915-5b714517e994) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '45d917ea-9407-414f-b382-da47398cb2cd', 'volume_name': 'volume-45d917ea-9407-414f-b382-da47398cb2cd', 'volume_size': 1}' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:03:58 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-0f152045-1a51-441f-b486-7be4012946fa tempest-SnapshotDependencyTests-1831731183 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b330dde0-7f1c-4eb5-af3e-3250dce40950) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:03:58 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-0f152045-1a51-441f-b486-7be4012946fa tempest-SnapshotDependencyTests-1831731183 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b330dde0-7f1c-4eb5-af3e-3250dce40950) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:03:58 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-0f152045-1a51-441f-b486-7be4012946fa tempest-SnapshotDependencyTests-1831731183 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (53daa575-d75c-47b9-a60c-aca86f1639ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:03:58 devstack cinder-volume[87272]: INFO cinder.volume.flows.manager.create_volume [None req-0f152045-1a51-441f-b486-7be4012946fa tempest-SnapshotDependencyTests-1831731183 None] Volume 45d917ea-9407-414f-b382-da47398cb2cd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-45d917ea-9407-414f-b382-da47398cb2cd', 'volume_size': 1} Nov 04 11:03:58 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-0f152045-1a51-441f-b486-7be4012946fa tempest-SnapshotDependencyTests-1831731183 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 11:03:58 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-0f152045-1a51-441f-b486-7be4012946fa tempest-SnapshotDependencyTests-1831731183 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 11:03:58 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-0f152045-1a51-441f-b486-7be4012946fa tempest-SnapshotDependencyTests-1831731183 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T10:03:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-784305182',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=45d917ea-9407-414f-b382-da47398cb2cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='caaba54d10fb4d0dbb8be451b7a26614',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T10:03:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T10:03:58Z,use_quota=True,user_id='05443ff8821c4dc686095c28dc3649c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8989e4f-21e3-4f0a-9584-0d818784e883),volume_type_id=f8989e4f-21e3-4f0a-9584-0d818784e883)}" {{(pid=87272) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 04 11:03:58 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.remotefs [None req-0f152045-1a51-441f-b486-7be4012946fa tempest-SnapshotDependencyTests-1831731183 None] Creating volume 45d917ea-9407-414f-b382-da47398cb2cd {{(pid=87272) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 11:03:58 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-0f152045-1a51-441f-b486-7be4012946fa tempest-SnapshotDependencyTests-1831731183 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 11:03:58 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-0f152045-1a51-441f-b486-7be4012946fa tempest-SnapshotDependencyTests-1831731183 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 11:03:58 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-0f152045-1a51-441f-b486-7be4012946fa tempest-SnapshotDependencyTests-1831731183 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898': None} {{(pid=87272) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 11:03:58 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-0f152045-1a51-441f-b486-7be4012946fa tempest-SnapshotDependencyTests-1831731183 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'] {{(pid=87272) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 11:03:58 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-0f152045-1a51-441f-b486-7be4012946fa tempest-SnapshotDependencyTests-1831731183 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 11:03:58 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-0f152045-1a51-441f-b486-7be4012946fa tempest-SnapshotDependencyTests-1831731183 None] Selected osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898 as target Quobyte volume. {{(pid=87272) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 11:03:58 devstack cinder-volume[87272]: INFO cinder.volume.drivers.remotefs [None req-0f152045-1a51-441f-b486-7be4012946fa tempest-SnapshotDependencyTests-1831731183 None] casted to osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898 Nov 04 11:03:58 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-0f152045-1a51-441f-b486-7be4012946fa tempest-SnapshotDependencyTests-1831731183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-45d917ea-9407-414f-b382-da47398cb2cd 1073741824 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:03:58 devstack sudo[101978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-45d917ea-9407-414f-b382-da47398cb2cd 1073741824 Nov 04 11:03:58 devstack sudo[101978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:03:58 devstack sudo[101978]: pam_unix(sudo:session): session closed for user root Nov 04 11:03:58 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-0f152045-1a51-441f-b486-7be4012946fa tempest-SnapshotDependencyTests-1831731183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-45d917ea-9407-414f-b382-da47398cb2cd 1073741824" returned: 0 in 0.485s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:03:58 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-0f152045-1a51-441f-b486-7be4012946fa tempest-SnapshotDependencyTests-1831731183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-45d917ea-9407-414f-b382-da47398cb2cd {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:03:58 devstack sudo[101983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-45d917ea-9407-414f-b382-da47398cb2cd Nov 04 11:03:58 devstack sudo[101983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:03:58 devstack sudo[101983]: pam_unix(sudo:session): session closed for user root Nov 04 11:03:58 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-0f152045-1a51-441f-b486-7be4012946fa tempest-SnapshotDependencyTests-1831731183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-45d917ea-9407-414f-b382-da47398cb2cd" returned: 0 in 0.258s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:03:58 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-0f152045-1a51-441f-b486-7be4012946fa tempest-SnapshotDependencyTests-1831731183 None] <== create_volume: return (799ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'} {{(pid=87272) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 04 11:03:58 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-0f152045-1a51-441f-b486-7be4012946fa tempest-SnapshotDependencyTests-1831731183 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.802s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 11:03:58 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-0f152045-1a51-441f-b486-7be4012946fa tempest-SnapshotDependencyTests-1831731183 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (53daa575-d75c-47b9-a60c-aca86f1639ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-45d917ea-9407-414f-b382-da47398cb2cd', 'volume_size': 1}' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:03:58 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-0f152045-1a51-441f-b486-7be4012946fa tempest-SnapshotDependencyTests-1831731183 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5bea947f-8518-497c-b9bd-499209c124b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:03:58 devstack cinder-volume[87272]: INFO cinder.volume.flows.manager.create_volume [None req-0f152045-1a51-441f-b486-7be4012946fa tempest-SnapshotDependencyTests-1831731183 None] Volume volume-45d917ea-9407-414f-b382-da47398cb2cd (45d917ea-9407-414f-b382-da47398cb2cd): created successfully Nov 04 11:03:58 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-0f152045-1a51-441f-b486-7be4012946fa tempest-SnapshotDependencyTests-1831731183 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5bea947f-8518-497c-b9bd-499209c124b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:03:58 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-0f152045-1a51-441f-b486-7be4012946fa tempest-SnapshotDependencyTests-1831731183 None] Flow 'volume_create_manager' (314de21a-14c2-410d-ac80-74a63cc17acb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87272) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 11:03:58 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-0f152045-1a51-441f-b486-7be4012946fa tempest-SnapshotDependencyTests-1831731183 None] Created volume successfully. Nov 04 11:04:00 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-232006d4-2fcf-4d60-b937-5db92061ee3c tempest-SnapshotDependencyTests-1831731183 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 11:04:00 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-232006d4-2fcf-4d60-b937-5db92061ee3c tempest-SnapshotDependencyTests-1831731183 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 11:04:00 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.remotefs [None req-232006d4-2fcf-4d60-b937-5db92061ee3c tempest-SnapshotDependencyTests-1831731183 None] Creating offline snapshot e07bc96f-1e59-4dda-aac0-3d51a613848c of volume 45d917ea-9407-414f-b382-da47398cb2cd {{(pid=87272) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 04 11:04:00 devstack cinder-volume[87272]: DEBUG oslo.privsep.daemon [-] privsep: reply[3279f418-a5d6-4bb3-8d14-da556f301e1b]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 11:04:00 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-232006d4-2fcf-4d60-b937-5db92061ee3c tempest-SnapshotDependencyTests-1831731183 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-45d917ea-9407-414f-b382-da47398cb2cd {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:04:00 devstack sudo[101986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-45d917ea-9407-414f-b382-da47398cb2cd Nov 04 11:04:00 devstack sudo[101986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:04:00 devstack sudo[101986]: pam_unix(sudo:session): session closed for user root Nov 04 11:04:00 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-232006d4-2fcf-4d60-b937-5db92061ee3c tempest-SnapshotDependencyTests-1831731183 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-45d917ea-9407-414f-b382-da47398cb2cd" returned: 0 in 0.551s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:04:00 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-232006d4-2fcf-4d60-b937-5db92061ee3c tempest-SnapshotDependencyTests-1831731183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-45d917ea-9407-414f-b382-da47398cb2cd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-45d917ea-9407-414f-b382-da47398cb2cd.e07bc96f-1e59-4dda-aac0-3d51a613848c 1G {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:04:00 devstack sudo[101992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-45d917ea-9407-414f-b382-da47398cb2cd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-45d917ea-9407-414f-b382-da47398cb2cd.e07bc96f-1e59-4dda-aac0-3d51a613848c 1G Nov 04 11:04:00 devstack sudo[101992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:04:01 devstack sudo[101992]: pam_unix(sudo:session): session closed for user root Nov 04 11:04:01 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-232006d4-2fcf-4d60-b937-5db92061ee3c tempest-SnapshotDependencyTests-1831731183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-45d917ea-9407-414f-b382-da47398cb2cd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-45d917ea-9407-414f-b382-da47398cb2cd.e07bc96f-1e59-4dda-aac0-3d51a613848c 1G" returned: 0 in 0.534s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:04:01 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-232006d4-2fcf-4d60-b937-5db92061ee3c tempest-SnapshotDependencyTests-1831731183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-45d917ea-9407-414f-b382-da47398cb2cd -F qcow2 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-45d917ea-9407-414f-b382-da47398cb2cd.e07bc96f-1e59-4dda-aac0-3d51a613848c {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:04:01 devstack sudo[101998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-45d917ea-9407-414f-b382-da47398cb2cd -F qcow2 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-45d917ea-9407-414f-b382-da47398cb2cd.e07bc96f-1e59-4dda-aac0-3d51a613848c Nov 04 11:04:01 devstack sudo[101998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:04:01 devstack sudo[101998]: pam_unix(sudo:session): session closed for user root Nov 04 11:04:01 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-232006d4-2fcf-4d60-b937-5db92061ee3c tempest-SnapshotDependencyTests-1831731183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-45d917ea-9407-414f-b382-da47398cb2cd -F qcow2 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-45d917ea-9407-414f-b382-da47398cb2cd.e07bc96f-1e59-4dda-aac0-3d51a613848c" returned: 0 in 0.332s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:04:01 devstack cinder-volume[87272]: WARNING cinder.volume.drivers.remotefs [None req-232006d4-2fcf-4d60-b937-5db92061ee3c tempest-SnapshotDependencyTests-1831731183 None] /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-45d917ea-9407-414f-b382-da47398cb2cd.e07bc96f-1e59-4dda-aac0-3d51a613848c is being set with open permissions: ugo+rw Nov 04 11:04:01 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-232006d4-2fcf-4d60-b937-5db92061ee3c tempest-SnapshotDependencyTests-1831731183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-45d917ea-9407-414f-b382-da47398cb2cd.e07bc96f-1e59-4dda-aac0-3d51a613848c {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:04:01 devstack sudo[102005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-45d917ea-9407-414f-b382-da47398cb2cd.e07bc96f-1e59-4dda-aac0-3d51a613848c Nov 04 11:04:01 devstack sudo[102005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:04:02 devstack sudo[102005]: pam_unix(sudo:session): session closed for user root Nov 04 11:04:02 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-232006d4-2fcf-4d60-b937-5db92061ee3c tempest-SnapshotDependencyTests-1831731183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-45d917ea-9407-414f-b382-da47398cb2cd.e07bc96f-1e59-4dda-aac0-3d51a613848c" returned: 0 in 0.282s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:04:02 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-232006d4-2fcf-4d60-b937-5db92061ee3c tempest-SnapshotDependencyTests-1831731183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-45d917ea-9407-414f-b382-da47398cb2cd.info {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:04:02 devstack sudo[102008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-45d917ea-9407-414f-b382-da47398cb2cd.info Nov 04 11:04:02 devstack sudo[102008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:04:02 devstack sudo[102008]: pam_unix(sudo:session): session closed for user root Nov 04 11:04:02 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-232006d4-2fcf-4d60-b937-5db92061ee3c tempest-SnapshotDependencyTests-1831731183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-45d917ea-9407-414f-b382-da47398cb2cd.info" returned: 0 in 0.295s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:04:02 devstack cinder-volume[87272]: WARNING cinder.volume.drivers.remotefs [None req-232006d4-2fcf-4d60-b937-5db92061ee3c tempest-SnapshotDependencyTests-1831731183 None] /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-45d917ea-9407-414f-b382-da47398cb2cd.info is being set with open permissions: ugo+rw Nov 04 11:04:02 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-232006d4-2fcf-4d60-b937-5db92061ee3c tempest-SnapshotDependencyTests-1831731183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-45d917ea-9407-414f-b382-da47398cb2cd.info {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:04:02 devstack sudo[102011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-45d917ea-9407-414f-b382-da47398cb2cd.info Nov 04 11:04:02 devstack sudo[102011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:04:02 devstack sudo[102011]: pam_unix(sudo:session): session closed for user root Nov 04 11:04:02 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-232006d4-2fcf-4d60-b937-5db92061ee3c tempest-SnapshotDependencyTests-1831731183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-45d917ea-9407-414f-b382-da47398cb2cd.info" returned: 0 in 0.279s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:04:02 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-232006d4-2fcf-4d60-b937-5db92061ee3c tempest-SnapshotDependencyTests-1831731183 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.403s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 11:04:02 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-232006d4-2fcf-4d60-b937-5db92061ee3c tempest-SnapshotDependencyTests-1831731183 None] Create snapshot completed successfully Nov 04 11:04:04 devstack cinder-volume[87272]: DEBUG cinder.volume.flows.manager.create_volume [None req-511ebefc-38d8-46e3-9763-cce4873fce1e tempest-SnapshotDependencyTests-1831731183 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87272) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 11:04:04 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-511ebefc-38d8-46e3-9763-cce4873fce1e tempest-SnapshotDependencyTests-1831731183 None] Flow 'volume_create_manager' (04ca5c02-0336-4536-894c-0a62d9b100b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 11:04:04 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-511ebefc-38d8-46e3-9763-cce4873fce1e tempest-SnapshotDependencyTests-1831731183 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac9995ca-145c-4bbf-91a2-b8b88c16e22d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:04:04 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-511ebefc-38d8-46e3-9763-cce4873fce1e tempest-SnapshotDependencyTests-1831731183 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac9995ca-145c-4bbf-91a2-b8b88c16e22d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T10:04:04Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5aeada47-73a5-46c6-9824-e71e23d80eef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='caaba54d10fb4d0dbb8be451b7a26614',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T10:04:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=e07bc96f-1e59-4dda-aac0-3d51a613848c,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T10:04:04Z,use_quota=True,user_id='05443ff8821c4dc686095c28dc3649c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8989e4f-21e3-4f0a-9584-0d818784e883),volume_type_id=f8989e4f-21e3-4f0a-9584-0d818784e883)' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:04:04 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-511ebefc-38d8-46e3-9763-cce4873fce1e tempest-SnapshotDependencyTests-1831731183 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca207037-8176-4e92-8ea9-334bfc1f83f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:04:04 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-511ebefc-38d8-46e3-9763-cce4873fce1e tempest-SnapshotDependencyTests-1831731183 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca207037-8176-4e92-8ea9-334bfc1f83f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:04:04 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-511ebefc-38d8-46e3-9763-cce4873fce1e tempest-SnapshotDependencyTests-1831731183 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (355ad2ee-519c-4e16-b0cf-795470632d4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:04:04 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-511ebefc-38d8-46e3-9763-cce4873fce1e tempest-SnapshotDependencyTests-1831731183 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (355ad2ee-519c-4e16-b0cf-795470632d4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '5aeada47-73a5-46c6-9824-e71e23d80eef', 'volume_name': 'volume-5aeada47-73a5-46c6-9824-e71e23d80eef', 'volume_size': 1, 'snapshot_id': 'e07bc96f-1e59-4dda-aac0-3d51a613848c'}' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:04:04 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-511ebefc-38d8-46e3-9763-cce4873fce1e tempest-SnapshotDependencyTests-1831731183 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d91080f5-5a97-4be9-afdb-20610b5c7dc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:04:04 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-511ebefc-38d8-46e3-9763-cce4873fce1e tempest-SnapshotDependencyTests-1831731183 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d91080f5-5a97-4be9-afdb-20610b5c7dc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:04:04 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-511ebefc-38d8-46e3-9763-cce4873fce1e tempest-SnapshotDependencyTests-1831731183 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb17e8b9-345e-4b17-97fd-a78745e216fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:04:04 devstack cinder-volume[87272]: INFO cinder.volume.flows.manager.create_volume [None req-511ebefc-38d8-46e3-9763-cce4873fce1e tempest-SnapshotDependencyTests-1831731183 None] Volume 5aeada47-73a5-46c6-9824-e71e23d80eef: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-5aeada47-73a5-46c6-9824-e71e23d80eef', 'volume_size': 1, 'snapshot_id': 'e07bc96f-1e59-4dda-aac0-3d51a613848c'} Nov 04 11:04:04 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-511ebefc-38d8-46e3-9763-cce4873fce1e tempest-SnapshotDependencyTests-1831731183 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 11:04:04 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-511ebefc-38d8-46e3-9763-cce4873fce1e tempest-SnapshotDependencyTests-1831731183 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 11:04:04 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-511ebefc-38d8-46e3-9763-cce4873fce1e tempest-SnapshotDependencyTests-1831731183 None] Acquiring lock "cinder-quobyte-e07bc96f-1e59-4dda-aac0-3d51a613848c-5aeada47-73a5-46c6-9824-e71e23d80eef" by "_create_volume_from_snapshot" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 11:04:04 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-511ebefc-38d8-46e3-9763-cce4873fce1e tempest-SnapshotDependencyTests-1831731183 None] Lock "cinder-quobyte-e07bc96f-1e59-4dda-aac0-3d51a613848c-5aeada47-73a5-46c6-9824-e71e23d80eef" acquired by "_create_volume_from_snapshot" :: waited 0.014s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 11:04:04 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-511ebefc-38d8-46e3-9763-cce4873fce1e tempest-SnapshotDependencyTests-1831731183 None] Creating volume 5aeada47-73a5-46c6-9824-e71e23d80eef from snapshot e07bc96f-1e59-4dda-aac0-3d51a613848c {{(pid=87272) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 04 11:04:04 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-511ebefc-38d8-46e3-9763-cce4873fce1e tempest-SnapshotDependencyTests-1831731183 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 11:04:04 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-511ebefc-38d8-46e3-9763-cce4873fce1e tempest-SnapshotDependencyTests-1831731183 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 11:04:04 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-511ebefc-38d8-46e3-9763-cce4873fce1e tempest-SnapshotDependencyTests-1831731183 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898': None} {{(pid=87272) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 11:04:04 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-511ebefc-38d8-46e3-9763-cce4873fce1e tempest-SnapshotDependencyTests-1831731183 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'] {{(pid=87272) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 11:04:04 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-511ebefc-38d8-46e3-9763-cce4873fce1e tempest-SnapshotDependencyTests-1831731183 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 11:04:04 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-511ebefc-38d8-46e3-9763-cce4873fce1e tempest-SnapshotDependencyTests-1831731183 None] Selected osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898 as target Quobyte volume. {{(pid=87272) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 11:04:04 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-511ebefc-38d8-46e3-9763-cce4873fce1e tempest-SnapshotDependencyTests-1831731183 None] Acquiring lock "cinder-quobyte-5aeada47-73a5-46c6-9824-e71e23d80eef" by "_copy_volume_from_snapshot" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 11:04:04 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-511ebefc-38d8-46e3-9763-cce4873fce1e tempest-SnapshotDependencyTests-1831731183 None] Lock "cinder-quobyte-5aeada47-73a5-46c6-9824-e71e23d80eef" acquired by "_copy_volume_from_snapshot" :: waited 0.016s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 11:04:04 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-511ebefc-38d8-46e3-9763-cce4873fce1e tempest-SnapshotDependencyTests-1831731183 None] snapshot: e07bc96f-1e59-4dda-aac0-3d51a613848c, volume: 5aeada47-73a5-46c6-9824-e71e23d80eef, {{(pid=87272) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 04 11:04:04 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-511ebefc-38d8-46e3-9763-cce4873fce1e tempest-SnapshotDependencyTests-1831731183 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 11:04:04 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-511ebefc-38d8-46e3-9763-cce4873fce1e tempest-SnapshotDependencyTests-1831731183 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 11:04:04 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-511ebefc-38d8-46e3-9763-cce4873fce1e tempest-SnapshotDependencyTests-1831731183 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898': None} {{(pid=87272) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 11:04:04 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-511ebefc-38d8-46e3-9763-cce4873fce1e tempest-SnapshotDependencyTests-1831731183 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'] {{(pid=87272) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 11:04:04 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-511ebefc-38d8-46e3-9763-cce4873fce1e tempest-SnapshotDependencyTests-1831731183 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 11:04:04 devstack cinder-volume[87272]: DEBUG oslo.privsep.daemon [-] privsep: reply[170694da-0350-4798-89e2-b81b6cf2612e]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 11:04:04 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-511ebefc-38d8-46e3-9763-cce4873fce1e tempest-SnapshotDependencyTests-1831731183 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-45d917ea-9407-414f-b382-da47398cb2cd.e07bc96f-1e59-4dda-aac0-3d51a613848c {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:04:04 devstack sudo[102014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-45d917ea-9407-414f-b382-da47398cb2cd.e07bc96f-1e59-4dda-aac0-3d51a613848c Nov 04 11:04:04 devstack sudo[102014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:04:04 devstack sudo[102014]: pam_unix(sudo:session): session closed for user root Nov 04 11:04:04 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-511ebefc-38d8-46e3-9763-cce4873fce1e tempest-SnapshotDependencyTests-1831731183 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-45d917ea-9407-414f-b382-da47398cb2cd.e07bc96f-1e59-4dda-aac0-3d51a613848c" returned: 0 in 0.401s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:04:04 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.remotefs [None req-511ebefc-38d8-46e3-9763-cce4873fce1e tempest-SnapshotDependencyTests-1831731183 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-45d917ea-9407-414f-b382-da47398cb2cd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87272) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 11:04:04 devstack cinder-volume[87272]: DEBUG oslo.privsep.daemon [-] privsep: reply[3967d05f-c9eb-4024-9cfa-e5d734dc4337]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 11:04:04 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-511ebefc-38d8-46e3-9763-cce4873fce1e tempest-SnapshotDependencyTests-1831731183 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-45d917ea-9407-414f-b382-da47398cb2cd {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:04:05 devstack sudo[102020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-45d917ea-9407-414f-b382-da47398cb2cd Nov 04 11:04:05 devstack sudo[102020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:04:05 devstack sudo[102020]: pam_unix(sudo:session): session closed for user root Nov 04 11:04:05 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-511ebefc-38d8-46e3-9763-cce4873fce1e tempest-SnapshotDependencyTests-1831731183 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-45d917ea-9407-414f-b382-da47398cb2cd" returned: 0 in 0.467s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:04:05 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-511ebefc-38d8-46e3-9763-cce4873fce1e tempest-SnapshotDependencyTests-1831731183 None] will copy from snapshot at /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-45d917ea-9407-414f-b382-da47398cb2cd {{(pid=87272) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 04 11:04:05 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-511ebefc-38d8-46e3-9763-cce4873fce1e tempest-SnapshotDependencyTests-1831731183 None] Creating direct copy from snapshot {{(pid=87272) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 04 11:04:05 devstack cinder-volume[87272]: DEBUG cinder.utils [None req-511ebefc-38d8-46e3-9763-cce4873fce1e tempest-SnapshotDependencyTests-1831731183 None] Path /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-5aeada47-73a5-46c6-9824-e71e23d80eef not found in is_blk_device check {{(pid=87272) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Nov 04 11:04:05 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-511ebefc-38d8-46e3-9763-cce4873fce1e tempest-SnapshotDependencyTests-1831731183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-45d917ea-9407-414f-b382-da47398cb2cd /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-5aeada47-73a5-46c6-9824-e71e23d80eef {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:04:05 devstack sudo[102025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-45d917ea-9407-414f-b382-da47398cb2cd /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-5aeada47-73a5-46c6-9824-e71e23d80eef Nov 04 11:04:05 devstack sudo[102025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:04:05 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-8581b636-ad7d-4ba9-83e8-0ed5574d036b tempest-VolumesNegativeTest-1603017832 None] Acquiring lock "cinder-2eac0574-4aea-4ed4-bffa-a29bb35c6315-delete_volume" by "delete_volume" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 11:04:05 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-8581b636-ad7d-4ba9-83e8-0ed5574d036b tempest-VolumesNegativeTest-1603017832 None] Lock "cinder-2eac0574-4aea-4ed4-bffa-a29bb35c6315-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 11:04:05 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-8581b636-ad7d-4ba9-83e8-0ed5574d036b tempest-VolumesNegativeTest-1603017832 None] Acquiring lock "cinder-quobyte-2eac0574-4aea-4ed4-bffa-a29bb35c6315" by "delete_volume" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 11:04:05 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-8581b636-ad7d-4ba9-83e8-0ed5574d036b tempest-VolumesNegativeTest-1603017832 None] Lock "cinder-quobyte-2eac0574-4aea-4ed4-bffa-a29bb35c6315" acquired by "delete_volume" :: waited 0.027s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 11:04:05 devstack cinder-volume[87272]: DEBUG oslo.privsep.daemon [-] privsep: reply[95b3fb64-8cf1-4648-a77b-baec9012fe1d]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 11:04:05 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-8581b636-ad7d-4ba9-83e8-0ed5574d036b tempest-VolumesNegativeTest-1603017832 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-2eac0574-4aea-4ed4-bffa-a29bb35c6315 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:04:05 devstack sudo[102029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-2eac0574-4aea-4ed4-bffa-a29bb35c6315 Nov 04 11:04:05 devstack sudo[102029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:04:06 devstack sudo[102029]: pam_unix(sudo:session): session closed for user root Nov 04 11:04:06 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-8581b636-ad7d-4ba9-83e8-0ed5574d036b tempest-VolumesNegativeTest-1603017832 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-2eac0574-4aea-4ed4-bffa-a29bb35c6315" returned: 0 in 0.636s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:04:06 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-8581b636-ad7d-4ba9-83e8-0ed5574d036b tempest-VolumesNegativeTest-1603017832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-2eac0574-4aea-4ed4-bffa-a29bb35c6315 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:04:06 devstack sudo[102042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-2eac0574-4aea-4ed4-bffa-a29bb35c6315 Nov 04 11:04:06 devstack sudo[102042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:04:06 devstack sudo[102042]: pam_unix(sudo:session): session closed for user root Nov 04 11:04:06 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-8581b636-ad7d-4ba9-83e8-0ed5574d036b tempest-VolumesNegativeTest-1603017832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-2eac0574-4aea-4ed4-bffa-a29bb35c6315" returned: 0 in 0.530s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:04:06 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-8581b636-ad7d-4ba9-83e8-0ed5574d036b tempest-VolumesNegativeTest-1603017832 None] Lock "cinder-quobyte-2eac0574-4aea-4ed4-bffa-a29bb35c6315" released by "delete_volume" :: held 1.233s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 11:04:06 devstack cinder-volume[87272]: DEBUG cinder.quota [None req-8581b636-ad7d-4ba9-83e8-0ed5574d036b tempest-VolumesNegativeTest-1603017832 None] Created reservations ['98fcfd5f-a392-45c4-abc3-dd5c90407d37', '12f1c547-271e-4fdb-9fc6-81ccaf747742', 'd1d0a9e3-0f2d-4a88-adb0-7ad1a42c54e3', 'c81a6f68-5587-46a6-bf87-9c7541b4f731'] {{(pid=87272) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 11:04:07 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-8581b636-ad7d-4ba9-83e8-0ed5574d036b tempest-VolumesNegativeTest-1603017832 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 11:04:07 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-8581b636-ad7d-4ba9-83e8-0ed5574d036b tempest-VolumesNegativeTest-1603017832 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 11:04:07 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-8581b636-ad7d-4ba9-83e8-0ed5574d036b tempest-VolumesNegativeTest-1603017832 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898': None} {{(pid=87272) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 11:04:07 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-8581b636-ad7d-4ba9-83e8-0ed5574d036b tempest-VolumesNegativeTest-1603017832 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'] {{(pid=87272) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 11:04:07 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-8581b636-ad7d-4ba9-83e8-0ed5574d036b tempest-VolumesNegativeTest-1603017832 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 11:04:07 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-8581b636-ad7d-4ba9-83e8-0ed5574d036b tempest-VolumesNegativeTest-1603017832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:04:07 devstack sudo[102046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1 Nov 04 11:04:07 devstack sudo[102046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:04:07 devstack sudo[102046]: pam_unix(sudo:session): session closed for user root Nov 04 11:04:07 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-8581b636-ad7d-4ba9-83e8-0ed5574d036b tempest-VolumesNegativeTest-1603017832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1" returned: 0 in 0.446s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:04:07 devstack cinder-volume[87272]: DEBUG cinder.manager [None req-8581b636-ad7d-4ba9-83e8-0ed5574d036b tempest-VolumesNegativeTest-1603017832 None] Notifying Schedulers of capabilities ... {{(pid=87272) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 11:04:07 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-8581b636-ad7d-4ba9-83e8-0ed5574d036b tempest-VolumesNegativeTest-1603017832 None] Deleted volume successfully. Nov 04 11:04:07 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-8581b636-ad7d-4ba9-83e8-0ed5574d036b tempest-VolumesNegativeTest-1603017832 None] Lock "cinder-2eac0574-4aea-4ed4-bffa-a29bb35c6315-delete_volume" released by "delete_volume" :: held 2.074s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 11:04:13 devstack sudo[102025]: pam_unix(sudo:session): session closed for user root Nov 04 11:04:13 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-511ebefc-38d8-46e3-9763-cce4873fce1e tempest-SnapshotDependencyTests-1831731183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-45d917ea-9407-414f-b382-da47398cb2cd /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-5aeada47-73a5-46c6-9824-e71e23d80eef" returned: 0 in 8.431s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:04:13 devstack cinder-volume[87272]: DEBUG cinder.image.image_utils [None req-511ebefc-38d8-46e3-9763-cce4873fce1e tempest-SnapshotDependencyTests-1831731183 None] Image conversion details: src /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-45d917ea-9407-414f-b382-da47398cb2cd, size 1024.00 MB, duration 8.43 sec, destination /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-5aeada47-73a5-46c6-9824-e71e23d80eef {{(pid=87272) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Nov 04 11:04:13 devstack cinder-volume[87272]: INFO cinder.image.image_utils [None req-511ebefc-38d8-46e3-9763-cce4873fce1e tempest-SnapshotDependencyTests-1831731183 None] Converted 1024.00 MB image at 121.44 MB/s Nov 04 11:04:13 devstack cinder-volume[87272]: WARNING cinder.volume.drivers.remotefs [None req-511ebefc-38d8-46e3-9763-cce4873fce1e tempest-SnapshotDependencyTests-1831731183 None] /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-5aeada47-73a5-46c6-9824-e71e23d80eef is being set with open permissions: ugo+rw Nov 04 11:04:13 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-511ebefc-38d8-46e3-9763-cce4873fce1e tempest-SnapshotDependencyTests-1831731183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-5aeada47-73a5-46c6-9824-e71e23d80eef {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:04:13 devstack sudo[102051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-5aeada47-73a5-46c6-9824-e71e23d80eef Nov 04 11:04:13 devstack sudo[102051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:04:14 devstack sudo[102051]: pam_unix(sudo:session): session closed for user root Nov 04 11:04:14 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-511ebefc-38d8-46e3-9763-cce4873fce1e tempest-SnapshotDependencyTests-1831731183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-5aeada47-73a5-46c6-9824-e71e23d80eef" returned: 0 in 0.259s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:04:14 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-511ebefc-38d8-46e3-9763-cce4873fce1e tempest-SnapshotDependencyTests-1831731183 None] Lock "cinder-quobyte-5aeada47-73a5-46c6-9824-e71e23d80eef" released by "_copy_volume_from_snapshot" :: held 9.690s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 11:04:14 devstack cinder-volume[87272]: DEBUG oslo_service.periodic_task [None req-236af0be-7f9d-4c80-b3d7-d645a9cd0dd1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87272) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 04 11:04:14 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-236af0be-7f9d-4c80-b3d7-d645a9cd0dd1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 11:04:14 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-236af0be-7f9d-4c80-b3d7-d645a9cd0dd1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 11:04:14 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-236af0be-7f9d-4c80-b3d7-d645a9cd0dd1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898': None} {{(pid=87272) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 11:04:14 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-236af0be-7f9d-4c80-b3d7-d645a9cd0dd1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'] {{(pid=87272) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 11:04:14 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-236af0be-7f9d-4c80-b3d7-d645a9cd0dd1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 11:04:14 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-236af0be-7f9d-4c80-b3d7-d645a9cd0dd1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:04:14 devstack sudo[102054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1 Nov 04 11:04:14 devstack sudo[102054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:04:14 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-511ebefc-38d8-46e3-9763-cce4873fce1e tempest-SnapshotDependencyTests-1831731183 None] Lock "cinder-quobyte-e07bc96f-1e59-4dda-aac0-3d51a613848c-5aeada47-73a5-46c6-9824-e71e23d80eef" released by "_create_volume_from_snapshot" :: held 9.852s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 11:04:14 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-511ebefc-38d8-46e3-9763-cce4873fce1e tempest-SnapshotDependencyTests-1831731183 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.869s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 11:04:14 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-511ebefc-38d8-46e3-9763-cce4873fce1e tempest-SnapshotDependencyTests-1831731183 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb17e8b9-345e-4b17-97fd-a78745e216fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5aeada47-73a5-46c6-9824-e71e23d80eef', 'volume_size': 1, 'snapshot_id': 'e07bc96f-1e59-4dda-aac0-3d51a613848c'}' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:04:14 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-511ebefc-38d8-46e3-9763-cce4873fce1e tempest-SnapshotDependencyTests-1831731183 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (91c02373-83aa-42fe-a692-2bb158956fb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:04:14 devstack cinder-volume[87272]: INFO cinder.volume.flows.manager.create_volume [None req-511ebefc-38d8-46e3-9763-cce4873fce1e tempest-SnapshotDependencyTests-1831731183 None] Volume volume-5aeada47-73a5-46c6-9824-e71e23d80eef (5aeada47-73a5-46c6-9824-e71e23d80eef): created successfully Nov 04 11:04:14 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-511ebefc-38d8-46e3-9763-cce4873fce1e tempest-SnapshotDependencyTests-1831731183 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (91c02373-83aa-42fe-a692-2bb158956fb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:04:14 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-511ebefc-38d8-46e3-9763-cce4873fce1e tempest-SnapshotDependencyTests-1831731183 None] Flow 'volume_create_manager' (04ca5c02-0336-4536-894c-0a62d9b100b8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87272) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 11:04:14 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-511ebefc-38d8-46e3-9763-cce4873fce1e tempest-SnapshotDependencyTests-1831731183 None] Created volume successfully. Nov 04 11:04:14 devstack cinder-volume[87272]: DEBUG cinder.volume.flows.manager.create_volume [None req-f7670913-65c7-495c-82b1-97486f544a7a tempest-VolumesSnapshotListTestJSON-214810329 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87272) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 11:04:14 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-f7670913-65c7-495c-82b1-97486f544a7a tempest-VolumesSnapshotListTestJSON-214810329 None] Flow 'volume_create_manager' (059f0342-f4a2-4a1f-96d4-f8484f66be0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 11:04:14 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-f7670913-65c7-495c-82b1-97486f544a7a tempest-VolumesSnapshotListTestJSON-214810329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a08fa87-4e1a-4372-833d-47f183c4ed82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:04:14 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-f7670913-65c7-495c-82b1-97486f544a7a tempest-VolumesSnapshotListTestJSON-214810329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a08fa87-4e1a-4372-833d-47f183c4ed82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T10:04:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-804479791',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a9e9cdf6-eb51-4996-9768-51e631e92a0e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='48bdda9e0fc9450f8381411b526eae06',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T10:04:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T10:04:14Z,use_quota=True,user_id='6596fc34c8f143ed960cb173af718b4b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8989e4f-21e3-4f0a-9584-0d818784e883),volume_type_id=f8989e4f-21e3-4f0a-9584-0d818784e883)' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:04:14 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-f7670913-65c7-495c-82b1-97486f544a7a tempest-VolumesSnapshotListTestJSON-214810329 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d55c01f-6ae8-45fe-ab44-2ef39b1f9b41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:04:14 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-f7670913-65c7-495c-82b1-97486f544a7a tempest-VolumesSnapshotListTestJSON-214810329 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d55c01f-6ae8-45fe-ab44-2ef39b1f9b41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:04:14 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-f7670913-65c7-495c-82b1-97486f544a7a tempest-VolumesSnapshotListTestJSON-214810329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c53f5c72-165b-4a4d-ac8a-6a7f9d7e765b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:04:14 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-f7670913-65c7-495c-82b1-97486f544a7a tempest-VolumesSnapshotListTestJSON-214810329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c53f5c72-165b-4a4d-ac8a-6a7f9d7e765b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a9e9cdf6-eb51-4996-9768-51e631e92a0e', 'volume_name': 'volume-a9e9cdf6-eb51-4996-9768-51e631e92a0e', 'volume_size': 1}' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:04:14 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-f7670913-65c7-495c-82b1-97486f544a7a tempest-VolumesSnapshotListTestJSON-214810329 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (19ba9b32-8e4e-4f9a-b50e-8fbd7e3433c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:04:14 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-f7670913-65c7-495c-82b1-97486f544a7a tempest-VolumesSnapshotListTestJSON-214810329 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (19ba9b32-8e4e-4f9a-b50e-8fbd7e3433c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:04:14 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-f7670913-65c7-495c-82b1-97486f544a7a tempest-VolumesSnapshotListTestJSON-214810329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd1831bd-0c7d-450a-be95-a1c0ae925252) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:04:14 devstack cinder-volume[87272]: INFO cinder.volume.flows.manager.create_volume [None req-f7670913-65c7-495c-82b1-97486f544a7a tempest-VolumesSnapshotListTestJSON-214810329 None] Volume a9e9cdf6-eb51-4996-9768-51e631e92a0e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a9e9cdf6-eb51-4996-9768-51e631e92a0e', 'volume_size': 1} Nov 04 11:04:14 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-f7670913-65c7-495c-82b1-97486f544a7a tempest-VolumesSnapshotListTestJSON-214810329 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 11:04:14 devstack sudo[102054]: pam_unix(sudo:session): session closed for user root Nov 04 11:04:14 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-f7670913-65c7-495c-82b1-97486f544a7a tempest-VolumesSnapshotListTestJSON-214810329 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 11:04:14 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-f7670913-65c7-495c-82b1-97486f544a7a tempest-VolumesSnapshotListTestJSON-214810329 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T10:04:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-804479791',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a9e9cdf6-eb51-4996-9768-51e631e92a0e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='48bdda9e0fc9450f8381411b526eae06',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T10:04:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T10:04:14Z,use_quota=True,user_id='6596fc34c8f143ed960cb173af718b4b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8989e4f-21e3-4f0a-9584-0d818784e883),volume_type_id=f8989e4f-21e3-4f0a-9584-0d818784e883)}" {{(pid=87272) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 04 11:04:14 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.remotefs [None req-f7670913-65c7-495c-82b1-97486f544a7a tempest-VolumesSnapshotListTestJSON-214810329 None] Creating volume a9e9cdf6-eb51-4996-9768-51e631e92a0e {{(pid=87272) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 11:04:14 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-f7670913-65c7-495c-82b1-97486f544a7a tempest-VolumesSnapshotListTestJSON-214810329 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 11:04:14 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-f7670913-65c7-495c-82b1-97486f544a7a tempest-VolumesSnapshotListTestJSON-214810329 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 11:04:14 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-f7670913-65c7-495c-82b1-97486f544a7a tempest-VolumesSnapshotListTestJSON-214810329 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898': None} {{(pid=87272) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 11:04:14 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-f7670913-65c7-495c-82b1-97486f544a7a tempest-VolumesSnapshotListTestJSON-214810329 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'] {{(pid=87272) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 11:04:14 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-f7670913-65c7-495c-82b1-97486f544a7a tempest-VolumesSnapshotListTestJSON-214810329 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 11:04:14 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-f7670913-65c7-495c-82b1-97486f544a7a tempest-VolumesSnapshotListTestJSON-214810329 None] Selected osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898 as target Quobyte volume. {{(pid=87272) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 11:04:14 devstack cinder-volume[87272]: INFO cinder.volume.drivers.remotefs [None req-f7670913-65c7-495c-82b1-97486f544a7a tempest-VolumesSnapshotListTestJSON-214810329 None] casted to osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898 Nov 04 11:04:14 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-f7670913-65c7-495c-82b1-97486f544a7a tempest-VolumesSnapshotListTestJSON-214810329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-a9e9cdf6-eb51-4996-9768-51e631e92a0e 1073741824 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:04:14 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-236af0be-7f9d-4c80-b3d7-d645a9cd0dd1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1" returned: 0 in 0.354s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:04:14 devstack cinder-volume[87272]: DEBUG cinder.manager [None req-236af0be-7f9d-4c80-b3d7-d645a9cd0dd1 None None] Notifying Schedulers of capabilities ... {{(pid=87272) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 11:04:14 devstack cinder-volume[87272]: DEBUG oslo_service.periodic_task [None req-236af0be-7f9d-4c80-b3d7-d645a9cd0dd1 None None] Running periodic task VolumeManager._thread_info {{(pid=87272) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 04 11:04:14 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-236af0be-7f9d-4c80-b3d7-d645a9cd0dd1 None None] thread count: 28 {{(pid=87272) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 04 11:04:14 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-236af0be-7f9d-4c80-b3d7-d645a9cd0dd1 None None] thread info: [<_MainThread(MainThread, started 127085713244288)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87272) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 04 11:04:14 devstack sudo[102057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-a9e9cdf6-eb51-4996-9768-51e631e92a0e 1073741824 Nov 04 11:04:14 devstack sudo[102057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:04:14 devstack sudo[102057]: pam_unix(sudo:session): session closed for user root Nov 04 11:04:14 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-f7670913-65c7-495c-82b1-97486f544a7a tempest-VolumesSnapshotListTestJSON-214810329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-a9e9cdf6-eb51-4996-9768-51e631e92a0e 1073741824" returned: 0 in 0.450s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:04:14 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-f7670913-65c7-495c-82b1-97486f544a7a tempest-VolumesSnapshotListTestJSON-214810329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-a9e9cdf6-eb51-4996-9768-51e631e92a0e {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:04:15 devstack sudo[102063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-a9e9cdf6-eb51-4996-9768-51e631e92a0e Nov 04 11:04:15 devstack sudo[102063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:04:15 devstack sudo[102063]: pam_unix(sudo:session): session closed for user root Nov 04 11:04:15 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-f7670913-65c7-495c-82b1-97486f544a7a tempest-VolumesSnapshotListTestJSON-214810329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-a9e9cdf6-eb51-4996-9768-51e631e92a0e" returned: 0 in 0.237s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:04:15 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-f7670913-65c7-495c-82b1-97486f544a7a tempest-VolumesSnapshotListTestJSON-214810329 None] <== create_volume: return (729ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'} {{(pid=87272) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 04 11:04:15 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-f7670913-65c7-495c-82b1-97486f544a7a tempest-VolumesSnapshotListTestJSON-214810329 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.731s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 11:04:15 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-f7670913-65c7-495c-82b1-97486f544a7a tempest-VolumesSnapshotListTestJSON-214810329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd1831bd-0c7d-450a-be95-a1c0ae925252) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a9e9cdf6-eb51-4996-9768-51e631e92a0e', 'volume_size': 1}' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:04:15 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-f7670913-65c7-495c-82b1-97486f544a7a tempest-VolumesSnapshotListTestJSON-214810329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cca83d59-2b34-4b39-80c6-9fe544c0e1f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:04:15 devstack cinder-volume[87272]: INFO cinder.volume.flows.manager.create_volume [None req-f7670913-65c7-495c-82b1-97486f544a7a tempest-VolumesSnapshotListTestJSON-214810329 None] Volume volume-a9e9cdf6-eb51-4996-9768-51e631e92a0e (a9e9cdf6-eb51-4996-9768-51e631e92a0e): created successfully Nov 04 11:04:15 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-f7670913-65c7-495c-82b1-97486f544a7a tempest-VolumesSnapshotListTestJSON-214810329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cca83d59-2b34-4b39-80c6-9fe544c0e1f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:04:15 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-f7670913-65c7-495c-82b1-97486f544a7a tempest-VolumesSnapshotListTestJSON-214810329 None] Flow 'volume_create_manager' (059f0342-f4a2-4a1f-96d4-f8484f66be0b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87272) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 11:04:15 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-f7670913-65c7-495c-82b1-97486f544a7a tempest-VolumesSnapshotListTestJSON-214810329 None] Created volume successfully. Nov 04 11:04:15 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-809b3690-3ace-4abf-90db-8a361f675a99 tempest-SnapshotDependencyTests-1831731183 None] Acquiring lock "cinder-e07bc96f-1e59-4dda-aac0-3d51a613848c-delete_snapshot" by "delete_snapshot" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 11:04:15 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-809b3690-3ace-4abf-90db-8a361f675a99 tempest-SnapshotDependencyTests-1831731183 None] Lock "cinder-e07bc96f-1e59-4dda-aac0-3d51a613848c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 11:04:15 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-809b3690-3ace-4abf-90db-8a361f675a99 tempest-SnapshotDependencyTests-1831731183 None] Acquiring lock "cinder-quobyte-45d917ea-9407-414f-b382-da47398cb2cd" by "delete_snapshot" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 11:04:15 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-809b3690-3ace-4abf-90db-8a361f675a99 tempest-SnapshotDependencyTests-1831731183 None] Lock "cinder-quobyte-45d917ea-9407-414f-b382-da47398cb2cd" acquired by "delete_snapshot" :: waited 0.034s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 11:04:15 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-809b3690-3ace-4abf-90db-8a361f675a99 tempest-SnapshotDependencyTests-1831731183 None] Acquiring lock "cinder-quobyte-e07bc96f-1e59-4dda-aac0-3d51a613848c" by "_delete_snapshot" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 11:04:15 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-809b3690-3ace-4abf-90db-8a361f675a99 tempest-SnapshotDependencyTests-1831731183 None] Lock "cinder-quobyte-e07bc96f-1e59-4dda-aac0-3d51a613848c" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 11:04:15 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.remotefs [None req-809b3690-3ace-4abf-90db-8a361f675a99 tempest-SnapshotDependencyTests-1831731183 None] Deleting offline snapshot e07bc96f-1e59-4dda-aac0-3d51a613848c of volume 45d917ea-9407-414f-b382-da47398cb2cd {{(pid=87272) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 04 11:04:15 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.remotefs [None req-809b3690-3ace-4abf-90db-8a361f675a99 tempest-SnapshotDependencyTests-1831731183 None] snapshot_file for this snap is: volume-45d917ea-9407-414f-b382-da47398cb2cd.e07bc96f-1e59-4dda-aac0-3d51a613848c {{(pid=87272) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 04 11:04:15 devstack cinder-volume[87272]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b2e0768-b1fc-4759-8df0-7fd3a60c63c8]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 11:04:15 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-809b3690-3ace-4abf-90db-8a361f675a99 tempest-SnapshotDependencyTests-1831731183 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-45d917ea-9407-414f-b382-da47398cb2cd.e07bc96f-1e59-4dda-aac0-3d51a613848c {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:04:15 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-5113814f-eab3-4708-82ce-0ec7f84aa56e tempest-VolumesSnapshotListTestJSON-214810329 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 11:04:15 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-5113814f-eab3-4708-82ce-0ec7f84aa56e tempest-VolumesSnapshotListTestJSON-214810329 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 11:04:15 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.remotefs [None req-5113814f-eab3-4708-82ce-0ec7f84aa56e tempest-VolumesSnapshotListTestJSON-214810329 None] Creating offline snapshot f99ee97e-8748-40a0-b17c-1909f0c4dda5 of volume a9e9cdf6-eb51-4996-9768-51e631e92a0e {{(pid=87272) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 04 11:04:15 devstack sudo[102066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-45d917ea-9407-414f-b382-da47398cb2cd.e07bc96f-1e59-4dda-aac0-3d51a613848c Nov 04 11:04:15 devstack cinder-volume[87272]: DEBUG oslo.privsep.daemon [-] privsep: reply[b243b9c8-1560-4733-83f0-dce75620a8be]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 11:04:15 devstack sudo[102066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:04:15 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-5113814f-eab3-4708-82ce-0ec7f84aa56e tempest-VolumesSnapshotListTestJSON-214810329 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-a9e9cdf6-eb51-4996-9768-51e631e92a0e {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:04:15 devstack sudo[102068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-a9e9cdf6-eb51-4996-9768-51e631e92a0e Nov 04 11:04:15 devstack sudo[102068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:04:15 devstack sudo[102066]: pam_unix(sudo:session): session closed for user root Nov 04 11:04:15 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-809b3690-3ace-4abf-90db-8a361f675a99 tempest-SnapshotDependencyTests-1831731183 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-45d917ea-9407-414f-b382-da47398cb2cd.e07bc96f-1e59-4dda-aac0-3d51a613848c" returned: 0 in 0.405s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:04:15 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.remotefs [None req-809b3690-3ace-4abf-90db-8a361f675a99 tempest-SnapshotDependencyTests-1831731183 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-45d917ea-9407-414f-b382-da47398cb2cd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87272) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 11:04:16 devstack cinder-volume[87272]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddb71663-32c0-4bca-a339-eb33b3472c9b]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 11:04:16 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-809b3690-3ace-4abf-90db-8a361f675a99 tempest-SnapshotDependencyTests-1831731183 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-45d917ea-9407-414f-b382-da47398cb2cd {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:04:16 devstack sudo[102073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-45d917ea-9407-414f-b382-da47398cb2cd Nov 04 11:04:16 devstack sudo[102073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:04:16 devstack sudo[102068]: pam_unix(sudo:session): session closed for user root Nov 04 11:04:16 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-5113814f-eab3-4708-82ce-0ec7f84aa56e tempest-VolumesSnapshotListTestJSON-214810329 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-a9e9cdf6-eb51-4996-9768-51e631e92a0e" returned: 0 in 0.460s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:04:16 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-5113814f-eab3-4708-82ce-0ec7f84aa56e tempest-VolumesSnapshotListTestJSON-214810329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-a9e9cdf6-eb51-4996-9768-51e631e92a0e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-a9e9cdf6-eb51-4996-9768-51e631e92a0e.f99ee97e-8748-40a0-b17c-1909f0c4dda5 1G {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:04:16 devstack sudo[102078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-a9e9cdf6-eb51-4996-9768-51e631e92a0e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-a9e9cdf6-eb51-4996-9768-51e631e92a0e.f99ee97e-8748-40a0-b17c-1909f0c4dda5 1G Nov 04 11:04:16 devstack sudo[102078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:04:16 devstack sudo[102073]: pam_unix(sudo:session): session closed for user root Nov 04 11:04:16 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-809b3690-3ace-4abf-90db-8a361f675a99 tempest-SnapshotDependencyTests-1831731183 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-45d917ea-9407-414f-b382-da47398cb2cd" returned: 0 in 0.579s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:04:16 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-809b3690-3ace-4abf-90db-8a361f675a99 tempest-SnapshotDependencyTests-1831731183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-45d917ea-9407-414f-b382-da47398cb2cd.e07bc96f-1e59-4dda-aac0-3d51a613848c {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:04:16 devstack sudo[102078]: pam_unix(sudo:session): session closed for user root Nov 04 11:04:16 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-5113814f-eab3-4708-82ce-0ec7f84aa56e tempest-VolumesSnapshotListTestJSON-214810329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-a9e9cdf6-eb51-4996-9768-51e631e92a0e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-a9e9cdf6-eb51-4996-9768-51e631e92a0e.f99ee97e-8748-40a0-b17c-1909f0c4dda5 1G" returned: 0 in 0.453s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:04:16 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-5113814f-eab3-4708-82ce-0ec7f84aa56e tempest-VolumesSnapshotListTestJSON-214810329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a9e9cdf6-eb51-4996-9768-51e631e92a0e -F qcow2 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-a9e9cdf6-eb51-4996-9768-51e631e92a0e.f99ee97e-8748-40a0-b17c-1909f0c4dda5 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:04:16 devstack sudo[102089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-45d917ea-9407-414f-b382-da47398cb2cd.e07bc96f-1e59-4dda-aac0-3d51a613848c Nov 04 11:04:16 devstack sudo[102089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:04:16 devstack sudo[102090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a9e9cdf6-eb51-4996-9768-51e631e92a0e -F qcow2 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-a9e9cdf6-eb51-4996-9768-51e631e92a0e.f99ee97e-8748-40a0-b17c-1909f0c4dda5 Nov 04 11:04:16 devstack sudo[102090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:04:16 devstack sudo[102090]: pam_unix(sudo:session): session closed for user root Nov 04 11:04:16 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-5113814f-eab3-4708-82ce-0ec7f84aa56e tempest-VolumesSnapshotListTestJSON-214810329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a9e9cdf6-eb51-4996-9768-51e631e92a0e -F qcow2 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-a9e9cdf6-eb51-4996-9768-51e631e92a0e.f99ee97e-8748-40a0-b17c-1909f0c4dda5" returned: 0 in 0.295s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:04:16 devstack cinder-volume[87272]: WARNING cinder.volume.drivers.remotefs [None req-5113814f-eab3-4708-82ce-0ec7f84aa56e tempest-VolumesSnapshotListTestJSON-214810329 None] /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-a9e9cdf6-eb51-4996-9768-51e631e92a0e.f99ee97e-8748-40a0-b17c-1909f0c4dda5 is being set with open permissions: ugo+rw Nov 04 11:04:16 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-5113814f-eab3-4708-82ce-0ec7f84aa56e tempest-VolumesSnapshotListTestJSON-214810329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-a9e9cdf6-eb51-4996-9768-51e631e92a0e.f99ee97e-8748-40a0-b17c-1909f0c4dda5 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:04:16 devstack sudo[102099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-a9e9cdf6-eb51-4996-9768-51e631e92a0e.f99ee97e-8748-40a0-b17c-1909f0c4dda5 Nov 04 11:04:16 devstack sudo[102099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:04:16 devstack sudo[102089]: pam_unix(sudo:session): session closed for user root Nov 04 11:04:16 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-809b3690-3ace-4abf-90db-8a361f675a99 tempest-SnapshotDependencyTests-1831731183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-45d917ea-9407-414f-b382-da47398cb2cd.e07bc96f-1e59-4dda-aac0-3d51a613848c" returned: 0 in 0.351s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:04:16 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-809b3690-3ace-4abf-90db-8a361f675a99 tempest-SnapshotDependencyTests-1831731183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-45d917ea-9407-414f-b382-da47398cb2cd.e07bc96f-1e59-4dda-aac0-3d51a613848c {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:04:16 devstack sudo[102101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-45d917ea-9407-414f-b382-da47398cb2cd.e07bc96f-1e59-4dda-aac0-3d51a613848c Nov 04 11:04:16 devstack sudo[102101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:04:17 devstack sudo[102099]: pam_unix(sudo:session): session closed for user root Nov 04 11:04:17 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-5113814f-eab3-4708-82ce-0ec7f84aa56e tempest-VolumesSnapshotListTestJSON-214810329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-a9e9cdf6-eb51-4996-9768-51e631e92a0e.f99ee97e-8748-40a0-b17c-1909f0c4dda5" returned: 0 in 0.369s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:04:17 devstack sudo[102101]: pam_unix(sudo:session): session closed for user root Nov 04 11:04:17 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-809b3690-3ace-4abf-90db-8a361f675a99 tempest-SnapshotDependencyTests-1831731183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-45d917ea-9407-414f-b382-da47398cb2cd.e07bc96f-1e59-4dda-aac0-3d51a613848c" returned: 0 in 0.355s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:04:17 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-5113814f-eab3-4708-82ce-0ec7f84aa56e tempest-VolumesSnapshotListTestJSON-214810329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-a9e9cdf6-eb51-4996-9768-51e631e92a0e.info {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:04:17 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-809b3690-3ace-4abf-90db-8a361f675a99 tempest-SnapshotDependencyTests-1831731183 None] Lock "cinder-quobyte-e07bc96f-1e59-4dda-aac0-3d51a613848c" released by "_delete_snapshot" :: held 1.852s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 11:04:17 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-809b3690-3ace-4abf-90db-8a361f675a99 tempest-SnapshotDependencyTests-1831731183 None] Lock "cinder-quobyte-45d917ea-9407-414f-b382-da47398cb2cd" released by "delete_snapshot" :: held 1.886s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 11:04:17 devstack sudo[102105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-a9e9cdf6-eb51-4996-9768-51e631e92a0e.info Nov 04 11:04:17 devstack sudo[102105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:04:17 devstack cinder-volume[87272]: DEBUG cinder.quota [None req-809b3690-3ace-4abf-90db-8a361f675a99 tempest-SnapshotDependencyTests-1831731183 None] Created reservations ['2b0e3ea1-844b-4f43-acdf-12d5231a0404', 'a4df1d50-1b0f-46f7-acec-8ba1cb8f6b85', 'c0f16da4-45a3-46d3-b853-2bf6a98325f4', '00e56dba-87a7-43cc-8a48-86fb6ab8b76a'] {{(pid=87272) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 11:04:17 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-809b3690-3ace-4abf-90db-8a361f675a99 tempest-SnapshotDependencyTests-1831731183 None] Delete snapshot completed successfully. Nov 04 11:04:17 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-809b3690-3ace-4abf-90db-8a361f675a99 tempest-SnapshotDependencyTests-1831731183 None] Lock "cinder-e07bc96f-1e59-4dda-aac0-3d51a613848c-delete_snapshot" released by "delete_snapshot" :: held 2.084s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 11:04:17 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-9369a81c-bf74-4abd-87ac-f1ece8efe281 tempest-SnapshotDependencyTests-1831731183 None] Acquiring lock "cinder-45d917ea-9407-414f-b382-da47398cb2cd-delete_volume" by "delete_volume" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 11:04:17 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-9369a81c-bf74-4abd-87ac-f1ece8efe281 tempest-SnapshotDependencyTests-1831731183 None] Lock "cinder-45d917ea-9407-414f-b382-da47398cb2cd-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 11:04:17 devstack sudo[102105]: pam_unix(sudo:session): session closed for user root Nov 04 11:04:17 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-5113814f-eab3-4708-82ce-0ec7f84aa56e tempest-VolumesSnapshotListTestJSON-214810329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-a9e9cdf6-eb51-4996-9768-51e631e92a0e.info" returned: 0 in 0.354s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:04:17 devstack cinder-volume[87272]: WARNING cinder.volume.drivers.remotefs [None req-5113814f-eab3-4708-82ce-0ec7f84aa56e tempest-VolumesSnapshotListTestJSON-214810329 None] /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-a9e9cdf6-eb51-4996-9768-51e631e92a0e.info is being set with open permissions: ugo+rw Nov 04 11:04:17 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-5113814f-eab3-4708-82ce-0ec7f84aa56e tempest-VolumesSnapshotListTestJSON-214810329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-a9e9cdf6-eb51-4996-9768-51e631e92a0e.info {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:04:17 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-9369a81c-bf74-4abd-87ac-f1ece8efe281 tempest-SnapshotDependencyTests-1831731183 None] Acquiring lock "cinder-quobyte-45d917ea-9407-414f-b382-da47398cb2cd" by "delete_volume" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 11:04:17 devstack sudo[102108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-a9e9cdf6-eb51-4996-9768-51e631e92a0e.info Nov 04 11:04:17 devstack sudo[102108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:04:17 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-9369a81c-bf74-4abd-87ac-f1ece8efe281 tempest-SnapshotDependencyTests-1831731183 None] Lock "cinder-quobyte-45d917ea-9407-414f-b382-da47398cb2cd" acquired by "delete_volume" :: waited 0.015s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 11:04:17 devstack cinder-volume[87272]: DEBUG oslo.privsep.daemon [-] privsep: reply[76fc491d-94c4-47c8-992b-b554499696d7]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 11:04:17 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-9369a81c-bf74-4abd-87ac-f1ece8efe281 tempest-SnapshotDependencyTests-1831731183 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-45d917ea-9407-414f-b382-da47398cb2cd {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:04:17 devstack sudo[102110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-45d917ea-9407-414f-b382-da47398cb2cd Nov 04 11:04:17 devstack sudo[102110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:04:17 devstack sudo[102108]: pam_unix(sudo:session): session closed for user root Nov 04 11:04:17 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-5113814f-eab3-4708-82ce-0ec7f84aa56e tempest-VolumesSnapshotListTestJSON-214810329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-a9e9cdf6-eb51-4996-9768-51e631e92a0e.info" returned: 0 in 0.260s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:04:17 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-5113814f-eab3-4708-82ce-0ec7f84aa56e tempest-VolumesSnapshotListTestJSON-214810329 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.332s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 11:04:18 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-5113814f-eab3-4708-82ce-0ec7f84aa56e tempest-VolumesSnapshotListTestJSON-214810329 None] Create snapshot completed successfully Nov 04 11:04:18 devstack sudo[102110]: pam_unix(sudo:session): session closed for user root Nov 04 11:04:18 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-9369a81c-bf74-4abd-87ac-f1ece8efe281 tempest-SnapshotDependencyTests-1831731183 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-45d917ea-9407-414f-b382-da47398cb2cd" returned: 0 in 0.404s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:04:18 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-9369a81c-bf74-4abd-87ac-f1ece8efe281 tempest-SnapshotDependencyTests-1831731183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-45d917ea-9407-414f-b382-da47398cb2cd {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:04:18 devstack sudo[102116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-45d917ea-9407-414f-b382-da47398cb2cd Nov 04 11:04:18 devstack sudo[102116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:04:18 devstack sudo[102116]: pam_unix(sudo:session): session closed for user root Nov 04 11:04:18 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-9369a81c-bf74-4abd-87ac-f1ece8efe281 tempest-SnapshotDependencyTests-1831731183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-45d917ea-9407-414f-b382-da47398cb2cd" returned: 0 in 0.235s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:04:18 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-9369a81c-bf74-4abd-87ac-f1ece8efe281 tempest-SnapshotDependencyTests-1831731183 None] Lock "cinder-quobyte-45d917ea-9407-414f-b382-da47398cb2cd" released by "delete_volume" :: held 0.714s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 11:04:18 devstack cinder-volume[87272]: DEBUG cinder.quota [None req-9369a81c-bf74-4abd-87ac-f1ece8efe281 tempest-SnapshotDependencyTests-1831731183 None] Created reservations ['9ec4ac1b-1624-4b89-9457-0a1229a6a079', '16ad1565-4974-47d2-a3c3-bfc7421b84bf', '24900b11-cd97-425f-8aa6-cd144300bcea', 'ef40bd49-3fd3-449b-a454-35e33a7ed6d1'] {{(pid=87272) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 11:04:18 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-9369a81c-bf74-4abd-87ac-f1ece8efe281 tempest-SnapshotDependencyTests-1831731183 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 11:04:18 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-9369a81c-bf74-4abd-87ac-f1ece8efe281 tempest-SnapshotDependencyTests-1831731183 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 11:04:18 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-9369a81c-bf74-4abd-87ac-f1ece8efe281 tempest-SnapshotDependencyTests-1831731183 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898': None} {{(pid=87272) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 11:04:18 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-9369a81c-bf74-4abd-87ac-f1ece8efe281 tempest-SnapshotDependencyTests-1831731183 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'] {{(pid=87272) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 11:04:18 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-9369a81c-bf74-4abd-87ac-f1ece8efe281 tempest-SnapshotDependencyTests-1831731183 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 11:04:18 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-9369a81c-bf74-4abd-87ac-f1ece8efe281 tempest-SnapshotDependencyTests-1831731183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:04:18 devstack sudo[102119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1 Nov 04 11:04:18 devstack sudo[102119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:04:18 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-c0b4cacb-6be8-4705-80c3-548962f9db04 tempest-SnapshotDependencyTests-1831731183 None] Acquiring lock "cinder-5aeada47-73a5-46c6-9824-e71e23d80eef-delete_volume" by "delete_volume" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 11:04:18 devstack sudo[102119]: pam_unix(sudo:session): session closed for user root Nov 04 11:04:18 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-9369a81c-bf74-4abd-87ac-f1ece8efe281 tempest-SnapshotDependencyTests-1831731183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1" returned: 0 in 0.255s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:04:18 devstack cinder-volume[87272]: DEBUG cinder.manager [None req-9369a81c-bf74-4abd-87ac-f1ece8efe281 tempest-SnapshotDependencyTests-1831731183 None] Notifying Schedulers of capabilities ... {{(pid=87272) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 11:04:18 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-9369a81c-bf74-4abd-87ac-f1ece8efe281 tempest-SnapshotDependencyTests-1831731183 None] Deleted volume successfully. Nov 04 11:04:18 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-c0b4cacb-6be8-4705-80c3-548962f9db04 tempest-SnapshotDependencyTests-1831731183 None] Lock "cinder-5aeada47-73a5-46c6-9824-e71e23d80eef-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 11:04:18 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-9369a81c-bf74-4abd-87ac-f1ece8efe281 tempest-SnapshotDependencyTests-1831731183 None] Lock "cinder-45d917ea-9407-414f-b382-da47398cb2cd-delete_volume" released by "delete_volume" :: held 1.239s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 11:04:18 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-c0b4cacb-6be8-4705-80c3-548962f9db04 tempest-SnapshotDependencyTests-1831731183 None] Acquiring lock "cinder-quobyte-5aeada47-73a5-46c6-9824-e71e23d80eef" by "delete_volume" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 11:04:18 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-c0b4cacb-6be8-4705-80c3-548962f9db04 tempest-SnapshotDependencyTests-1831731183 None] Lock "cinder-quobyte-5aeada47-73a5-46c6-9824-e71e23d80eef" acquired by "delete_volume" :: waited 0.019s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 11:04:18 devstack cinder-volume[87272]: DEBUG oslo.privsep.daemon [-] privsep: reply[35cc3ee0-549c-4e7d-a150-5fbae899089d]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 11:04:18 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-c0b4cacb-6be8-4705-80c3-548962f9db04 tempest-SnapshotDependencyTests-1831731183 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-5aeada47-73a5-46c6-9824-e71e23d80eef {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:04:19 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-8284ea14-8e72-4da4-afce-69cdba37c175 tempest-VolumesSnapshotListTestJSON-214810329 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 11:04:19 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-8284ea14-8e72-4da4-afce-69cdba37c175 tempest-VolumesSnapshotListTestJSON-214810329 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 11:04:19 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.remotefs [None req-8284ea14-8e72-4da4-afce-69cdba37c175 tempest-VolumesSnapshotListTestJSON-214810329 None] Creating offline snapshot 263711d4-2cf3-4dd4-aeeb-5aa23b97aa6e of volume a9e9cdf6-eb51-4996-9768-51e631e92a0e {{(pid=87272) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 04 11:04:19 devstack sudo[102122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-5aeada47-73a5-46c6-9824-e71e23d80eef Nov 04 11:04:19 devstack sudo[102122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:04:19 devstack cinder-volume[87272]: DEBUG oslo.privsep.daemon [-] privsep: reply[553ef3e7-b7a2-4320-80e2-c926f2a4672a]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 11:04:19 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-8284ea14-8e72-4da4-afce-69cdba37c175 tempest-VolumesSnapshotListTestJSON-214810329 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-a9e9cdf6-eb51-4996-9768-51e631e92a0e.f99ee97e-8748-40a0-b17c-1909f0c4dda5 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:04:19 devstack sudo[102124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-a9e9cdf6-eb51-4996-9768-51e631e92a0e.f99ee97e-8748-40a0-b17c-1909f0c4dda5 Nov 04 11:04:19 devstack sudo[102124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:04:19 devstack sudo[102122]: pam_unix(sudo:session): session closed for user root Nov 04 11:04:19 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-c0b4cacb-6be8-4705-80c3-548962f9db04 tempest-SnapshotDependencyTests-1831731183 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-5aeada47-73a5-46c6-9824-e71e23d80eef" returned: 0 in 0.468s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:04:19 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-c0b4cacb-6be8-4705-80c3-548962f9db04 tempest-SnapshotDependencyTests-1831731183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-5aeada47-73a5-46c6-9824-e71e23d80eef {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:04:19 devstack sudo[102129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-5aeada47-73a5-46c6-9824-e71e23d80eef Nov 04 11:04:19 devstack sudo[102129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:04:19 devstack sudo[102124]: pam_unix(sudo:session): session closed for user root Nov 04 11:04:19 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-8284ea14-8e72-4da4-afce-69cdba37c175 tempest-VolumesSnapshotListTestJSON-214810329 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-a9e9cdf6-eb51-4996-9768-51e631e92a0e.f99ee97e-8748-40a0-b17c-1909f0c4dda5" returned: 0 in 0.418s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:04:19 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.remotefs [None req-8284ea14-8e72-4da4-afce-69cdba37c175 tempest-VolumesSnapshotListTestJSON-214810329 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a9e9cdf6-eb51-4996-9768-51e631e92a0e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87272) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 11:04:19 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-8284ea14-8e72-4da4-afce-69cdba37c175 tempest-VolumesSnapshotListTestJSON-214810329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-a9e9cdf6-eb51-4996-9768-51e631e92a0e.f99ee97e-8748-40a0-b17c-1909f0c4dda5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-a9e9cdf6-eb51-4996-9768-51e631e92a0e.263711d4-2cf3-4dd4-aeeb-5aa23b97aa6e 1G {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:04:19 devstack sudo[102134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-a9e9cdf6-eb51-4996-9768-51e631e92a0e.f99ee97e-8748-40a0-b17c-1909f0c4dda5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-a9e9cdf6-eb51-4996-9768-51e631e92a0e.263711d4-2cf3-4dd4-aeeb-5aa23b97aa6e 1G Nov 04 11:04:19 devstack sudo[102134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:04:19 devstack sudo[102129]: pam_unix(sudo:session): session closed for user root Nov 04 11:04:19 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-c0b4cacb-6be8-4705-80c3-548962f9db04 tempest-SnapshotDependencyTests-1831731183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-5aeada47-73a5-46c6-9824-e71e23d80eef" returned: 0 in 0.291s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:04:19 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-c0b4cacb-6be8-4705-80c3-548962f9db04 tempest-SnapshotDependencyTests-1831731183 None] Lock "cinder-quobyte-5aeada47-73a5-46c6-9824-e71e23d80eef" released by "delete_volume" :: held 0.819s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 11:04:19 devstack cinder-volume[87272]: DEBUG cinder.quota [None req-c0b4cacb-6be8-4705-80c3-548962f9db04 tempest-SnapshotDependencyTests-1831731183 None] Created reservations ['4e8a840f-0a2d-4cca-9c8d-4da267bf7d56', '190b39bc-ebfa-4376-8e2f-08e62b897bad', 'a01ac3a7-2fb2-4065-8b1e-e7dd23a36591', '00a1ef9e-ad4c-4326-b980-95727c914aab'] {{(pid=87272) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 11:04:19 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-c0b4cacb-6be8-4705-80c3-548962f9db04 tempest-SnapshotDependencyTests-1831731183 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 11:04:19 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-c0b4cacb-6be8-4705-80c3-548962f9db04 tempest-SnapshotDependencyTests-1831731183 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 11:04:19 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-c0b4cacb-6be8-4705-80c3-548962f9db04 tempest-SnapshotDependencyTests-1831731183 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898': None} {{(pid=87272) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 11:04:19 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-c0b4cacb-6be8-4705-80c3-548962f9db04 tempest-SnapshotDependencyTests-1831731183 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'] {{(pid=87272) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 11:04:19 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-c0b4cacb-6be8-4705-80c3-548962f9db04 tempest-SnapshotDependencyTests-1831731183 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 11:04:19 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-c0b4cacb-6be8-4705-80c3-548962f9db04 tempest-SnapshotDependencyTests-1831731183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:04:19 devstack sudo[102140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1 Nov 04 11:04:19 devstack sudo[102140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:04:20 devstack sudo[102134]: pam_unix(sudo:session): session closed for user root Nov 04 11:04:20 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-8284ea14-8e72-4da4-afce-69cdba37c175 tempest-VolumesSnapshotListTestJSON-214810329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-a9e9cdf6-eb51-4996-9768-51e631e92a0e.f99ee97e-8748-40a0-b17c-1909f0c4dda5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-a9e9cdf6-eb51-4996-9768-51e631e92a0e.263711d4-2cf3-4dd4-aeeb-5aa23b97aa6e 1G" returned: 0 in 0.630s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:04:20 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-8284ea14-8e72-4da4-afce-69cdba37c175 tempest-VolumesSnapshotListTestJSON-214810329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a9e9cdf6-eb51-4996-9768-51e631e92a0e.f99ee97e-8748-40a0-b17c-1909f0c4dda5 -F qcow2 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-a9e9cdf6-eb51-4996-9768-51e631e92a0e.263711d4-2cf3-4dd4-aeeb-5aa23b97aa6e {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:04:20 devstack sudo[102140]: pam_unix(sudo:session): session closed for user root Nov 04 11:04:20 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-c0b4cacb-6be8-4705-80c3-548962f9db04 tempest-SnapshotDependencyTests-1831731183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1" returned: 0 in 0.351s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:04:20 devstack cinder-volume[87272]: DEBUG cinder.manager [None req-c0b4cacb-6be8-4705-80c3-548962f9db04 tempest-SnapshotDependencyTests-1831731183 None] Notifying Schedulers of capabilities ... {{(pid=87272) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 11:04:20 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-c0b4cacb-6be8-4705-80c3-548962f9db04 tempest-SnapshotDependencyTests-1831731183 None] Deleted volume successfully. Nov 04 11:04:20 devstack sudo[102144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a9e9cdf6-eb51-4996-9768-51e631e92a0e.f99ee97e-8748-40a0-b17c-1909f0c4dda5 -F qcow2 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-a9e9cdf6-eb51-4996-9768-51e631e92a0e.263711d4-2cf3-4dd4-aeeb-5aa23b97aa6e Nov 04 11:04:20 devstack sudo[102144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:04:20 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-c0b4cacb-6be8-4705-80c3-548962f9db04 tempest-SnapshotDependencyTests-1831731183 None] Lock "cinder-5aeada47-73a5-46c6-9824-e71e23d80eef-delete_volume" released by "delete_volume" :: held 1.454s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 11:04:20 devstack sudo[102144]: pam_unix(sudo:session): session closed for user root Nov 04 11:04:20 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-8284ea14-8e72-4da4-afce-69cdba37c175 tempest-VolumesSnapshotListTestJSON-214810329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a9e9cdf6-eb51-4996-9768-51e631e92a0e.f99ee97e-8748-40a0-b17c-1909f0c4dda5 -F qcow2 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-a9e9cdf6-eb51-4996-9768-51e631e92a0e.263711d4-2cf3-4dd4-aeeb-5aa23b97aa6e" returned: 0 in 0.338s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:04:20 devstack cinder-volume[87272]: WARNING cinder.volume.drivers.remotefs [None req-8284ea14-8e72-4da4-afce-69cdba37c175 tempest-VolumesSnapshotListTestJSON-214810329 None] /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-a9e9cdf6-eb51-4996-9768-51e631e92a0e.263711d4-2cf3-4dd4-aeeb-5aa23b97aa6e is being set with open permissions: ugo+rw Nov 04 11:04:20 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-8284ea14-8e72-4da4-afce-69cdba37c175 tempest-VolumesSnapshotListTestJSON-214810329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-a9e9cdf6-eb51-4996-9768-51e631e92a0e.263711d4-2cf3-4dd4-aeeb-5aa23b97aa6e {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:04:20 devstack sudo[102149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-a9e9cdf6-eb51-4996-9768-51e631e92a0e.263711d4-2cf3-4dd4-aeeb-5aa23b97aa6e Nov 04 11:04:20 devstack sudo[102149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:04:20 devstack sudo[102149]: pam_unix(sudo:session): session closed for user root Nov 04 11:04:20 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-8284ea14-8e72-4da4-afce-69cdba37c175 tempest-VolumesSnapshotListTestJSON-214810329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-a9e9cdf6-eb51-4996-9768-51e631e92a0e.263711d4-2cf3-4dd4-aeeb-5aa23b97aa6e" returned: 0 in 0.272s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:04:20 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-8284ea14-8e72-4da4-afce-69cdba37c175 tempest-VolumesSnapshotListTestJSON-214810329 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.809s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 11:04:20 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-8284ea14-8e72-4da4-afce-69cdba37c175 tempest-VolumesSnapshotListTestJSON-214810329 None] Create snapshot completed successfully Nov 04 11:04:21 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-d71e67ee-546a-4529-a225-818de46952cb tempest-VolumesSnapshotListTestJSON-214810329 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 11:04:21 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-d71e67ee-546a-4529-a225-818de46952cb tempest-VolumesSnapshotListTestJSON-214810329 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 11:04:21 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.remotefs [None req-d71e67ee-546a-4529-a225-818de46952cb tempest-VolumesSnapshotListTestJSON-214810329 None] Creating offline snapshot 371f5990-e7ae-4dbd-846c-b4f0a16c6a58 of volume a9e9cdf6-eb51-4996-9768-51e631e92a0e {{(pid=87272) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 04 11:04:21 devstack cinder-volume[87272]: DEBUG oslo.privsep.daemon [-] privsep: reply[d67c61e4-0d18-4d8f-bf04-c7136e508e90]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 11:04:21 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-d71e67ee-546a-4529-a225-818de46952cb tempest-VolumesSnapshotListTestJSON-214810329 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-a9e9cdf6-eb51-4996-9768-51e631e92a0e.263711d4-2cf3-4dd4-aeeb-5aa23b97aa6e {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:04:21 devstack sudo[102158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-a9e9cdf6-eb51-4996-9768-51e631e92a0e.263711d4-2cf3-4dd4-aeeb-5aa23b97aa6e Nov 04 11:04:21 devstack sudo[102158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:04:21 devstack sudo[102158]: pam_unix(sudo:session): session closed for user root Nov 04 11:04:21 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-d71e67ee-546a-4529-a225-818de46952cb tempest-VolumesSnapshotListTestJSON-214810329 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-a9e9cdf6-eb51-4996-9768-51e631e92a0e.263711d4-2cf3-4dd4-aeeb-5aa23b97aa6e" returned: 0 in 0.440s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:04:21 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.remotefs [None req-d71e67ee-546a-4529-a225-818de46952cb tempest-VolumesSnapshotListTestJSON-214810329 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a9e9cdf6-eb51-4996-9768-51e631e92a0e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87272) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 11:04:21 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-d71e67ee-546a-4529-a225-818de46952cb tempest-VolumesSnapshotListTestJSON-214810329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-a9e9cdf6-eb51-4996-9768-51e631e92a0e.263711d4-2cf3-4dd4-aeeb-5aa23b97aa6e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-a9e9cdf6-eb51-4996-9768-51e631e92a0e.371f5990-e7ae-4dbd-846c-b4f0a16c6a58 1G {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:04:21 devstack sudo[102165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-a9e9cdf6-eb51-4996-9768-51e631e92a0e.263711d4-2cf3-4dd4-aeeb-5aa23b97aa6e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-a9e9cdf6-eb51-4996-9768-51e631e92a0e.371f5990-e7ae-4dbd-846c-b4f0a16c6a58 1G Nov 04 11:04:21 devstack sudo[102165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:04:22 devstack sudo[102165]: pam_unix(sudo:session): session closed for user root Nov 04 11:04:22 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-d71e67ee-546a-4529-a225-818de46952cb tempest-VolumesSnapshotListTestJSON-214810329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-a9e9cdf6-eb51-4996-9768-51e631e92a0e.263711d4-2cf3-4dd4-aeeb-5aa23b97aa6e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-a9e9cdf6-eb51-4996-9768-51e631e92a0e.371f5990-e7ae-4dbd-846c-b4f0a16c6a58 1G" returned: 0 in 0.593s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:04:22 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-d71e67ee-546a-4529-a225-818de46952cb tempest-VolumesSnapshotListTestJSON-214810329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a9e9cdf6-eb51-4996-9768-51e631e92a0e.263711d4-2cf3-4dd4-aeeb-5aa23b97aa6e -F qcow2 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-a9e9cdf6-eb51-4996-9768-51e631e92a0e.371f5990-e7ae-4dbd-846c-b4f0a16c6a58 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:04:22 devstack sudo[102171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a9e9cdf6-eb51-4996-9768-51e631e92a0e.263711d4-2cf3-4dd4-aeeb-5aa23b97aa6e -F qcow2 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-a9e9cdf6-eb51-4996-9768-51e631e92a0e.371f5990-e7ae-4dbd-846c-b4f0a16c6a58 Nov 04 11:04:22 devstack sudo[102171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:04:22 devstack sudo[102171]: pam_unix(sudo:session): session closed for user root Nov 04 11:04:22 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-d71e67ee-546a-4529-a225-818de46952cb tempest-VolumesSnapshotListTestJSON-214810329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a9e9cdf6-eb51-4996-9768-51e631e92a0e.263711d4-2cf3-4dd4-aeeb-5aa23b97aa6e -F qcow2 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-a9e9cdf6-eb51-4996-9768-51e631e92a0e.371f5990-e7ae-4dbd-846c-b4f0a16c6a58" returned: 0 in 0.312s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:04:22 devstack cinder-volume[87272]: WARNING cinder.volume.drivers.remotefs [None req-d71e67ee-546a-4529-a225-818de46952cb tempest-VolumesSnapshotListTestJSON-214810329 None] /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-a9e9cdf6-eb51-4996-9768-51e631e92a0e.371f5990-e7ae-4dbd-846c-b4f0a16c6a58 is being set with open permissions: ugo+rw Nov 04 11:04:22 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-d71e67ee-546a-4529-a225-818de46952cb tempest-VolumesSnapshotListTestJSON-214810329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-a9e9cdf6-eb51-4996-9768-51e631e92a0e.371f5990-e7ae-4dbd-846c-b4f0a16c6a58 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:04:22 devstack sudo[102177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-a9e9cdf6-eb51-4996-9768-51e631e92a0e.371f5990-e7ae-4dbd-846c-b4f0a16c6a58 Nov 04 11:04:22 devstack sudo[102177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:04:23 devstack sudo[102177]: pam_unix(sudo:session): session closed for user root Nov 04 11:04:23 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-d71e67ee-546a-4529-a225-818de46952cb tempest-VolumesSnapshotListTestJSON-214810329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-a9e9cdf6-eb51-4996-9768-51e631e92a0e.371f5990-e7ae-4dbd-846c-b4f0a16c6a58" returned: 0 in 0.302s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:04:23 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-d71e67ee-546a-4529-a225-818de46952cb tempest-VolumesSnapshotListTestJSON-214810329 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.807s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 11:04:23 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-d71e67ee-546a-4529-a225-818de46952cb tempest-VolumesSnapshotListTestJSON-214810329 None] Create snapshot completed successfully Nov 04 11:04:24 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-1b8d9600-9590-4c2d-9d4a-8262bdb2c2b3 tempest-VolumesSnapshotListTestJSON-214810329 None] Acquiring lock "cinder-371f5990-e7ae-4dbd-846c-b4f0a16c6a58-delete_snapshot" by "delete_snapshot" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 11:04:24 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-1b8d9600-9590-4c2d-9d4a-8262bdb2c2b3 tempest-VolumesSnapshotListTestJSON-214810329 None] Lock "cinder-371f5990-e7ae-4dbd-846c-b4f0a16c6a58-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 11:04:24 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-1b8d9600-9590-4c2d-9d4a-8262bdb2c2b3 tempest-VolumesSnapshotListTestJSON-214810329 None] Acquiring lock "cinder-quobyte-a9e9cdf6-eb51-4996-9768-51e631e92a0e" by "delete_snapshot" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 11:04:24 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-1b8d9600-9590-4c2d-9d4a-8262bdb2c2b3 tempest-VolumesSnapshotListTestJSON-214810329 None] Lock "cinder-quobyte-a9e9cdf6-eb51-4996-9768-51e631e92a0e" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 11:04:24 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-1b8d9600-9590-4c2d-9d4a-8262bdb2c2b3 tempest-VolumesSnapshotListTestJSON-214810329 None] Acquiring lock "cinder-quobyte-371f5990-e7ae-4dbd-846c-b4f0a16c6a58" by "_delete_snapshot" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 11:04:24 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-1b8d9600-9590-4c2d-9d4a-8262bdb2c2b3 tempest-VolumesSnapshotListTestJSON-214810329 None] Lock "cinder-quobyte-371f5990-e7ae-4dbd-846c-b4f0a16c6a58" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 11:04:24 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.remotefs [None req-1b8d9600-9590-4c2d-9d4a-8262bdb2c2b3 tempest-VolumesSnapshotListTestJSON-214810329 None] Deleting offline snapshot 371f5990-e7ae-4dbd-846c-b4f0a16c6a58 of volume a9e9cdf6-eb51-4996-9768-51e631e92a0e {{(pid=87272) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 04 11:04:24 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.remotefs [None req-1b8d9600-9590-4c2d-9d4a-8262bdb2c2b3 tempest-VolumesSnapshotListTestJSON-214810329 None] snapshot_file for this snap is: volume-a9e9cdf6-eb51-4996-9768-51e631e92a0e.371f5990-e7ae-4dbd-846c-b4f0a16c6a58 {{(pid=87272) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 04 11:04:24 devstack cinder-volume[87272]: DEBUG oslo.privsep.daemon [-] privsep: reply[af369462-c490-4c50-8256-67e0ebefd062]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 11:04:24 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-1b8d9600-9590-4c2d-9d4a-8262bdb2c2b3 tempest-VolumesSnapshotListTestJSON-214810329 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-a9e9cdf6-eb51-4996-9768-51e631e92a0e.371f5990-e7ae-4dbd-846c-b4f0a16c6a58 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:04:24 devstack sudo[102180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-a9e9cdf6-eb51-4996-9768-51e631e92a0e.371f5990-e7ae-4dbd-846c-b4f0a16c6a58 Nov 04 11:04:24 devstack sudo[102180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:04:25 devstack sudo[102180]: pam_unix(sudo:session): session closed for user root Nov 04 11:04:25 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-1b8d9600-9590-4c2d-9d4a-8262bdb2c2b3 tempest-VolumesSnapshotListTestJSON-214810329 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-a9e9cdf6-eb51-4996-9768-51e631e92a0e.371f5990-e7ae-4dbd-846c-b4f0a16c6a58" returned: 0 in 0.557s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:04:25 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.remotefs [None req-1b8d9600-9590-4c2d-9d4a-8262bdb2c2b3 tempest-VolumesSnapshotListTestJSON-214810329 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a9e9cdf6-eb51-4996-9768-51e631e92a0e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87272) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 11:04:25 devstack cinder-volume[87272]: DEBUG oslo.privsep.daemon [-] privsep: reply[db428e6c-b9ad-4b46-a191-626645528acf]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 11:04:25 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-1b8d9600-9590-4c2d-9d4a-8262bdb2c2b3 tempest-VolumesSnapshotListTestJSON-214810329 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-a9e9cdf6-eb51-4996-9768-51e631e92a0e.263711d4-2cf3-4dd4-aeeb-5aa23b97aa6e {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:04:25 devstack sudo[102189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-a9e9cdf6-eb51-4996-9768-51e631e92a0e.263711d4-2cf3-4dd4-aeeb-5aa23b97aa6e Nov 04 11:04:25 devstack sudo[102189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:04:25 devstack sudo[102189]: pam_unix(sudo:session): session closed for user root Nov 04 11:04:25 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-1b8d9600-9590-4c2d-9d4a-8262bdb2c2b3 tempest-VolumesSnapshotListTestJSON-214810329 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-a9e9cdf6-eb51-4996-9768-51e631e92a0e.263711d4-2cf3-4dd4-aeeb-5aa23b97aa6e" returned: 0 in 0.456s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:04:25 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.remotefs [None req-1b8d9600-9590-4c2d-9d4a-8262bdb2c2b3 tempest-VolumesSnapshotListTestJSON-214810329 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a9e9cdf6-eb51-4996-9768-51e631e92a0e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87272) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 11:04:25 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-1b8d9600-9590-4c2d-9d4a-8262bdb2c2b3 tempest-VolumesSnapshotListTestJSON-214810329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-a9e9cdf6-eb51-4996-9768-51e631e92a0e.371f5990-e7ae-4dbd-846c-b4f0a16c6a58 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:04:25 devstack sudo[102195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-a9e9cdf6-eb51-4996-9768-51e631e92a0e.371f5990-e7ae-4dbd-846c-b4f0a16c6a58 Nov 04 11:04:25 devstack sudo[102195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:04:26 devstack sudo[102195]: pam_unix(sudo:session): session closed for user root Nov 04 11:04:26 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-1b8d9600-9590-4c2d-9d4a-8262bdb2c2b3 tempest-VolumesSnapshotListTestJSON-214810329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-a9e9cdf6-eb51-4996-9768-51e631e92a0e.371f5990-e7ae-4dbd-846c-b4f0a16c6a58" returned: 0 in 0.494s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:04:26 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-1b8d9600-9590-4c2d-9d4a-8262bdb2c2b3 tempest-VolumesSnapshotListTestJSON-214810329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-a9e9cdf6-eb51-4996-9768-51e631e92a0e.371f5990-e7ae-4dbd-846c-b4f0a16c6a58 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:04:26 devstack sudo[102201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-a9e9cdf6-eb51-4996-9768-51e631e92a0e.371f5990-e7ae-4dbd-846c-b4f0a16c6a58 Nov 04 11:04:26 devstack sudo[102201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:04:26 devstack sudo[102201]: pam_unix(sudo:session): session closed for user root Nov 04 11:04:26 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-1b8d9600-9590-4c2d-9d4a-8262bdb2c2b3 tempest-VolumesSnapshotListTestJSON-214810329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-a9e9cdf6-eb51-4996-9768-51e631e92a0e.371f5990-e7ae-4dbd-846c-b4f0a16c6a58" returned: 0 in 0.258s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:04:26 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-1b8d9600-9590-4c2d-9d4a-8262bdb2c2b3 tempest-VolumesSnapshotListTestJSON-214810329 None] Lock "cinder-quobyte-371f5990-e7ae-4dbd-846c-b4f0a16c6a58" released by "_delete_snapshot" :: held 1.903s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 11:04:26 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-1b8d9600-9590-4c2d-9d4a-8262bdb2c2b3 tempest-VolumesSnapshotListTestJSON-214810329 None] Lock "cinder-quobyte-a9e9cdf6-eb51-4996-9768-51e631e92a0e" released by "delete_snapshot" :: held 1.933s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 11:04:26 devstack cinder-volume[87272]: DEBUG cinder.quota [None req-1b8d9600-9590-4c2d-9d4a-8262bdb2c2b3 tempest-VolumesSnapshotListTestJSON-214810329 None] Created reservations ['700f219b-b2cb-4df7-b539-65a0e1712b36', '2b48438f-3cb6-4c7d-ad5b-980fee317d66', 'b530f805-1493-4275-9236-3e3dc04a4b1e', 'a869023c-3df7-4ef2-912e-27d7958ed7a3'] {{(pid=87272) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 11:04:26 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-1b8d9600-9590-4c2d-9d4a-8262bdb2c2b3 tempest-VolumesSnapshotListTestJSON-214810329 None] Delete snapshot completed successfully. Nov 04 11:04:26 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-1b8d9600-9590-4c2d-9d4a-8262bdb2c2b3 tempest-VolumesSnapshotListTestJSON-214810329 None] Lock "cinder-371f5990-e7ae-4dbd-846c-b4f0a16c6a58-delete_snapshot" released by "delete_snapshot" :: held 2.123s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 11:04:26 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-0f7ba022-fe38-468d-b79f-99997ffae78a tempest-VolumesSnapshotListTestJSON-214810329 None] Acquiring lock "cinder-263711d4-2cf3-4dd4-aeeb-5aa23b97aa6e-delete_snapshot" by "delete_snapshot" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 11:04:26 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-0f7ba022-fe38-468d-b79f-99997ffae78a tempest-VolumesSnapshotListTestJSON-214810329 None] Lock "cinder-263711d4-2cf3-4dd4-aeeb-5aa23b97aa6e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 11:04:26 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-0f7ba022-fe38-468d-b79f-99997ffae78a tempest-VolumesSnapshotListTestJSON-214810329 None] Acquiring lock "cinder-quobyte-a9e9cdf6-eb51-4996-9768-51e631e92a0e" by "delete_snapshot" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 11:04:26 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-0f7ba022-fe38-468d-b79f-99997ffae78a tempest-VolumesSnapshotListTestJSON-214810329 None] Lock "cinder-quobyte-a9e9cdf6-eb51-4996-9768-51e631e92a0e" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 11:04:26 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-0f7ba022-fe38-468d-b79f-99997ffae78a tempest-VolumesSnapshotListTestJSON-214810329 None] Acquiring lock "cinder-quobyte-263711d4-2cf3-4dd4-aeeb-5aa23b97aa6e" by "_delete_snapshot" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 11:04:26 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-0f7ba022-fe38-468d-b79f-99997ffae78a tempest-VolumesSnapshotListTestJSON-214810329 None] Lock "cinder-quobyte-263711d4-2cf3-4dd4-aeeb-5aa23b97aa6e" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 11:04:26 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.remotefs [None req-0f7ba022-fe38-468d-b79f-99997ffae78a tempest-VolumesSnapshotListTestJSON-214810329 None] Deleting offline snapshot 263711d4-2cf3-4dd4-aeeb-5aa23b97aa6e of volume a9e9cdf6-eb51-4996-9768-51e631e92a0e {{(pid=87272) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 04 11:04:27 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.remotefs [None req-0f7ba022-fe38-468d-b79f-99997ffae78a tempest-VolumesSnapshotListTestJSON-214810329 None] snapshot_file for this snap is: volume-a9e9cdf6-eb51-4996-9768-51e631e92a0e.263711d4-2cf3-4dd4-aeeb-5aa23b97aa6e {{(pid=87272) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 04 11:04:27 devstack cinder-volume[87272]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6d5fa6d-6cad-48bf-9015-28018376c057]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 11:04:27 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-0f7ba022-fe38-468d-b79f-99997ffae78a tempest-VolumesSnapshotListTestJSON-214810329 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-a9e9cdf6-eb51-4996-9768-51e631e92a0e.263711d4-2cf3-4dd4-aeeb-5aa23b97aa6e {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:04:27 devstack sudo[102206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-a9e9cdf6-eb51-4996-9768-51e631e92a0e.263711d4-2cf3-4dd4-aeeb-5aa23b97aa6e Nov 04 11:04:27 devstack sudo[102206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:04:27 devstack sudo[102206]: pam_unix(sudo:session): session closed for user root Nov 04 11:04:27 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-0f7ba022-fe38-468d-b79f-99997ffae78a tempest-VolumesSnapshotListTestJSON-214810329 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-a9e9cdf6-eb51-4996-9768-51e631e92a0e.263711d4-2cf3-4dd4-aeeb-5aa23b97aa6e" returned: 0 in 0.448s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:04:27 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.remotefs [None req-0f7ba022-fe38-468d-b79f-99997ffae78a tempest-VolumesSnapshotListTestJSON-214810329 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a9e9cdf6-eb51-4996-9768-51e631e92a0e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87272) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 11:04:27 devstack cinder-volume[87272]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb2501df-688c-45b1-9445-0172b3ba4c09]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 11:04:27 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-0f7ba022-fe38-468d-b79f-99997ffae78a tempest-VolumesSnapshotListTestJSON-214810329 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-a9e9cdf6-eb51-4996-9768-51e631e92a0e.f99ee97e-8748-40a0-b17c-1909f0c4dda5 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:04:27 devstack sudo[102211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-a9e9cdf6-eb51-4996-9768-51e631e92a0e.f99ee97e-8748-40a0-b17c-1909f0c4dda5 Nov 04 11:04:27 devstack sudo[102211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:04:27 devstack sudo[102211]: pam_unix(sudo:session): session closed for user root Nov 04 11:04:28 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-0f7ba022-fe38-468d-b79f-99997ffae78a tempest-VolumesSnapshotListTestJSON-214810329 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-a9e9cdf6-eb51-4996-9768-51e631e92a0e.f99ee97e-8748-40a0-b17c-1909f0c4dda5" returned: 0 in 0.473s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:04:28 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.remotefs [None req-0f7ba022-fe38-468d-b79f-99997ffae78a tempest-VolumesSnapshotListTestJSON-214810329 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a9e9cdf6-eb51-4996-9768-51e631e92a0e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87272) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 11:04:28 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-0f7ba022-fe38-468d-b79f-99997ffae78a tempest-VolumesSnapshotListTestJSON-214810329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-a9e9cdf6-eb51-4996-9768-51e631e92a0e.263711d4-2cf3-4dd4-aeeb-5aa23b97aa6e {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:04:28 devstack sudo[102216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-a9e9cdf6-eb51-4996-9768-51e631e92a0e.263711d4-2cf3-4dd4-aeeb-5aa23b97aa6e Nov 04 11:04:28 devstack sudo[102216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:04:28 devstack cinder-volume[87272]: DEBUG cinder.volume.flows.manager.create_volume [None req-b495a477-1102-419f-be94-b9c882fcab99 tempest-TestShelveInstance-950917247 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87272) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 11:04:28 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-b495a477-1102-419f-be94-b9c882fcab99 tempest-TestShelveInstance-950917247 None] Flow 'volume_create_manager' (27708586-0732-40bc-a6f2-525df997473a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 11:04:28 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-b495a477-1102-419f-be94-b9c882fcab99 tempest-TestShelveInstance-950917247 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b95884a0-6d0d-4b6a-8441-b37e904af52a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:04:28 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-b495a477-1102-419f-be94-b9c882fcab99 tempest-TestShelveInstance-950917247 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b95884a0-6d0d-4b6a-8441-b37e904af52a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T10:04:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1839520918',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7266d2a8-2c6e-4fe6-8df2-6eca6d71a40f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='088ee99c6f4e4ab6a57ea3ca29a4ff78',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T10:04:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T10:04:28Z,use_quota=True,user_id='b7732bb2e4044e51b7aa1a84b4732527',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8989e4f-21e3-4f0a-9584-0d818784e883),volume_type_id=f8989e4f-21e3-4f0a-9584-0d818784e883)' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:04:28 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-b495a477-1102-419f-be94-b9c882fcab99 tempest-TestShelveInstance-950917247 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0f54105-d160-4a31-a000-b4580d49bde6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:04:28 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-b495a477-1102-419f-be94-b9c882fcab99 tempest-TestShelveInstance-950917247 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0f54105-d160-4a31-a000-b4580d49bde6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:04:28 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-b495a477-1102-419f-be94-b9c882fcab99 tempest-TestShelveInstance-950917247 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3921b529-1de3-4cae-ad91-f4f8749ab9bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:04:28 devstack cinder-volume[87272]: DEBUG cinder.image.glance [None req-b495a477-1102-419f-be94-b9c882fcab99 tempest-TestShelveInstance-950917247 None] Creating Keystone auth plugin from conf {{(pid=87272) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 04 11:04:28 devstack sudo[102216]: pam_unix(sudo:session): session closed for user root Nov 04 11:04:28 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-0f7ba022-fe38-468d-b79f-99997ffae78a tempest-VolumesSnapshotListTestJSON-214810329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-a9e9cdf6-eb51-4996-9768-51e631e92a0e.263711d4-2cf3-4dd4-aeeb-5aa23b97aa6e" returned: 0 in 0.437s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:04:28 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-0f7ba022-fe38-468d-b79f-99997ffae78a tempest-VolumesSnapshotListTestJSON-214810329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-a9e9cdf6-eb51-4996-9768-51e631e92a0e.263711d4-2cf3-4dd4-aeeb-5aa23b97aa6e {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:04:28 devstack sudo[102223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-a9e9cdf6-eb51-4996-9768-51e631e92a0e.263711d4-2cf3-4dd4-aeeb-5aa23b97aa6e Nov 04 11:04:28 devstack sudo[102223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:04:28 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-b495a477-1102-419f-be94-b9c882fcab99 tempest-TestShelveInstance-950917247 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3921b529-1de3-4cae-ad91-f4f8749ab9bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '7266d2a8-2c6e-4fe6-8df2-6eca6d71a40f', 'volume_name': 'volume-7266d2a8-2c6e-4fe6-8df2-6eca6d71a40f', 'volume_size': 1, 'image_id': 'e21f1c05-a199-4b20-94c3-a13f8db1348a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e21f1c05-a199-4b20-94c3-a13f8db1348a', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'a0568d152f1945e380a1ac4afff5179c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'e21f1c05-a199-4b20-94c3-a13f8db1348a', 'created_at': datetime.datetime(2026, 11, 4, 9, 43, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 4, 9, 44, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e21f1c05-a199-4b20-94c3-a13f8db1348a/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:04:28 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-b495a477-1102-419f-be94-b9c882fcab99 tempest-TestShelveInstance-950917247 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be6e3081-3f8e-4e9f-a2ad-97de35695274) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:04:28 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-b495a477-1102-419f-be94-b9c882fcab99 tempest-TestShelveInstance-950917247 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be6e3081-3f8e-4e9f-a2ad-97de35695274) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:04:28 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-b495a477-1102-419f-be94-b9c882fcab99 tempest-TestShelveInstance-950917247 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca9be091-4874-415d-b5bc-3f8bf2da4670) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:04:28 devstack cinder-volume[87272]: INFO cinder.volume.flows.manager.create_volume [None req-b495a477-1102-419f-be94-b9c882fcab99 tempest-TestShelveInstance-950917247 None] Volume 7266d2a8-2c6e-4fe6-8df2-6eca6d71a40f: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-7266d2a8-2c6e-4fe6-8df2-6eca6d71a40f', 'volume_size': 1, 'image_id': 'e21f1c05-a199-4b20-94c3-a13f8db1348a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e21f1c05-a199-4b20-94c3-a13f8db1348a', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'a0568d152f1945e380a1ac4afff5179c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'e21f1c05-a199-4b20-94c3-a13f8db1348a', 'created_at': datetime.datetime(2026, 11, 4, 9, 43, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 4, 9, 44, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e21f1c05-a199-4b20-94c3-a13f8db1348a/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Nov 04 11:04:28 devstack cinder-volume[87272]: DEBUG cinder.volume.flows.manager.create_volume [None req-b495a477-1102-419f-be94-b9c882fcab99 tempest-TestShelveInstance-950917247 None] Trying to clone 7266d2a8-2c6e-4fe6-8df2-6eca6d71a40f from image e21f1c05-a199-4b20-94c3-a13f8db1348a at location (None, [{'url': 'file:///opt/stack/data/glance/images/e21f1c05-a199-4b20-94c3-a13f8db1348a', 'metadata': {}}]). {{(pid=87272) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 04 11:04:28 devstack sudo[102223]: pam_unix(sudo:session): session closed for user root Nov 04 11:04:28 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-0f7ba022-fe38-468d-b79f-99997ffae78a tempest-VolumesSnapshotListTestJSON-214810329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-a9e9cdf6-eb51-4996-9768-51e631e92a0e.263711d4-2cf3-4dd4-aeeb-5aa23b97aa6e" returned: 0 in 0.256s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:04:28 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-0f7ba022-fe38-468d-b79f-99997ffae78a tempest-VolumesSnapshotListTestJSON-214810329 None] Lock "cinder-quobyte-263711d4-2cf3-4dd4-aeeb-5aa23b97aa6e" released by "_delete_snapshot" :: held 1.773s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 11:04:28 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-0f7ba022-fe38-468d-b79f-99997ffae78a tempest-VolumesSnapshotListTestJSON-214810329 None] Lock "cinder-quobyte-a9e9cdf6-eb51-4996-9768-51e631e92a0e" released by "delete_snapshot" :: held 1.804s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 11:04:28 devstack cinder-volume[87272]: DEBUG cinder.image.image_utils [None req-b495a477-1102-419f-be94-b9c882fcab99 tempest-TestShelveInstance-950917247 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_e21f1c05-a199-4b20-94c3-a13f8db1348a_fvnuvemtdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87272) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Nov 04 11:04:28 devstack cinder-volume[87272]: INFO cinder.image.image_utils [None req-b495a477-1102-419f-be94-b9c882fcab99 tempest-TestShelveInstance-950917247 None] Image download 20.69 MB at 20.69 MB/s Nov 04 11:04:28 devstack cinder-volume[87272]: DEBUG cinder.quota [None req-0f7ba022-fe38-468d-b79f-99997ffae78a tempest-VolumesSnapshotListTestJSON-214810329 None] Created reservations ['f34e78df-2cc3-45a5-8a8e-3394ec87d5a3', 'ee39d216-810c-4419-8145-fb40b4147eab', 'ffcb27ed-c038-4cfa-9001-2d4af7df24f3', 'af03dd25-7125-40e4-9095-3c300423c14e'] {{(pid=87272) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 11:04:28 devstack cinder-volume[87272]: DEBUG oslo.privsep.daemon [-] privsep: reply[75e0505a-4e9d-4388-9dec-8c0596d71f0b]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 11:04:28 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-b495a477-1102-419f-be94-b9c882fcab99 tempest-TestShelveInstance-950917247 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e21f1c05-a199-4b20-94c3-a13f8db1348a_fvnuvemtdevstack@QuobyteHD {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:04:29 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-0f7ba022-fe38-468d-b79f-99997ffae78a tempest-VolumesSnapshotListTestJSON-214810329 None] Delete snapshot completed successfully. Nov 04 11:04:29 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-0f7ba022-fe38-468d-b79f-99997ffae78a tempest-VolumesSnapshotListTestJSON-214810329 None] Lock "cinder-263711d4-2cf3-4dd4-aeeb-5aa23b97aa6e-delete_snapshot" released by "delete_snapshot" :: held 2.138s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 11:04:29 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-fd6e2583-6880-420f-ac54-adbad798cd80 tempest-VolumesSnapshotListTestJSON-214810329 None] Acquiring lock "cinder-f99ee97e-8748-40a0-b17c-1909f0c4dda5-delete_snapshot" by "delete_snapshot" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 11:04:29 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-fd6e2583-6880-420f-ac54-adbad798cd80 tempest-VolumesSnapshotListTestJSON-214810329 None] Lock "cinder-f99ee97e-8748-40a0-b17c-1909f0c4dda5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 11:04:29 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-fd6e2583-6880-420f-ac54-adbad798cd80 tempest-VolumesSnapshotListTestJSON-214810329 None] Acquiring lock "cinder-quobyte-a9e9cdf6-eb51-4996-9768-51e631e92a0e" by "delete_snapshot" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 11:04:29 devstack sudo[102227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e21f1c05-a199-4b20-94c3-a13f8db1348a_fvnuvemtdevstack@QuobyteHD Nov 04 11:04:29 devstack sudo[102227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:04:29 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-fd6e2583-6880-420f-ac54-adbad798cd80 tempest-VolumesSnapshotListTestJSON-214810329 None] Lock "cinder-quobyte-a9e9cdf6-eb51-4996-9768-51e631e92a0e" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 11:04:29 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-fd6e2583-6880-420f-ac54-adbad798cd80 tempest-VolumesSnapshotListTestJSON-214810329 None] Acquiring lock "cinder-quobyte-f99ee97e-8748-40a0-b17c-1909f0c4dda5" by "_delete_snapshot" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 11:04:29 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-fd6e2583-6880-420f-ac54-adbad798cd80 tempest-VolumesSnapshotListTestJSON-214810329 None] Lock "cinder-quobyte-f99ee97e-8748-40a0-b17c-1909f0c4dda5" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 11:04:29 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.remotefs [None req-fd6e2583-6880-420f-ac54-adbad798cd80 tempest-VolumesSnapshotListTestJSON-214810329 None] Deleting offline snapshot f99ee97e-8748-40a0-b17c-1909f0c4dda5 of volume a9e9cdf6-eb51-4996-9768-51e631e92a0e {{(pid=87272) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 04 11:04:29 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.remotefs [None req-fd6e2583-6880-420f-ac54-adbad798cd80 tempest-VolumesSnapshotListTestJSON-214810329 None] snapshot_file for this snap is: volume-a9e9cdf6-eb51-4996-9768-51e631e92a0e.f99ee97e-8748-40a0-b17c-1909f0c4dda5 {{(pid=87272) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 04 11:04:29 devstack cinder-volume[87272]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d81b0a0-a5bc-4181-926f-f587e96ac36c]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 11:04:29 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-fd6e2583-6880-420f-ac54-adbad798cd80 tempest-VolumesSnapshotListTestJSON-214810329 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-a9e9cdf6-eb51-4996-9768-51e631e92a0e.f99ee97e-8748-40a0-b17c-1909f0c4dda5 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:04:29 devstack sudo[102229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-a9e9cdf6-eb51-4996-9768-51e631e92a0e.f99ee97e-8748-40a0-b17c-1909f0c4dda5 Nov 04 11:04:29 devstack sudo[102229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:04:29 devstack sudo[102227]: pam_unix(sudo:session): session closed for user root Nov 04 11:04:29 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-b495a477-1102-419f-be94-b9c882fcab99 tempest-TestShelveInstance-950917247 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e21f1c05-a199-4b20-94c3-a13f8db1348a_fvnuvemtdevstack@QuobyteHD" returned: 0 in 0.492s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:04:29 devstack cinder-volume[87272]: DEBUG cinder.image.image_utils [None req-b495a477-1102-419f-be94-b9c882fcab99 tempest-TestShelveInstance-950917247 None] Temporary image e21f1c05-a199-4b20-94c3-a13f8db1348a is fetched for user b7732bb2e4044e51b7aa1a84b4732527. {{(pid=87272) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Nov 04 11:04:29 devstack cinder-volume[87272]: DEBUG oslo.privsep.daemon [-] privsep: reply[1aa4bb60-3421-420a-900e-43e4d9597573]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 11:04:29 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-b495a477-1102-419f-be94-b9c882fcab99 tempest-TestShelveInstance-950917247 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e21f1c05-a199-4b20-94c3-a13f8db1348a_fvnuvemtdevstack@QuobyteHD {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:04:29 devstack sudo[102229]: pam_unix(sudo:session): session closed for user root Nov 04 11:04:29 devstack sudo[102234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e21f1c05-a199-4b20-94c3-a13f8db1348a_fvnuvemtdevstack@QuobyteHD Nov 04 11:04:29 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-fd6e2583-6880-420f-ac54-adbad798cd80 tempest-VolumesSnapshotListTestJSON-214810329 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-a9e9cdf6-eb51-4996-9768-51e631e92a0e.f99ee97e-8748-40a0-b17c-1909f0c4dda5" returned: 0 in 0.401s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:04:29 devstack sudo[102234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:04:29 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.remotefs [None req-fd6e2583-6880-420f-ac54-adbad798cd80 tempest-VolumesSnapshotListTestJSON-214810329 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a9e9cdf6-eb51-4996-9768-51e631e92a0e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87272) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 11:04:29 devstack cinder-volume[87272]: DEBUG oslo.privsep.daemon [-] privsep: reply[24e1f52b-2aad-45b5-a26a-b15cafe30362]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 11:04:29 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-fd6e2583-6880-420f-ac54-adbad798cd80 tempest-VolumesSnapshotListTestJSON-214810329 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-a9e9cdf6-eb51-4996-9768-51e631e92a0e {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:04:29 devstack sudo[102239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-a9e9cdf6-eb51-4996-9768-51e631e92a0e Nov 04 11:04:29 devstack sudo[102239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:04:29 devstack sudo[102234]: pam_unix(sudo:session): session closed for user root Nov 04 11:04:29 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-b495a477-1102-419f-be94-b9c882fcab99 tempest-TestShelveInstance-950917247 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e21f1c05-a199-4b20-94c3-a13f8db1348a_fvnuvemtdevstack@QuobyteHD" returned: 0 in 0.387s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:04:29 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-b495a477-1102-419f-be94-b9c882fcab99 tempest-TestShelveInstance-950917247 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 11:04:29 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-b495a477-1102-419f-be94-b9c882fcab99 tempest-TestShelveInstance-950917247 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 11:04:29 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-b495a477-1102-419f-be94-b9c882fcab99 tempest-TestShelveInstance-950917247 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T10:04:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1839520918',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7266d2a8-2c6e-4fe6-8df2-6eca6d71a40f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='088ee99c6f4e4ab6a57ea3ca29a4ff78',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T10:04:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T10:04:28Z,use_quota=True,user_id='b7732bb2e4044e51b7aa1a84b4732527',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8989e4f-21e3-4f0a-9584-0d818784e883),volume_type_id=f8989e4f-21e3-4f0a-9584-0d818784e883)}" {{(pid=87272) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 04 11:04:29 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.remotefs [None req-b495a477-1102-419f-be94-b9c882fcab99 tempest-TestShelveInstance-950917247 None] Creating volume 7266d2a8-2c6e-4fe6-8df2-6eca6d71a40f {{(pid=87272) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 11:04:29 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-b495a477-1102-419f-be94-b9c882fcab99 tempest-TestShelveInstance-950917247 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 11:04:29 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-b495a477-1102-419f-be94-b9c882fcab99 tempest-TestShelveInstance-950917247 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 11:04:29 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-b495a477-1102-419f-be94-b9c882fcab99 tempest-TestShelveInstance-950917247 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898': None} {{(pid=87272) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 11:04:29 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-b495a477-1102-419f-be94-b9c882fcab99 tempest-TestShelveInstance-950917247 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'] {{(pid=87272) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 11:04:29 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-b495a477-1102-419f-be94-b9c882fcab99 tempest-TestShelveInstance-950917247 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 11:04:29 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-b495a477-1102-419f-be94-b9c882fcab99 tempest-TestShelveInstance-950917247 None] Selected osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898 as target Quobyte volume. {{(pid=87272) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 11:04:29 devstack cinder-volume[87272]: INFO cinder.volume.drivers.remotefs [None req-b495a477-1102-419f-be94-b9c882fcab99 tempest-TestShelveInstance-950917247 None] casted to osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898 Nov 04 11:04:29 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-b495a477-1102-419f-be94-b9c882fcab99 tempest-TestShelveInstance-950917247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-7266d2a8-2c6e-4fe6-8df2-6eca6d71a40f 1073741824 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:04:30 devstack sudo[102245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-7266d2a8-2c6e-4fe6-8df2-6eca6d71a40f 1073741824 Nov 04 11:04:30 devstack sudo[102245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:04:30 devstack sudo[102239]: pam_unix(sudo:session): session closed for user root Nov 04 11:04:30 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-fd6e2583-6880-420f-ac54-adbad798cd80 tempest-VolumesSnapshotListTestJSON-214810329 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-a9e9cdf6-eb51-4996-9768-51e631e92a0e" returned: 0 in 0.517s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:04:30 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-fd6e2583-6880-420f-ac54-adbad798cd80 tempest-VolumesSnapshotListTestJSON-214810329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-a9e9cdf6-eb51-4996-9768-51e631e92a0e.f99ee97e-8748-40a0-b17c-1909f0c4dda5 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:04:30 devstack sudo[102285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-a9e9cdf6-eb51-4996-9768-51e631e92a0e.f99ee97e-8748-40a0-b17c-1909f0c4dda5 Nov 04 11:04:30 devstack sudo[102285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:04:30 devstack sudo[102245]: pam_unix(sudo:session): session closed for user root Nov 04 11:04:30 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-b495a477-1102-419f-be94-b9c882fcab99 tempest-TestShelveInstance-950917247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-7266d2a8-2c6e-4fe6-8df2-6eca6d71a40f 1073741824" returned: 0 in 0.593s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:04:30 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-b495a477-1102-419f-be94-b9c882fcab99 tempest-TestShelveInstance-950917247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-7266d2a8-2c6e-4fe6-8df2-6eca6d71a40f {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:04:30 devstack sudo[102296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-7266d2a8-2c6e-4fe6-8df2-6eca6d71a40f Nov 04 11:04:30 devstack sudo[102296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:04:30 devstack sudo[102285]: pam_unix(sudo:session): session closed for user root Nov 04 11:04:30 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-fd6e2583-6880-420f-ac54-adbad798cd80 tempest-VolumesSnapshotListTestJSON-214810329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-a9e9cdf6-eb51-4996-9768-51e631e92a0e.f99ee97e-8748-40a0-b17c-1909f0c4dda5" returned: 0 in 0.408s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:04:30 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-fd6e2583-6880-420f-ac54-adbad798cd80 tempest-VolumesSnapshotListTestJSON-214810329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-a9e9cdf6-eb51-4996-9768-51e631e92a0e.f99ee97e-8748-40a0-b17c-1909f0c4dda5 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:04:30 devstack sudo[102298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-a9e9cdf6-eb51-4996-9768-51e631e92a0e.f99ee97e-8748-40a0-b17c-1909f0c4dda5 Nov 04 11:04:30 devstack sudo[102298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:04:30 devstack sudo[102296]: pam_unix(sudo:session): session closed for user root Nov 04 11:04:30 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-b495a477-1102-419f-be94-b9c882fcab99 tempest-TestShelveInstance-950917247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-7266d2a8-2c6e-4fe6-8df2-6eca6d71a40f" returned: 0 in 0.262s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:04:30 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-b495a477-1102-419f-be94-b9c882fcab99 tempest-TestShelveInstance-950917247 None] <== create_volume: return (905ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'} {{(pid=87272) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 04 11:04:30 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-b495a477-1102-419f-be94-b9c882fcab99 tempest-TestShelveInstance-950917247 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.911s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 11:04:30 devstack cinder-volume[87272]: DEBUG cinder.volume.volume_utils [None req-b495a477-1102-419f-be94-b9c882fcab99 tempest-TestShelveInstance-950917247 None] Attempting download of e21f1c05-a199-4b20-94c3-a13f8db1348a ((None, [{'url': 'file:///opt/stack/data/glance/images/e21f1c05-a199-4b20-94c3-a13f8db1348a', 'metadata': {}}])) to volume 7266d2a8-2c6e-4fe6-8df2-6eca6d71a40f. {{(pid=87272) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Nov 04 11:04:30 devstack sudo[102298]: pam_unix(sudo:session): session closed for user root Nov 04 11:04:30 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-fd6e2583-6880-420f-ac54-adbad798cd80 tempest-VolumesSnapshotListTestJSON-214810329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-a9e9cdf6-eb51-4996-9768-51e631e92a0e.f99ee97e-8748-40a0-b17c-1909f0c4dda5" returned: 0 in 0.264s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:04:30 devstack cinder-volume[87272]: DEBUG oslo.privsep.daemon [-] privsep: reply[e63116b9-50cd-47c4-ac22-54c34a784c9d]: (4, 'raw') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 11:04:30 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-b495a477-1102-419f-be94-b9c882fcab99 tempest-TestShelveInstance-950917247 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e21f1c05-a199-4b20-94c3-a13f8db1348a_kiots2y8 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:04:30 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-fd6e2583-6880-420f-ac54-adbad798cd80 tempest-VolumesSnapshotListTestJSON-214810329 None] Lock "cinder-quobyte-f99ee97e-8748-40a0-b17c-1909f0c4dda5" released by "_delete_snapshot" :: held 1.747s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 11:04:31 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-fd6e2583-6880-420f-ac54-adbad798cd80 tempest-VolumesSnapshotListTestJSON-214810329 None] Lock "cinder-quobyte-a9e9cdf6-eb51-4996-9768-51e631e92a0e" released by "delete_snapshot" :: held 1.774s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 11:04:31 devstack cinder-volume[87272]: DEBUG cinder.quota [None req-fd6e2583-6880-420f-ac54-adbad798cd80 tempest-VolumesSnapshotListTestJSON-214810329 None] Created reservations ['527e18d9-7092-475b-a44f-317f0f346f2d', 'e73d4bf5-8d61-4132-814c-e299752d73ed', '81fe3bad-c3fb-443a-bec8-28b723d53974', 'a0b57d99-6811-42d8-8d0b-f69949941cee'] {{(pid=87272) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 11:04:31 devstack sudo[102302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e21f1c05-a199-4b20-94c3-a13f8db1348a_kiots2y8 Nov 04 11:04:31 devstack sudo[102302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:04:31 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-fd6e2583-6880-420f-ac54-adbad798cd80 tempest-VolumesSnapshotListTestJSON-214810329 None] Delete snapshot completed successfully. Nov 04 11:04:31 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-fd6e2583-6880-420f-ac54-adbad798cd80 tempest-VolumesSnapshotListTestJSON-214810329 None] Lock "cinder-f99ee97e-8748-40a0-b17c-1909f0c4dda5-delete_snapshot" released by "delete_snapshot" :: held 2.003s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 11:04:31 devstack sudo[102302]: pam_unix(sudo:session): session closed for user root Nov 04 11:04:31 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-b495a477-1102-419f-be94-b9c882fcab99 tempest-TestShelveInstance-950917247 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e21f1c05-a199-4b20-94c3-a13f8db1348a_kiots2y8" returned: 0 in 0.423s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:04:31 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-b495a477-1102-419f-be94-b9c882fcab99 tempest-TestShelveInstance-950917247 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e21f1c05-a199-4b20-94c3-a13f8db1348a_kiots2y8 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:04:31 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-42030a02-0a19-4aed-9210-34f4e341d632 tempest-VolumesSnapshotListTestJSON-214810329 None] Acquiring lock "cinder-a9e9cdf6-eb51-4996-9768-51e631e92a0e-delete_volume" by "delete_volume" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 11:04:31 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-42030a02-0a19-4aed-9210-34f4e341d632 tempest-VolumesSnapshotListTestJSON-214810329 None] Lock "cinder-a9e9cdf6-eb51-4996-9768-51e631e92a0e-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 11:04:31 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-42030a02-0a19-4aed-9210-34f4e341d632 tempest-VolumesSnapshotListTestJSON-214810329 None] Acquiring lock "cinder-quobyte-a9e9cdf6-eb51-4996-9768-51e631e92a0e" by "delete_volume" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 11:04:31 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-42030a02-0a19-4aed-9210-34f4e341d632 tempest-VolumesSnapshotListTestJSON-214810329 None] Lock "cinder-quobyte-a9e9cdf6-eb51-4996-9768-51e631e92a0e" acquired by "delete_volume" :: waited 0.019s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 11:04:31 devstack sudo[102306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e21f1c05-a199-4b20-94c3-a13f8db1348a_kiots2y8 Nov 04 11:04:31 devstack sudo[102306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:04:31 devstack cinder-volume[87272]: DEBUG oslo.privsep.daemon [-] privsep: reply[70fcaafa-a7d1-4db8-b869-c94cee63eb1a]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 11:04:31 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-42030a02-0a19-4aed-9210-34f4e341d632 tempest-VolumesSnapshotListTestJSON-214810329 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-a9e9cdf6-eb51-4996-9768-51e631e92a0e {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:04:31 devstack sudo[102308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-a9e9cdf6-eb51-4996-9768-51e631e92a0e Nov 04 11:04:31 devstack sudo[102308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:04:31 devstack sudo[102306]: pam_unix(sudo:session): session closed for user root Nov 04 11:04:31 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-b495a477-1102-419f-be94-b9c882fcab99 tempest-TestShelveInstance-950917247 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e21f1c05-a199-4b20-94c3-a13f8db1348a_kiots2y8" returned: 1 in 0.377s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:04:31 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-b495a477-1102-419f-be94-b9c882fcab99 tempest-TestShelveInstance-950917247 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e21f1c05-a199-4b20-94c3-a13f8db1348a_kiots2y8' failed. Not Retrying. {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 04 11:04:31 devstack cinder-volume[87272]: DEBUG oslo.privsep.daemon [-] privsep: reply[1067e62c-5e77-46d6-b74c-336b449bcc69]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 11:04:31 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-b495a477-1102-419f-be94-b9c882fcab99 tempest-TestShelveInstance-950917247 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e21f1c05-a199-4b20-94c3-a13f8db1348a_fvnuvemtdevstack@QuobyteHD {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:04:31 devstack sudo[102312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e21f1c05-a199-4b20-94c3-a13f8db1348a_fvnuvemtdevstack@QuobyteHD Nov 04 11:04:31 devstack sudo[102312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:04:31 devstack sudo[102308]: pam_unix(sudo:session): session closed for user root Nov 04 11:04:32 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-42030a02-0a19-4aed-9210-34f4e341d632 tempest-VolumesSnapshotListTestJSON-214810329 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-a9e9cdf6-eb51-4996-9768-51e631e92a0e" returned: 0 in 0.423s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:04:32 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-42030a02-0a19-4aed-9210-34f4e341d632 tempest-VolumesSnapshotListTestJSON-214810329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-a9e9cdf6-eb51-4996-9768-51e631e92a0e {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:04:32 devstack sudo[102317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-a9e9cdf6-eb51-4996-9768-51e631e92a0e Nov 04 11:04:32 devstack sudo[102317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:04:32 devstack sudo[102312]: pam_unix(sudo:session): session closed for user root Nov 04 11:04:32 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-b495a477-1102-419f-be94-b9c882fcab99 tempest-TestShelveInstance-950917247 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e21f1c05-a199-4b20-94c3-a13f8db1348a_fvnuvemtdevstack@QuobyteHD" returned: 0 in 0.375s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:04:32 devstack cinder-volume[87272]: DEBUG cinder.image.image_utils [None req-b495a477-1102-419f-be94-b9c882fcab99 tempest-TestShelveInstance-950917247 None] e21f1c05-a199-4b20-94c3-a13f8db1348a was qcow2, converting to qcow2 {{(pid=87272) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Nov 04 11:04:32 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-b495a477-1102-419f-be94-b9c882fcab99 tempest-TestShelveInstance-950917247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_e21f1c05-a199-4b20-94c3-a13f8db1348a_fvnuvemtdevstack@QuobyteHD /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-7266d2a8-2c6e-4fe6-8df2-6eca6d71a40f {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:04:32 devstack sudo[102322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_e21f1c05-a199-4b20-94c3-a13f8db1348a_fvnuvemtdevstack@QuobyteHD /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-7266d2a8-2c6e-4fe6-8df2-6eca6d71a40f Nov 04 11:04:32 devstack sudo[102322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:04:32 devstack sudo[102317]: pam_unix(sudo:session): session closed for user root Nov 04 11:04:32 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-42030a02-0a19-4aed-9210-34f4e341d632 tempest-VolumesSnapshotListTestJSON-214810329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-a9e9cdf6-eb51-4996-9768-51e631e92a0e" returned: 0 in 0.280s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:04:32 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-42030a02-0a19-4aed-9210-34f4e341d632 tempest-VolumesSnapshotListTestJSON-214810329 None] Lock "cinder-quobyte-a9e9cdf6-eb51-4996-9768-51e631e92a0e" released by "delete_volume" :: held 0.798s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 11:04:32 devstack cinder-volume[87272]: DEBUG cinder.quota [None req-42030a02-0a19-4aed-9210-34f4e341d632 tempest-VolumesSnapshotListTestJSON-214810329 None] Created reservations ['cfe28618-4c13-45c9-b46c-cdd23d38120c', '169abfef-dcc6-4100-865f-e385665719ee', '48a535d9-5684-49c7-a754-f7e2022ed284', '8927f220-aab3-4034-8ae1-da2bdc81e0ac'] {{(pid=87272) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 11:04:32 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-42030a02-0a19-4aed-9210-34f4e341d632 tempest-VolumesSnapshotListTestJSON-214810329 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 11:04:32 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-42030a02-0a19-4aed-9210-34f4e341d632 tempest-VolumesSnapshotListTestJSON-214810329 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 11:04:32 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-42030a02-0a19-4aed-9210-34f4e341d632 tempest-VolumesSnapshotListTestJSON-214810329 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898': None} {{(pid=87272) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 11:04:32 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-42030a02-0a19-4aed-9210-34f4e341d632 tempest-VolumesSnapshotListTestJSON-214810329 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'] {{(pid=87272) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 11:04:32 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-42030a02-0a19-4aed-9210-34f4e341d632 tempest-VolumesSnapshotListTestJSON-214810329 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 11:04:32 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-42030a02-0a19-4aed-9210-34f4e341d632 tempest-VolumesSnapshotListTestJSON-214810329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:04:32 devstack sudo[102328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1 Nov 04 11:04:32 devstack sudo[102328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:04:32 devstack sudo[102328]: pam_unix(sudo:session): session closed for user root Nov 04 11:04:32 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-42030a02-0a19-4aed-9210-34f4e341d632 tempest-VolumesSnapshotListTestJSON-214810329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1" returned: 0 in 0.273s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:04:32 devstack cinder-volume[87272]: DEBUG cinder.manager [None req-42030a02-0a19-4aed-9210-34f4e341d632 tempest-VolumesSnapshotListTestJSON-214810329 None] Notifying Schedulers of capabilities ... {{(pid=87272) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 11:04:32 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-42030a02-0a19-4aed-9210-34f4e341d632 tempest-VolumesSnapshotListTestJSON-214810329 None] Deleted volume successfully. Nov 04 11:04:32 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-42030a02-0a19-4aed-9210-34f4e341d632 tempest-VolumesSnapshotListTestJSON-214810329 None] Lock "cinder-a9e9cdf6-eb51-4996-9768-51e631e92a0e-delete_volume" released by "delete_volume" :: held 1.344s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 11:04:34 devstack sudo[102322]: pam_unix(sudo:session): session closed for user root Nov 04 11:04:34 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-b495a477-1102-419f-be94-b9c882fcab99 tempest-TestShelveInstance-950917247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_e21f1c05-a199-4b20-94c3-a13f8db1348a_fvnuvemtdevstack@QuobyteHD /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-7266d2a8-2c6e-4fe6-8df2-6eca6d71a40f" returned: 0 in 1.987s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:04:34 devstack cinder-volume[87272]: DEBUG cinder.image.image_utils [None req-b495a477-1102-419f-be94-b9c882fcab99 tempest-TestShelveInstance-950917247 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_e21f1c05-a199-4b20-94c3-a13f8db1348a_fvnuvemtdevstack@QuobyteHD, size 112.00 MB, duration 1.99 sec, destination /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-7266d2a8-2c6e-4fe6-8df2-6eca6d71a40f {{(pid=87272) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Nov 04 11:04:34 devstack cinder-volume[87272]: INFO cinder.image.image_utils [None req-b495a477-1102-419f-be94-b9c882fcab99 tempest-TestShelveInstance-950917247 None] Converted 112.00 MB image at 56.33 MB/s Nov 04 11:04:34 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-b495a477-1102-419f-be94-b9c882fcab99 tempest-TestShelveInstance-950917247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-7266d2a8-2c6e-4fe6-8df2-6eca6d71a40f 1G {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:04:34 devstack sudo[102334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-7266d2a8-2c6e-4fe6-8df2-6eca6d71a40f 1G Nov 04 11:04:34 devstack sudo[102334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:04:34 devstack sudo[102334]: pam_unix(sudo:session): session closed for user root Nov 04 11:04:34 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-b495a477-1102-419f-be94-b9c882fcab99 tempest-TestShelveInstance-950917247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-7266d2a8-2c6e-4fe6-8df2-6eca6d71a40f 1G" returned: 0 in 0.353s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:04:34 devstack cinder-volume[87272]: DEBUG cinder.volume.volume_utils [None req-b495a477-1102-419f-be94-b9c882fcab99 tempest-TestShelveInstance-950917247 None] Downloaded image e21f1c05-a199-4b20-94c3-a13f8db1348a ((None, [{'url': 'file:///opt/stack/data/glance/images/e21f1c05-a199-4b20-94c3-a13f8db1348a', 'metadata': {}}])) to volume 7266d2a8-2c6e-4fe6-8df2-6eca6d71a40f successfully. {{(pid=87272) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Nov 04 11:04:34 devstack cinder-volume[87272]: DEBUG cinder.image.image_utils [None req-b495a477-1102-419f-be94-b9c882fcab99 tempest-TestShelveInstance-950917247 None] Temporary image e21f1c05-a199-4b20-94c3-a13f8db1348a for user b7732bb2e4044e51b7aa1a84b4732527 is deleted. {{(pid=87272) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Nov 04 11:04:34 devstack cinder-volume[87272]: DEBUG cinder.volume.volume_utils [None req-b495a477-1102-419f-be94-b9c882fcab99 tempest-TestShelveInstance-950917247 None] Marking volume 7266d2a8-2c6e-4fe6-8df2-6eca6d71a40f as bootable. {{(pid=87272) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Nov 04 11:04:34 devstack cinder-volume[87272]: DEBUG cinder.volume.flows.manager.create_volume [None req-b495a477-1102-419f-be94-b9c882fcab99 tempest-TestShelveInstance-950917247 None] Copying metadata from image e21f1c05-a199-4b20-94c3-a13f8db1348a to 7266d2a8-2c6e-4fe6-8df2-6eca6d71a40f. {{(pid=87272) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 04 11:04:34 devstack cinder-volume[87272]: DEBUG cinder.volume.flows.manager.create_volume [None req-b495a477-1102-419f-be94-b9c882fcab99 tempest-TestShelveInstance-950917247 None] Creating volume glance metadata for volume 7266d2a8-2c6e-4fe6-8df2-6eca6d71a40f backed by image e21f1c05-a199-4b20-94c3-a13f8db1348a with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'e21f1c05-a199-4b20-94c3-a13f8db1348a', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87272) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 04 11:04:34 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-b495a477-1102-419f-be94-b9c882fcab99 tempest-TestShelveInstance-950917247 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca9be091-4874-415d-b5bc-3f8bf2da4670) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7266d2a8-2c6e-4fe6-8df2-6eca6d71a40f', 'volume_size': 1, 'image_id': 'e21f1c05-a199-4b20-94c3-a13f8db1348a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e21f1c05-a199-4b20-94c3-a13f8db1348a', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'a0568d152f1945e380a1ac4afff5179c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'e21f1c05-a199-4b20-94c3-a13f8db1348a', 'created_at': datetime.datetime(2026, 11, 4, 9, 43, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 4, 9, 44, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e21f1c05-a199-4b20-94c3-a13f8db1348a/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:04:34 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-b495a477-1102-419f-be94-b9c882fcab99 tempest-TestShelveInstance-950917247 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f624b58a-850e-4942-aa08-82abd87c4a5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:04:34 devstack cinder-volume[87272]: INFO cinder.volume.flows.manager.create_volume [None req-b495a477-1102-419f-be94-b9c882fcab99 tempest-TestShelveInstance-950917247 None] Volume volume-7266d2a8-2c6e-4fe6-8df2-6eca6d71a40f (7266d2a8-2c6e-4fe6-8df2-6eca6d71a40f): created successfully Nov 04 11:04:34 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-b495a477-1102-419f-be94-b9c882fcab99 tempest-TestShelveInstance-950917247 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f624b58a-850e-4942-aa08-82abd87c4a5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:04:34 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-b495a477-1102-419f-be94-b9c882fcab99 tempest-TestShelveInstance-950917247 None] Flow 'volume_create_manager' (27708586-0732-40bc-a6f2-525df997473a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87272) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 11:04:34 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-b495a477-1102-419f-be94-b9c882fcab99 tempest-TestShelveInstance-950917247 None] Created volume successfully. Nov 04 11:04:38 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [req-6b00dd49-035c-4fa6-8bb8-51f01a39e0fd req-8972efb2-d5ac-47ec-8501-a04333503f04 tempest-TestShelveInstance-950917247 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 11:04:38 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [req-6b00dd49-035c-4fa6-8bb8-51f01a39e0fd req-8972efb2-d5ac-47ec-8501-a04333503f04 tempest-TestShelveInstance-950917247 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 11:04:38 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [req-6b00dd49-035c-4fa6-8bb8-51f01a39e0fd req-8972efb2-d5ac-47ec-8501-a04333503f04 tempest-TestShelveInstance-950917247 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.040s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 11:04:38 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [req-6b00dd49-035c-4fa6-8bb8-51f01a39e0fd req-8972efb2-d5ac-47ec-8501-a04333503f04 tempest-TestShelveInstance-950917247 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898', 'name': 'volume-7266d2a8-2c6e-4fe6-8df2-6eca6d71a40f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '7aa834d6-e790-4d9a-be0e-57ee487cfd73', 'enforce_multipath': True} {{(pid=87272) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 04 11:04:38 devstack cinder-volume[87272]: INFO cinder.volume.manager [req-6b00dd49-035c-4fa6-8bb8-51f01a39e0fd req-8972efb2-d5ac-47ec-8501-a04333503f04 tempest-TestShelveInstance-950917247 None] attachment_update completed successfully. Nov 04 11:04:48 devstack cinder-volume[87272]: DEBUG dbcounter [-] [87272] Writing DB stats cinder:UPDATE=69,cinder:SELECT=75,cinder:INSERT=25,cinder:DELETE=6 {{(pid=87272) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 11:04:56 devstack cinder-volume[87272]: DEBUG dbcounter [-] [87272] Writing DB stats cinder:SELECT=77,cinder:UPDATE=80,cinder:DELETE=6,cinder:INSERT=26 {{(pid=87272) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 11:05:01 devstack cinder-volume[87272]: DEBUG cinder.volume.flows.manager.create_volume [None req-ebc86907-026a-45ed-a9f0-d799961f0f46 tempest-TestInstancesWithCinderVolumes-746758368 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87272) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 11:05:01 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-ebc86907-026a-45ed-a9f0-d799961f0f46 tempest-TestInstancesWithCinderVolumes-746758368 None] Flow 'volume_create_manager' (319f3f74-7299-4938-87a5-5fefa0ba6505) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 11:05:01 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-ebc86907-026a-45ed-a9f0-d799961f0f46 tempest-TestInstancesWithCinderVolumes-746758368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf66098e-c5e5-4880-90a7-49f0335e8ce4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:05:01 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-ebc86907-026a-45ed-a9f0-d799961f0f46 tempest-TestInstancesWithCinderVolumes-746758368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf66098e-c5e5-4880-90a7-49f0335e8ce4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T10:05:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-155439217',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b8366db-73f3-469f-a9be-e2635173e3ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='53cef4f0200842a3be3fe4ccec9fc883',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T10:05:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T10:05:02Z,use_quota=True,user_id='0a826b4600d6458ba5cfa4b6a04efa11',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8062361e-0e15-4b0a-9a9a-d8a4a1987cb8),volume_type_id=8062361e-0e15-4b0a-9a9a-d8a4a1987cb8)' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:05:01 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-ebc86907-026a-45ed-a9f0-d799961f0f46 tempest-TestInstancesWithCinderVolumes-746758368 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7d36d79-b8ad-4bcc-94c3-c9a878bb2eee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:05:01 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-ebc86907-026a-45ed-a9f0-d799961f0f46 tempest-TestInstancesWithCinderVolumes-746758368 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7d36d79-b8ad-4bcc-94c3-c9a878bb2eee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:05:01 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-ebc86907-026a-45ed-a9f0-d799961f0f46 tempest-TestInstancesWithCinderVolumes-746758368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e30df996-2ce4-4e23-b4a1-eeef159c63ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:05:01 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-ebc86907-026a-45ed-a9f0-d799961f0f46 tempest-TestInstancesWithCinderVolumes-746758368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e30df996-2ce4-4e23-b4a1-eeef159c63ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7b8366db-73f3-469f-a9be-e2635173e3ec', 'volume_name': 'volume-7b8366db-73f3-469f-a9be-e2635173e3ec', 'volume_size': 1}' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:05:01 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-ebc86907-026a-45ed-a9f0-d799961f0f46 tempest-TestInstancesWithCinderVolumes-746758368 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (811db8fc-ae35-4235-8925-ff12bfc51bd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:05:01 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-ebc86907-026a-45ed-a9f0-d799961f0f46 tempest-TestInstancesWithCinderVolumes-746758368 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (811db8fc-ae35-4235-8925-ff12bfc51bd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:05:01 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-ebc86907-026a-45ed-a9f0-d799961f0f46 tempest-TestInstancesWithCinderVolumes-746758368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f4bea74-ae8e-492e-8805-b18d683c12e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:05:01 devstack cinder-volume[87272]: INFO cinder.volume.flows.manager.create_volume [None req-ebc86907-026a-45ed-a9f0-d799961f0f46 tempest-TestInstancesWithCinderVolumes-746758368 None] Volume 7b8366db-73f3-469f-a9be-e2635173e3ec: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7b8366db-73f3-469f-a9be-e2635173e3ec', 'volume_size': 1} Nov 04 11:05:01 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-ebc86907-026a-45ed-a9f0-d799961f0f46 tempest-TestInstancesWithCinderVolumes-746758368 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 11:05:01 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-ebc86907-026a-45ed-a9f0-d799961f0f46 tempest-TestInstancesWithCinderVolumes-746758368 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 11:05:01 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-ebc86907-026a-45ed-a9f0-d799961f0f46 tempest-TestInstancesWithCinderVolumes-746758368 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T10:05:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-155439217',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b8366db-73f3-469f-a9be-e2635173e3ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='53cef4f0200842a3be3fe4ccec9fc883',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T10:05:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T10:05:02Z,use_quota=True,user_id='0a826b4600d6458ba5cfa4b6a04efa11',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8062361e-0e15-4b0a-9a9a-d8a4a1987cb8),volume_type_id=8062361e-0e15-4b0a-9a9a-d8a4a1987cb8)}" {{(pid=87272) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 04 11:05:01 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.remotefs [None req-ebc86907-026a-45ed-a9f0-d799961f0f46 tempest-TestInstancesWithCinderVolumes-746758368 None] Creating volume 7b8366db-73f3-469f-a9be-e2635173e3ec {{(pid=87272) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 11:05:01 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-ebc86907-026a-45ed-a9f0-d799961f0f46 tempest-TestInstancesWithCinderVolumes-746758368 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 11:05:01 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-ebc86907-026a-45ed-a9f0-d799961f0f46 tempest-TestInstancesWithCinderVolumes-746758368 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 11:05:01 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-ebc86907-026a-45ed-a9f0-d799961f0f46 tempest-TestInstancesWithCinderVolumes-746758368 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898': None} {{(pid=87272) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 11:05:01 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-ebc86907-026a-45ed-a9f0-d799961f0f46 tempest-TestInstancesWithCinderVolumes-746758368 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'] {{(pid=87272) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 11:05:01 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-ebc86907-026a-45ed-a9f0-d799961f0f46 tempest-TestInstancesWithCinderVolumes-746758368 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 11:05:01 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-ebc86907-026a-45ed-a9f0-d799961f0f46 tempest-TestInstancesWithCinderVolumes-746758368 None] Selected osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898 as target Quobyte volume. {{(pid=87272) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 11:05:01 devstack cinder-volume[87272]: INFO cinder.volume.drivers.remotefs [None req-ebc86907-026a-45ed-a9f0-d799961f0f46 tempest-TestInstancesWithCinderVolumes-746758368 None] casted to osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898 Nov 04 11:05:01 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-ebc86907-026a-45ed-a9f0-d799961f0f46 tempest-TestInstancesWithCinderVolumes-746758368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-7b8366db-73f3-469f-a9be-e2635173e3ec 1073741824 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:05:01 devstack sudo[102877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-7b8366db-73f3-469f-a9be-e2635173e3ec 1073741824 Nov 04 11:05:01 devstack sudo[102877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:05:01 devstack cinder-volume[87272]: DEBUG cinder.volume.flows.manager.create_volume [None req-6183cf2a-109a-48df-9172-102de0e149ed tempest-TestInstancesWithCinderVolumes-746758368 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87272) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 11:05:02 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-6183cf2a-109a-48df-9172-102de0e149ed tempest-TestInstancesWithCinderVolumes-746758368 None] Flow 'volume_create_manager' (7882fc92-28d6-45e1-86e8-7727fb4b13bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 11:05:02 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-6183cf2a-109a-48df-9172-102de0e149ed tempest-TestInstancesWithCinderVolumes-746758368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (38b5d858-3d33-4caa-afa6-ff3141d06af9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:05:02 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-6183cf2a-109a-48df-9172-102de0e149ed tempest-TestInstancesWithCinderVolumes-746758368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (38b5d858-3d33-4caa-afa6-ff3141d06af9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T10:05:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1115206319',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f5b74216-220d-4249-ad9d-e571b959090f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='53cef4f0200842a3be3fe4ccec9fc883',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T10:05:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T10:05:02Z,use_quota=True,user_id='0a826b4600d6458ba5cfa4b6a04efa11',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db557ab5-107f-4a45-bbce-be0d64e4a1ce),volume_type_id=db557ab5-107f-4a45-bbce-be0d64e4a1ce)' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:05:02 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-6183cf2a-109a-48df-9172-102de0e149ed tempest-TestInstancesWithCinderVolumes-746758368 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a4bf082c-6fe9-4611-84f8-7c81f838d144) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:05:02 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-6183cf2a-109a-48df-9172-102de0e149ed tempest-TestInstancesWithCinderVolumes-746758368 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a4bf082c-6fe9-4611-84f8-7c81f838d144) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:05:02 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-6183cf2a-109a-48df-9172-102de0e149ed tempest-TestInstancesWithCinderVolumes-746758368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca7e76cf-2962-491b-8073-d2613c70c30a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:05:02 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-6183cf2a-109a-48df-9172-102de0e149ed tempest-TestInstancesWithCinderVolumes-746758368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca7e76cf-2962-491b-8073-d2613c70c30a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f5b74216-220d-4249-ad9d-e571b959090f', 'volume_name': 'volume-f5b74216-220d-4249-ad9d-e571b959090f', 'volume_size': 1}' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:05:02 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-6183cf2a-109a-48df-9172-102de0e149ed tempest-TestInstancesWithCinderVolumes-746758368 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb7d73d2-e8f6-4317-b15d-3855aa551f22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:05:02 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-6183cf2a-109a-48df-9172-102de0e149ed tempest-TestInstancesWithCinderVolumes-746758368 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb7d73d2-e8f6-4317-b15d-3855aa551f22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:05:02 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-6183cf2a-109a-48df-9172-102de0e149ed tempest-TestInstancesWithCinderVolumes-746758368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a8c5c12-1a56-4db3-9d59-b5f06a9bfe3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:05:02 devstack cinder-volume[87272]: INFO cinder.volume.flows.manager.create_volume [None req-6183cf2a-109a-48df-9172-102de0e149ed tempest-TestInstancesWithCinderVolumes-746758368 None] Volume f5b74216-220d-4249-ad9d-e571b959090f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f5b74216-220d-4249-ad9d-e571b959090f', 'volume_size': 1} Nov 04 11:05:02 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-6183cf2a-109a-48df-9172-102de0e149ed tempest-TestInstancesWithCinderVolumes-746758368 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 11:05:02 devstack sudo[102877]: pam_unix(sudo:session): session closed for user root Nov 04 11:05:02 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-ebc86907-026a-45ed-a9f0-d799961f0f46 tempest-TestInstancesWithCinderVolumes-746758368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-7b8366db-73f3-469f-a9be-e2635173e3ec 1073741824" returned: 0 in 0.477s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:05:02 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-ebc86907-026a-45ed-a9f0-d799961f0f46 tempest-TestInstancesWithCinderVolumes-746758368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-7b8366db-73f3-469f-a9be-e2635173e3ec {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:05:02 devstack sudo[102883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-7b8366db-73f3-469f-a9be-e2635173e3ec Nov 04 11:05:02 devstack sudo[102883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:05:02 devstack sudo[102883]: pam_unix(sudo:session): session closed for user root Nov 04 11:05:02 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-ebc86907-026a-45ed-a9f0-d799961f0f46 tempest-TestInstancesWithCinderVolumes-746758368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-7b8366db-73f3-469f-a9be-e2635173e3ec" returned: 0 in 0.271s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:05:02 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-ebc86907-026a-45ed-a9f0-d799961f0f46 tempest-TestInstancesWithCinderVolumes-746758368 None] <== create_volume: return (787ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'} {{(pid=87272) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 04 11:05:02 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-ebc86907-026a-45ed-a9f0-d799961f0f46 tempest-TestInstancesWithCinderVolumes-746758368 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.790s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 11:05:02 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-6183cf2a-109a-48df-9172-102de0e149ed tempest-TestInstancesWithCinderVolumes-746758368 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.383s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 11:05:02 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-6183cf2a-109a-48df-9172-102de0e149ed tempest-TestInstancesWithCinderVolumes-746758368 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T10:05:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1115206319',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f5b74216-220d-4249-ad9d-e571b959090f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='53cef4f0200842a3be3fe4ccec9fc883',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T10:05:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T10:05:02Z,use_quota=True,user_id='0a826b4600d6458ba5cfa4b6a04efa11',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db557ab5-107f-4a45-bbce-be0d64e4a1ce),volume_type_id=db557ab5-107f-4a45-bbce-be0d64e4a1ce)}" {{(pid=87272) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 04 11:05:02 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.remotefs [None req-6183cf2a-109a-48df-9172-102de0e149ed tempest-TestInstancesWithCinderVolumes-746758368 None] Creating volume f5b74216-220d-4249-ad9d-e571b959090f {{(pid=87272) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 11:05:02 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-6183cf2a-109a-48df-9172-102de0e149ed tempest-TestInstancesWithCinderVolumes-746758368 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 11:05:02 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-6183cf2a-109a-48df-9172-102de0e149ed tempest-TestInstancesWithCinderVolumes-746758368 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 11:05:02 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-6183cf2a-109a-48df-9172-102de0e149ed tempest-TestInstancesWithCinderVolumes-746758368 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898': None} {{(pid=87272) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 11:05:02 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-6183cf2a-109a-48df-9172-102de0e149ed tempest-TestInstancesWithCinderVolumes-746758368 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'] {{(pid=87272) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 11:05:02 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-6183cf2a-109a-48df-9172-102de0e149ed tempest-TestInstancesWithCinderVolumes-746758368 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 11:05:02 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-6183cf2a-109a-48df-9172-102de0e149ed tempest-TestInstancesWithCinderVolumes-746758368 None] Selected osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898 as target Quobyte volume. {{(pid=87272) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 11:05:02 devstack cinder-volume[87272]: INFO cinder.volume.drivers.remotefs [None req-6183cf2a-109a-48df-9172-102de0e149ed tempest-TestInstancesWithCinderVolumes-746758368 None] casted to osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898 Nov 04 11:05:02 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-6183cf2a-109a-48df-9172-102de0e149ed tempest-TestInstancesWithCinderVolumes-746758368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-f5b74216-220d-4249-ad9d-e571b959090f 1073741824 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:05:02 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-ebc86907-026a-45ed-a9f0-d799961f0f46 tempest-TestInstancesWithCinderVolumes-746758368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f4bea74-ae8e-492e-8805-b18d683c12e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7b8366db-73f3-469f-a9be-e2635173e3ec', 'volume_size': 1}' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:05:02 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-ebc86907-026a-45ed-a9f0-d799961f0f46 tempest-TestInstancesWithCinderVolumes-746758368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc6a64b7-8c41-403f-903c-83dbe92718fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:05:02 devstack sudo[102886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-f5b74216-220d-4249-ad9d-e571b959090f 1073741824 Nov 04 11:05:02 devstack sudo[102886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:05:02 devstack cinder-volume[87272]: INFO cinder.volume.flows.manager.create_volume [None req-ebc86907-026a-45ed-a9f0-d799961f0f46 tempest-TestInstancesWithCinderVolumes-746758368 None] Volume volume-7b8366db-73f3-469f-a9be-e2635173e3ec (7b8366db-73f3-469f-a9be-e2635173e3ec): created successfully Nov 04 11:05:02 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-ebc86907-026a-45ed-a9f0-d799961f0f46 tempest-TestInstancesWithCinderVolumes-746758368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc6a64b7-8c41-403f-903c-83dbe92718fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:05:02 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-ebc86907-026a-45ed-a9f0-d799961f0f46 tempest-TestInstancesWithCinderVolumes-746758368 None] Flow 'volume_create_manager' (319f3f74-7299-4938-87a5-5fefa0ba6505) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87272) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 11:05:02 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-ebc86907-026a-45ed-a9f0-d799961f0f46 tempest-TestInstancesWithCinderVolumes-746758368 None] Created volume successfully. Nov 04 11:05:02 devstack cinder-volume[87272]: DEBUG cinder.volume.flows.manager.create_volume [None req-daefef23-ad39-435d-a33e-03f280bc0aae tempest-TestInstancesWithCinderVolumes-746758368 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87272) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 11:05:02 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-daefef23-ad39-435d-a33e-03f280bc0aae tempest-TestInstancesWithCinderVolumes-746758368 None] Flow 'volume_create_manager' (73ebc575-e11f-4405-80a6-c95b9e9489b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 11:05:02 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-daefef23-ad39-435d-a33e-03f280bc0aae tempest-TestInstancesWithCinderVolumes-746758368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9dbb57f1-2fda-4572-861b-f39a1ec1f215) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:05:02 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-daefef23-ad39-435d-a33e-03f280bc0aae tempest-TestInstancesWithCinderVolumes-746758368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9dbb57f1-2fda-4572-861b-f39a1ec1f215) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T10:05:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-498412359',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1511e7e5-77db-49b5-a689-acfffffc1d76,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='53cef4f0200842a3be3fe4ccec9fc883',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T10:05:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T10:05:03Z,use_quota=True,user_id='0a826b4600d6458ba5cfa4b6a04efa11',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8de05ad-ee0e-4c3a-8a23-e120bd50aa37),volume_type_id=f8de05ad-ee0e-4c3a-8a23-e120bd50aa37)' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:05:02 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-daefef23-ad39-435d-a33e-03f280bc0aae tempest-TestInstancesWithCinderVolumes-746758368 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a52b0f99-4dbf-498f-b166-80e2ae1b5604) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:05:02 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-daefef23-ad39-435d-a33e-03f280bc0aae tempest-TestInstancesWithCinderVolumes-746758368 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a52b0f99-4dbf-498f-b166-80e2ae1b5604) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:05:02 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-daefef23-ad39-435d-a33e-03f280bc0aae tempest-TestInstancesWithCinderVolumes-746758368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8651be23-cdcf-4551-9d3c-cf45a9d7e61e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:05:02 devstack cinder-volume[87272]: DEBUG cinder.image.glance [None req-daefef23-ad39-435d-a33e-03f280bc0aae tempest-TestInstancesWithCinderVolumes-746758368 None] Creating Keystone auth plugin from conf {{(pid=87272) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 04 11:05:02 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-daefef23-ad39-435d-a33e-03f280bc0aae tempest-TestInstancesWithCinderVolumes-746758368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8651be23-cdcf-4551-9d3c-cf45a9d7e61e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '1511e7e5-77db-49b5-a689-acfffffc1d76', 'volume_name': 'volume-1511e7e5-77db-49b5-a689-acfffffc1d76', 'volume_size': 1, 'image_id': 'd717310f-6300-451b-a00c-b450083ca9a6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d717310f-6300-451b-a00c-b450083ca9a6', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--665756709', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '53cef4f0200842a3be3fe4ccec9fc883', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd717310f-6300-451b-a00c-b450083ca9a6', 'created_at': datetime.datetime(2026, 11, 4, 10, 4, 59, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 4, 10, 5, 1, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d717310f-6300-451b-a00c-b450083ca9a6/file', 'properties': {}}, 'image_service': }' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:05:02 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-daefef23-ad39-435d-a33e-03f280bc0aae tempest-TestInstancesWithCinderVolumes-746758368 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29096d47-3ca8-4d53-8eb2-ee5217446775) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:05:02 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-daefef23-ad39-435d-a33e-03f280bc0aae tempest-TestInstancesWithCinderVolumes-746758368 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29096d47-3ca8-4d53-8eb2-ee5217446775) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:05:02 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-daefef23-ad39-435d-a33e-03f280bc0aae tempest-TestInstancesWithCinderVolumes-746758368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d839c5ec-0c21-4086-8075-82c685cb94fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:05:02 devstack cinder-volume[87272]: INFO cinder.volume.flows.manager.create_volume [None req-daefef23-ad39-435d-a33e-03f280bc0aae tempest-TestInstancesWithCinderVolumes-746758368 None] Volume 1511e7e5-77db-49b5-a689-acfffffc1d76: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-1511e7e5-77db-49b5-a689-acfffffc1d76', 'volume_size': 1, 'image_id': 'd717310f-6300-451b-a00c-b450083ca9a6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d717310f-6300-451b-a00c-b450083ca9a6', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--665756709', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '53cef4f0200842a3be3fe4ccec9fc883', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd717310f-6300-451b-a00c-b450083ca9a6', 'created_at': datetime.datetime(2026, 11, 4, 10, 4, 59, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 4, 10, 5, 1, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d717310f-6300-451b-a00c-b450083ca9a6/file', 'properties': {}}, 'image_service': } Nov 04 11:05:02 devstack cinder-volume[87272]: DEBUG cinder.volume.flows.manager.create_volume [None req-daefef23-ad39-435d-a33e-03f280bc0aae tempest-TestInstancesWithCinderVolumes-746758368 None] Trying to clone 1511e7e5-77db-49b5-a689-acfffffc1d76 from image d717310f-6300-451b-a00c-b450083ca9a6 at location (None, [{'url': 'file:///opt/stack/data/glance/images/d717310f-6300-451b-a00c-b450083ca9a6', 'metadata': {}}]). {{(pid=87272) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 04 11:05:02 devstack sudo[102886]: pam_unix(sudo:session): session closed for user root Nov 04 11:05:02 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-6183cf2a-109a-48df-9172-102de0e149ed tempest-TestInstancesWithCinderVolumes-746758368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-f5b74216-220d-4249-ad9d-e571b959090f 1073741824" returned: 0 in 0.464s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:05:02 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-6183cf2a-109a-48df-9172-102de0e149ed tempest-TestInstancesWithCinderVolumes-746758368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-f5b74216-220d-4249-ad9d-e571b959090f {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:05:03 devstack sudo[102892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-f5b74216-220d-4249-ad9d-e571b959090f Nov 04 11:05:03 devstack sudo[102892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:05:03 devstack sudo[102892]: pam_unix(sudo:session): session closed for user root Nov 04 11:05:03 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-6183cf2a-109a-48df-9172-102de0e149ed tempest-TestInstancesWithCinderVolumes-746758368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-f5b74216-220d-4249-ad9d-e571b959090f" returned: 0 in 0.246s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:05:03 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-6183cf2a-109a-48df-9172-102de0e149ed tempest-TestInstancesWithCinderVolumes-746758368 None] <== create_volume: return (758ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'} {{(pid=87272) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 04 11:05:03 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-6183cf2a-109a-48df-9172-102de0e149ed tempest-TestInstancesWithCinderVolumes-746758368 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.760s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 11:05:03 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-6183cf2a-109a-48df-9172-102de0e149ed tempest-TestInstancesWithCinderVolumes-746758368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a8c5c12-1a56-4db3-9d59-b5f06a9bfe3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f5b74216-220d-4249-ad9d-e571b959090f', 'volume_size': 1}' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:05:03 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-6183cf2a-109a-48df-9172-102de0e149ed tempest-TestInstancesWithCinderVolumes-746758368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b96f67a-e49e-4fbd-82ee-2800e4f74104) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:05:03 devstack cinder-volume[87272]: INFO cinder.volume.flows.manager.create_volume [None req-6183cf2a-109a-48df-9172-102de0e149ed tempest-TestInstancesWithCinderVolumes-746758368 None] Volume volume-f5b74216-220d-4249-ad9d-e571b959090f (f5b74216-220d-4249-ad9d-e571b959090f): created successfully Nov 04 11:05:03 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-6183cf2a-109a-48df-9172-102de0e149ed tempest-TestInstancesWithCinderVolumes-746758368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b96f67a-e49e-4fbd-82ee-2800e4f74104) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:05:03 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-6183cf2a-109a-48df-9172-102de0e149ed tempest-TestInstancesWithCinderVolumes-746758368 None] Flow 'volume_create_manager' (7882fc92-28d6-45e1-86e8-7727fb4b13bc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87272) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 11:05:03 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-6183cf2a-109a-48df-9172-102de0e149ed tempest-TestInstancesWithCinderVolumes-746758368 None] Created volume successfully. Nov 04 11:05:05 devstack cinder-volume[87272]: DEBUG cinder.image.image_utils [None req-daefef23-ad39-435d-a33e-03f280bc0aae tempest-TestInstancesWithCinderVolumes-746758368 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_d717310f-6300-451b-a00c-b450083ca9a6_fkcnof4udevstack@QuobyteHD, size 20.69 MB, duration 2.79 sec {{(pid=87272) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Nov 04 11:05:05 devstack cinder-volume[87272]: INFO cinder.image.image_utils [None req-daefef23-ad39-435d-a33e-03f280bc0aae tempest-TestInstancesWithCinderVolumes-746758368 None] Image download 20.69 MB at 7.41 MB/s Nov 04 11:05:05 devstack cinder-volume[87272]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b2bf12a-822f-47a0-a31b-75f7de765f9a]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 11:05:05 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-daefef23-ad39-435d-a33e-03f280bc0aae tempest-TestInstancesWithCinderVolumes-746758368 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d717310f-6300-451b-a00c-b450083ca9a6_fkcnof4udevstack@QuobyteHD {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:05:05 devstack sudo[102895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d717310f-6300-451b-a00c-b450083ca9a6_fkcnof4udevstack@QuobyteHD Nov 04 11:05:05 devstack sudo[102895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:05:06 devstack sudo[102895]: pam_unix(sudo:session): session closed for user root Nov 04 11:05:06 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-daefef23-ad39-435d-a33e-03f280bc0aae tempest-TestInstancesWithCinderVolumes-746758368 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d717310f-6300-451b-a00c-b450083ca9a6_fkcnof4udevstack@QuobyteHD" returned: 0 in 0.333s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:05:06 devstack cinder-volume[87272]: DEBUG cinder.image.image_utils [None req-daefef23-ad39-435d-a33e-03f280bc0aae tempest-TestInstancesWithCinderVolumes-746758368 None] Temporary image d717310f-6300-451b-a00c-b450083ca9a6 is fetched for user 0a826b4600d6458ba5cfa4b6a04efa11. {{(pid=87272) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Nov 04 11:05:06 devstack cinder-volume[87272]: DEBUG oslo.privsep.daemon [-] privsep: reply[50f6d986-2620-4a0b-bba1-9840ff27ecc9]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 11:05:06 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-daefef23-ad39-435d-a33e-03f280bc0aae tempest-TestInstancesWithCinderVolumes-746758368 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d717310f-6300-451b-a00c-b450083ca9a6_fkcnof4udevstack@QuobyteHD {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:05:06 devstack sudo[102900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d717310f-6300-451b-a00c-b450083ca9a6_fkcnof4udevstack@QuobyteHD Nov 04 11:05:06 devstack sudo[102900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:05:06 devstack sudo[102900]: pam_unix(sudo:session): session closed for user root Nov 04 11:05:06 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-daefef23-ad39-435d-a33e-03f280bc0aae tempest-TestInstancesWithCinderVolumes-746758368 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d717310f-6300-451b-a00c-b450083ca9a6_fkcnof4udevstack@QuobyteHD" returned: 0 in 0.335s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:05:06 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-daefef23-ad39-435d-a33e-03f280bc0aae tempest-TestInstancesWithCinderVolumes-746758368 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 11:05:06 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-daefef23-ad39-435d-a33e-03f280bc0aae tempest-TestInstancesWithCinderVolumes-746758368 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 11:05:06 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-daefef23-ad39-435d-a33e-03f280bc0aae tempest-TestInstancesWithCinderVolumes-746758368 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T10:05:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-498412359',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1511e7e5-77db-49b5-a689-acfffffc1d76,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='53cef4f0200842a3be3fe4ccec9fc883',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T10:05:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T10:05:03Z,use_quota=True,user_id='0a826b4600d6458ba5cfa4b6a04efa11',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8de05ad-ee0e-4c3a-8a23-e120bd50aa37),volume_type_id=f8de05ad-ee0e-4c3a-8a23-e120bd50aa37)}" {{(pid=87272) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 04 11:05:06 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.remotefs [None req-daefef23-ad39-435d-a33e-03f280bc0aae tempest-TestInstancesWithCinderVolumes-746758368 None] Creating volume 1511e7e5-77db-49b5-a689-acfffffc1d76 {{(pid=87272) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 11:05:06 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-daefef23-ad39-435d-a33e-03f280bc0aae tempest-TestInstancesWithCinderVolumes-746758368 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 11:05:06 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-daefef23-ad39-435d-a33e-03f280bc0aae tempest-TestInstancesWithCinderVolumes-746758368 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 11:05:06 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-daefef23-ad39-435d-a33e-03f280bc0aae tempest-TestInstancesWithCinderVolumes-746758368 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898': None} {{(pid=87272) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 11:05:06 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-daefef23-ad39-435d-a33e-03f280bc0aae tempest-TestInstancesWithCinderVolumes-746758368 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'] {{(pid=87272) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 11:05:06 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-daefef23-ad39-435d-a33e-03f280bc0aae tempest-TestInstancesWithCinderVolumes-746758368 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 11:05:06 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-daefef23-ad39-435d-a33e-03f280bc0aae tempest-TestInstancesWithCinderVolumes-746758368 None] Selected osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898 as target Quobyte volume. {{(pid=87272) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 11:05:06 devstack cinder-volume[87272]: INFO cinder.volume.drivers.remotefs [None req-daefef23-ad39-435d-a33e-03f280bc0aae tempest-TestInstancesWithCinderVolumes-746758368 None] casted to osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898 Nov 04 11:05:06 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-daefef23-ad39-435d-a33e-03f280bc0aae tempest-TestInstancesWithCinderVolumes-746758368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-1511e7e5-77db-49b5-a689-acfffffc1d76 1073741824 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:05:06 devstack sudo[102906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-1511e7e5-77db-49b5-a689-acfffffc1d76 1073741824 Nov 04 11:05:06 devstack sudo[102906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:05:06 devstack sudo[102906]: pam_unix(sudo:session): session closed for user root Nov 04 11:05:06 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-daefef23-ad39-435d-a33e-03f280bc0aae tempest-TestInstancesWithCinderVolumes-746758368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-1511e7e5-77db-49b5-a689-acfffffc1d76 1073741824" returned: 0 in 0.437s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:05:06 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-daefef23-ad39-435d-a33e-03f280bc0aae tempest-TestInstancesWithCinderVolumes-746758368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-1511e7e5-77db-49b5-a689-acfffffc1d76 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:05:06 devstack sudo[102911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-1511e7e5-77db-49b5-a689-acfffffc1d76 Nov 04 11:05:06 devstack sudo[102911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:05:07 devstack sudo[102911]: pam_unix(sudo:session): session closed for user root Nov 04 11:05:07 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-daefef23-ad39-435d-a33e-03f280bc0aae tempest-TestInstancesWithCinderVolumes-746758368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-1511e7e5-77db-49b5-a689-acfffffc1d76" returned: 0 in 0.233s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:05:07 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-daefef23-ad39-435d-a33e-03f280bc0aae tempest-TestInstancesWithCinderVolumes-746758368 None] <== create_volume: return (717ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'} {{(pid=87272) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 04 11:05:07 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-daefef23-ad39-435d-a33e-03f280bc0aae tempest-TestInstancesWithCinderVolumes-746758368 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.721s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 11:05:07 devstack cinder-volume[87272]: DEBUG cinder.volume.volume_utils [None req-daefef23-ad39-435d-a33e-03f280bc0aae tempest-TestInstancesWithCinderVolumes-746758368 None] Attempting download of d717310f-6300-451b-a00c-b450083ca9a6 ((None, [{'url': 'file:///opt/stack/data/glance/images/d717310f-6300-451b-a00c-b450083ca9a6', 'metadata': {}}])) to volume 1511e7e5-77db-49b5-a689-acfffffc1d76. {{(pid=87272) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Nov 04 11:05:07 devstack cinder-volume[87272]: DEBUG oslo.privsep.daemon [-] privsep: reply[291db69a-2327-4e47-ba92-ad88e48fb552]: (4, 'raw') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 11:05:07 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-daefef23-ad39-435d-a33e-03f280bc0aae tempest-TestInstancesWithCinderVolumes-746758368 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d717310f-6300-451b-a00c-b450083ca9a6_nu9_7nre {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:05:07 devstack sudo[102914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d717310f-6300-451b-a00c-b450083ca9a6_nu9_7nre Nov 04 11:05:07 devstack sudo[102914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:05:07 devstack sudo[102914]: pam_unix(sudo:session): session closed for user root Nov 04 11:05:07 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-daefef23-ad39-435d-a33e-03f280bc0aae tempest-TestInstancesWithCinderVolumes-746758368 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d717310f-6300-451b-a00c-b450083ca9a6_nu9_7nre" returned: 0 in 0.312s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:05:07 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-daefef23-ad39-435d-a33e-03f280bc0aae tempest-TestInstancesWithCinderVolumes-746758368 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d717310f-6300-451b-a00c-b450083ca9a6_nu9_7nre {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:05:07 devstack sudo[102918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d717310f-6300-451b-a00c-b450083ca9a6_nu9_7nre Nov 04 11:05:07 devstack sudo[102918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:05:07 devstack sudo[102918]: pam_unix(sudo:session): session closed for user root Nov 04 11:05:07 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-daefef23-ad39-435d-a33e-03f280bc0aae tempest-TestInstancesWithCinderVolumes-746758368 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d717310f-6300-451b-a00c-b450083ca9a6_nu9_7nre" returned: 1 in 0.357s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:05:07 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-daefef23-ad39-435d-a33e-03f280bc0aae tempest-TestInstancesWithCinderVolumes-746758368 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d717310f-6300-451b-a00c-b450083ca9a6_nu9_7nre' failed. Not Retrying. {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 04 11:05:07 devstack cinder-volume[87272]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c7576e3-096a-459e-97fa-21bb139f9a3d]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 11:05:07 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-daefef23-ad39-435d-a33e-03f280bc0aae tempest-TestInstancesWithCinderVolumes-746758368 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d717310f-6300-451b-a00c-b450083ca9a6_fkcnof4udevstack@QuobyteHD {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:05:08 devstack sudo[102923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d717310f-6300-451b-a00c-b450083ca9a6_fkcnof4udevstack@QuobyteHD Nov 04 11:05:08 devstack sudo[102923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:05:08 devstack sudo[102923]: pam_unix(sudo:session): session closed for user root Nov 04 11:05:08 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-daefef23-ad39-435d-a33e-03f280bc0aae tempest-TestInstancesWithCinderVolumes-746758368 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d717310f-6300-451b-a00c-b450083ca9a6_fkcnof4udevstack@QuobyteHD" returned: 0 in 0.340s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:05:08 devstack cinder-volume[87272]: DEBUG cinder.image.image_utils [None req-daefef23-ad39-435d-a33e-03f280bc0aae tempest-TestInstancesWithCinderVolumes-746758368 None] d717310f-6300-451b-a00c-b450083ca9a6 was qcow2, converting to qcow2 {{(pid=87272) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Nov 04 11:05:08 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-daefef23-ad39-435d-a33e-03f280bc0aae tempest-TestInstancesWithCinderVolumes-746758368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d717310f-6300-451b-a00c-b450083ca9a6_fkcnof4udevstack@QuobyteHD /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-1511e7e5-77db-49b5-a689-acfffffc1d76 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:05:08 devstack sudo[102928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d717310f-6300-451b-a00c-b450083ca9a6_fkcnof4udevstack@QuobyteHD /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-1511e7e5-77db-49b5-a689-acfffffc1d76 Nov 04 11:05:08 devstack sudo[102928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:05:10 devstack sudo[102928]: pam_unix(sudo:session): session closed for user root Nov 04 11:05:10 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-daefef23-ad39-435d-a33e-03f280bc0aae tempest-TestInstancesWithCinderVolumes-746758368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d717310f-6300-451b-a00c-b450083ca9a6_fkcnof4udevstack@QuobyteHD /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-1511e7e5-77db-49b5-a689-acfffffc1d76" returned: 0 in 1.860s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:05:10 devstack cinder-volume[87272]: DEBUG cinder.image.image_utils [None req-daefef23-ad39-435d-a33e-03f280bc0aae tempest-TestInstancesWithCinderVolumes-746758368 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_d717310f-6300-451b-a00c-b450083ca9a6_fkcnof4udevstack@QuobyteHD, size 112.00 MB, duration 1.86 sec, destination /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-1511e7e5-77db-49b5-a689-acfffffc1d76 {{(pid=87272) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Nov 04 11:05:10 devstack cinder-volume[87272]: INFO cinder.image.image_utils [None req-daefef23-ad39-435d-a33e-03f280bc0aae tempest-TestInstancesWithCinderVolumes-746758368 None] Converted 112.00 MB image at 60.16 MB/s Nov 04 11:05:10 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-daefef23-ad39-435d-a33e-03f280bc0aae tempest-TestInstancesWithCinderVolumes-746758368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-1511e7e5-77db-49b5-a689-acfffffc1d76 1G {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:05:10 devstack sudo[102943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-1511e7e5-77db-49b5-a689-acfffffc1d76 1G Nov 04 11:05:10 devstack sudo[102943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:05:10 devstack sudo[102943]: pam_unix(sudo:session): session closed for user root Nov 04 11:05:10 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-daefef23-ad39-435d-a33e-03f280bc0aae tempest-TestInstancesWithCinderVolumes-746758368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-1511e7e5-77db-49b5-a689-acfffffc1d76 1G" returned: 0 in 0.333s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:05:10 devstack cinder-volume[87272]: DEBUG cinder.volume.volume_utils [None req-daefef23-ad39-435d-a33e-03f280bc0aae tempest-TestInstancesWithCinderVolumes-746758368 None] Downloaded image d717310f-6300-451b-a00c-b450083ca9a6 ((None, [{'url': 'file:///opt/stack/data/glance/images/d717310f-6300-451b-a00c-b450083ca9a6', 'metadata': {}}])) to volume 1511e7e5-77db-49b5-a689-acfffffc1d76 successfully. {{(pid=87272) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Nov 04 11:05:10 devstack cinder-volume[87272]: DEBUG cinder.image.image_utils [None req-daefef23-ad39-435d-a33e-03f280bc0aae tempest-TestInstancesWithCinderVolumes-746758368 None] Temporary image d717310f-6300-451b-a00c-b450083ca9a6 for user 0a826b4600d6458ba5cfa4b6a04efa11 is deleted. {{(pid=87272) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Nov 04 11:05:10 devstack cinder-volume[87272]: DEBUG cinder.volume.volume_utils [None req-daefef23-ad39-435d-a33e-03f280bc0aae tempest-TestInstancesWithCinderVolumes-746758368 None] Marking volume 1511e7e5-77db-49b5-a689-acfffffc1d76 as bootable. {{(pid=87272) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Nov 04 11:05:10 devstack cinder-volume[87272]: DEBUG cinder.volume.flows.manager.create_volume [None req-daefef23-ad39-435d-a33e-03f280bc0aae tempest-TestInstancesWithCinderVolumes-746758368 None] Copying metadata from image d717310f-6300-451b-a00c-b450083ca9a6 to 1511e7e5-77db-49b5-a689-acfffffc1d76. {{(pid=87272) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 04 11:05:10 devstack cinder-volume[87272]: DEBUG cinder.volume.flows.manager.create_volume [None req-daefef23-ad39-435d-a33e-03f280bc0aae tempest-TestInstancesWithCinderVolumes-746758368 None] Creating volume glance metadata for volume 1511e7e5-77db-49b5-a689-acfffffc1d76 backed by image d717310f-6300-451b-a00c-b450083ca9a6 with: {'image_id': 'd717310f-6300-451b-a00c-b450083ca9a6', 'image_name': 'tempest-scenario-img--665756709', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87272) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 04 11:05:10 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-daefef23-ad39-435d-a33e-03f280bc0aae tempest-TestInstancesWithCinderVolumes-746758368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d839c5ec-0c21-4086-8075-82c685cb94fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1511e7e5-77db-49b5-a689-acfffffc1d76', 'volume_size': 1, 'image_id': 'd717310f-6300-451b-a00c-b450083ca9a6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d717310f-6300-451b-a00c-b450083ca9a6', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--665756709', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '53cef4f0200842a3be3fe4ccec9fc883', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd717310f-6300-451b-a00c-b450083ca9a6', 'created_at': datetime.datetime(2026, 11, 4, 10, 4, 59, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 4, 10, 5, 1, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d717310f-6300-451b-a00c-b450083ca9a6/file', 'properties': {}}, 'image_service': }' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:05:10 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-daefef23-ad39-435d-a33e-03f280bc0aae tempest-TestInstancesWithCinderVolumes-746758368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (38ab71d7-1212-4071-a828-f309000af92b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:05:10 devstack cinder-volume[87272]: INFO cinder.volume.flows.manager.create_volume [None req-daefef23-ad39-435d-a33e-03f280bc0aae tempest-TestInstancesWithCinderVolumes-746758368 None] Volume volume-1511e7e5-77db-49b5-a689-acfffffc1d76 (1511e7e5-77db-49b5-a689-acfffffc1d76): created successfully Nov 04 11:05:10 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-daefef23-ad39-435d-a33e-03f280bc0aae tempest-TestInstancesWithCinderVolumes-746758368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (38ab71d7-1212-4071-a828-f309000af92b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:05:10 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-daefef23-ad39-435d-a33e-03f280bc0aae tempest-TestInstancesWithCinderVolumes-746758368 None] Flow 'volume_create_manager' (73ebc575-e11f-4405-80a6-c95b9e9489b3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87272) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 11:05:10 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-daefef23-ad39-435d-a33e-03f280bc0aae tempest-TestInstancesWithCinderVolumes-746758368 None] Created volume successfully. Nov 04 11:05:13 devstack cinder-volume[87272]: INFO cinder.volume.manager [req-216de2f0-8d85-4802-bb9a-7c3a0b318a1f req-821c491c-23c7-44a1-a699-f7ff6d351432 tempest-TestShelveInstance-950917247 None] Terminate volume connection completed successfully. Nov 04 11:05:13 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [req-216de2f0-8d85-4802-bb9a-7c3a0b318a1f req-821c491c-23c7-44a1-a699-f7ff6d351432 tempest-TestShelveInstance-950917247 None] Deleting attachment 7aa834d6-e790-4d9a-be0e-57ee487cfd73. {{(pid=87272) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 04 11:05:13 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [req-9de0a765-d859-4381-83a6-1878a1789f93 req-955009f6-db18-48c8-a88f-adbad1654413 tempest-TestInstancesWithCinderVolumes-746758368 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 11:05:13 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [req-9de0a765-d859-4381-83a6-1878a1789f93 req-955009f6-db18-48c8-a88f-adbad1654413 tempest-TestInstancesWithCinderVolumes-746758368 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 11:05:13 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [req-9de0a765-d859-4381-83a6-1878a1789f93 req-955009f6-db18-48c8-a88f-adbad1654413 tempest-TestInstancesWithCinderVolumes-746758368 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.011s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 11:05:14 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [req-9de0a765-d859-4381-83a6-1878a1789f93 req-955009f6-db18-48c8-a88f-adbad1654413 tempest-TestInstancesWithCinderVolumes-746758368 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898', 'name': 'volume-1511e7e5-77db-49b5-a689-acfffffc1d76', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '0cb55937-0d54-4b09-8007-6167429f800e', 'enforce_multipath': True} {{(pid=87272) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 04 11:05:14 devstack cinder-volume[87272]: INFO cinder.volume.manager [req-9de0a765-d859-4381-83a6-1878a1789f93 req-955009f6-db18-48c8-a88f-adbad1654413 tempest-TestInstancesWithCinderVolumes-746758368 None] attachment_update completed successfully. Nov 04 11:05:14 devstack cinder-volume[87272]: DEBUG oslo_service.periodic_task [None req-236af0be-7f9d-4c80-b3d7-d645a9cd0dd1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87272) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 04 11:05:14 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-236af0be-7f9d-4c80-b3d7-d645a9cd0dd1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 11:05:14 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-236af0be-7f9d-4c80-b3d7-d645a9cd0dd1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 11:05:14 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-236af0be-7f9d-4c80-b3d7-d645a9cd0dd1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898': None} {{(pid=87272) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 11:05:14 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-236af0be-7f9d-4c80-b3d7-d645a9cd0dd1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'] {{(pid=87272) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 11:05:14 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-236af0be-7f9d-4c80-b3d7-d645a9cd0dd1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 11:05:14 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-236af0be-7f9d-4c80-b3d7-d645a9cd0dd1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:05:14 devstack sudo[102985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1 Nov 04 11:05:14 devstack sudo[102985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:05:14 devstack sudo[102985]: pam_unix(sudo:session): session closed for user root Nov 04 11:05:14 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-236af0be-7f9d-4c80-b3d7-d645a9cd0dd1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1" returned: 0 in 0.344s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:05:14 devstack cinder-volume[87272]: DEBUG cinder.manager [None req-236af0be-7f9d-4c80-b3d7-d645a9cd0dd1 None None] Notifying Schedulers of capabilities ... {{(pid=87272) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 11:05:14 devstack cinder-volume[87272]: DEBUG oslo_service.periodic_task [None req-236af0be-7f9d-4c80-b3d7-d645a9cd0dd1 None None] Running periodic task VolumeManager._thread_info {{(pid=87272) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 04 11:05:14 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-236af0be-7f9d-4c80-b3d7-d645a9cd0dd1 None None] thread count: 28 {{(pid=87272) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 04 11:05:14 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-236af0be-7f9d-4c80-b3d7-d645a9cd0dd1 None None] thread info: [<_MainThread(MainThread, started 127085713244288)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87272) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 04 11:05:16 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [req-0c4d9b98-0a19-4611-83d5-52f471134364 req-1003baf9-f619-438b-9179-ce2a02432917 tempest-TestShelveInstance-950917247 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 11:05:16 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [req-0c4d9b98-0a19-4611-83d5-52f471134364 req-1003baf9-f619-438b-9179-ce2a02432917 tempest-TestShelveInstance-950917247 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 11:05:16 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [req-0c4d9b98-0a19-4611-83d5-52f471134364 req-1003baf9-f619-438b-9179-ce2a02432917 tempest-TestShelveInstance-950917247 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.012s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 11:05:16 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [req-0c4d9b98-0a19-4611-83d5-52f471134364 req-1003baf9-f619-438b-9179-ce2a02432917 tempest-TestShelveInstance-950917247 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898', 'name': 'volume-7266d2a8-2c6e-4fe6-8df2-6eca6d71a40f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '2d946c5e-56b0-4ab0-a3ee-c35cebed9073', 'enforce_multipath': True} {{(pid=87272) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 04 11:05:16 devstack cinder-volume[87272]: INFO cinder.volume.manager [req-0c4d9b98-0a19-4611-83d5-52f471134364 req-1003baf9-f619-438b-9179-ce2a02432917 tempest-TestShelveInstance-950917247 None] attachment_update completed successfully. Nov 04 11:05:26 devstack cinder-volume[87272]: DEBUG dbcounter [-] [87272] Writing DB stats cinder:SELECT=25,cinder:UPDATE=12,cinder:DELETE=3,cinder:INSERT=7 {{(pid=87272) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 11:05:26 devstack cinder-volume[87272]: DEBUG dbcounter [-] [87272] Writing DB stats cinder:SELECT=26,cinder:UPDATE=15,cinder:INSERT=5 {{(pid=87272) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 11:05:48 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [req-2a3f7555-b658-4de8-a793-1d4ceb7cda85 req-752a042a-8473-4f5c-a80a-0b3dd869fd5a tempest-TestInstancesWithCinderVolumes-746758368 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 11:05:48 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [req-2a3f7555-b658-4de8-a793-1d4ceb7cda85 req-752a042a-8473-4f5c-a80a-0b3dd869fd5a tempest-TestInstancesWithCinderVolumes-746758368 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 11:05:48 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [req-2a3f7555-b658-4de8-a793-1d4ceb7cda85 req-752a042a-8473-4f5c-a80a-0b3dd869fd5a tempest-TestInstancesWithCinderVolumes-746758368 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.011s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 11:05:48 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [req-2a3f7555-b658-4de8-a793-1d4ceb7cda85 req-752a042a-8473-4f5c-a80a-0b3dd869fd5a tempest-TestInstancesWithCinderVolumes-746758368 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898', 'name': 'volume-7b8366db-73f3-469f-a9be-e2635173e3ec', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '88d10712-b8f8-4ea6-a7e8-8225d91e71bd', 'enforce_multipath': True} {{(pid=87272) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 04 11:05:48 devstack cinder-volume[87272]: INFO cinder.volume.manager [req-2a3f7555-b658-4de8-a793-1d4ceb7cda85 req-752a042a-8473-4f5c-a80a-0b3dd869fd5a tempest-TestInstancesWithCinderVolumes-746758368 None] attachment_update completed successfully. Nov 04 11:05:50 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [req-0753127d-7c57-43c2-8050-001bebf91fe3 req-728413bc-02d7-4492-96bf-eab505aee892 tempest-TestInstancesWithCinderVolumes-746758368 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 11:05:50 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [req-0753127d-7c57-43c2-8050-001bebf91fe3 req-728413bc-02d7-4492-96bf-eab505aee892 tempest-TestInstancesWithCinderVolumes-746758368 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 11:05:50 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [req-0753127d-7c57-43c2-8050-001bebf91fe3 req-728413bc-02d7-4492-96bf-eab505aee892 tempest-TestInstancesWithCinderVolumes-746758368 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.010s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 11:05:50 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [req-0753127d-7c57-43c2-8050-001bebf91fe3 req-728413bc-02d7-4492-96bf-eab505aee892 tempest-TestInstancesWithCinderVolumes-746758368 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898', 'name': 'volume-f5b74216-220d-4249-ad9d-e571b959090f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '92817acf-d503-4d65-91e3-e0b815a84904', 'enforce_multipath': True} {{(pid=87272) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 04 11:05:50 devstack cinder-volume[87272]: INFO cinder.volume.manager [req-0753127d-7c57-43c2-8050-001bebf91fe3 req-728413bc-02d7-4492-96bf-eab505aee892 tempest-TestInstancesWithCinderVolumes-746758368 None] attachment_update completed successfully. Nov 04 11:05:55 devstack cinder-volume[87272]: INFO cinder.volume.manager [req-099553f1-0706-425a-ad73-cca81a9d3857 req-fa445521-b50e-4440-baea-a6565fb871ca tempest-TestInstancesWithCinderVolumes-746758368 None] Terminate volume connection completed successfully. Nov 04 11:05:55 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [req-099553f1-0706-425a-ad73-cca81a9d3857 req-fa445521-b50e-4440-baea-a6565fb871ca tempest-TestInstancesWithCinderVolumes-746758368 None] Deleting attachment 88d10712-b8f8-4ea6-a7e8-8225d91e71bd. {{(pid=87272) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 04 11:05:56 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-031246b5-3409-4f73-a854-966808476a4a tempest-TestInstancesWithCinderVolumes-746758368 None] Acquiring lock "cinder-7b8366db-73f3-469f-a9be-e2635173e3ec-delete_volume" by "delete_volume" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 11:05:56 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-031246b5-3409-4f73-a854-966808476a4a tempest-TestInstancesWithCinderVolumes-746758368 None] Lock "cinder-7b8366db-73f3-469f-a9be-e2635173e3ec-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 11:05:56 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-031246b5-3409-4f73-a854-966808476a4a tempest-TestInstancesWithCinderVolumes-746758368 None] Acquiring lock "cinder-quobyte-7b8366db-73f3-469f-a9be-e2635173e3ec" by "delete_volume" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 11:05:56 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-031246b5-3409-4f73-a854-966808476a4a tempest-TestInstancesWithCinderVolumes-746758368 None] Lock "cinder-quobyte-7b8366db-73f3-469f-a9be-e2635173e3ec" acquired by "delete_volume" :: waited 0.016s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 11:05:56 devstack cinder-volume[87272]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d5c15a1-5865-4c81-94c5-0abd68c0f78b]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 11:05:56 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-031246b5-3409-4f73-a854-966808476a4a tempest-TestInstancesWithCinderVolumes-746758368 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-7b8366db-73f3-469f-a9be-e2635173e3ec {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:05:56 devstack sudo[103707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-7b8366db-73f3-469f-a9be-e2635173e3ec Nov 04 11:05:56 devstack sudo[103707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:05:56 devstack sudo[103707]: pam_unix(sudo:session): session closed for user root Nov 04 11:05:56 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-031246b5-3409-4f73-a854-966808476a4a tempest-TestInstancesWithCinderVolumes-746758368 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-7b8366db-73f3-469f-a9be-e2635173e3ec" returned: 0 in 0.456s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:05:56 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-031246b5-3409-4f73-a854-966808476a4a tempest-TestInstancesWithCinderVolumes-746758368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-7b8366db-73f3-469f-a9be-e2635173e3ec {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:05:56 devstack sudo[103713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-7b8366db-73f3-469f-a9be-e2635173e3ec Nov 04 11:05:56 devstack sudo[103713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:05:56 devstack sudo[103713]: pam_unix(sudo:session): session closed for user root Nov 04 11:05:56 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-031246b5-3409-4f73-a854-966808476a4a tempest-TestInstancesWithCinderVolumes-746758368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-7b8366db-73f3-469f-a9be-e2635173e3ec" returned: 0 in 0.328s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:05:56 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-031246b5-3409-4f73-a854-966808476a4a tempest-TestInstancesWithCinderVolumes-746758368 None] Lock "cinder-quobyte-7b8366db-73f3-469f-a9be-e2635173e3ec" released by "delete_volume" :: held 0.849s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 11:05:56 devstack cinder-volume[87272]: WARNING cinder.quota [None req-031246b5-3409-4f73-a854-966808476a4a tempest-TestInstancesWithCinderVolumes-746758368 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1607805006-149042986 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1607805006-149042986, it is now deprecated. Please use the default quota class for default quota. Nov 04 11:05:56 devstack cinder-volume[87272]: WARNING cinder.quota [None req-031246b5-3409-4f73-a854-966808476a4a tempest-TestInstancesWithCinderVolumes-746758368 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1607805006-149042986 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1607805006-149042986, it is now deprecated. Please use the default quota class for default quota. Nov 04 11:05:56 devstack cinder-volume[87272]: DEBUG cinder.quota [None req-031246b5-3409-4f73-a854-966808476a4a tempest-TestInstancesWithCinderVolumes-746758368 None] Created reservations ['e3efa877-1a1b-430a-a9b7-400879371ff1', '69a4be92-8b02-4f5b-9979-8a1fffc5c8df', 'f494dcce-280d-4023-b0c5-726533c5042e', '5de19297-cbbb-42e7-9d46-4b305598ce4c'] {{(pid=87272) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 11:05:57 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-031246b5-3409-4f73-a854-966808476a4a tempest-TestInstancesWithCinderVolumes-746758368 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 11:05:57 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-031246b5-3409-4f73-a854-966808476a4a tempest-TestInstancesWithCinderVolumes-746758368 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 11:05:57 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-031246b5-3409-4f73-a854-966808476a4a tempest-TestInstancesWithCinderVolumes-746758368 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898': None} {{(pid=87272) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 11:05:57 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-031246b5-3409-4f73-a854-966808476a4a tempest-TestInstancesWithCinderVolumes-746758368 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'] {{(pid=87272) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 11:05:57 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-031246b5-3409-4f73-a854-966808476a4a tempest-TestInstancesWithCinderVolumes-746758368 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 11:05:57 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-031246b5-3409-4f73-a854-966808476a4a tempest-TestInstancesWithCinderVolumes-746758368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:05:57 devstack sudo[103716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1 Nov 04 11:05:57 devstack sudo[103716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:05:57 devstack sudo[103716]: pam_unix(sudo:session): session closed for user root Nov 04 11:05:57 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-031246b5-3409-4f73-a854-966808476a4a tempest-TestInstancesWithCinderVolumes-746758368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1" returned: 0 in 0.266s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:05:57 devstack cinder-volume[87272]: DEBUG cinder.manager [None req-031246b5-3409-4f73-a854-966808476a4a tempest-TestInstancesWithCinderVolumes-746758368 None] Notifying Schedulers of capabilities ... {{(pid=87272) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 11:05:57 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-031246b5-3409-4f73-a854-966808476a4a tempest-TestInstancesWithCinderVolumes-746758368 None] Deleted volume successfully. Nov 04 11:05:57 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-031246b5-3409-4f73-a854-966808476a4a tempest-TestInstancesWithCinderVolumes-746758368 None] Lock "cinder-7b8366db-73f3-469f-a9be-e2635173e3ec-delete_volume" released by "delete_volume" :: held 1.365s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 11:05:59 devstack cinder-volume[87272]: INFO cinder.volume.manager [req-43a03c12-4e74-41c9-9853-0d4d9a125a88 req-103eb2db-cee3-4c9e-92a0-b4bdceaea807 tempest-TestInstancesWithCinderVolumes-746758368 None] Terminate volume connection completed successfully. Nov 04 11:05:59 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [req-43a03c12-4e74-41c9-9853-0d4d9a125a88 req-103eb2db-cee3-4c9e-92a0-b4bdceaea807 tempest-TestInstancesWithCinderVolumes-746758368 None] Deleting attachment 92817acf-d503-4d65-91e3-e0b815a84904. {{(pid=87272) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 04 11:06:00 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-6125f6b8-1aef-4e76-8fb0-7862a5164101 tempest-TestInstancesWithCinderVolumes-746758368 None] Acquiring lock "cinder-f5b74216-220d-4249-ad9d-e571b959090f-delete_volume" by "delete_volume" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 11:06:00 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-6125f6b8-1aef-4e76-8fb0-7862a5164101 tempest-TestInstancesWithCinderVolumes-746758368 None] Lock "cinder-f5b74216-220d-4249-ad9d-e571b959090f-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 11:06:00 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-6125f6b8-1aef-4e76-8fb0-7862a5164101 tempest-TestInstancesWithCinderVolumes-746758368 None] Acquiring lock "cinder-quobyte-f5b74216-220d-4249-ad9d-e571b959090f" by "delete_volume" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 11:06:00 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-6125f6b8-1aef-4e76-8fb0-7862a5164101 tempest-TestInstancesWithCinderVolumes-746758368 None] Lock "cinder-quobyte-f5b74216-220d-4249-ad9d-e571b959090f" acquired by "delete_volume" :: waited 0.021s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 11:06:00 devstack cinder-volume[87272]: DEBUG oslo.privsep.daemon [-] privsep: reply[424b83d7-39ca-4dcd-933d-478a17663a06]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 11:06:00 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-6125f6b8-1aef-4e76-8fb0-7862a5164101 tempest-TestInstancesWithCinderVolumes-746758368 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-f5b74216-220d-4249-ad9d-e571b959090f {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:06:00 devstack sudo[103776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-f5b74216-220d-4249-ad9d-e571b959090f Nov 04 11:06:00 devstack sudo[103776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:06:01 devstack sudo[103776]: pam_unix(sudo:session): session closed for user root Nov 04 11:06:01 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-6125f6b8-1aef-4e76-8fb0-7862a5164101 tempest-TestInstancesWithCinderVolumes-746758368 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-f5b74216-220d-4249-ad9d-e571b959090f" returned: 0 in 0.435s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:06:01 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-6125f6b8-1aef-4e76-8fb0-7862a5164101 tempest-TestInstancesWithCinderVolumes-746758368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-f5b74216-220d-4249-ad9d-e571b959090f {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:06:01 devstack sudo[103781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-f5b74216-220d-4249-ad9d-e571b959090f Nov 04 11:06:01 devstack sudo[103781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:06:01 devstack cinder-volume[87272]: INFO cinder.volume.manager [req-06448899-d3ba-4c9c-8de9-8a005acd55a2 req-0332397b-6133-4e46-99fb-851d7466d24e tempest-TestShelveInstance-950917247 None] Terminate volume connection completed successfully. Nov 04 11:06:01 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [req-06448899-d3ba-4c9c-8de9-8a005acd55a2 req-0332397b-6133-4e46-99fb-851d7466d24e tempest-TestShelveInstance-950917247 None] Deleting attachment 2d946c5e-56b0-4ab0-a3ee-c35cebed9073. {{(pid=87272) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 04 11:06:01 devstack sudo[103781]: pam_unix(sudo:session): session closed for user root Nov 04 11:06:01 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-6125f6b8-1aef-4e76-8fb0-7862a5164101 tempest-TestInstancesWithCinderVolumes-746758368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-f5b74216-220d-4249-ad9d-e571b959090f" returned: 0 in 0.395s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:06:01 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-6125f6b8-1aef-4e76-8fb0-7862a5164101 tempest-TestInstancesWithCinderVolumes-746758368 None] Lock "cinder-quobyte-f5b74216-220d-4249-ad9d-e571b959090f" released by "delete_volume" :: held 0.892s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 11:06:01 devstack cinder-volume[87272]: WARNING cinder.quota [None req-6125f6b8-1aef-4e76-8fb0-7862a5164101 tempest-TestInstancesWithCinderVolumes-746758368 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1344474772-597089602 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1344474772-597089602, it is now deprecated. Please use the default quota class for default quota. Nov 04 11:06:01 devstack cinder-volume[87272]: WARNING cinder.quota [None req-6125f6b8-1aef-4e76-8fb0-7862a5164101 tempest-TestInstancesWithCinderVolumes-746758368 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1344474772-597089602 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1344474772-597089602, it is now deprecated. Please use the default quota class for default quota. Nov 04 11:06:01 devstack cinder-volume[87272]: DEBUG cinder.quota [None req-6125f6b8-1aef-4e76-8fb0-7862a5164101 tempest-TestInstancesWithCinderVolumes-746758368 None] Created reservations ['d99b27c8-39eb-4e24-82f1-b20f0f9168cb', 'aedf403b-2e4b-49e2-8c72-3cdef24208c5', 'ac245d5b-32b7-4863-8e1f-6c870df4d786', '978c9729-f364-4036-9a57-545540c0a7bc'] {{(pid=87272) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 11:06:01 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-6125f6b8-1aef-4e76-8fb0-7862a5164101 tempest-TestInstancesWithCinderVolumes-746758368 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 11:06:01 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-6125f6b8-1aef-4e76-8fb0-7862a5164101 tempest-TestInstancesWithCinderVolumes-746758368 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 11:06:01 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-6125f6b8-1aef-4e76-8fb0-7862a5164101 tempest-TestInstancesWithCinderVolumes-746758368 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898': None} {{(pid=87272) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 11:06:01 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-6125f6b8-1aef-4e76-8fb0-7862a5164101 tempest-TestInstancesWithCinderVolumes-746758368 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'] {{(pid=87272) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 11:06:01 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-6125f6b8-1aef-4e76-8fb0-7862a5164101 tempest-TestInstancesWithCinderVolumes-746758368 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 11:06:01 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-6125f6b8-1aef-4e76-8fb0-7862a5164101 tempest-TestInstancesWithCinderVolumes-746758368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:06:01 devstack cinder-volume[87272]: DEBUG cinder.coordination [req-06448899-d3ba-4c9c-8de9-8a005acd55a2 req-a1c198e5-9c44-4e1d-8393-1d6f4b75fc83 tempest-TestShelveInstance-950917247 None] Acquiring lock "cinder-7266d2a8-2c6e-4fe6-8df2-6eca6d71a40f-delete_volume" by "delete_volume" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 11:06:01 devstack sudo[103786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1 Nov 04 11:06:01 devstack sudo[103786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:06:01 devstack cinder-volume[87272]: DEBUG cinder.coordination [req-06448899-d3ba-4c9c-8de9-8a005acd55a2 req-a1c198e5-9c44-4e1d-8393-1d6f4b75fc83 tempest-TestShelveInstance-950917247 None] Lock "cinder-7266d2a8-2c6e-4fe6-8df2-6eca6d71a40f-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 11:06:01 devstack cinder-volume[87272]: DEBUG cinder.coordination [req-06448899-d3ba-4c9c-8de9-8a005acd55a2 req-a1c198e5-9c44-4e1d-8393-1d6f4b75fc83 tempest-TestShelveInstance-950917247 None] Acquiring lock "cinder-quobyte-7266d2a8-2c6e-4fe6-8df2-6eca6d71a40f" by "delete_volume" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 11:06:01 devstack cinder-volume[87272]: DEBUG cinder.coordination [req-06448899-d3ba-4c9c-8de9-8a005acd55a2 req-a1c198e5-9c44-4e1d-8393-1d6f4b75fc83 tempest-TestShelveInstance-950917247 None] Lock "cinder-quobyte-7266d2a8-2c6e-4fe6-8df2-6eca6d71a40f" acquired by "delete_volume" :: waited 0.025s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 11:06:01 devstack cinder-volume[87272]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8051fd1-78f0-47c9-a62f-af602d2dae00]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 11:06:01 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [req-06448899-d3ba-4c9c-8de9-8a005acd55a2 req-a1c198e5-9c44-4e1d-8393-1d6f4b75fc83 tempest-TestShelveInstance-950917247 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-7266d2a8-2c6e-4fe6-8df2-6eca6d71a40f {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:06:01 devstack sudo[103788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-7266d2a8-2c6e-4fe6-8df2-6eca6d71a40f Nov 04 11:06:01 devstack sudo[103788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:06:02 devstack sudo[103786]: pam_unix(sudo:session): session closed for user root Nov 04 11:06:02 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-6125f6b8-1aef-4e76-8fb0-7862a5164101 tempest-TestInstancesWithCinderVolumes-746758368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1" returned: 0 in 0.369s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:06:02 devstack cinder-volume[87272]: DEBUG cinder.manager [None req-6125f6b8-1aef-4e76-8fb0-7862a5164101 tempest-TestInstancesWithCinderVolumes-746758368 None] Notifying Schedulers of capabilities ... {{(pid=87272) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 11:06:02 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-6125f6b8-1aef-4e76-8fb0-7862a5164101 tempest-TestInstancesWithCinderVolumes-746758368 None] Deleted volume successfully. Nov 04 11:06:02 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-6125f6b8-1aef-4e76-8fb0-7862a5164101 tempest-TestInstancesWithCinderVolumes-746758368 None] Lock "cinder-f5b74216-220d-4249-ad9d-e571b959090f-delete_volume" released by "delete_volume" :: held 1.552s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 11:06:02 devstack sudo[103788]: pam_unix(sudo:session): session closed for user root Nov 04 11:06:02 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [req-06448899-d3ba-4c9c-8de9-8a005acd55a2 req-a1c198e5-9c44-4e1d-8393-1d6f4b75fc83 tempest-TestShelveInstance-950917247 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-7266d2a8-2c6e-4fe6-8df2-6eca6d71a40f" returned: 0 in 0.499s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:06:02 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [req-06448899-d3ba-4c9c-8de9-8a005acd55a2 req-a1c198e5-9c44-4e1d-8393-1d6f4b75fc83 tempest-TestShelveInstance-950917247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-7266d2a8-2c6e-4fe6-8df2-6eca6d71a40f {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:06:02 devstack sudo[103795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-7266d2a8-2c6e-4fe6-8df2-6eca6d71a40f Nov 04 11:06:02 devstack sudo[103795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:06:02 devstack sudo[103795]: pam_unix(sudo:session): session closed for user root Nov 04 11:06:02 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [req-06448899-d3ba-4c9c-8de9-8a005acd55a2 req-a1c198e5-9c44-4e1d-8393-1d6f4b75fc83 tempest-TestShelveInstance-950917247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-7266d2a8-2c6e-4fe6-8df2-6eca6d71a40f" returned: 0 in 0.334s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:06:02 devstack cinder-volume[87272]: DEBUG cinder.coordination [req-06448899-d3ba-4c9c-8de9-8a005acd55a2 req-a1c198e5-9c44-4e1d-8393-1d6f4b75fc83 tempest-TestShelveInstance-950917247 None] Lock "cinder-quobyte-7266d2a8-2c6e-4fe6-8df2-6eca6d71a40f" released by "delete_volume" :: held 0.910s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 11:06:02 devstack cinder-volume[87272]: DEBUG cinder.quota [req-06448899-d3ba-4c9c-8de9-8a005acd55a2 req-a1c198e5-9c44-4e1d-8393-1d6f4b75fc83 tempest-TestShelveInstance-950917247 None] Created reservations ['92024772-e6eb-4050-a453-7f939cf0c246', 'ba1526c5-9fd3-4070-996b-b801f06d88bd', '0e49c325-4d4c-442b-9e71-afc6956cf305', '20134d9e-302d-44af-94d1-7470d7afe724'] {{(pid=87272) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 11:06:02 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [req-06448899-d3ba-4c9c-8de9-8a005acd55a2 req-a1c198e5-9c44-4e1d-8393-1d6f4b75fc83 tempest-TestShelveInstance-950917247 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 11:06:02 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [req-06448899-d3ba-4c9c-8de9-8a005acd55a2 req-a1c198e5-9c44-4e1d-8393-1d6f4b75fc83 tempest-TestShelveInstance-950917247 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 11:06:02 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [req-06448899-d3ba-4c9c-8de9-8a005acd55a2 req-a1c198e5-9c44-4e1d-8393-1d6f4b75fc83 tempest-TestShelveInstance-950917247 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898': None} {{(pid=87272) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 11:06:02 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [req-06448899-d3ba-4c9c-8de9-8a005acd55a2 req-a1c198e5-9c44-4e1d-8393-1d6f4b75fc83 tempest-TestShelveInstance-950917247 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'] {{(pid=87272) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 11:06:02 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [req-06448899-d3ba-4c9c-8de9-8a005acd55a2 req-a1c198e5-9c44-4e1d-8393-1d6f4b75fc83 tempest-TestShelveInstance-950917247 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 11:06:02 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [req-06448899-d3ba-4c9c-8de9-8a005acd55a2 req-a1c198e5-9c44-4e1d-8393-1d6f4b75fc83 tempest-TestShelveInstance-950917247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:06:02 devstack sudo[103798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1 Nov 04 11:06:02 devstack sudo[103798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:06:03 devstack sudo[103798]: pam_unix(sudo:session): session closed for user root Nov 04 11:06:03 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [req-06448899-d3ba-4c9c-8de9-8a005acd55a2 req-a1c198e5-9c44-4e1d-8393-1d6f4b75fc83 tempest-TestShelveInstance-950917247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1" returned: 0 in 0.305s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:06:03 devstack cinder-volume[87272]: DEBUG cinder.manager [req-06448899-d3ba-4c9c-8de9-8a005acd55a2 req-a1c198e5-9c44-4e1d-8393-1d6f4b75fc83 tempest-TestShelveInstance-950917247 None] Notifying Schedulers of capabilities ... {{(pid=87272) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 11:06:03 devstack cinder-volume[87272]: INFO cinder.volume.manager [req-06448899-d3ba-4c9c-8de9-8a005acd55a2 req-a1c198e5-9c44-4e1d-8393-1d6f4b75fc83 tempest-TestShelveInstance-950917247 None] Deleted volume successfully. Nov 04 11:06:03 devstack cinder-volume[87272]: DEBUG cinder.coordination [req-06448899-d3ba-4c9c-8de9-8a005acd55a2 req-a1c198e5-9c44-4e1d-8393-1d6f4b75fc83 tempest-TestShelveInstance-950917247 None] Lock "cinder-7266d2a8-2c6e-4fe6-8df2-6eca6d71a40f-delete_volume" released by "delete_volume" :: held 1.529s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 11:06:06 devstack cinder-volume[87272]: INFO cinder.volume.manager [req-3e74f952-da5c-4447-a11f-38795733b145 req-06d848f7-e41a-41e1-b11f-f659412299c1 tempest-TestInstancesWithCinderVolumes-746758368 None] Terminate volume connection completed successfully. Nov 04 11:06:06 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [req-3e74f952-da5c-4447-a11f-38795733b145 req-06d848f7-e41a-41e1-b11f-f659412299c1 tempest-TestInstancesWithCinderVolumes-746758368 None] Deleting attachment 0cb55937-0d54-4b09-8007-6167429f800e. {{(pid=87272) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 04 11:06:07 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-e034f28e-3b27-4581-8eb9-69b29972bcd7 tempest-TestInstancesWithCinderVolumes-746758368 None] Acquiring lock "cinder-1511e7e5-77db-49b5-a689-acfffffc1d76-delete_volume" by "delete_volume" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 11:06:07 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-e034f28e-3b27-4581-8eb9-69b29972bcd7 tempest-TestInstancesWithCinderVolumes-746758368 None] Lock "cinder-1511e7e5-77db-49b5-a689-acfffffc1d76-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 11:06:07 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-e034f28e-3b27-4581-8eb9-69b29972bcd7 tempest-TestInstancesWithCinderVolumes-746758368 None] Acquiring lock "cinder-quobyte-1511e7e5-77db-49b5-a689-acfffffc1d76" by "delete_volume" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 11:06:07 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-e034f28e-3b27-4581-8eb9-69b29972bcd7 tempest-TestInstancesWithCinderVolumes-746758368 None] Lock "cinder-quobyte-1511e7e5-77db-49b5-a689-acfffffc1d76" acquired by "delete_volume" :: waited 0.015s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 11:06:07 devstack cinder-volume[87272]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ca27f1c-07a1-418a-bab1-2efb7bd61f0c]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 11:06:07 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-e034f28e-3b27-4581-8eb9-69b29972bcd7 tempest-TestInstancesWithCinderVolumes-746758368 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-1511e7e5-77db-49b5-a689-acfffffc1d76 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:06:07 devstack sudo[103830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-1511e7e5-77db-49b5-a689-acfffffc1d76 Nov 04 11:06:07 devstack sudo[103830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:06:07 devstack sudo[103830]: pam_unix(sudo:session): session closed for user root Nov 04 11:06:07 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-e034f28e-3b27-4581-8eb9-69b29972bcd7 tempest-TestInstancesWithCinderVolumes-746758368 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-1511e7e5-77db-49b5-a689-acfffffc1d76" returned: 0 in 0.378s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:06:07 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-e034f28e-3b27-4581-8eb9-69b29972bcd7 tempest-TestInstancesWithCinderVolumes-746758368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-1511e7e5-77db-49b5-a689-acfffffc1d76 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:06:07 devstack sudo[103836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-1511e7e5-77db-49b5-a689-acfffffc1d76 Nov 04 11:06:07 devstack sudo[103836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:06:07 devstack sudo[103836]: pam_unix(sudo:session): session closed for user root Nov 04 11:06:08 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-e034f28e-3b27-4581-8eb9-69b29972bcd7 tempest-TestInstancesWithCinderVolumes-746758368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-1511e7e5-77db-49b5-a689-acfffffc1d76" returned: 0 in 0.284s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:06:08 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-e034f28e-3b27-4581-8eb9-69b29972bcd7 tempest-TestInstancesWithCinderVolumes-746758368 None] Lock "cinder-quobyte-1511e7e5-77db-49b5-a689-acfffffc1d76" released by "delete_volume" :: held 0.703s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 11:06:08 devstack cinder-volume[87272]: WARNING cinder.quota [None req-e034f28e-3b27-4581-8eb9-69b29972bcd7 tempest-TestInstancesWithCinderVolumes-746758368 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1427505692-2100306300 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1427505692-2100306300, it is now deprecated. Please use the default quota class for default quota. Nov 04 11:06:08 devstack cinder-volume[87272]: WARNING cinder.quota [None req-e034f28e-3b27-4581-8eb9-69b29972bcd7 tempest-TestInstancesWithCinderVolumes-746758368 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1427505692-2100306300 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1427505692-2100306300, it is now deprecated. Please use the default quota class for default quota. Nov 04 11:06:08 devstack cinder-volume[87272]: DEBUG cinder.quota [None req-e034f28e-3b27-4581-8eb9-69b29972bcd7 tempest-TestInstancesWithCinderVolumes-746758368 None] Created reservations ['ee8dd502-8a3f-4c98-9028-2799614acbfd', 'ee39683e-31da-408e-804d-d6a228e529da', '05508d87-5994-4e3a-ba3b-19d9b7e842f0', '84027995-56e4-46e8-ba19-6645d6a4413c'] {{(pid=87272) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 11:06:08 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-e034f28e-3b27-4581-8eb9-69b29972bcd7 tempest-TestInstancesWithCinderVolumes-746758368 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 11:06:08 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-e034f28e-3b27-4581-8eb9-69b29972bcd7 tempest-TestInstancesWithCinderVolumes-746758368 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 11:06:08 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-e034f28e-3b27-4581-8eb9-69b29972bcd7 tempest-TestInstancesWithCinderVolumes-746758368 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898': None} {{(pid=87272) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 11:06:08 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-e034f28e-3b27-4581-8eb9-69b29972bcd7 tempest-TestInstancesWithCinderVolumes-746758368 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'] {{(pid=87272) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 11:06:08 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-e034f28e-3b27-4581-8eb9-69b29972bcd7 tempest-TestInstancesWithCinderVolumes-746758368 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 11:06:08 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-e034f28e-3b27-4581-8eb9-69b29972bcd7 tempest-TestInstancesWithCinderVolumes-746758368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:06:08 devstack sudo[103839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1 Nov 04 11:06:08 devstack sudo[103839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:06:08 devstack sudo[103839]: pam_unix(sudo:session): session closed for user root Nov 04 11:06:08 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-e034f28e-3b27-4581-8eb9-69b29972bcd7 tempest-TestInstancesWithCinderVolumes-746758368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1" returned: 0 in 0.261s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:06:08 devstack cinder-volume[87272]: DEBUG cinder.manager [None req-e034f28e-3b27-4581-8eb9-69b29972bcd7 tempest-TestInstancesWithCinderVolumes-746758368 None] Notifying Schedulers of capabilities ... {{(pid=87272) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 11:06:08 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-e034f28e-3b27-4581-8eb9-69b29972bcd7 tempest-TestInstancesWithCinderVolumes-746758368 None] Deleted volume successfully. Nov 04 11:06:08 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-e034f28e-3b27-4581-8eb9-69b29972bcd7 tempest-TestInstancesWithCinderVolumes-746758368 None] Lock "cinder-1511e7e5-77db-49b5-a689-acfffffc1d76-delete_volume" released by "delete_volume" :: held 1.272s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 11:06:14 devstack cinder-volume[87272]: DEBUG oslo_service.periodic_task [None req-236af0be-7f9d-4c80-b3d7-d645a9cd0dd1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87272) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 04 11:06:14 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-236af0be-7f9d-4c80-b3d7-d645a9cd0dd1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 11:06:14 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-236af0be-7f9d-4c80-b3d7-d645a9cd0dd1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 11:06:14 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-236af0be-7f9d-4c80-b3d7-d645a9cd0dd1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898': None} {{(pid=87272) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 11:06:14 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-236af0be-7f9d-4c80-b3d7-d645a9cd0dd1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'] {{(pid=87272) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 11:06:14 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-236af0be-7f9d-4c80-b3d7-d645a9cd0dd1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 11:06:14 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-236af0be-7f9d-4c80-b3d7-d645a9cd0dd1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:06:14 devstack sudo[103847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1 Nov 04 11:06:14 devstack sudo[103847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:06:14 devstack sudo[103847]: pam_unix(sudo:session): session closed for user root Nov 04 11:06:14 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-236af0be-7f9d-4c80-b3d7-d645a9cd0dd1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1" returned: 0 in 0.351s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:06:14 devstack cinder-volume[87272]: DEBUG cinder.manager [None req-236af0be-7f9d-4c80-b3d7-d645a9cd0dd1 None None] Notifying Schedulers of capabilities ... {{(pid=87272) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 11:06:14 devstack cinder-volume[87272]: DEBUG oslo_service.periodic_task [None req-236af0be-7f9d-4c80-b3d7-d645a9cd0dd1 None None] Running periodic task VolumeManager._thread_info {{(pid=87272) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 04 11:06:14 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-236af0be-7f9d-4c80-b3d7-d645a9cd0dd1 None None] thread count: 28 {{(pid=87272) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 04 11:06:14 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-236af0be-7f9d-4c80-b3d7-d645a9cd0dd1 None None] thread info: [<_MainThread(MainThread, started 127085713244288)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87272) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 04 11:06:18 devstack cinder-volume[87272]: DEBUG dbcounter [-] [87272] Writing DB stats cinder:SELECT=39,cinder:UPDATE=41,cinder:INSERT=8,cinder:DELETE=2 {{(pid=87272) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 11:06:18 devstack cinder-volume[87272]: DEBUG dbcounter [-] [87272] Writing DB stats cinder:SELECT=35,cinder:UPDATE=29,cinder:INSERT=8,cinder:DELETE=2 {{(pid=87272) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 11:06:49 devstack cinder-volume[87272]: DEBUG cinder.volume.flows.manager.create_volume [None req-0a17dbf5-7cae-4ad8-b258-2d6af7fe760c tempest-TestStampPattern-1122407784 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87272) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 11:06:49 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-0a17dbf5-7cae-4ad8-b258-2d6af7fe760c tempest-TestStampPattern-1122407784 None] Flow 'volume_create_manager' (f003446a-e0c7-4d22-8bfc-b55c66f7bd48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 11:06:49 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-0a17dbf5-7cae-4ad8-b258-2d6af7fe760c tempest-TestStampPattern-1122407784 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0cefd393-e34a-41cf-936e-4d1cd07e060e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:06:49 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-0a17dbf5-7cae-4ad8-b258-2d6af7fe760c tempest-TestStampPattern-1122407784 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0cefd393-e34a-41cf-936e-4d1cd07e060e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T10:06:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1255722484',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d8dbc52a-7d55-4220-af52-9d4db4cf33b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='88d287146ca3459a87214867ef20b385',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T10:06:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T10:06:49Z,use_quota=True,user_id='c96051f3b97d41708cb8f991352c96d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8989e4f-21e3-4f0a-9584-0d818784e883),volume_type_id=f8989e4f-21e3-4f0a-9584-0d818784e883)' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:06:49 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-0a17dbf5-7cae-4ad8-b258-2d6af7fe760c tempest-TestStampPattern-1122407784 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b6bb08eb-91cb-40e8-b75d-01c760ae27c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:06:49 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-0a17dbf5-7cae-4ad8-b258-2d6af7fe760c tempest-TestStampPattern-1122407784 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b6bb08eb-91cb-40e8-b75d-01c760ae27c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:06:49 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-0a17dbf5-7cae-4ad8-b258-2d6af7fe760c tempest-TestStampPattern-1122407784 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b93cbb2f-0540-424a-a073-6b628440b5ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:06:49 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-0a17dbf5-7cae-4ad8-b258-2d6af7fe760c tempest-TestStampPattern-1122407784 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b93cbb2f-0540-424a-a073-6b628440b5ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd8dbc52a-7d55-4220-af52-9d4db4cf33b3', 'volume_name': 'volume-d8dbc52a-7d55-4220-af52-9d4db4cf33b3', 'volume_size': 1}' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:06:49 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-0a17dbf5-7cae-4ad8-b258-2d6af7fe760c tempest-TestStampPattern-1122407784 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (090b347d-151f-4c4e-9115-eaf2b9dd760b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:06:49 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-0a17dbf5-7cae-4ad8-b258-2d6af7fe760c tempest-TestStampPattern-1122407784 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (090b347d-151f-4c4e-9115-eaf2b9dd760b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:06:49 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-0a17dbf5-7cae-4ad8-b258-2d6af7fe760c tempest-TestStampPattern-1122407784 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8f78a67-2a82-4042-ba2e-11145835d9c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:06:49 devstack cinder-volume[87272]: INFO cinder.volume.flows.manager.create_volume [None req-0a17dbf5-7cae-4ad8-b258-2d6af7fe760c tempest-TestStampPattern-1122407784 None] Volume d8dbc52a-7d55-4220-af52-9d4db4cf33b3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d8dbc52a-7d55-4220-af52-9d4db4cf33b3', 'volume_size': 1} Nov 04 11:06:49 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-0a17dbf5-7cae-4ad8-b258-2d6af7fe760c tempest-TestStampPattern-1122407784 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 11:06:49 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-0a17dbf5-7cae-4ad8-b258-2d6af7fe760c tempest-TestStampPattern-1122407784 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 11:06:49 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-0a17dbf5-7cae-4ad8-b258-2d6af7fe760c tempest-TestStampPattern-1122407784 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T10:06:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1255722484',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d8dbc52a-7d55-4220-af52-9d4db4cf33b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='88d287146ca3459a87214867ef20b385',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T10:06:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T10:06:49Z,use_quota=True,user_id='c96051f3b97d41708cb8f991352c96d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8989e4f-21e3-4f0a-9584-0d818784e883),volume_type_id=f8989e4f-21e3-4f0a-9584-0d818784e883)}" {{(pid=87272) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 04 11:06:49 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.remotefs [None req-0a17dbf5-7cae-4ad8-b258-2d6af7fe760c tempest-TestStampPattern-1122407784 None] Creating volume d8dbc52a-7d55-4220-af52-9d4db4cf33b3 {{(pid=87272) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 11:06:49 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-0a17dbf5-7cae-4ad8-b258-2d6af7fe760c tempest-TestStampPattern-1122407784 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 11:06:49 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-0a17dbf5-7cae-4ad8-b258-2d6af7fe760c tempest-TestStampPattern-1122407784 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 11:06:49 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-0a17dbf5-7cae-4ad8-b258-2d6af7fe760c tempest-TestStampPattern-1122407784 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898': None} {{(pid=87272) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 11:06:49 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-0a17dbf5-7cae-4ad8-b258-2d6af7fe760c tempest-TestStampPattern-1122407784 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'] {{(pid=87272) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 11:06:49 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-0a17dbf5-7cae-4ad8-b258-2d6af7fe760c tempest-TestStampPattern-1122407784 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 11:06:49 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-0a17dbf5-7cae-4ad8-b258-2d6af7fe760c tempest-TestStampPattern-1122407784 None] Selected osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898 as target Quobyte volume. {{(pid=87272) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 11:06:49 devstack cinder-volume[87272]: INFO cinder.volume.drivers.remotefs [None req-0a17dbf5-7cae-4ad8-b258-2d6af7fe760c tempest-TestStampPattern-1122407784 None] casted to osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898 Nov 04 11:06:49 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-0a17dbf5-7cae-4ad8-b258-2d6af7fe760c tempest-TestStampPattern-1122407784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-d8dbc52a-7d55-4220-af52-9d4db4cf33b3 1073741824 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:06:49 devstack sudo[103921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-d8dbc52a-7d55-4220-af52-9d4db4cf33b3 1073741824 Nov 04 11:06:49 devstack sudo[103921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:06:50 devstack sudo[103921]: pam_unix(sudo:session): session closed for user root Nov 04 11:06:50 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-0a17dbf5-7cae-4ad8-b258-2d6af7fe760c tempest-TestStampPattern-1122407784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-d8dbc52a-7d55-4220-af52-9d4db4cf33b3 1073741824" returned: 0 in 0.540s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:06:50 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-0a17dbf5-7cae-4ad8-b258-2d6af7fe760c tempest-TestStampPattern-1122407784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-d8dbc52a-7d55-4220-af52-9d4db4cf33b3 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:06:50 devstack sudo[103928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-d8dbc52a-7d55-4220-af52-9d4db4cf33b3 Nov 04 11:06:50 devstack sudo[103928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:06:50 devstack sudo[103928]: pam_unix(sudo:session): session closed for user root Nov 04 11:06:50 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-0a17dbf5-7cae-4ad8-b258-2d6af7fe760c tempest-TestStampPattern-1122407784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-d8dbc52a-7d55-4220-af52-9d4db4cf33b3" returned: 0 in 0.309s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:06:50 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-0a17dbf5-7cae-4ad8-b258-2d6af7fe760c tempest-TestStampPattern-1122407784 None] <== create_volume: return (931ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'} {{(pid=87272) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 04 11:06:50 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-0a17dbf5-7cae-4ad8-b258-2d6af7fe760c tempest-TestStampPattern-1122407784 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.938s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 11:06:50 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-0a17dbf5-7cae-4ad8-b258-2d6af7fe760c tempest-TestStampPattern-1122407784 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8f78a67-2a82-4042-ba2e-11145835d9c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d8dbc52a-7d55-4220-af52-9d4db4cf33b3', 'volume_size': 1}' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:06:50 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-0a17dbf5-7cae-4ad8-b258-2d6af7fe760c tempest-TestStampPattern-1122407784 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4249d102-f8b7-4233-90c5-955b41a0a17a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:06:50 devstack cinder-volume[87272]: INFO cinder.volume.flows.manager.create_volume [None req-0a17dbf5-7cae-4ad8-b258-2d6af7fe760c tempest-TestStampPattern-1122407784 None] Volume volume-d8dbc52a-7d55-4220-af52-9d4db4cf33b3 (d8dbc52a-7d55-4220-af52-9d4db4cf33b3): created successfully Nov 04 11:06:50 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-0a17dbf5-7cae-4ad8-b258-2d6af7fe760c tempest-TestStampPattern-1122407784 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4249d102-f8b7-4233-90c5-955b41a0a17a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:06:50 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-0a17dbf5-7cae-4ad8-b258-2d6af7fe760c tempest-TestStampPattern-1122407784 None] Flow 'volume_create_manager' (f003446a-e0c7-4d22-8bfc-b55c66f7bd48) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87272) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 11:06:50 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-0a17dbf5-7cae-4ad8-b258-2d6af7fe760c tempest-TestStampPattern-1122407784 None] Created volume successfully. Nov 04 11:07:00 devstack cinder-volume[87272]: DEBUG dbcounter [-] [87272] Writing DB stats cinder:SELECT=3,cinder:UPDATE=5,cinder:INSERT=1 {{(pid=87272) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 11:07:00 devstack cinder-volume[87272]: DEBUG dbcounter [-] [87272] Writing DB stats cinder:UPDATE=2,cinder:SELECT=2,cinder:DELETE=1 {{(pid=87272) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 11:07:14 devstack cinder-volume[87272]: DEBUG oslo_service.periodic_task [None req-236af0be-7f9d-4c80-b3d7-d645a9cd0dd1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87272) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 04 11:07:14 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-236af0be-7f9d-4c80-b3d7-d645a9cd0dd1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 11:07:14 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-236af0be-7f9d-4c80-b3d7-d645a9cd0dd1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 11:07:14 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-236af0be-7f9d-4c80-b3d7-d645a9cd0dd1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898': None} {{(pid=87272) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 11:07:14 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-236af0be-7f9d-4c80-b3d7-d645a9cd0dd1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'] {{(pid=87272) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 11:07:14 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-236af0be-7f9d-4c80-b3d7-d645a9cd0dd1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 11:07:14 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-236af0be-7f9d-4c80-b3d7-d645a9cd0dd1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:07:14 devstack sudo[104143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1 Nov 04 11:07:14 devstack sudo[104143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:07:14 devstack sudo[104143]: pam_unix(sudo:session): session closed for user root Nov 04 11:07:14 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-236af0be-7f9d-4c80-b3d7-d645a9cd0dd1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1" returned: 0 in 0.252s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:07:14 devstack cinder-volume[87272]: DEBUG cinder.manager [None req-236af0be-7f9d-4c80-b3d7-d645a9cd0dd1 None None] Notifying Schedulers of capabilities ... {{(pid=87272) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 11:07:14 devstack cinder-volume[87272]: DEBUG oslo_service.periodic_task [None req-236af0be-7f9d-4c80-b3d7-d645a9cd0dd1 None None] Running periodic task VolumeManager._thread_info {{(pid=87272) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 04 11:07:14 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-236af0be-7f9d-4c80-b3d7-d645a9cd0dd1 None None] thread count: 28 {{(pid=87272) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 04 11:07:14 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-236af0be-7f9d-4c80-b3d7-d645a9cd0dd1 None None] thread info: [<_MainThread(MainThread, started 127085713244288)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87272) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 04 11:07:15 devstack cinder-volume[87272]: DEBUG cinder.volume.flows.manager.create_volume [None req-62d4b556-7067-4c63-8dc6-05bbdd3ddd9b tempest-TestServerVolumeAttachScenarioOldVersion-846714132 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87272) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 11:07:15 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-62d4b556-7067-4c63-8dc6-05bbdd3ddd9b tempest-TestServerVolumeAttachScenarioOldVersion-846714132 None] Flow 'volume_create_manager' (5ed9e272-da96-4f32-882d-7c3119bc6c84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 11:07:15 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-62d4b556-7067-4c63-8dc6-05bbdd3ddd9b tempest-TestServerVolumeAttachScenarioOldVersion-846714132 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b19949de-8496-4710-8d52-fa25c96d553d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:07:15 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-62d4b556-7067-4c63-8dc6-05bbdd3ddd9b tempest-TestServerVolumeAttachScenarioOldVersion-846714132 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b19949de-8496-4710-8d52-fa25c96d553d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T10:07:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1340567047',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=355cfa1e-a692-4337-8c32-9983a0157e12,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='79076da0fab94b5b9d4e07c8f22a1e35',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T10:07:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T10:07:16Z,use_quota=True,user_id='a499d7a6ef0f4d668a14fbc37f187a40',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8989e4f-21e3-4f0a-9584-0d818784e883),volume_type_id=f8989e4f-21e3-4f0a-9584-0d818784e883)' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:07:16 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-62d4b556-7067-4c63-8dc6-05bbdd3ddd9b tempest-TestServerVolumeAttachScenarioOldVersion-846714132 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d1f0f981-5a04-4b0d-91c7-512482302ff6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:07:16 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-62d4b556-7067-4c63-8dc6-05bbdd3ddd9b tempest-TestServerVolumeAttachScenarioOldVersion-846714132 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d1f0f981-5a04-4b0d-91c7-512482302ff6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:07:16 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-62d4b556-7067-4c63-8dc6-05bbdd3ddd9b tempest-TestServerVolumeAttachScenarioOldVersion-846714132 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (681580c6-7b7b-44a3-812f-28f123f49d28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:07:16 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-62d4b556-7067-4c63-8dc6-05bbdd3ddd9b tempest-TestServerVolumeAttachScenarioOldVersion-846714132 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (681580c6-7b7b-44a3-812f-28f123f49d28) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '355cfa1e-a692-4337-8c32-9983a0157e12', 'volume_name': 'volume-355cfa1e-a692-4337-8c32-9983a0157e12', 'volume_size': 1}' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:07:16 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-62d4b556-7067-4c63-8dc6-05bbdd3ddd9b tempest-TestServerVolumeAttachScenarioOldVersion-846714132 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21c85dc2-d09a-452e-8256-fe2ee40e900c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:07:16 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-62d4b556-7067-4c63-8dc6-05bbdd3ddd9b tempest-TestServerVolumeAttachScenarioOldVersion-846714132 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21c85dc2-d09a-452e-8256-fe2ee40e900c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:07:16 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-62d4b556-7067-4c63-8dc6-05bbdd3ddd9b tempest-TestServerVolumeAttachScenarioOldVersion-846714132 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4911a003-ad18-4bb3-bceb-b9918b52fc24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:07:16 devstack cinder-volume[87272]: INFO cinder.volume.flows.manager.create_volume [None req-62d4b556-7067-4c63-8dc6-05bbdd3ddd9b tempest-TestServerVolumeAttachScenarioOldVersion-846714132 None] Volume 355cfa1e-a692-4337-8c32-9983a0157e12: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-355cfa1e-a692-4337-8c32-9983a0157e12', 'volume_size': 1} Nov 04 11:07:16 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-62d4b556-7067-4c63-8dc6-05bbdd3ddd9b tempest-TestServerVolumeAttachScenarioOldVersion-846714132 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 11:07:16 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-62d4b556-7067-4c63-8dc6-05bbdd3ddd9b tempest-TestServerVolumeAttachScenarioOldVersion-846714132 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 11:07:16 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-62d4b556-7067-4c63-8dc6-05bbdd3ddd9b tempest-TestServerVolumeAttachScenarioOldVersion-846714132 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T10:07:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1340567047',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=355cfa1e-a692-4337-8c32-9983a0157e12,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='79076da0fab94b5b9d4e07c8f22a1e35',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T10:07:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T10:07:16Z,use_quota=True,user_id='a499d7a6ef0f4d668a14fbc37f187a40',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8989e4f-21e3-4f0a-9584-0d818784e883),volume_type_id=f8989e4f-21e3-4f0a-9584-0d818784e883)}" {{(pid=87272) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 04 11:07:16 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.remotefs [None req-62d4b556-7067-4c63-8dc6-05bbdd3ddd9b tempest-TestServerVolumeAttachScenarioOldVersion-846714132 None] Creating volume 355cfa1e-a692-4337-8c32-9983a0157e12 {{(pid=87272) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 11:07:16 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-62d4b556-7067-4c63-8dc6-05bbdd3ddd9b tempest-TestServerVolumeAttachScenarioOldVersion-846714132 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 11:07:16 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-62d4b556-7067-4c63-8dc6-05bbdd3ddd9b tempest-TestServerVolumeAttachScenarioOldVersion-846714132 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 11:07:16 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-62d4b556-7067-4c63-8dc6-05bbdd3ddd9b tempest-TestServerVolumeAttachScenarioOldVersion-846714132 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898': None} {{(pid=87272) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 11:07:16 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-62d4b556-7067-4c63-8dc6-05bbdd3ddd9b tempest-TestServerVolumeAttachScenarioOldVersion-846714132 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'] {{(pid=87272) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 11:07:16 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-62d4b556-7067-4c63-8dc6-05bbdd3ddd9b tempest-TestServerVolumeAttachScenarioOldVersion-846714132 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 11:07:16 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-62d4b556-7067-4c63-8dc6-05bbdd3ddd9b tempest-TestServerVolumeAttachScenarioOldVersion-846714132 None] Selected osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898 as target Quobyte volume. {{(pid=87272) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 11:07:16 devstack cinder-volume[87272]: INFO cinder.volume.drivers.remotefs [None req-62d4b556-7067-4c63-8dc6-05bbdd3ddd9b tempest-TestServerVolumeAttachScenarioOldVersion-846714132 None] casted to osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898 Nov 04 11:07:16 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-62d4b556-7067-4c63-8dc6-05bbdd3ddd9b tempest-TestServerVolumeAttachScenarioOldVersion-846714132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-355cfa1e-a692-4337-8c32-9983a0157e12 1073741824 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:07:16 devstack sudo[104148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-355cfa1e-a692-4337-8c32-9983a0157e12 1073741824 Nov 04 11:07:16 devstack sudo[104148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:07:16 devstack sudo[104148]: pam_unix(sudo:session): session closed for user root Nov 04 11:07:16 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-62d4b556-7067-4c63-8dc6-05bbdd3ddd9b tempest-TestServerVolumeAttachScenarioOldVersion-846714132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-355cfa1e-a692-4337-8c32-9983a0157e12 1073741824" returned: 0 in 0.422s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:07:16 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-62d4b556-7067-4c63-8dc6-05bbdd3ddd9b tempest-TestServerVolumeAttachScenarioOldVersion-846714132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-355cfa1e-a692-4337-8c32-9983a0157e12 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:07:16 devstack sudo[104155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-355cfa1e-a692-4337-8c32-9983a0157e12 Nov 04 11:07:16 devstack sudo[104155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:07:16 devstack sudo[104155]: pam_unix(sudo:session): session closed for user root Nov 04 11:07:16 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-62d4b556-7067-4c63-8dc6-05bbdd3ddd9b tempest-TestServerVolumeAttachScenarioOldVersion-846714132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-355cfa1e-a692-4337-8c32-9983a0157e12" returned: 0 in 0.249s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:07:16 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-62d4b556-7067-4c63-8dc6-05bbdd3ddd9b tempest-TestServerVolumeAttachScenarioOldVersion-846714132 None] <== create_volume: return (714ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'} {{(pid=87272) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 04 11:07:16 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-62d4b556-7067-4c63-8dc6-05bbdd3ddd9b tempest-TestServerVolumeAttachScenarioOldVersion-846714132 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.717s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 11:07:16 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-62d4b556-7067-4c63-8dc6-05bbdd3ddd9b tempest-TestServerVolumeAttachScenarioOldVersion-846714132 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4911a003-ad18-4bb3-bceb-b9918b52fc24) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-355cfa1e-a692-4337-8c32-9983a0157e12', 'volume_size': 1}' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:07:16 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-62d4b556-7067-4c63-8dc6-05bbdd3ddd9b tempest-TestServerVolumeAttachScenarioOldVersion-846714132 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee5ceec7-b275-4f56-8b2e-82a9eb0a9b92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:07:16 devstack cinder-volume[87272]: INFO cinder.volume.flows.manager.create_volume [None req-62d4b556-7067-4c63-8dc6-05bbdd3ddd9b tempest-TestServerVolumeAttachScenarioOldVersion-846714132 None] Volume volume-355cfa1e-a692-4337-8c32-9983a0157e12 (355cfa1e-a692-4337-8c32-9983a0157e12): created successfully Nov 04 11:07:16 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-62d4b556-7067-4c63-8dc6-05bbdd3ddd9b tempest-TestServerVolumeAttachScenarioOldVersion-846714132 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee5ceec7-b275-4f56-8b2e-82a9eb0a9b92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:07:16 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-62d4b556-7067-4c63-8dc6-05bbdd3ddd9b tempest-TestServerVolumeAttachScenarioOldVersion-846714132 None] Flow 'volume_create_manager' (5ed9e272-da96-4f32-882d-7c3119bc6c84) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87272) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 11:07:16 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-62d4b556-7067-4c63-8dc6-05bbdd3ddd9b tempest-TestServerVolumeAttachScenarioOldVersion-846714132 None] Created volume successfully. Nov 04 11:07:17 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [req-3e3c297c-3121-4779-b8cf-c23b634fa3b8 req-2d82e99c-0f17-4b2a-a410-0b417537cb2c tempest-TestServerVolumeAttachScenarioOldVersion-846714132 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 11:07:17 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [req-3e3c297c-3121-4779-b8cf-c23b634fa3b8 req-2d82e99c-0f17-4b2a-a410-0b417537cb2c tempest-TestServerVolumeAttachScenarioOldVersion-846714132 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 11:07:17 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [req-3e3c297c-3121-4779-b8cf-c23b634fa3b8 req-2d82e99c-0f17-4b2a-a410-0b417537cb2c tempest-TestServerVolumeAttachScenarioOldVersion-846714132 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.016s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 11:07:17 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [req-3e3c297c-3121-4779-b8cf-c23b634fa3b8 req-2d82e99c-0f17-4b2a-a410-0b417537cb2c tempest-TestServerVolumeAttachScenarioOldVersion-846714132 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898', 'name': 'volume-355cfa1e-a692-4337-8c32-9983a0157e12', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '95c299c6-c668-44ee-92fd-c0c06fc036bd', 'enforce_multipath': True} {{(pid=87272) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 04 11:07:17 devstack cinder-volume[87272]: INFO cinder.volume.manager [req-3e3c297c-3121-4779-b8cf-c23b634fa3b8 req-2d82e99c-0f17-4b2a-a410-0b417537cb2c tempest-TestServerVolumeAttachScenarioOldVersion-846714132 None] attachment_update completed successfully. Nov 04 11:07:20 devstack cinder-volume[87272]: INFO cinder.volume.manager [req-f7cdb6dc-e278-4426-8d04-3702c9818d2c req-810c0c06-0fd9-4ed7-a24e-69048470a50f tempest-TestServerVolumeAttachScenarioOldVersion-846714132 None] Terminate volume connection completed successfully. Nov 04 11:07:20 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [req-f7cdb6dc-e278-4426-8d04-3702c9818d2c req-810c0c06-0fd9-4ed7-a24e-69048470a50f tempest-TestServerVolumeAttachScenarioOldVersion-846714132 None] Deleting attachment 95c299c6-c668-44ee-92fd-c0c06fc036bd. {{(pid=87272) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 04 11:07:21 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-10328591-182e-461c-b258-aa5435b35fab tempest-TestServerVolumeAttachScenarioOldVersion-846714132 None] Acquiring lock "cinder-355cfa1e-a692-4337-8c32-9983a0157e12-delete_volume" by "delete_volume" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 11:07:21 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-10328591-182e-461c-b258-aa5435b35fab tempest-TestServerVolumeAttachScenarioOldVersion-846714132 None] Lock "cinder-355cfa1e-a692-4337-8c32-9983a0157e12-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 11:07:21 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-10328591-182e-461c-b258-aa5435b35fab tempest-TestServerVolumeAttachScenarioOldVersion-846714132 None] Acquiring lock "cinder-quobyte-355cfa1e-a692-4337-8c32-9983a0157e12" by "delete_volume" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 11:07:21 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-10328591-182e-461c-b258-aa5435b35fab tempest-TestServerVolumeAttachScenarioOldVersion-846714132 None] Lock "cinder-quobyte-355cfa1e-a692-4337-8c32-9983a0157e12" acquired by "delete_volume" :: waited 0.019s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 11:07:21 devstack cinder-volume[87272]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1911dd5-cbcb-45dc-8fd9-ce917d814dc2]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 11:07:21 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-10328591-182e-461c-b258-aa5435b35fab tempest-TestServerVolumeAttachScenarioOldVersion-846714132 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-355cfa1e-a692-4337-8c32-9983a0157e12 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:07:22 devstack sudo[104622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-355cfa1e-a692-4337-8c32-9983a0157e12 Nov 04 11:07:22 devstack sudo[104622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:07:22 devstack sudo[104622]: pam_unix(sudo:session): session closed for user root Nov 04 11:07:22 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-10328591-182e-461c-b258-aa5435b35fab tempest-TestServerVolumeAttachScenarioOldVersion-846714132 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-355cfa1e-a692-4337-8c32-9983a0157e12" returned: 0 in 0.444s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:07:22 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-10328591-182e-461c-b258-aa5435b35fab tempest-TestServerVolumeAttachScenarioOldVersion-846714132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-355cfa1e-a692-4337-8c32-9983a0157e12 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:07:22 devstack sudo[104632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-355cfa1e-a692-4337-8c32-9983a0157e12 Nov 04 11:07:22 devstack sudo[104632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:07:22 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [req-8f701e0f-58b3-48f6-9ecc-64f2d4fafc41 req-5c828fc0-c1e9-4638-a178-f60f55d19ccd tempest-TestStampPattern-1122407784 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 11:07:22 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [req-8f701e0f-58b3-48f6-9ecc-64f2d4fafc41 req-5c828fc0-c1e9-4638-a178-f60f55d19ccd tempest-TestStampPattern-1122407784 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 11:07:22 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [req-8f701e0f-58b3-48f6-9ecc-64f2d4fafc41 req-5c828fc0-c1e9-4638-a178-f60f55d19ccd tempest-TestStampPattern-1122407784 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.015s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 11:07:22 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [req-8f701e0f-58b3-48f6-9ecc-64f2d4fafc41 req-5c828fc0-c1e9-4638-a178-f60f55d19ccd tempest-TestStampPattern-1122407784 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898', 'name': 'volume-d8dbc52a-7d55-4220-af52-9d4db4cf33b3', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ab9e3f43-36ba-4518-81ff-3aa7453b60d4', 'enforce_multipath': True} {{(pid=87272) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 04 11:07:22 devstack sudo[104632]: pam_unix(sudo:session): session closed for user root Nov 04 11:07:22 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-10328591-182e-461c-b258-aa5435b35fab tempest-TestServerVolumeAttachScenarioOldVersion-846714132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-355cfa1e-a692-4337-8c32-9983a0157e12" returned: 0 in 0.289s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:07:22 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-10328591-182e-461c-b258-aa5435b35fab tempest-TestServerVolumeAttachScenarioOldVersion-846714132 None] Lock "cinder-quobyte-355cfa1e-a692-4337-8c32-9983a0157e12" released by "delete_volume" :: held 0.782s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 11:07:22 devstack cinder-volume[87272]: INFO cinder.volume.manager [req-8f701e0f-58b3-48f6-9ecc-64f2d4fafc41 req-5c828fc0-c1e9-4638-a178-f60f55d19ccd tempest-TestStampPattern-1122407784 None] attachment_update completed successfully. Nov 04 11:07:22 devstack cinder-volume[87272]: DEBUG cinder.quota [None req-10328591-182e-461c-b258-aa5435b35fab tempest-TestServerVolumeAttachScenarioOldVersion-846714132 None] Created reservations ['2c48d2a7-84b3-4669-a11b-58ede1c64d3d', 'd0c72146-c68a-4452-bacc-25c54441b1cc', 'e4c1b3d1-c48e-4261-b6be-37a47bbec3d2', '80ab7519-b65c-4b46-b9b5-0d5e85ef0660'] {{(pid=87272) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 11:07:22 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-10328591-182e-461c-b258-aa5435b35fab tempest-TestServerVolumeAttachScenarioOldVersion-846714132 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 11:07:22 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-10328591-182e-461c-b258-aa5435b35fab tempest-TestServerVolumeAttachScenarioOldVersion-846714132 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 11:07:22 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-10328591-182e-461c-b258-aa5435b35fab tempest-TestServerVolumeAttachScenarioOldVersion-846714132 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898': None} {{(pid=87272) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 11:07:22 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-10328591-182e-461c-b258-aa5435b35fab tempest-TestServerVolumeAttachScenarioOldVersion-846714132 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'] {{(pid=87272) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 11:07:22 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-10328591-182e-461c-b258-aa5435b35fab tempest-TestServerVolumeAttachScenarioOldVersion-846714132 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 11:07:22 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-10328591-182e-461c-b258-aa5435b35fab tempest-TestServerVolumeAttachScenarioOldVersion-846714132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:07:22 devstack sudo[104643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1 Nov 04 11:07:22 devstack sudo[104643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:07:23 devstack sudo[104643]: pam_unix(sudo:session): session closed for user root Nov 04 11:07:23 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-10328591-182e-461c-b258-aa5435b35fab tempest-TestServerVolumeAttachScenarioOldVersion-846714132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1" returned: 0 in 0.317s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:07:23 devstack cinder-volume[87272]: DEBUG cinder.manager [None req-10328591-182e-461c-b258-aa5435b35fab tempest-TestServerVolumeAttachScenarioOldVersion-846714132 None] Notifying Schedulers of capabilities ... {{(pid=87272) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 11:07:23 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-10328591-182e-461c-b258-aa5435b35fab tempest-TestServerVolumeAttachScenarioOldVersion-846714132 None] Deleted volume successfully. Nov 04 11:07:23 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-10328591-182e-461c-b258-aa5435b35fab tempest-TestServerVolumeAttachScenarioOldVersion-846714132 None] Lock "cinder-355cfa1e-a692-4337-8c32-9983a0157e12-delete_volume" released by "delete_volume" :: held 1.387s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 11:07:28 devstack cinder-volume[87272]: INFO cinder.volume.manager [req-e5b994b4-87d1-4046-bea3-e07a3d8aec9b req-27cc2300-1b3d-45b7-92de-f07c23b5daba tempest-TestStampPattern-1122407784 None] Terminate volume connection completed successfully. Nov 04 11:07:28 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [req-e5b994b4-87d1-4046-bea3-e07a3d8aec9b req-27cc2300-1b3d-45b7-92de-f07c23b5daba tempest-TestStampPattern-1122407784 None] Deleting attachment ab9e3f43-36ba-4518-81ff-3aa7453b60d4. {{(pid=87272) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 04 11:07:29 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-e3b998e7-c8fb-43fc-9f6d-0b038ba82122 tempest-TestStampPattern-1122407784 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 11:07:29 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-e3b998e7-c8fb-43fc-9f6d-0b038ba82122 tempest-TestStampPattern-1122407784 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 11:07:29 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.remotefs [None req-e3b998e7-c8fb-43fc-9f6d-0b038ba82122 tempest-TestStampPattern-1122407784 None] Creating offline snapshot 60a94640-e77b-4f62-8006-e84f6c68c072 of volume d8dbc52a-7d55-4220-af52-9d4db4cf33b3 {{(pid=87272) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 04 11:07:29 devstack cinder-volume[87272]: DEBUG oslo.privsep.daemon [-] privsep: reply[24b2058a-4215-4107-8bc6-b983e6601baf]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 11:07:29 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-e3b998e7-c8fb-43fc-9f6d-0b038ba82122 tempest-TestStampPattern-1122407784 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-d8dbc52a-7d55-4220-af52-9d4db4cf33b3 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:07:29 devstack sudo[105139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-d8dbc52a-7d55-4220-af52-9d4db4cf33b3 Nov 04 11:07:29 devstack sudo[105139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:07:29 devstack sudo[105139]: pam_unix(sudo:session): session closed for user root Nov 04 11:07:29 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-e3b998e7-c8fb-43fc-9f6d-0b038ba82122 tempest-TestStampPattern-1122407784 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-d8dbc52a-7d55-4220-af52-9d4db4cf33b3" returned: 0 in 0.402s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:07:29 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-e3b998e7-c8fb-43fc-9f6d-0b038ba82122 tempest-TestStampPattern-1122407784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-d8dbc52a-7d55-4220-af52-9d4db4cf33b3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-d8dbc52a-7d55-4220-af52-9d4db4cf33b3.60a94640-e77b-4f62-8006-e84f6c68c072 1G {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:07:29 devstack sudo[105145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-d8dbc52a-7d55-4220-af52-9d4db4cf33b3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-d8dbc52a-7d55-4220-af52-9d4db4cf33b3.60a94640-e77b-4f62-8006-e84f6c68c072 1G Nov 04 11:07:29 devstack sudo[105145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:07:30 devstack sudo[105145]: pam_unix(sudo:session): session closed for user root Nov 04 11:07:30 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-e3b998e7-c8fb-43fc-9f6d-0b038ba82122 tempest-TestStampPattern-1122407784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-d8dbc52a-7d55-4220-af52-9d4db4cf33b3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-d8dbc52a-7d55-4220-af52-9d4db4cf33b3.60a94640-e77b-4f62-8006-e84f6c68c072 1G" returned: 0 in 0.464s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:07:30 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-e3b998e7-c8fb-43fc-9f6d-0b038ba82122 tempest-TestStampPattern-1122407784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d8dbc52a-7d55-4220-af52-9d4db4cf33b3 -F qcow2 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-d8dbc52a-7d55-4220-af52-9d4db4cf33b3.60a94640-e77b-4f62-8006-e84f6c68c072 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:07:30 devstack sudo[105150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d8dbc52a-7d55-4220-af52-9d4db4cf33b3 -F qcow2 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-d8dbc52a-7d55-4220-af52-9d4db4cf33b3.60a94640-e77b-4f62-8006-e84f6c68c072 Nov 04 11:07:30 devstack sudo[105150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:07:30 devstack sudo[105150]: pam_unix(sudo:session): session closed for user root Nov 04 11:07:30 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-e3b998e7-c8fb-43fc-9f6d-0b038ba82122 tempest-TestStampPattern-1122407784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d8dbc52a-7d55-4220-af52-9d4db4cf33b3 -F qcow2 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-d8dbc52a-7d55-4220-af52-9d4db4cf33b3.60a94640-e77b-4f62-8006-e84f6c68c072" returned: 0 in 0.325s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:07:30 devstack cinder-volume[87272]: WARNING cinder.volume.drivers.remotefs [None req-e3b998e7-c8fb-43fc-9f6d-0b038ba82122 tempest-TestStampPattern-1122407784 None] /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-d8dbc52a-7d55-4220-af52-9d4db4cf33b3.60a94640-e77b-4f62-8006-e84f6c68c072 is being set with open permissions: ugo+rw Nov 04 11:07:30 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-e3b998e7-c8fb-43fc-9f6d-0b038ba82122 tempest-TestStampPattern-1122407784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-d8dbc52a-7d55-4220-af52-9d4db4cf33b3.60a94640-e77b-4f62-8006-e84f6c68c072 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:07:30 devstack sudo[105155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-d8dbc52a-7d55-4220-af52-9d4db4cf33b3.60a94640-e77b-4f62-8006-e84f6c68c072 Nov 04 11:07:30 devstack sudo[105155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:07:30 devstack sudo[105155]: pam_unix(sudo:session): session closed for user root Nov 04 11:07:30 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-e3b998e7-c8fb-43fc-9f6d-0b038ba82122 tempest-TestStampPattern-1122407784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-d8dbc52a-7d55-4220-af52-9d4db4cf33b3.60a94640-e77b-4f62-8006-e84f6c68c072" returned: 0 in 0.265s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:07:30 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-e3b998e7-c8fb-43fc-9f6d-0b038ba82122 tempest-TestStampPattern-1122407784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-d8dbc52a-7d55-4220-af52-9d4db4cf33b3.info {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:07:30 devstack sudo[105158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-d8dbc52a-7d55-4220-af52-9d4db4cf33b3.info Nov 04 11:07:30 devstack sudo[105158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:07:31 devstack sudo[105158]: pam_unix(sudo:session): session closed for user root Nov 04 11:07:31 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-e3b998e7-c8fb-43fc-9f6d-0b038ba82122 tempest-TestStampPattern-1122407784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-d8dbc52a-7d55-4220-af52-9d4db4cf33b3.info" returned: 0 in 0.270s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:07:31 devstack cinder-volume[87272]: WARNING cinder.volume.drivers.remotefs [None req-e3b998e7-c8fb-43fc-9f6d-0b038ba82122 tempest-TestStampPattern-1122407784 None] /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-d8dbc52a-7d55-4220-af52-9d4db4cf33b3.info is being set with open permissions: ugo+rw Nov 04 11:07:31 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-e3b998e7-c8fb-43fc-9f6d-0b038ba82122 tempest-TestStampPattern-1122407784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-d8dbc52a-7d55-4220-af52-9d4db4cf33b3.info {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:07:31 devstack sudo[105161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-d8dbc52a-7d55-4220-af52-9d4db4cf33b3.info Nov 04 11:07:31 devstack sudo[105161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:07:31 devstack sudo[105161]: pam_unix(sudo:session): session closed for user root Nov 04 11:07:31 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-e3b998e7-c8fb-43fc-9f6d-0b038ba82122 tempest-TestStampPattern-1122407784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-d8dbc52a-7d55-4220-af52-9d4db4cf33b3.info" returned: 0 in 0.270s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:07:31 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-e3b998e7-c8fb-43fc-9f6d-0b038ba82122 tempest-TestStampPattern-1122407784 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.105s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 11:07:31 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-e3b998e7-c8fb-43fc-9f6d-0b038ba82122 tempest-TestStampPattern-1122407784 None] Create snapshot completed successfully Nov 04 11:07:39 devstack cinder-volume[87272]: DEBUG cinder.volume.flows.manager.create_volume [None req-ef5c485b-a36b-49a2-8af3-ea69079e538a tempest-TestStampPattern-1122407784 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87272) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 11:07:39 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-ef5c485b-a36b-49a2-8af3-ea69079e538a tempest-TestStampPattern-1122407784 None] Flow 'volume_create_manager' (76cb3e4a-569d-480f-a07f-8a1e148c878f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 11:07:39 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-ef5c485b-a36b-49a2-8af3-ea69079e538a tempest-TestStampPattern-1122407784 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (279c2956-8aa2-4102-a90c-8fbe8d4c358b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:07:39 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-ef5c485b-a36b-49a2-8af3-ea69079e538a tempest-TestStampPattern-1122407784 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (279c2956-8aa2-4102-a90c-8fbe8d4c358b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T10:07:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-446036261',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b995b16-60e9-42bf-961b-d32fc2177ef7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='88d287146ca3459a87214867ef20b385',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T10:07:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=60a94640-e77b-4f62-8006-e84f6c68c072,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T10:07:40Z,use_quota=True,user_id='c96051f3b97d41708cb8f991352c96d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8989e4f-21e3-4f0a-9584-0d818784e883),volume_type_id=f8989e4f-21e3-4f0a-9584-0d818784e883)' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:07:39 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-ef5c485b-a36b-49a2-8af3-ea69079e538a tempest-TestStampPattern-1122407784 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d882aa21-e935-489f-bef5-2da12ed614c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:07:39 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-ef5c485b-a36b-49a2-8af3-ea69079e538a tempest-TestStampPattern-1122407784 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d882aa21-e935-489f-bef5-2da12ed614c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:07:39 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-ef5c485b-a36b-49a2-8af3-ea69079e538a tempest-TestStampPattern-1122407784 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f94397e5-7bc5-458a-a54a-1ef6866ded0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:07:39 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-ef5c485b-a36b-49a2-8af3-ea69079e538a tempest-TestStampPattern-1122407784 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f94397e5-7bc5-458a-a54a-1ef6866ded0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '3b995b16-60e9-42bf-961b-d32fc2177ef7', 'volume_name': 'volume-3b995b16-60e9-42bf-961b-d32fc2177ef7', 'volume_size': 1, 'snapshot_id': '60a94640-e77b-4f62-8006-e84f6c68c072'}' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:07:39 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-ef5c485b-a36b-49a2-8af3-ea69079e538a tempest-TestStampPattern-1122407784 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (542c409f-5ab2-4c09-bbe5-0d0424cb4f7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:07:39 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-ef5c485b-a36b-49a2-8af3-ea69079e538a tempest-TestStampPattern-1122407784 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (542c409f-5ab2-4c09-bbe5-0d0424cb4f7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:07:39 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-ef5c485b-a36b-49a2-8af3-ea69079e538a tempest-TestStampPattern-1122407784 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c9c43a96-bb61-496e-b0fb-8e6aef56469a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:07:39 devstack cinder-volume[87272]: INFO cinder.volume.flows.manager.create_volume [None req-ef5c485b-a36b-49a2-8af3-ea69079e538a tempest-TestStampPattern-1122407784 None] Volume 3b995b16-60e9-42bf-961b-d32fc2177ef7: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-3b995b16-60e9-42bf-961b-d32fc2177ef7', 'volume_size': 1, 'snapshot_id': '60a94640-e77b-4f62-8006-e84f6c68c072'} Nov 04 11:07:39 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-ef5c485b-a36b-49a2-8af3-ea69079e538a tempest-TestStampPattern-1122407784 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 11:07:39 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-ef5c485b-a36b-49a2-8af3-ea69079e538a tempest-TestStampPattern-1122407784 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 11:07:39 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-ef5c485b-a36b-49a2-8af3-ea69079e538a tempest-TestStampPattern-1122407784 None] Acquiring lock "cinder-quobyte-60a94640-e77b-4f62-8006-e84f6c68c072-3b995b16-60e9-42bf-961b-d32fc2177ef7" by "_create_volume_from_snapshot" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 11:07:39 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-ef5c485b-a36b-49a2-8af3-ea69079e538a tempest-TestStampPattern-1122407784 None] Lock "cinder-quobyte-60a94640-e77b-4f62-8006-e84f6c68c072-3b995b16-60e9-42bf-961b-d32fc2177ef7" acquired by "_create_volume_from_snapshot" :: waited 0.017s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 11:07:39 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-ef5c485b-a36b-49a2-8af3-ea69079e538a tempest-TestStampPattern-1122407784 None] Creating volume 3b995b16-60e9-42bf-961b-d32fc2177ef7 from snapshot 60a94640-e77b-4f62-8006-e84f6c68c072 {{(pid=87272) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 04 11:07:39 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-ef5c485b-a36b-49a2-8af3-ea69079e538a tempest-TestStampPattern-1122407784 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 11:07:39 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-ef5c485b-a36b-49a2-8af3-ea69079e538a tempest-TestStampPattern-1122407784 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 11:07:39 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-ef5c485b-a36b-49a2-8af3-ea69079e538a tempest-TestStampPattern-1122407784 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898': None} {{(pid=87272) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 11:07:39 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-ef5c485b-a36b-49a2-8af3-ea69079e538a tempest-TestStampPattern-1122407784 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'] {{(pid=87272) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 11:07:39 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-ef5c485b-a36b-49a2-8af3-ea69079e538a tempest-TestStampPattern-1122407784 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 11:07:39 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-ef5c485b-a36b-49a2-8af3-ea69079e538a tempest-TestStampPattern-1122407784 None] Selected osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898 as target Quobyte volume. {{(pid=87272) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 11:07:39 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-ef5c485b-a36b-49a2-8af3-ea69079e538a tempest-TestStampPattern-1122407784 None] Acquiring lock "cinder-quobyte-3b995b16-60e9-42bf-961b-d32fc2177ef7" by "_copy_volume_from_snapshot" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 11:07:39 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-ef5c485b-a36b-49a2-8af3-ea69079e538a tempest-TestStampPattern-1122407784 None] Lock "cinder-quobyte-3b995b16-60e9-42bf-961b-d32fc2177ef7" acquired by "_copy_volume_from_snapshot" :: waited 0.016s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 11:07:39 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-ef5c485b-a36b-49a2-8af3-ea69079e538a tempest-TestStampPattern-1122407784 None] snapshot: 60a94640-e77b-4f62-8006-e84f6c68c072, volume: 3b995b16-60e9-42bf-961b-d32fc2177ef7, {{(pid=87272) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 04 11:07:39 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-ef5c485b-a36b-49a2-8af3-ea69079e538a tempest-TestStampPattern-1122407784 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 11:07:39 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-ef5c485b-a36b-49a2-8af3-ea69079e538a tempest-TestStampPattern-1122407784 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 11:07:39 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-ef5c485b-a36b-49a2-8af3-ea69079e538a tempest-TestStampPattern-1122407784 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898': None} {{(pid=87272) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 11:07:39 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-ef5c485b-a36b-49a2-8af3-ea69079e538a tempest-TestStampPattern-1122407784 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'] {{(pid=87272) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 11:07:39 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-ef5c485b-a36b-49a2-8af3-ea69079e538a tempest-TestStampPattern-1122407784 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 11:07:39 devstack cinder-volume[87272]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad33661a-3535-4643-a984-4e6fae1faaa7]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 11:07:39 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-ef5c485b-a36b-49a2-8af3-ea69079e538a tempest-TestStampPattern-1122407784 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-d8dbc52a-7d55-4220-af52-9d4db4cf33b3.60a94640-e77b-4f62-8006-e84f6c68c072 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:07:40 devstack sudo[105230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-d8dbc52a-7d55-4220-af52-9d4db4cf33b3.60a94640-e77b-4f62-8006-e84f6c68c072 Nov 04 11:07:40 devstack sudo[105230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:07:40 devstack sudo[105230]: pam_unix(sudo:session): session closed for user root Nov 04 11:07:40 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-ef5c485b-a36b-49a2-8af3-ea69079e538a tempest-TestStampPattern-1122407784 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-d8dbc52a-7d55-4220-af52-9d4db4cf33b3.60a94640-e77b-4f62-8006-e84f6c68c072" returned: 0 in 0.471s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:07:40 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.remotefs [None req-ef5c485b-a36b-49a2-8af3-ea69079e538a tempest-TestStampPattern-1122407784 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d8dbc52a-7d55-4220-af52-9d4db4cf33b3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87272) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 11:07:40 devstack cinder-volume[87272]: DEBUG oslo.privsep.daemon [-] privsep: reply[918b8002-ae48-49e4-a004-5923ba330e62]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 11:07:40 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-ef5c485b-a36b-49a2-8af3-ea69079e538a tempest-TestStampPattern-1122407784 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-d8dbc52a-7d55-4220-af52-9d4db4cf33b3 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:07:40 devstack sudo[105235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-d8dbc52a-7d55-4220-af52-9d4db4cf33b3 Nov 04 11:07:40 devstack sudo[105235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:07:40 devstack sudo[105235]: pam_unix(sudo:session): session closed for user root Nov 04 11:07:40 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-ef5c485b-a36b-49a2-8af3-ea69079e538a tempest-TestStampPattern-1122407784 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-d8dbc52a-7d55-4220-af52-9d4db4cf33b3" returned: 0 in 0.469s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:07:40 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-ef5c485b-a36b-49a2-8af3-ea69079e538a tempest-TestStampPattern-1122407784 None] will copy from snapshot at /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-d8dbc52a-7d55-4220-af52-9d4db4cf33b3 {{(pid=87272) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 04 11:07:40 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-ef5c485b-a36b-49a2-8af3-ea69079e538a tempest-TestStampPattern-1122407784 None] Creating direct copy from snapshot {{(pid=87272) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 04 11:07:40 devstack cinder-volume[87272]: DEBUG cinder.utils [None req-ef5c485b-a36b-49a2-8af3-ea69079e538a tempest-TestStampPattern-1122407784 None] Path /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-3b995b16-60e9-42bf-961b-d32fc2177ef7 not found in is_blk_device check {{(pid=87272) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Nov 04 11:07:40 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-ef5c485b-a36b-49a2-8af3-ea69079e538a tempest-TestStampPattern-1122407784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-d8dbc52a-7d55-4220-af52-9d4db4cf33b3 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-3b995b16-60e9-42bf-961b-d32fc2177ef7 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:07:40 devstack sudo[105243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-d8dbc52a-7d55-4220-af52-9d4db4cf33b3 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-3b995b16-60e9-42bf-961b-d32fc2177ef7 Nov 04 11:07:40 devstack sudo[105243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:07:49 devstack cinder-volume[87272]: DEBUG dbcounter [-] [87272] Writing DB stats cinder:SELECT=26,cinder:INSERT=3,cinder:UPDATE=14,cinder:DELETE=2 {{(pid=87272) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 11:07:49 devstack cinder-volume[87272]: DEBUG dbcounter [-] [87272] Writing DB stats cinder:UPDATE=18,cinder:SELECT=29,cinder:INSERT=3,cinder:DELETE=1 {{(pid=87272) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 11:07:50 devstack cinder-volume[87272]: DEBUG cinder.volume.flows.manager.create_volume [None req-292c0bd9-7c34-4272-a4fe-8030b7042bf9 tempest-VolumeImageDependencyTests-347657137 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87272) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 11:07:50 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-292c0bd9-7c34-4272-a4fe-8030b7042bf9 tempest-VolumeImageDependencyTests-347657137 None] Flow 'volume_create_manager' (ee22e82c-c31f-46d0-ade7-9387653f4dad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 11:07:50 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-292c0bd9-7c34-4272-a4fe-8030b7042bf9 tempest-VolumeImageDependencyTests-347657137 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e9cd7e2-9880-4e7d-bd60-451d98c2e382) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:07:50 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-292c0bd9-7c34-4272-a4fe-8030b7042bf9 tempest-VolumeImageDependencyTests-347657137 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e9cd7e2-9880-4e7d-bd60-451d98c2e382) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T10:07:49Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e1c603cc-b92c-4a6d-88c4-261b7d9c6da0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='080b2b0551734b5f921c509a3352af01',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T10:07:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T10:07:50Z,use_quota=True,user_id='5f94a74665d94096b80e1cca66ed6aae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8989e4f-21e3-4f0a-9584-0d818784e883),volume_type_id=f8989e4f-21e3-4f0a-9584-0d818784e883)' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:07:50 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-292c0bd9-7c34-4272-a4fe-8030b7042bf9 tempest-VolumeImageDependencyTests-347657137 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (423d3ed8-d10b-4b8c-a897-9b32d5b4753f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:07:50 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-292c0bd9-7c34-4272-a4fe-8030b7042bf9 tempest-VolumeImageDependencyTests-347657137 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (423d3ed8-d10b-4b8c-a897-9b32d5b4753f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:07:50 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-292c0bd9-7c34-4272-a4fe-8030b7042bf9 tempest-VolumeImageDependencyTests-347657137 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a431941-51ec-42c7-966d-408708cea88b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:07:50 devstack sudo[105243]: pam_unix(sudo:session): session closed for user root Nov 04 11:07:50 devstack cinder-volume[87272]: DEBUG cinder.image.glance [None req-292c0bd9-7c34-4272-a4fe-8030b7042bf9 tempest-VolumeImageDependencyTests-347657137 None] Creating Keystone auth plugin from conf {{(pid=87272) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 04 11:07:50 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-ef5c485b-a36b-49a2-8af3-ea69079e538a tempest-TestStampPattern-1122407784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-d8dbc52a-7d55-4220-af52-9d4db4cf33b3 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-3b995b16-60e9-42bf-961b-d32fc2177ef7" returned: 0 in 9.224s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:07:50 devstack cinder-volume[87272]: DEBUG cinder.image.image_utils [None req-ef5c485b-a36b-49a2-8af3-ea69079e538a tempest-TestStampPattern-1122407784 None] Image conversion details: src /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-d8dbc52a-7d55-4220-af52-9d4db4cf33b3, size 1024.00 MB, duration 9.23 sec, destination /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-3b995b16-60e9-42bf-961b-d32fc2177ef7 {{(pid=87272) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Nov 04 11:07:50 devstack cinder-volume[87272]: INFO cinder.image.image_utils [None req-ef5c485b-a36b-49a2-8af3-ea69079e538a tempest-TestStampPattern-1122407784 None] Converted 1024.00 MB image at 111.00 MB/s Nov 04 11:07:50 devstack cinder-volume[87272]: WARNING cinder.volume.drivers.remotefs [None req-ef5c485b-a36b-49a2-8af3-ea69079e538a tempest-TestStampPattern-1122407784 None] /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-3b995b16-60e9-42bf-961b-d32fc2177ef7 is being set with open permissions: ugo+rw Nov 04 11:07:50 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-ef5c485b-a36b-49a2-8af3-ea69079e538a tempest-TestStampPattern-1122407784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-3b995b16-60e9-42bf-961b-d32fc2177ef7 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:07:50 devstack sudo[105325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-3b995b16-60e9-42bf-961b-d32fc2177ef7 Nov 04 11:07:50 devstack sudo[105325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:07:50 devstack sudo[105325]: pam_unix(sudo:session): session closed for user root Nov 04 11:07:50 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-ef5c485b-a36b-49a2-8af3-ea69079e538a tempest-TestStampPattern-1122407784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-3b995b16-60e9-42bf-961b-d32fc2177ef7" returned: 0 in 0.294s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:07:50 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-ef5c485b-a36b-49a2-8af3-ea69079e538a tempest-TestStampPattern-1122407784 None] Lock "cinder-quobyte-3b995b16-60e9-42bf-961b-d32fc2177ef7" released by "_copy_volume_from_snapshot" :: held 10.576s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 11:07:50 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-ef5c485b-a36b-49a2-8af3-ea69079e538a tempest-TestStampPattern-1122407784 None] Lock "cinder-quobyte-60a94640-e77b-4f62-8006-e84f6c68c072-3b995b16-60e9-42bf-961b-d32fc2177ef7" released by "_create_volume_from_snapshot" :: held 10.666s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 11:07:50 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-ef5c485b-a36b-49a2-8af3-ea69079e538a tempest-TestStampPattern-1122407784 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.685s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 11:07:50 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-ef5c485b-a36b-49a2-8af3-ea69079e538a tempest-TestStampPattern-1122407784 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c9c43a96-bb61-496e-b0fb-8e6aef56469a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3b995b16-60e9-42bf-961b-d32fc2177ef7', 'volume_size': 1, 'snapshot_id': '60a94640-e77b-4f62-8006-e84f6c68c072'}' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:07:50 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-ef5c485b-a36b-49a2-8af3-ea69079e538a tempest-TestStampPattern-1122407784 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (43f6a0f8-6646-4b96-a64c-10be000a71aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:07:50 devstack cinder-volume[87272]: INFO cinder.volume.flows.manager.create_volume [None req-ef5c485b-a36b-49a2-8af3-ea69079e538a tempest-TestStampPattern-1122407784 None] Volume volume-3b995b16-60e9-42bf-961b-d32fc2177ef7 (3b995b16-60e9-42bf-961b-d32fc2177ef7): created successfully Nov 04 11:07:50 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-ef5c485b-a36b-49a2-8af3-ea69079e538a tempest-TestStampPattern-1122407784 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (43f6a0f8-6646-4b96-a64c-10be000a71aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:07:50 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-ef5c485b-a36b-49a2-8af3-ea69079e538a tempest-TestStampPattern-1122407784 None] Flow 'volume_create_manager' (76cb3e4a-569d-480f-a07f-8a1e148c878f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87272) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 11:07:50 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-ef5c485b-a36b-49a2-8af3-ea69079e538a tempest-TestStampPattern-1122407784 None] Created volume successfully. Nov 04 11:07:50 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-292c0bd9-7c34-4272-a4fe-8030b7042bf9 tempest-VolumeImageDependencyTests-347657137 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a431941-51ec-42c7-966d-408708cea88b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'e1c603cc-b92c-4a6d-88c4-261b7d9c6da0', 'volume_name': 'volume-e1c603cc-b92c-4a6d-88c4-261b7d9c6da0', 'volume_size': 1, 'image_id': '66bf42b8-1de7-4190-a87a-58808073631d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/66bf42b8-1de7-4190-a87a-58808073631d', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'd807feaf490866a51d38062fbace6bec', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '080b2b0551734b5f921c509a3352af01', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '2b3e82794a51c18aebe552de8c42a51332b921c99a02e71c347c8cc0f0d3a492f4f579b6f4ae9be87f579c18bbf3fc8913dae3ab7985eb497fa42a597f78b039', 'id': '66bf42b8-1de7-4190-a87a-58808073631d', 'created_at': datetime.datetime(2026, 11, 4, 10, 7, 44, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 4, 10, 7, 48, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/66bf42b8-1de7-4190-a87a-58808073631d/file', 'properties': {}}, 'image_service': }' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:07:50 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-292c0bd9-7c34-4272-a4fe-8030b7042bf9 tempest-VolumeImageDependencyTests-347657137 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c099da1-db49-464a-931b-f37c86a6d547) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:07:50 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-292c0bd9-7c34-4272-a4fe-8030b7042bf9 tempest-VolumeImageDependencyTests-347657137 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c099da1-db49-464a-931b-f37c86a6d547) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:07:50 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-292c0bd9-7c34-4272-a4fe-8030b7042bf9 tempest-VolumeImageDependencyTests-347657137 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d772c503-5e79-4bb6-b6b8-a5b30ff236d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:07:50 devstack cinder-volume[87272]: INFO cinder.volume.flows.manager.create_volume [None req-292c0bd9-7c34-4272-a4fe-8030b7042bf9 tempest-VolumeImageDependencyTests-347657137 None] Volume e1c603cc-b92c-4a6d-88c4-261b7d9c6da0: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-e1c603cc-b92c-4a6d-88c4-261b7d9c6da0', 'volume_size': 1, 'image_id': '66bf42b8-1de7-4190-a87a-58808073631d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/66bf42b8-1de7-4190-a87a-58808073631d', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'd807feaf490866a51d38062fbace6bec', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '080b2b0551734b5f921c509a3352af01', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '2b3e82794a51c18aebe552de8c42a51332b921c99a02e71c347c8cc0f0d3a492f4f579b6f4ae9be87f579c18bbf3fc8913dae3ab7985eb497fa42a597f78b039', 'id': '66bf42b8-1de7-4190-a87a-58808073631d', 'created_at': datetime.datetime(2026, 11, 4, 10, 7, 44, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 4, 10, 7, 48, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/66bf42b8-1de7-4190-a87a-58808073631d/file', 'properties': {}}, 'image_service': } Nov 04 11:07:50 devstack cinder-volume[87272]: DEBUG cinder.volume.flows.manager.create_volume [None req-292c0bd9-7c34-4272-a4fe-8030b7042bf9 tempest-VolumeImageDependencyTests-347657137 None] Trying to clone e1c603cc-b92c-4a6d-88c4-261b7d9c6da0 from image 66bf42b8-1de7-4190-a87a-58808073631d at location (None, [{'url': 'file:///opt/stack/data/glance/images/66bf42b8-1de7-4190-a87a-58808073631d', 'metadata': {}}]). {{(pid=87272) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 04 11:07:50 devstack cinder-volume[87272]: DEBUG cinder.image.image_utils [None req-292c0bd9-7c34-4272-a4fe-8030b7042bf9 tempest-VolumeImageDependencyTests-347657137 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_66bf42b8-1de7-4190-a87a-58808073631d_e8jvp1thdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87272) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Nov 04 11:07:50 devstack cinder-volume[87272]: INFO cinder.image.image_utils [None req-292c0bd9-7c34-4272-a4fe-8030b7042bf9 tempest-VolumeImageDependencyTests-347657137 None] Image download 0.00 MB at 0.00 MB/s Nov 04 11:07:50 devstack cinder-volume[87272]: DEBUG oslo.privsep.daemon [-] privsep: reply[d11ab307-e51c-4460-8151-c9c52bc23365]: (4, 'raw') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 11:07:50 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-292c0bd9-7c34-4272-a4fe-8030b7042bf9 tempest-VolumeImageDependencyTests-347657137 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_66bf42b8-1de7-4190-a87a-58808073631d_e8jvp1thdevstack@QuobyteHD {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:07:51 devstack sudo[105331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_66bf42b8-1de7-4190-a87a-58808073631d_e8jvp1thdevstack@QuobyteHD Nov 04 11:07:51 devstack sudo[105331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:07:51 devstack sudo[105331]: pam_unix(sudo:session): session closed for user root Nov 04 11:07:51 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-292c0bd9-7c34-4272-a4fe-8030b7042bf9 tempest-VolumeImageDependencyTests-347657137 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_66bf42b8-1de7-4190-a87a-58808073631d_e8jvp1thdevstack@QuobyteHD" returned: 0 in 0.401s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:07:51 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-292c0bd9-7c34-4272-a4fe-8030b7042bf9 tempest-VolumeImageDependencyTests-347657137 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_66bf42b8-1de7-4190-a87a-58808073631d_e8jvp1thdevstack@QuobyteHD {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:07:51 devstack sudo[105335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_66bf42b8-1de7-4190-a87a-58808073631d_e8jvp1thdevstack@QuobyteHD Nov 04 11:07:51 devstack sudo[105335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:07:51 devstack sudo[105335]: pam_unix(sudo:session): session closed for user root Nov 04 11:07:51 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-292c0bd9-7c34-4272-a4fe-8030b7042bf9 tempest-VolumeImageDependencyTests-347657137 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_66bf42b8-1de7-4190-a87a-58808073631d_e8jvp1thdevstack@QuobyteHD" returned: 1 in 0.368s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:07:51 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-292c0bd9-7c34-4272-a4fe-8030b7042bf9 tempest-VolumeImageDependencyTests-347657137 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_66bf42b8-1de7-4190-a87a-58808073631d_e8jvp1thdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 04 11:07:51 devstack cinder-volume[87272]: DEBUG cinder.image.image_utils [None req-292c0bd9-7c34-4272-a4fe-8030b7042bf9 tempest-VolumeImageDependencyTests-347657137 None] Temporary image 66bf42b8-1de7-4190-a87a-58808073631d is fetched for user 5f94a74665d94096b80e1cca66ed6aae. {{(pid=87272) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Nov 04 11:07:51 devstack cinder-volume[87272]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bd2b83d-6a0e-4bd5-9879-ff31529726cd]: (4, 'raw') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 11:07:51 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-292c0bd9-7c34-4272-a4fe-8030b7042bf9 tempest-VolumeImageDependencyTests-347657137 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_66bf42b8-1de7-4190-a87a-58808073631d_e8jvp1thdevstack@QuobyteHD {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:07:51 devstack sudo[105340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_66bf42b8-1de7-4190-a87a-58808073631d_e8jvp1thdevstack@QuobyteHD Nov 04 11:07:51 devstack sudo[105340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:07:52 devstack sudo[105340]: pam_unix(sudo:session): session closed for user root Nov 04 11:07:52 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-292c0bd9-7c34-4272-a4fe-8030b7042bf9 tempest-VolumeImageDependencyTests-347657137 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_66bf42b8-1de7-4190-a87a-58808073631d_e8jvp1thdevstack@QuobyteHD" returned: 0 in 0.353s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:07:52 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-292c0bd9-7c34-4272-a4fe-8030b7042bf9 tempest-VolumeImageDependencyTests-347657137 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_66bf42b8-1de7-4190-a87a-58808073631d_e8jvp1thdevstack@QuobyteHD {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:07:52 devstack sudo[105344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_66bf42b8-1de7-4190-a87a-58808073631d_e8jvp1thdevstack@QuobyteHD Nov 04 11:07:52 devstack sudo[105344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:07:52 devstack sudo[105344]: pam_unix(sudo:session): session closed for user root Nov 04 11:07:52 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-292c0bd9-7c34-4272-a4fe-8030b7042bf9 tempest-VolumeImageDependencyTests-347657137 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_66bf42b8-1de7-4190-a87a-58808073631d_e8jvp1thdevstack@QuobyteHD" returned: 1 in 0.364s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:07:52 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-292c0bd9-7c34-4272-a4fe-8030b7042bf9 tempest-VolumeImageDependencyTests-347657137 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_66bf42b8-1de7-4190-a87a-58808073631d_e8jvp1thdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 04 11:07:52 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-292c0bd9-7c34-4272-a4fe-8030b7042bf9 tempest-VolumeImageDependencyTests-347657137 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 11:07:52 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-292c0bd9-7c34-4272-a4fe-8030b7042bf9 tempest-VolumeImageDependencyTests-347657137 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 11:07:52 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-292c0bd9-7c34-4272-a4fe-8030b7042bf9 tempest-VolumeImageDependencyTests-347657137 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T10:07:49Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e1c603cc-b92c-4a6d-88c4-261b7d9c6da0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='080b2b0551734b5f921c509a3352af01',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T10:07:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T10:07:50Z,use_quota=True,user_id='5f94a74665d94096b80e1cca66ed6aae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8989e4f-21e3-4f0a-9584-0d818784e883),volume_type_id=f8989e4f-21e3-4f0a-9584-0d818784e883)}" {{(pid=87272) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 04 11:07:52 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.remotefs [None req-292c0bd9-7c34-4272-a4fe-8030b7042bf9 tempest-VolumeImageDependencyTests-347657137 None] Creating volume e1c603cc-b92c-4a6d-88c4-261b7d9c6da0 {{(pid=87272) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 11:07:52 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-292c0bd9-7c34-4272-a4fe-8030b7042bf9 tempest-VolumeImageDependencyTests-347657137 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 11:07:52 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-292c0bd9-7c34-4272-a4fe-8030b7042bf9 tempest-VolumeImageDependencyTests-347657137 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 11:07:52 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-292c0bd9-7c34-4272-a4fe-8030b7042bf9 tempest-VolumeImageDependencyTests-347657137 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898': None} {{(pid=87272) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 11:07:52 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-292c0bd9-7c34-4272-a4fe-8030b7042bf9 tempest-VolumeImageDependencyTests-347657137 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'] {{(pid=87272) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 11:07:52 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-292c0bd9-7c34-4272-a4fe-8030b7042bf9 tempest-VolumeImageDependencyTests-347657137 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 11:07:52 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-292c0bd9-7c34-4272-a4fe-8030b7042bf9 tempest-VolumeImageDependencyTests-347657137 None] Selected osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898 as target Quobyte volume. {{(pid=87272) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 11:07:52 devstack cinder-volume[87272]: INFO cinder.volume.drivers.remotefs [None req-292c0bd9-7c34-4272-a4fe-8030b7042bf9 tempest-VolumeImageDependencyTests-347657137 None] casted to osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898 Nov 04 11:07:52 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-292c0bd9-7c34-4272-a4fe-8030b7042bf9 tempest-VolumeImageDependencyTests-347657137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-e1c603cc-b92c-4a6d-88c4-261b7d9c6da0 1073741824 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:07:52 devstack sudo[105349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-e1c603cc-b92c-4a6d-88c4-261b7d9c6da0 1073741824 Nov 04 11:07:52 devstack sudo[105349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:07:52 devstack sudo[105349]: pam_unix(sudo:session): session closed for user root Nov 04 11:07:52 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-292c0bd9-7c34-4272-a4fe-8030b7042bf9 tempest-VolumeImageDependencyTests-347657137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-e1c603cc-b92c-4a6d-88c4-261b7d9c6da0 1073741824" returned: 0 in 0.500s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:07:53 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-292c0bd9-7c34-4272-a4fe-8030b7042bf9 tempest-VolumeImageDependencyTests-347657137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-e1c603cc-b92c-4a6d-88c4-261b7d9c6da0 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:07:53 devstack sudo[105355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-e1c603cc-b92c-4a6d-88c4-261b7d9c6da0 Nov 04 11:07:53 devstack sudo[105355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:07:53 devstack sudo[105355]: pam_unix(sudo:session): session closed for user root Nov 04 11:07:53 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-292c0bd9-7c34-4272-a4fe-8030b7042bf9 tempest-VolumeImageDependencyTests-347657137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-e1c603cc-b92c-4a6d-88c4-261b7d9c6da0" returned: 0 in 0.280s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:07:53 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-292c0bd9-7c34-4272-a4fe-8030b7042bf9 tempest-VolumeImageDependencyTests-347657137 None] <== create_volume: return (848ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'} {{(pid=87272) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 04 11:07:53 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-292c0bd9-7c34-4272-a4fe-8030b7042bf9 tempest-VolumeImageDependencyTests-347657137 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.850s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 11:07:53 devstack cinder-volume[87272]: DEBUG cinder.volume.volume_utils [None req-292c0bd9-7c34-4272-a4fe-8030b7042bf9 tempest-VolumeImageDependencyTests-347657137 None] Attempting download of 66bf42b8-1de7-4190-a87a-58808073631d ((None, [{'url': 'file:///opt/stack/data/glance/images/66bf42b8-1de7-4190-a87a-58808073631d', 'metadata': {}}])) to volume e1c603cc-b92c-4a6d-88c4-261b7d9c6da0. {{(pid=87272) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Nov 04 11:07:53 devstack cinder-volume[87272]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae956acf-d6bf-4d3e-8099-111524513ef7]: (4, 'raw') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 11:07:53 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-292c0bd9-7c34-4272-a4fe-8030b7042bf9 tempest-VolumeImageDependencyTests-347657137 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_66bf42b8-1de7-4190-a87a-58808073631d_tmh50r_2 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:07:53 devstack sudo[105358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_66bf42b8-1de7-4190-a87a-58808073631d_tmh50r_2 Nov 04 11:07:53 devstack sudo[105358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:07:53 devstack sudo[105358]: pam_unix(sudo:session): session closed for user root Nov 04 11:07:53 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-292c0bd9-7c34-4272-a4fe-8030b7042bf9 tempest-VolumeImageDependencyTests-347657137 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_66bf42b8-1de7-4190-a87a-58808073631d_tmh50r_2" returned: 0 in 0.409s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:07:53 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-292c0bd9-7c34-4272-a4fe-8030b7042bf9 tempest-VolumeImageDependencyTests-347657137 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_66bf42b8-1de7-4190-a87a-58808073631d_tmh50r_2 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:07:53 devstack sudo[105363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_66bf42b8-1de7-4190-a87a-58808073631d_tmh50r_2 Nov 04 11:07:53 devstack sudo[105363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:07:54 devstack sudo[105363]: pam_unix(sudo:session): session closed for user root Nov 04 11:07:54 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-292c0bd9-7c34-4272-a4fe-8030b7042bf9 tempest-VolumeImageDependencyTests-347657137 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_66bf42b8-1de7-4190-a87a-58808073631d_tmh50r_2" returned: 1 in 0.341s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:07:54 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-292c0bd9-7c34-4272-a4fe-8030b7042bf9 tempest-VolumeImageDependencyTests-347657137 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_66bf42b8-1de7-4190-a87a-58808073631d_tmh50r_2' failed. Not Retrying. {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 04 11:07:54 devstack cinder-volume[87272]: DEBUG oslo.privsep.daemon [-] privsep: reply[edd129b9-c456-4e6e-94c5-76dd6edda247]: (4, 'raw') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 11:07:54 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-292c0bd9-7c34-4272-a4fe-8030b7042bf9 tempest-VolumeImageDependencyTests-347657137 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_66bf42b8-1de7-4190-a87a-58808073631d_e8jvp1thdevstack@QuobyteHD {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:07:54 devstack sudo[105368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_66bf42b8-1de7-4190-a87a-58808073631d_e8jvp1thdevstack@QuobyteHD Nov 04 11:07:54 devstack sudo[105368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:07:54 devstack sudo[105368]: pam_unix(sudo:session): session closed for user root Nov 04 11:07:54 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-292c0bd9-7c34-4272-a4fe-8030b7042bf9 tempest-VolumeImageDependencyTests-347657137 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_66bf42b8-1de7-4190-a87a-58808073631d_e8jvp1thdevstack@QuobyteHD" returned: 0 in 0.335s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:07:54 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-292c0bd9-7c34-4272-a4fe-8030b7042bf9 tempest-VolumeImageDependencyTests-347657137 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_66bf42b8-1de7-4190-a87a-58808073631d_e8jvp1thdevstack@QuobyteHD {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:07:54 devstack sudo[105372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_66bf42b8-1de7-4190-a87a-58808073631d_e8jvp1thdevstack@QuobyteHD Nov 04 11:07:54 devstack sudo[105372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:07:54 devstack sudo[105372]: pam_unix(sudo:session): session closed for user root Nov 04 11:07:54 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-292c0bd9-7c34-4272-a4fe-8030b7042bf9 tempest-VolumeImageDependencyTests-347657137 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_66bf42b8-1de7-4190-a87a-58808073631d_e8jvp1thdevstack@QuobyteHD" returned: 1 in 0.345s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:07:54 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-292c0bd9-7c34-4272-a4fe-8030b7042bf9 tempest-VolumeImageDependencyTests-347657137 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_66bf42b8-1de7-4190-a87a-58808073631d_e8jvp1thdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 04 11:07:54 devstack cinder-volume[87272]: DEBUG cinder.image.image_utils [None req-292c0bd9-7c34-4272-a4fe-8030b7042bf9 tempest-VolumeImageDependencyTests-347657137 None] 66bf42b8-1de7-4190-a87a-58808073631d was raw, converting to qcow2 {{(pid=87272) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Nov 04 11:07:54 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-292c0bd9-7c34-4272-a4fe-8030b7042bf9 tempest-VolumeImageDependencyTests-347657137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_66bf42b8-1de7-4190-a87a-58808073631d_e8jvp1thdevstack@QuobyteHD /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-e1c603cc-b92c-4a6d-88c4-261b7d9c6da0 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:07:54 devstack sudo[105377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_66bf42b8-1de7-4190-a87a-58808073631d_e8jvp1thdevstack@QuobyteHD /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-e1c603cc-b92c-4a6d-88c4-261b7d9c6da0 Nov 04 11:07:54 devstack sudo[105377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:07:55 devstack sudo[105377]: pam_unix(sudo:session): session closed for user root Nov 04 11:07:55 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-292c0bd9-7c34-4272-a4fe-8030b7042bf9 tempest-VolumeImageDependencyTests-347657137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_66bf42b8-1de7-4190-a87a-58808073631d_e8jvp1thdevstack@QuobyteHD /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-e1c603cc-b92c-4a6d-88c4-261b7d9c6da0" returned: 0 in 0.460s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:07:55 devstack cinder-volume[87272]: DEBUG cinder.image.image_utils [None req-292c0bd9-7c34-4272-a4fe-8030b7042bf9 tempest-VolumeImageDependencyTests-347657137 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_66bf42b8-1de7-4190-a87a-58808073631d_e8jvp1thdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-e1c603cc-b92c-4a6d-88c4-261b7d9c6da0 {{(pid=87272) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Nov 04 11:07:55 devstack cinder-volume[87272]: INFO cinder.image.image_utils [None req-292c0bd9-7c34-4272-a4fe-8030b7042bf9 tempest-VolumeImageDependencyTests-347657137 None] Converted 0.00 MB image at 0.00 MB/s Nov 04 11:07:55 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-292c0bd9-7c34-4272-a4fe-8030b7042bf9 tempest-VolumeImageDependencyTests-347657137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-e1c603cc-b92c-4a6d-88c4-261b7d9c6da0 1G {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:07:55 devstack sudo[105383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-e1c603cc-b92c-4a6d-88c4-261b7d9c6da0 1G Nov 04 11:07:55 devstack sudo[105383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:07:55 devstack sudo[105383]: pam_unix(sudo:session): session closed for user root Nov 04 11:07:55 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-292c0bd9-7c34-4272-a4fe-8030b7042bf9 tempest-VolumeImageDependencyTests-347657137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-e1c603cc-b92c-4a6d-88c4-261b7d9c6da0 1G" returned: 0 in 0.322s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:07:55 devstack cinder-volume[87272]: DEBUG cinder.volume.volume_utils [None req-292c0bd9-7c34-4272-a4fe-8030b7042bf9 tempest-VolumeImageDependencyTests-347657137 None] Downloaded image 66bf42b8-1de7-4190-a87a-58808073631d ((None, [{'url': 'file:///opt/stack/data/glance/images/66bf42b8-1de7-4190-a87a-58808073631d', 'metadata': {}}])) to volume e1c603cc-b92c-4a6d-88c4-261b7d9c6da0 successfully. {{(pid=87272) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Nov 04 11:07:55 devstack cinder-volume[87272]: DEBUG cinder.image.image_utils [None req-292c0bd9-7c34-4272-a4fe-8030b7042bf9 tempest-VolumeImageDependencyTests-347657137 None] Temporary image 66bf42b8-1de7-4190-a87a-58808073631d for user 5f94a74665d94096b80e1cca66ed6aae is deleted. {{(pid=87272) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Nov 04 11:07:55 devstack cinder-volume[87272]: DEBUG cinder.volume.volume_utils [None req-292c0bd9-7c34-4272-a4fe-8030b7042bf9 tempest-VolumeImageDependencyTests-347657137 None] Marking volume e1c603cc-b92c-4a6d-88c4-261b7d9c6da0 as bootable. {{(pid=87272) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Nov 04 11:07:55 devstack cinder-volume[87272]: DEBUG cinder.volume.flows.manager.create_volume [None req-292c0bd9-7c34-4272-a4fe-8030b7042bf9 tempest-VolumeImageDependencyTests-347657137 None] Copying metadata from image 66bf42b8-1de7-4190-a87a-58808073631d to e1c603cc-b92c-4a6d-88c4-261b7d9c6da0. {{(pid=87272) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 04 11:07:55 devstack cinder-volume[87272]: DEBUG cinder.volume.flows.manager.create_volume [None req-292c0bd9-7c34-4272-a4fe-8030b7042bf9 tempest-VolumeImageDependencyTests-347657137 None] Creating volume glance metadata for volume e1c603cc-b92c-4a6d-88c4-261b7d9c6da0 backed by image 66bf42b8-1de7-4190-a87a-58808073631d with: {'image_id': '66bf42b8-1de7-4190-a87a-58808073631d', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': 'd807feaf490866a51d38062fbace6bec', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87272) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 04 11:07:55 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-292c0bd9-7c34-4272-a4fe-8030b7042bf9 tempest-VolumeImageDependencyTests-347657137 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d772c503-5e79-4bb6-b6b8-a5b30ff236d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e1c603cc-b92c-4a6d-88c4-261b7d9c6da0', 'volume_size': 1, 'image_id': '66bf42b8-1de7-4190-a87a-58808073631d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/66bf42b8-1de7-4190-a87a-58808073631d', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'd807feaf490866a51d38062fbace6bec', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '080b2b0551734b5f921c509a3352af01', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '2b3e82794a51c18aebe552de8c42a51332b921c99a02e71c347c8cc0f0d3a492f4f579b6f4ae9be87f579c18bbf3fc8913dae3ab7985eb497fa42a597f78b039', 'id': '66bf42b8-1de7-4190-a87a-58808073631d', 'created_at': datetime.datetime(2026, 11, 4, 10, 7, 44, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 4, 10, 7, 48, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/66bf42b8-1de7-4190-a87a-58808073631d/file', 'properties': {}}, 'image_service': }' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:07:55 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-292c0bd9-7c34-4272-a4fe-8030b7042bf9 tempest-VolumeImageDependencyTests-347657137 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd4e4c47-150d-4f06-9181-0571ba6979fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:07:55 devstack cinder-volume[87272]: INFO cinder.volume.flows.manager.create_volume [None req-292c0bd9-7c34-4272-a4fe-8030b7042bf9 tempest-VolumeImageDependencyTests-347657137 None] Volume volume-e1c603cc-b92c-4a6d-88c4-261b7d9c6da0 (e1c603cc-b92c-4a6d-88c4-261b7d9c6da0): created successfully Nov 04 11:07:55 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-292c0bd9-7c34-4272-a4fe-8030b7042bf9 tempest-VolumeImageDependencyTests-347657137 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd4e4c47-150d-4f06-9181-0571ba6979fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:07:55 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-292c0bd9-7c34-4272-a4fe-8030b7042bf9 tempest-VolumeImageDependencyTests-347657137 None] Flow 'volume_create_manager' (ee22e82c-c31f-46d0-ade7-9387653f4dad) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87272) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 11:07:55 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-292c0bd9-7c34-4272-a4fe-8030b7042bf9 tempest-VolumeImageDependencyTests-347657137 None] Created volume successfully. Nov 04 11:07:56 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-316c0418-168f-42ee-ada2-4f87f49eb5f5 tempest-VolumeImageDependencyTests-347657137 None] Acquiring lock "cinder-e1c603cc-b92c-4a6d-88c4-261b7d9c6da0-delete_volume" by "delete_volume" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 11:07:56 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-316c0418-168f-42ee-ada2-4f87f49eb5f5 tempest-VolumeImageDependencyTests-347657137 None] Lock "cinder-e1c603cc-b92c-4a6d-88c4-261b7d9c6da0-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 11:07:56 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-316c0418-168f-42ee-ada2-4f87f49eb5f5 tempest-VolumeImageDependencyTests-347657137 None] Acquiring lock "cinder-quobyte-e1c603cc-b92c-4a6d-88c4-261b7d9c6da0" by "delete_volume" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 11:07:56 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-316c0418-168f-42ee-ada2-4f87f49eb5f5 tempest-VolumeImageDependencyTests-347657137 None] Lock "cinder-quobyte-e1c603cc-b92c-4a6d-88c4-261b7d9c6da0" acquired by "delete_volume" :: waited 0.014s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 11:07:56 devstack cinder-volume[87272]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5326c9c-605a-46dc-85e5-c325eb21d40f]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 11:07:56 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-316c0418-168f-42ee-ada2-4f87f49eb5f5 tempest-VolumeImageDependencyTests-347657137 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-e1c603cc-b92c-4a6d-88c4-261b7d9c6da0 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:07:56 devstack sudo[105389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-e1c603cc-b92c-4a6d-88c4-261b7d9c6da0 Nov 04 11:07:56 devstack sudo[105389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:07:56 devstack sudo[105389]: pam_unix(sudo:session): session closed for user root Nov 04 11:07:56 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-316c0418-168f-42ee-ada2-4f87f49eb5f5 tempest-VolumeImageDependencyTests-347657137 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-e1c603cc-b92c-4a6d-88c4-261b7d9c6da0" returned: 0 in 0.384s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:07:56 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-316c0418-168f-42ee-ada2-4f87f49eb5f5 tempest-VolumeImageDependencyTests-347657137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-e1c603cc-b92c-4a6d-88c4-261b7d9c6da0 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:07:56 devstack sudo[105396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-e1c603cc-b92c-4a6d-88c4-261b7d9c6da0 Nov 04 11:07:56 devstack sudo[105396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:07:57 devstack sudo[105396]: pam_unix(sudo:session): session closed for user root Nov 04 11:07:57 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-316c0418-168f-42ee-ada2-4f87f49eb5f5 tempest-VolumeImageDependencyTests-347657137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-e1c603cc-b92c-4a6d-88c4-261b7d9c6da0" returned: 0 in 0.244s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:07:57 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-316c0418-168f-42ee-ada2-4f87f49eb5f5 tempest-VolumeImageDependencyTests-347657137 None] Lock "cinder-quobyte-e1c603cc-b92c-4a6d-88c4-261b7d9c6da0" released by "delete_volume" :: held 0.668s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 11:07:57 devstack cinder-volume[87272]: DEBUG cinder.quota [None req-316c0418-168f-42ee-ada2-4f87f49eb5f5 tempest-VolumeImageDependencyTests-347657137 None] Created reservations ['f0d32a26-81fa-40e7-a5e3-246066f7e8e0', '81758e58-484b-4e91-8a32-8a90568f0186', '235e6913-162d-4e2e-ace0-f37d6189637a', 'eacdb432-3af6-4b35-af46-b8e80ce5a503'] {{(pid=87272) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 11:07:57 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-316c0418-168f-42ee-ada2-4f87f49eb5f5 tempest-VolumeImageDependencyTests-347657137 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 11:07:57 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-316c0418-168f-42ee-ada2-4f87f49eb5f5 tempest-VolumeImageDependencyTests-347657137 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 11:07:57 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-316c0418-168f-42ee-ada2-4f87f49eb5f5 tempest-VolumeImageDependencyTests-347657137 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898': None} {{(pid=87272) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 11:07:57 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-316c0418-168f-42ee-ada2-4f87f49eb5f5 tempest-VolumeImageDependencyTests-347657137 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'] {{(pid=87272) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 11:07:57 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-316c0418-168f-42ee-ada2-4f87f49eb5f5 tempest-VolumeImageDependencyTests-347657137 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 11:07:57 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-316c0418-168f-42ee-ada2-4f87f49eb5f5 tempest-VolumeImageDependencyTests-347657137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:07:57 devstack sudo[105408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1 Nov 04 11:07:57 devstack sudo[105408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:07:57 devstack sudo[105408]: pam_unix(sudo:session): session closed for user root Nov 04 11:07:57 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-316c0418-168f-42ee-ada2-4f87f49eb5f5 tempest-VolumeImageDependencyTests-347657137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1" returned: 0 in 0.285s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:07:57 devstack cinder-volume[87272]: DEBUG cinder.manager [None req-316c0418-168f-42ee-ada2-4f87f49eb5f5 tempest-VolumeImageDependencyTests-347657137 None] Notifying Schedulers of capabilities ... {{(pid=87272) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 11:07:57 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-316c0418-168f-42ee-ada2-4f87f49eb5f5 tempest-VolumeImageDependencyTests-347657137 None] Deleted volume successfully. Nov 04 11:07:57 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-316c0418-168f-42ee-ada2-4f87f49eb5f5 tempest-VolumeImageDependencyTests-347657137 None] Lock "cinder-e1c603cc-b92c-4a6d-88c4-261b7d9c6da0-delete_volume" released by "delete_volume" :: held 1.221s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 11:08:00 devstack cinder-volume[87272]: DEBUG cinder.volume.flows.manager.create_volume [None req-6687332c-9598-45f8-8c40-a6ed0aced43c tempest-CinderUnicodeTest-166757166 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87272) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 11:08:00 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-6687332c-9598-45f8-8c40-a6ed0aced43c tempest-CinderUnicodeTest-166757166 None] Flow 'volume_create_manager' (f027fc57-bad8-442c-b2b5-57d06fa11cef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 11:08:00 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-6687332c-9598-45f8-8c40-a6ed0aced43c tempest-CinderUnicodeTest-166757166 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e3f129e-fd43-4e5b-afc2-0f0224de4da1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:08:00 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-6687332c-9598-45f8-8c40-a6ed0aced43c tempest-CinderUnicodeTest-166757166 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e3f129e-fd43-4e5b-afc2-0f0224de4da1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T10:08:01Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=602c9b8a-b60c-4201-a680-c58b37ab77c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a863d6043744dc9950fca4925623bcc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T10:08:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T10:08:01Z,use_quota=True,user_id='b0bfd7f09a29421482be51857ebae9de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8989e4f-21e3-4f0a-9584-0d818784e883),volume_type_id=f8989e4f-21e3-4f0a-9584-0d818784e883)' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:08:00 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-6687332c-9598-45f8-8c40-a6ed0aced43c tempest-CinderUnicodeTest-166757166 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc1a9515-bfc5-48f6-9e53-621240e83bff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:08:00 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-6687332c-9598-45f8-8c40-a6ed0aced43c tempest-CinderUnicodeTest-166757166 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc1a9515-bfc5-48f6-9e53-621240e83bff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:08:00 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-6687332c-9598-45f8-8c40-a6ed0aced43c tempest-CinderUnicodeTest-166757166 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66261bf3-c621-4dd0-9b63-0f524dbe3f4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:08:00 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-6687332c-9598-45f8-8c40-a6ed0aced43c tempest-CinderUnicodeTest-166757166 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66261bf3-c621-4dd0-9b63-0f524dbe3f4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '602c9b8a-b60c-4201-a680-c58b37ab77c0', 'volume_name': 'volume-602c9b8a-b60c-4201-a680-c58b37ab77c0', 'volume_size': 1}' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:08:00 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-6687332c-9598-45f8-8c40-a6ed0aced43c tempest-CinderUnicodeTest-166757166 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0728d02b-e092-4dd1-b05f-0f5f6387b58d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:08:00 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-6687332c-9598-45f8-8c40-a6ed0aced43c tempest-CinderUnicodeTest-166757166 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0728d02b-e092-4dd1-b05f-0f5f6387b58d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:08:00 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-6687332c-9598-45f8-8c40-a6ed0aced43c tempest-CinderUnicodeTest-166757166 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (88a2ce3c-52a6-47d2-8513-9da0e03a6735) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:08:00 devstack cinder-volume[87272]: INFO cinder.volume.flows.manager.create_volume [None req-6687332c-9598-45f8-8c40-a6ed0aced43c tempest-CinderUnicodeTest-166757166 None] Volume 602c9b8a-b60c-4201-a680-c58b37ab77c0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-602c9b8a-b60c-4201-a680-c58b37ab77c0', 'volume_size': 1} Nov 04 11:08:00 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-6687332c-9598-45f8-8c40-a6ed0aced43c tempest-CinderUnicodeTest-166757166 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 11:08:00 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-6687332c-9598-45f8-8c40-a6ed0aced43c tempest-CinderUnicodeTest-166757166 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 11:08:00 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-6687332c-9598-45f8-8c40-a6ed0aced43c tempest-CinderUnicodeTest-166757166 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T10:08:01Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=602c9b8a-b60c-4201-a680-c58b37ab77c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a863d6043744dc9950fca4925623bcc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T10:08:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T10:08:01Z,use_quota=True,user_id='b0bfd7f09a29421482be51857ebae9de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8989e4f-21e3-4f0a-9584-0d818784e883),volume_type_id=f8989e4f-21e3-4f0a-9584-0d818784e883)}" {{(pid=87272) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 04 11:08:00 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.remotefs [None req-6687332c-9598-45f8-8c40-a6ed0aced43c tempest-CinderUnicodeTest-166757166 None] Creating volume 602c9b8a-b60c-4201-a680-c58b37ab77c0 {{(pid=87272) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 11:08:00 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-6687332c-9598-45f8-8c40-a6ed0aced43c tempest-CinderUnicodeTest-166757166 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 11:08:00 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-6687332c-9598-45f8-8c40-a6ed0aced43c tempest-CinderUnicodeTest-166757166 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 11:08:00 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-6687332c-9598-45f8-8c40-a6ed0aced43c tempest-CinderUnicodeTest-166757166 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898': None} {{(pid=87272) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 11:08:00 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-6687332c-9598-45f8-8c40-a6ed0aced43c tempest-CinderUnicodeTest-166757166 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'] {{(pid=87272) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 11:08:00 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-6687332c-9598-45f8-8c40-a6ed0aced43c tempest-CinderUnicodeTest-166757166 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 11:08:00 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-6687332c-9598-45f8-8c40-a6ed0aced43c tempest-CinderUnicodeTest-166757166 None] Selected osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898 as target Quobyte volume. {{(pid=87272) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 11:08:00 devstack cinder-volume[87272]: INFO cinder.volume.drivers.remotefs [None req-6687332c-9598-45f8-8c40-a6ed0aced43c tempest-CinderUnicodeTest-166757166 None] casted to osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898 Nov 04 11:08:00 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-6687332c-9598-45f8-8c40-a6ed0aced43c tempest-CinderUnicodeTest-166757166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-602c9b8a-b60c-4201-a680-c58b37ab77c0 1073741824 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:08:00 devstack sudo[105414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-602c9b8a-b60c-4201-a680-c58b37ab77c0 1073741824 Nov 04 11:08:00 devstack sudo[105414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:08:01 devstack sudo[105414]: pam_unix(sudo:session): session closed for user root Nov 04 11:08:01 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-6687332c-9598-45f8-8c40-a6ed0aced43c tempest-CinderUnicodeTest-166757166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-602c9b8a-b60c-4201-a680-c58b37ab77c0 1073741824" returned: 0 in 0.401s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:08:01 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-6687332c-9598-45f8-8c40-a6ed0aced43c tempest-CinderUnicodeTest-166757166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-602c9b8a-b60c-4201-a680-c58b37ab77c0 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:08:01 devstack sudo[105419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-602c9b8a-b60c-4201-a680-c58b37ab77c0 Nov 04 11:08:01 devstack sudo[105419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:08:01 devstack sudo[105419]: pam_unix(sudo:session): session closed for user root Nov 04 11:08:01 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-6687332c-9598-45f8-8c40-a6ed0aced43c tempest-CinderUnicodeTest-166757166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-602c9b8a-b60c-4201-a680-c58b37ab77c0" returned: 0 in 0.247s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:08:01 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-6687332c-9598-45f8-8c40-a6ed0aced43c tempest-CinderUnicodeTest-166757166 None] <== create_volume: return (686ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'} {{(pid=87272) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 04 11:08:01 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-6687332c-9598-45f8-8c40-a6ed0aced43c tempest-CinderUnicodeTest-166757166 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.689s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 11:08:01 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-6687332c-9598-45f8-8c40-a6ed0aced43c tempest-CinderUnicodeTest-166757166 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (88a2ce3c-52a6-47d2-8513-9da0e03a6735) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-602c9b8a-b60c-4201-a680-c58b37ab77c0', 'volume_size': 1}' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:08:01 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-6687332c-9598-45f8-8c40-a6ed0aced43c tempest-CinderUnicodeTest-166757166 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca5649e6-907d-4065-a4fa-53b0a3566585) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:08:01 devstack cinder-volume[87272]: INFO cinder.volume.flows.manager.create_volume [None req-6687332c-9598-45f8-8c40-a6ed0aced43c tempest-CinderUnicodeTest-166757166 None] Volume volume-602c9b8a-b60c-4201-a680-c58b37ab77c0 (602c9b8a-b60c-4201-a680-c58b37ab77c0): created successfully Nov 04 11:08:01 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-6687332c-9598-45f8-8c40-a6ed0aced43c tempest-CinderUnicodeTest-166757166 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca5649e6-907d-4065-a4fa-53b0a3566585) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:08:01 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-6687332c-9598-45f8-8c40-a6ed0aced43c tempest-CinderUnicodeTest-166757166 None] Flow 'volume_create_manager' (f027fc57-bad8-442c-b2b5-57d06fa11cef) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87272) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 11:08:01 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-6687332c-9598-45f8-8c40-a6ed0aced43c tempest-CinderUnicodeTest-166757166 None] Created volume successfully. Nov 04 11:08:02 devstack cinder-volume[87272]: DEBUG cinder.volume.flows.manager.create_volume [None req-a9361efd-5114-410c-b61a-57bad12da68c tempest-CinderUnicodeTest-166757166 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87272) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 11:08:02 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-a9361efd-5114-410c-b61a-57bad12da68c tempest-CinderUnicodeTest-166757166 None] Flow 'volume_create_manager' (dccde6b4-1a4f-46ba-b058-c6e4ce62d950) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 11:08:02 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-a9361efd-5114-410c-b61a-57bad12da68c tempest-CinderUnicodeTest-166757166 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d7c427c-3291-40b3-a85d-9293108597d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:08:02 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-a9361efd-5114-410c-b61a-57bad12da68c tempest-CinderUnicodeTest-166757166 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d7c427c-3291-40b3-a85d-9293108597d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T10:08:02Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-999762706',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b8c233e-a11b-470e-a3ca-696d08cf5673,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a863d6043744dc9950fca4925623bcc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T10:08:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T10:08:02Z,use_quota=True,user_id='b0bfd7f09a29421482be51857ebae9de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8989e4f-21e3-4f0a-9584-0d818784e883),volume_type_id=f8989e4f-21e3-4f0a-9584-0d818784e883)' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:08:02 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-a9361efd-5114-410c-b61a-57bad12da68c tempest-CinderUnicodeTest-166757166 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c6fb175-5cd4-4fd9-a07b-b40be34216e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:08:02 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-a9361efd-5114-410c-b61a-57bad12da68c tempest-CinderUnicodeTest-166757166 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c6fb175-5cd4-4fd9-a07b-b40be34216e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:08:02 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-a9361efd-5114-410c-b61a-57bad12da68c tempest-CinderUnicodeTest-166757166 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2ec294a-1d58-41af-898f-d948ea49bb0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:08:02 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-a9361efd-5114-410c-b61a-57bad12da68c tempest-CinderUnicodeTest-166757166 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2ec294a-1d58-41af-898f-d948ea49bb0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0b8c233e-a11b-470e-a3ca-696d08cf5673', 'volume_name': 'volume-0b8c233e-a11b-470e-a3ca-696d08cf5673', 'volume_size': 1}' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:08:02 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-a9361efd-5114-410c-b61a-57bad12da68c tempest-CinderUnicodeTest-166757166 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fd5f465f-e187-465e-a7ad-093bbe9be4d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:08:02 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-a9361efd-5114-410c-b61a-57bad12da68c tempest-CinderUnicodeTest-166757166 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fd5f465f-e187-465e-a7ad-093bbe9be4d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:08:02 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-a9361efd-5114-410c-b61a-57bad12da68c tempest-CinderUnicodeTest-166757166 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b022f728-201d-4454-a3d7-3d2b2b88cdd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:08:02 devstack cinder-volume[87272]: INFO cinder.volume.flows.manager.create_volume [None req-a9361efd-5114-410c-b61a-57bad12da68c tempest-CinderUnicodeTest-166757166 None] Volume 0b8c233e-a11b-470e-a3ca-696d08cf5673: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0b8c233e-a11b-470e-a3ca-696d08cf5673', 'volume_size': 1} Nov 04 11:08:02 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-a9361efd-5114-410c-b61a-57bad12da68c tempest-CinderUnicodeTest-166757166 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 11:08:02 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-a9361efd-5114-410c-b61a-57bad12da68c tempest-CinderUnicodeTest-166757166 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 11:08:02 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-a9361efd-5114-410c-b61a-57bad12da68c tempest-CinderUnicodeTest-166757166 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T10:08:02Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-999762706',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b8c233e-a11b-470e-a3ca-696d08cf5673,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a863d6043744dc9950fca4925623bcc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T10:08:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T10:08:02Z,use_quota=True,user_id='b0bfd7f09a29421482be51857ebae9de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8989e4f-21e3-4f0a-9584-0d818784e883),volume_type_id=f8989e4f-21e3-4f0a-9584-0d818784e883)}" {{(pid=87272) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 04 11:08:02 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.remotefs [None req-a9361efd-5114-410c-b61a-57bad12da68c tempest-CinderUnicodeTest-166757166 None] Creating volume 0b8c233e-a11b-470e-a3ca-696d08cf5673 {{(pid=87272) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 11:08:02 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-a9361efd-5114-410c-b61a-57bad12da68c tempest-CinderUnicodeTest-166757166 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 11:08:02 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-a9361efd-5114-410c-b61a-57bad12da68c tempest-CinderUnicodeTest-166757166 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 11:08:02 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-a9361efd-5114-410c-b61a-57bad12da68c tempest-CinderUnicodeTest-166757166 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898': None} {{(pid=87272) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 11:08:02 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-a9361efd-5114-410c-b61a-57bad12da68c tempest-CinderUnicodeTest-166757166 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'] {{(pid=87272) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 11:08:02 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-a9361efd-5114-410c-b61a-57bad12da68c tempest-CinderUnicodeTest-166757166 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 11:08:02 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-a9361efd-5114-410c-b61a-57bad12da68c tempest-CinderUnicodeTest-166757166 None] Selected osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898 as target Quobyte volume. {{(pid=87272) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 11:08:02 devstack cinder-volume[87272]: INFO cinder.volume.drivers.remotefs [None req-a9361efd-5114-410c-b61a-57bad12da68c tempest-CinderUnicodeTest-166757166 None] casted to osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898 Nov 04 11:08:02 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-a9361efd-5114-410c-b61a-57bad12da68c tempest-CinderUnicodeTest-166757166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-0b8c233e-a11b-470e-a3ca-696d08cf5673 1073741824 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:08:02 devstack sudo[105422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-0b8c233e-a11b-470e-a3ca-696d08cf5673 1073741824 Nov 04 11:08:02 devstack sudo[105422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:08:02 devstack sudo[105422]: pam_unix(sudo:session): session closed for user root Nov 04 11:08:02 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-a9361efd-5114-410c-b61a-57bad12da68c tempest-CinderUnicodeTest-166757166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-0b8c233e-a11b-470e-a3ca-696d08cf5673 1073741824" returned: 0 in 0.441s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:08:03 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-a9361efd-5114-410c-b61a-57bad12da68c tempest-CinderUnicodeTest-166757166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-0b8c233e-a11b-470e-a3ca-696d08cf5673 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:08:03 devstack sudo[105435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-0b8c233e-a11b-470e-a3ca-696d08cf5673 Nov 04 11:08:03 devstack sudo[105435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:08:03 devstack sudo[105435]: pam_unix(sudo:session): session closed for user root Nov 04 11:08:03 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-a9361efd-5114-410c-b61a-57bad12da68c tempest-CinderUnicodeTest-166757166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-0b8c233e-a11b-470e-a3ca-696d08cf5673" returned: 0 in 0.255s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:08:03 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-a9361efd-5114-410c-b61a-57bad12da68c tempest-CinderUnicodeTest-166757166 None] <== create_volume: return (742ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'} {{(pid=87272) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 04 11:08:03 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-a9361efd-5114-410c-b61a-57bad12da68c tempest-CinderUnicodeTest-166757166 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.745s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 11:08:03 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-a9361efd-5114-410c-b61a-57bad12da68c tempest-CinderUnicodeTest-166757166 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b022f728-201d-4454-a3d7-3d2b2b88cdd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0b8c233e-a11b-470e-a3ca-696d08cf5673', 'volume_size': 1}' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:08:03 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-a9361efd-5114-410c-b61a-57bad12da68c tempest-CinderUnicodeTest-166757166 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f5b34132-9503-4883-8057-a1212f2794c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:08:03 devstack cinder-volume[87272]: INFO cinder.volume.flows.manager.create_volume [None req-a9361efd-5114-410c-b61a-57bad12da68c tempest-CinderUnicodeTest-166757166 None] Volume volume-0b8c233e-a11b-470e-a3ca-696d08cf5673 (0b8c233e-a11b-470e-a3ca-696d08cf5673): created successfully Nov 04 11:08:03 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-a9361efd-5114-410c-b61a-57bad12da68c tempest-CinderUnicodeTest-166757166 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f5b34132-9503-4883-8057-a1212f2794c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:08:03 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-a9361efd-5114-410c-b61a-57bad12da68c tempest-CinderUnicodeTest-166757166 None] Flow 'volume_create_manager' (dccde6b4-1a4f-46ba-b058-c6e4ce62d950) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87272) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 11:08:03 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-a9361efd-5114-410c-b61a-57bad12da68c tempest-CinderUnicodeTest-166757166 None] Created volume successfully. Nov 04 11:08:03 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-677a887e-cebe-4c5a-8661-1f600891a11e tempest-CinderUnicodeTest-166757166 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 11:08:03 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-677a887e-cebe-4c5a-8661-1f600891a11e tempest-CinderUnicodeTest-166757166 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 11:08:03 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.remotefs [None req-677a887e-cebe-4c5a-8661-1f600891a11e tempest-CinderUnicodeTest-166757166 None] Creating offline snapshot 89d6643d-9276-4c2a-a1d5-717d2327e593 of volume 0b8c233e-a11b-470e-a3ca-696d08cf5673 {{(pid=87272) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 04 11:08:03 devstack cinder-volume[87272]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ec6361d-2009-482f-967f-73637ae69459]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 11:08:03 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-677a887e-cebe-4c5a-8661-1f600891a11e tempest-CinderUnicodeTest-166757166 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-0b8c233e-a11b-470e-a3ca-696d08cf5673 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:08:03 devstack sudo[105438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-0b8c233e-a11b-470e-a3ca-696d08cf5673 Nov 04 11:08:03 devstack sudo[105438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:08:04 devstack sudo[105438]: pam_unix(sudo:session): session closed for user root Nov 04 11:08:04 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-677a887e-cebe-4c5a-8661-1f600891a11e tempest-CinderUnicodeTest-166757166 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-0b8c233e-a11b-470e-a3ca-696d08cf5673" returned: 0 in 0.357s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:08:04 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-677a887e-cebe-4c5a-8661-1f600891a11e tempest-CinderUnicodeTest-166757166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-0b8c233e-a11b-470e-a3ca-696d08cf5673,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-0b8c233e-a11b-470e-a3ca-696d08cf5673.89d6643d-9276-4c2a-a1d5-717d2327e593 1G {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:08:04 devstack sudo[105443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-0b8c233e-a11b-470e-a3ca-696d08cf5673,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-0b8c233e-a11b-470e-a3ca-696d08cf5673.89d6643d-9276-4c2a-a1d5-717d2327e593 1G Nov 04 11:08:04 devstack sudo[105443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:08:04 devstack sudo[105443]: pam_unix(sudo:session): session closed for user root Nov 04 11:08:04 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-677a887e-cebe-4c5a-8661-1f600891a11e tempest-CinderUnicodeTest-166757166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-0b8c233e-a11b-470e-a3ca-696d08cf5673,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-0b8c233e-a11b-470e-a3ca-696d08cf5673.89d6643d-9276-4c2a-a1d5-717d2327e593 1G" returned: 0 in 0.410s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:08:04 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-677a887e-cebe-4c5a-8661-1f600891a11e tempest-CinderUnicodeTest-166757166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0b8c233e-a11b-470e-a3ca-696d08cf5673 -F qcow2 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-0b8c233e-a11b-470e-a3ca-696d08cf5673.89d6643d-9276-4c2a-a1d5-717d2327e593 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:08:04 devstack sudo[105449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0b8c233e-a11b-470e-a3ca-696d08cf5673 -F qcow2 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-0b8c233e-a11b-470e-a3ca-696d08cf5673.89d6643d-9276-4c2a-a1d5-717d2327e593 Nov 04 11:08:04 devstack sudo[105449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:08:04 devstack sudo[105449]: pam_unix(sudo:session): session closed for user root Nov 04 11:08:04 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-677a887e-cebe-4c5a-8661-1f600891a11e tempest-CinderUnicodeTest-166757166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0b8c233e-a11b-470e-a3ca-696d08cf5673 -F qcow2 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-0b8c233e-a11b-470e-a3ca-696d08cf5673.89d6643d-9276-4c2a-a1d5-717d2327e593" returned: 0 in 0.295s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:08:04 devstack cinder-volume[87272]: WARNING cinder.volume.drivers.remotefs [None req-677a887e-cebe-4c5a-8661-1f600891a11e tempest-CinderUnicodeTest-166757166 None] /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-0b8c233e-a11b-470e-a3ca-696d08cf5673.89d6643d-9276-4c2a-a1d5-717d2327e593 is being set with open permissions: ugo+rw Nov 04 11:08:04 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-677a887e-cebe-4c5a-8661-1f600891a11e tempest-CinderUnicodeTest-166757166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-0b8c233e-a11b-470e-a3ca-696d08cf5673.89d6643d-9276-4c2a-a1d5-717d2327e593 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:08:04 devstack sudo[105454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-0b8c233e-a11b-470e-a3ca-696d08cf5673.89d6643d-9276-4c2a-a1d5-717d2327e593 Nov 04 11:08:04 devstack sudo[105454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:08:05 devstack sudo[105454]: pam_unix(sudo:session): session closed for user root Nov 04 11:08:05 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-677a887e-cebe-4c5a-8661-1f600891a11e tempest-CinderUnicodeTest-166757166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-0b8c233e-a11b-470e-a3ca-696d08cf5673.89d6643d-9276-4c2a-a1d5-717d2327e593" returned: 0 in 0.240s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:08:05 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-677a887e-cebe-4c5a-8661-1f600891a11e tempest-CinderUnicodeTest-166757166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-0b8c233e-a11b-470e-a3ca-696d08cf5673.info {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:08:05 devstack sudo[105457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-0b8c233e-a11b-470e-a3ca-696d08cf5673.info Nov 04 11:08:05 devstack sudo[105457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:08:05 devstack sudo[105457]: pam_unix(sudo:session): session closed for user root Nov 04 11:08:05 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-677a887e-cebe-4c5a-8661-1f600891a11e tempest-CinderUnicodeTest-166757166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-0b8c233e-a11b-470e-a3ca-696d08cf5673.info" returned: 0 in 0.251s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:08:05 devstack cinder-volume[87272]: WARNING cinder.volume.drivers.remotefs [None req-677a887e-cebe-4c5a-8661-1f600891a11e tempest-CinderUnicodeTest-166757166 None] /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-0b8c233e-a11b-470e-a3ca-696d08cf5673.info is being set with open permissions: ugo+rw Nov 04 11:08:05 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-677a887e-cebe-4c5a-8661-1f600891a11e tempest-CinderUnicodeTest-166757166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-0b8c233e-a11b-470e-a3ca-696d08cf5673.info {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:08:05 devstack sudo[105460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-0b8c233e-a11b-470e-a3ca-696d08cf5673.info Nov 04 11:08:05 devstack sudo[105460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:08:05 devstack sudo[105460]: pam_unix(sudo:session): session closed for user root Nov 04 11:08:05 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-677a887e-cebe-4c5a-8661-1f600891a11e tempest-CinderUnicodeTest-166757166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-0b8c233e-a11b-470e-a3ca-696d08cf5673.info" returned: 0 in 0.242s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:08:05 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-677a887e-cebe-4c5a-8661-1f600891a11e tempest-CinderUnicodeTest-166757166 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.881s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 11:08:05 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-677a887e-cebe-4c5a-8661-1f600891a11e tempest-CinderUnicodeTest-166757166 None] Create snapshot completed successfully Nov 04 11:08:05 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-07502134-8992-4979-b6a6-260c3fc66965 tempest-CinderUnicodeTest-166757166 None] Acquiring lock "cinder-89d6643d-9276-4c2a-a1d5-717d2327e593-delete_snapshot" by "delete_snapshot" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 11:08:05 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-07502134-8992-4979-b6a6-260c3fc66965 tempest-CinderUnicodeTest-166757166 None] Lock "cinder-89d6643d-9276-4c2a-a1d5-717d2327e593-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 11:08:05 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-07502134-8992-4979-b6a6-260c3fc66965 tempest-CinderUnicodeTest-166757166 None] Acquiring lock "cinder-quobyte-0b8c233e-a11b-470e-a3ca-696d08cf5673" by "delete_snapshot" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 11:08:05 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-07502134-8992-4979-b6a6-260c3fc66965 tempest-CinderUnicodeTest-166757166 None] Lock "cinder-quobyte-0b8c233e-a11b-470e-a3ca-696d08cf5673" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 11:08:05 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-07502134-8992-4979-b6a6-260c3fc66965 tempest-CinderUnicodeTest-166757166 None] Acquiring lock "cinder-quobyte-89d6643d-9276-4c2a-a1d5-717d2327e593" by "_delete_snapshot" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 11:08:05 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-07502134-8992-4979-b6a6-260c3fc66965 tempest-CinderUnicodeTest-166757166 None] Lock "cinder-quobyte-89d6643d-9276-4c2a-a1d5-717d2327e593" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 11:08:05 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.remotefs [None req-07502134-8992-4979-b6a6-260c3fc66965 tempest-CinderUnicodeTest-166757166 None] Deleting offline snapshot 89d6643d-9276-4c2a-a1d5-717d2327e593 of volume 0b8c233e-a11b-470e-a3ca-696d08cf5673 {{(pid=87272) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 04 11:08:05 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.remotefs [None req-07502134-8992-4979-b6a6-260c3fc66965 tempest-CinderUnicodeTest-166757166 None] snapshot_file for this snap is: volume-0b8c233e-a11b-470e-a3ca-696d08cf5673.89d6643d-9276-4c2a-a1d5-717d2327e593 {{(pid=87272) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 04 11:08:05 devstack cinder-volume[87272]: DEBUG oslo.privsep.daemon [-] privsep: reply[2567fe6a-f98e-4a94-9ecd-48fdb2e87f38]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 11:08:05 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-07502134-8992-4979-b6a6-260c3fc66965 tempest-CinderUnicodeTest-166757166 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-0b8c233e-a11b-470e-a3ca-696d08cf5673.89d6643d-9276-4c2a-a1d5-717d2327e593 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:08:06 devstack sudo[105463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-0b8c233e-a11b-470e-a3ca-696d08cf5673.89d6643d-9276-4c2a-a1d5-717d2327e593 Nov 04 11:08:06 devstack sudo[105463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:08:06 devstack sudo[105463]: pam_unix(sudo:session): session closed for user root Nov 04 11:08:06 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-07502134-8992-4979-b6a6-260c3fc66965 tempest-CinderUnicodeTest-166757166 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-0b8c233e-a11b-470e-a3ca-696d08cf5673.89d6643d-9276-4c2a-a1d5-717d2327e593" returned: 0 in 0.358s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:08:06 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.remotefs [None req-07502134-8992-4979-b6a6-260c3fc66965 tempest-CinderUnicodeTest-166757166 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0b8c233e-a11b-470e-a3ca-696d08cf5673(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87272) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 11:08:06 devstack cinder-volume[87272]: DEBUG oslo.privsep.daemon [-] privsep: reply[5df83c36-746b-4235-bcbb-60159c5eb711]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 11:08:06 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-07502134-8992-4979-b6a6-260c3fc66965 tempest-CinderUnicodeTest-166757166 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-0b8c233e-a11b-470e-a3ca-696d08cf5673 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:08:06 devstack sudo[105468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-0b8c233e-a11b-470e-a3ca-696d08cf5673 Nov 04 11:08:06 devstack sudo[105468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:08:06 devstack sudo[105468]: pam_unix(sudo:session): session closed for user root Nov 04 11:08:06 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-07502134-8992-4979-b6a6-260c3fc66965 tempest-CinderUnicodeTest-166757166 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-0b8c233e-a11b-470e-a3ca-696d08cf5673" returned: 0 in 0.363s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:08:06 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-07502134-8992-4979-b6a6-260c3fc66965 tempest-CinderUnicodeTest-166757166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-0b8c233e-a11b-470e-a3ca-696d08cf5673.89d6643d-9276-4c2a-a1d5-717d2327e593 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:08:06 devstack sudo[105474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-0b8c233e-a11b-470e-a3ca-696d08cf5673.89d6643d-9276-4c2a-a1d5-717d2327e593 Nov 04 11:08:06 devstack sudo[105474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:08:06 devstack sudo[105474]: pam_unix(sudo:session): session closed for user root Nov 04 11:08:06 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-07502134-8992-4979-b6a6-260c3fc66965 tempest-CinderUnicodeTest-166757166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-0b8c233e-a11b-470e-a3ca-696d08cf5673.89d6643d-9276-4c2a-a1d5-717d2327e593" returned: 0 in 0.315s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:08:06 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-07502134-8992-4979-b6a6-260c3fc66965 tempest-CinderUnicodeTest-166757166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-0b8c233e-a11b-470e-a3ca-696d08cf5673.89d6643d-9276-4c2a-a1d5-717d2327e593 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:08:07 devstack sudo[105479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-0b8c233e-a11b-470e-a3ca-696d08cf5673.89d6643d-9276-4c2a-a1d5-717d2327e593 Nov 04 11:08:07 devstack sudo[105479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:08:07 devstack sudo[105479]: pam_unix(sudo:session): session closed for user root Nov 04 11:08:07 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-07502134-8992-4979-b6a6-260c3fc66965 tempest-CinderUnicodeTest-166757166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-0b8c233e-a11b-470e-a3ca-696d08cf5673.89d6643d-9276-4c2a-a1d5-717d2327e593" returned: 0 in 0.231s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:08:07 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-07502134-8992-4979-b6a6-260c3fc66965 tempest-CinderUnicodeTest-166757166 None] Lock "cinder-quobyte-89d6643d-9276-4c2a-a1d5-717d2327e593" released by "_delete_snapshot" :: held 1.363s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 11:08:07 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-07502134-8992-4979-b6a6-260c3fc66965 tempest-CinderUnicodeTest-166757166 None] Lock "cinder-quobyte-0b8c233e-a11b-470e-a3ca-696d08cf5673" released by "delete_snapshot" :: held 1.383s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 11:08:07 devstack cinder-volume[87272]: DEBUG cinder.quota [None req-07502134-8992-4979-b6a6-260c3fc66965 tempest-CinderUnicodeTest-166757166 None] Created reservations ['7c052f4a-741a-42d7-a5aa-b3f67e2bf22f', 'f4da65c0-1f7f-4535-a557-461691f5929a', 'f894a8be-e625-4778-b4d0-6357805ea569', '536f58f2-4c4b-4188-9dc5-7a722a6eb762'] {{(pid=87272) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 11:08:07 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-07502134-8992-4979-b6a6-260c3fc66965 tempest-CinderUnicodeTest-166757166 None] Delete snapshot completed successfully. Nov 04 11:08:07 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-07502134-8992-4979-b6a6-260c3fc66965 tempest-CinderUnicodeTest-166757166 None] Lock "cinder-89d6643d-9276-4c2a-a1d5-717d2327e593-delete_snapshot" released by "delete_snapshot" :: held 1.511s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 11:08:07 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-e5968289-31c4-48e4-964f-ec368a46c214 tempest-CinderUnicodeTest-166757166 None] Acquiring lock "cinder-0b8c233e-a11b-470e-a3ca-696d08cf5673-delete_volume" by "delete_volume" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 11:08:08 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-e5968289-31c4-48e4-964f-ec368a46c214 tempest-CinderUnicodeTest-166757166 None] Lock "cinder-0b8c233e-a11b-470e-a3ca-696d08cf5673-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 11:08:08 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-e5968289-31c4-48e4-964f-ec368a46c214 tempest-CinderUnicodeTest-166757166 None] Acquiring lock "cinder-quobyte-0b8c233e-a11b-470e-a3ca-696d08cf5673" by "delete_volume" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 11:08:08 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-e5968289-31c4-48e4-964f-ec368a46c214 tempest-CinderUnicodeTest-166757166 None] Lock "cinder-quobyte-0b8c233e-a11b-470e-a3ca-696d08cf5673" acquired by "delete_volume" :: waited 0.023s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 11:08:08 devstack cinder-volume[87272]: DEBUG oslo.privsep.daemon [-] privsep: reply[f92e0daa-cbe6-458c-80c9-7c4238ae6ee6]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 11:08:08 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-e5968289-31c4-48e4-964f-ec368a46c214 tempest-CinderUnicodeTest-166757166 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-0b8c233e-a11b-470e-a3ca-696d08cf5673 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:08:08 devstack sudo[105483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-0b8c233e-a11b-470e-a3ca-696d08cf5673 Nov 04 11:08:08 devstack sudo[105483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:08:08 devstack sudo[105483]: pam_unix(sudo:session): session closed for user root Nov 04 11:08:08 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-e5968289-31c4-48e4-964f-ec368a46c214 tempest-CinderUnicodeTest-166757166 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-0b8c233e-a11b-470e-a3ca-696d08cf5673" returned: 0 in 0.347s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:08:08 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-e5968289-31c4-48e4-964f-ec368a46c214 tempest-CinderUnicodeTest-166757166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-0b8c233e-a11b-470e-a3ca-696d08cf5673 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:08:08 devstack sudo[105488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-0b8c233e-a11b-470e-a3ca-696d08cf5673 Nov 04 11:08:08 devstack sudo[105488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:08:08 devstack sudo[105488]: pam_unix(sudo:session): session closed for user root Nov 04 11:08:08 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-e5968289-31c4-48e4-964f-ec368a46c214 tempest-CinderUnicodeTest-166757166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-0b8c233e-a11b-470e-a3ca-696d08cf5673" returned: 0 in 0.244s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:08:08 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-e5968289-31c4-48e4-964f-ec368a46c214 tempest-CinderUnicodeTest-166757166 None] Lock "cinder-quobyte-0b8c233e-a11b-470e-a3ca-696d08cf5673" released by "delete_volume" :: held 0.656s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 11:08:08 devstack cinder-volume[87272]: DEBUG cinder.quota [None req-e5968289-31c4-48e4-964f-ec368a46c214 tempest-CinderUnicodeTest-166757166 None] Created reservations ['aa50a417-c713-4367-9ff3-99a5928d5c8d', 'e20eb333-4c00-4f20-882d-5bec7cb0a74b', '0485951b-471c-495d-afdd-788c8bf69337', '6e3d54a2-16a6-4a14-805a-0d6aea891e5d'] {{(pid=87272) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 11:08:08 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-e5968289-31c4-48e4-964f-ec368a46c214 tempest-CinderUnicodeTest-166757166 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 11:08:08 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-e5968289-31c4-48e4-964f-ec368a46c214 tempest-CinderUnicodeTest-166757166 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 11:08:08 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-e5968289-31c4-48e4-964f-ec368a46c214 tempest-CinderUnicodeTest-166757166 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898': None} {{(pid=87272) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 11:08:08 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-e5968289-31c4-48e4-964f-ec368a46c214 tempest-CinderUnicodeTest-166757166 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'] {{(pid=87272) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 11:08:08 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-e5968289-31c4-48e4-964f-ec368a46c214 tempest-CinderUnicodeTest-166757166 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 11:08:08 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-e5968289-31c4-48e4-964f-ec368a46c214 tempest-CinderUnicodeTest-166757166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:08:08 devstack sudo[105491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1 Nov 04 11:08:08 devstack sudo[105491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:08:09 devstack sudo[105491]: pam_unix(sudo:session): session closed for user root Nov 04 11:08:09 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-e5968289-31c4-48e4-964f-ec368a46c214 tempest-CinderUnicodeTest-166757166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1" returned: 0 in 0.232s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:08:09 devstack cinder-volume[87272]: DEBUG cinder.manager [None req-e5968289-31c4-48e4-964f-ec368a46c214 tempest-CinderUnicodeTest-166757166 None] Notifying Schedulers of capabilities ... {{(pid=87272) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 11:08:09 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-e5968289-31c4-48e4-964f-ec368a46c214 tempest-CinderUnicodeTest-166757166 None] Deleted volume successfully. Nov 04 11:08:09 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-e5968289-31c4-48e4-964f-ec368a46c214 tempest-CinderUnicodeTest-166757166 None] Lock "cinder-0b8c233e-a11b-470e-a3ca-696d08cf5673-delete_volume" released by "delete_volume" :: held 1.090s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 11:08:09 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-89cde6da-bb53-435d-a32c-9482b9fd9c67 tempest-CinderUnicodeTest-166757166 None] Acquiring lock "cinder-602c9b8a-b60c-4201-a680-c58b37ab77c0-delete_volume" by "delete_volume" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 11:08:09 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-89cde6da-bb53-435d-a32c-9482b9fd9c67 tempest-CinderUnicodeTest-166757166 None] Lock "cinder-602c9b8a-b60c-4201-a680-c58b37ab77c0-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 11:08:09 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-89cde6da-bb53-435d-a32c-9482b9fd9c67 tempest-CinderUnicodeTest-166757166 None] Acquiring lock "cinder-quobyte-602c9b8a-b60c-4201-a680-c58b37ab77c0" by "delete_volume" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 11:08:09 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-89cde6da-bb53-435d-a32c-9482b9fd9c67 tempest-CinderUnicodeTest-166757166 None] Lock "cinder-quobyte-602c9b8a-b60c-4201-a680-c58b37ab77c0" acquired by "delete_volume" :: waited 0.015s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 11:08:09 devstack cinder-volume[87272]: DEBUG oslo.privsep.daemon [-] privsep: reply[19b3a723-6370-458d-a8db-8a79bcde7348]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 11:08:09 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-89cde6da-bb53-435d-a32c-9482b9fd9c67 tempest-CinderUnicodeTest-166757166 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-602c9b8a-b60c-4201-a680-c58b37ab77c0 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:08:09 devstack sudo[105494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-602c9b8a-b60c-4201-a680-c58b37ab77c0 Nov 04 11:08:09 devstack sudo[105494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:08:09 devstack sudo[105494]: pam_unix(sudo:session): session closed for user root Nov 04 11:08:09 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-89cde6da-bb53-435d-a32c-9482b9fd9c67 tempest-CinderUnicodeTest-166757166 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-602c9b8a-b60c-4201-a680-c58b37ab77c0" returned: 0 in 0.340s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:08:09 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-89cde6da-bb53-435d-a32c-9482b9fd9c67 tempest-CinderUnicodeTest-166757166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-602c9b8a-b60c-4201-a680-c58b37ab77c0 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:08:09 devstack sudo[105499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-602c9b8a-b60c-4201-a680-c58b37ab77c0 Nov 04 11:08:09 devstack sudo[105499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:08:09 devstack sudo[105499]: pam_unix(sudo:session): session closed for user root Nov 04 11:08:09 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-89cde6da-bb53-435d-a32c-9482b9fd9c67 tempest-CinderUnicodeTest-166757166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-602c9b8a-b60c-4201-a680-c58b37ab77c0" returned: 0 in 0.230s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:08:09 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-89cde6da-bb53-435d-a32c-9482b9fd9c67 tempest-CinderUnicodeTest-166757166 None] Lock "cinder-quobyte-602c9b8a-b60c-4201-a680-c58b37ab77c0" released by "delete_volume" :: held 0.609s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 11:08:09 devstack cinder-volume[87272]: DEBUG cinder.quota [None req-89cde6da-bb53-435d-a32c-9482b9fd9c67 tempest-CinderUnicodeTest-166757166 None] Created reservations ['7d7943a5-17d0-444c-b5c4-00e0194eb768', '847d9036-8e29-40fc-a316-54ea485fbe0b', '803ead78-23f5-4164-acbe-9ee6d3f90209', '6068ba70-6fda-47a0-b68d-40dae9742f68'] {{(pid=87272) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 11:08:09 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-89cde6da-bb53-435d-a32c-9482b9fd9c67 tempest-CinderUnicodeTest-166757166 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 11:08:09 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-89cde6da-bb53-435d-a32c-9482b9fd9c67 tempest-CinderUnicodeTest-166757166 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 11:08:09 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-89cde6da-bb53-435d-a32c-9482b9fd9c67 tempest-CinderUnicodeTest-166757166 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898': None} {{(pid=87272) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 11:08:09 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-89cde6da-bb53-435d-a32c-9482b9fd9c67 tempest-CinderUnicodeTest-166757166 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'] {{(pid=87272) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 11:08:09 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-89cde6da-bb53-435d-a32c-9482b9fd9c67 tempest-CinderUnicodeTest-166757166 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 11:08:09 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-89cde6da-bb53-435d-a32c-9482b9fd9c67 tempest-CinderUnicodeTest-166757166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:08:09 devstack sudo[105502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1 Nov 04 11:08:09 devstack sudo[105502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:08:10 devstack sudo[105502]: pam_unix(sudo:session): session closed for user root Nov 04 11:08:10 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-89cde6da-bb53-435d-a32c-9482b9fd9c67 tempest-CinderUnicodeTest-166757166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1" returned: 0 in 0.248s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:08:10 devstack cinder-volume[87272]: DEBUG cinder.manager [None req-89cde6da-bb53-435d-a32c-9482b9fd9c67 tempest-CinderUnicodeTest-166757166 None] Notifying Schedulers of capabilities ... {{(pid=87272) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 11:08:10 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-89cde6da-bb53-435d-a32c-9482b9fd9c67 tempest-CinderUnicodeTest-166757166 None] Deleted volume successfully. Nov 04 11:08:10 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-89cde6da-bb53-435d-a32c-9482b9fd9c67 tempest-CinderUnicodeTest-166757166 None] Lock "cinder-602c9b8a-b60c-4201-a680-c58b37ab77c0-delete_volume" released by "delete_volume" :: held 1.051s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 11:08:13 devstack cinder-volume[87272]: DEBUG cinder.volume.flows.manager.create_volume [None req-f1464630-80e4-460e-bfda-921388bd59a6 tempest-ProjectReaderTests-1199121374 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87272) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 11:08:13 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-f1464630-80e4-460e-bfda-921388bd59a6 tempest-ProjectReaderTests-1199121374 None] Flow 'volume_create_manager' (12b10a5a-2722-4314-8965-2360a7320061) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 11:08:13 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-f1464630-80e4-460e-bfda-921388bd59a6 tempest-ProjectReaderTests-1199121374 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (21e30569-9023-47e2-ada5-3b3014e68cc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:08:13 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-f1464630-80e4-460e-bfda-921388bd59a6 tempest-ProjectReaderTests-1199121374 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (21e30569-9023-47e2-ada5-3b3014e68cc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T10:08:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-626672793',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fc27ad51-8147-4fe5-a3fa-4e4d8c421bcc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f0f270e780664abca07ae240b6467f0a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T10:08:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T10:08:14Z,use_quota=True,user_id='51968d55c36f456890731c00f7d5725b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8989e4f-21e3-4f0a-9584-0d818784e883),volume_type_id=f8989e4f-21e3-4f0a-9584-0d818784e883)' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:08:13 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-f1464630-80e4-460e-bfda-921388bd59a6 tempest-ProjectReaderTests-1199121374 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (86112280-c150-4133-8f41-9322801e126b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:08:13 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-f1464630-80e4-460e-bfda-921388bd59a6 tempest-ProjectReaderTests-1199121374 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (86112280-c150-4133-8f41-9322801e126b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:08:13 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-f1464630-80e4-460e-bfda-921388bd59a6 tempest-ProjectReaderTests-1199121374 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b8658ba2-2366-4e0f-b72b-c0b07c82ea0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:08:13 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-f1464630-80e4-460e-bfda-921388bd59a6 tempest-ProjectReaderTests-1199121374 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b8658ba2-2366-4e0f-b72b-c0b07c82ea0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fc27ad51-8147-4fe5-a3fa-4e4d8c421bcc', 'volume_name': 'volume-fc27ad51-8147-4fe5-a3fa-4e4d8c421bcc', 'volume_size': 1}' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:08:13 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-f1464630-80e4-460e-bfda-921388bd59a6 tempest-ProjectReaderTests-1199121374 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0e26dfb-8544-433a-b392-2b46058a51a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:08:13 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-f1464630-80e4-460e-bfda-921388bd59a6 tempest-ProjectReaderTests-1199121374 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0e26dfb-8544-433a-b392-2b46058a51a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:08:13 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-f1464630-80e4-460e-bfda-921388bd59a6 tempest-ProjectReaderTests-1199121374 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a68d5ff5-52ce-46fa-815e-cba9c70cdf0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:08:13 devstack cinder-volume[87272]: INFO cinder.volume.flows.manager.create_volume [None req-f1464630-80e4-460e-bfda-921388bd59a6 tempest-ProjectReaderTests-1199121374 None] Volume fc27ad51-8147-4fe5-a3fa-4e4d8c421bcc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fc27ad51-8147-4fe5-a3fa-4e4d8c421bcc', 'volume_size': 1} Nov 04 11:08:13 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-f1464630-80e4-460e-bfda-921388bd59a6 tempest-ProjectReaderTests-1199121374 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 11:08:13 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-f1464630-80e4-460e-bfda-921388bd59a6 tempest-ProjectReaderTests-1199121374 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 11:08:13 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-f1464630-80e4-460e-bfda-921388bd59a6 tempest-ProjectReaderTests-1199121374 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T10:08:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-626672793',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fc27ad51-8147-4fe5-a3fa-4e4d8c421bcc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f0f270e780664abca07ae240b6467f0a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T10:08:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T10:08:14Z,use_quota=True,user_id='51968d55c36f456890731c00f7d5725b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8989e4f-21e3-4f0a-9584-0d818784e883),volume_type_id=f8989e4f-21e3-4f0a-9584-0d818784e883)}" {{(pid=87272) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 04 11:08:13 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.remotefs [None req-f1464630-80e4-460e-bfda-921388bd59a6 tempest-ProjectReaderTests-1199121374 None] Creating volume fc27ad51-8147-4fe5-a3fa-4e4d8c421bcc {{(pid=87272) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 11:08:13 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-f1464630-80e4-460e-bfda-921388bd59a6 tempest-ProjectReaderTests-1199121374 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 11:08:13 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-f1464630-80e4-460e-bfda-921388bd59a6 tempest-ProjectReaderTests-1199121374 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 11:08:13 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-f1464630-80e4-460e-bfda-921388bd59a6 tempest-ProjectReaderTests-1199121374 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898': None} {{(pid=87272) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 11:08:13 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-f1464630-80e4-460e-bfda-921388bd59a6 tempest-ProjectReaderTests-1199121374 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'] {{(pid=87272) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 11:08:13 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-f1464630-80e4-460e-bfda-921388bd59a6 tempest-ProjectReaderTests-1199121374 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 11:08:13 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-f1464630-80e4-460e-bfda-921388bd59a6 tempest-ProjectReaderTests-1199121374 None] Selected osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898 as target Quobyte volume. {{(pid=87272) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 11:08:13 devstack cinder-volume[87272]: INFO cinder.volume.drivers.remotefs [None req-f1464630-80e4-460e-bfda-921388bd59a6 tempest-ProjectReaderTests-1199121374 None] casted to osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898 Nov 04 11:08:13 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-f1464630-80e4-460e-bfda-921388bd59a6 tempest-ProjectReaderTests-1199121374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-fc27ad51-8147-4fe5-a3fa-4e4d8c421bcc 1073741824 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:08:13 devstack sudo[105506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-fc27ad51-8147-4fe5-a3fa-4e4d8c421bcc 1073741824 Nov 04 11:08:13 devstack sudo[105506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:08:14 devstack cinder-volume[87272]: DEBUG oslo_service.periodic_task [None req-236af0be-7f9d-4c80-b3d7-d645a9cd0dd1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87272) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 04 11:08:14 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-236af0be-7f9d-4c80-b3d7-d645a9cd0dd1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 11:08:14 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-236af0be-7f9d-4c80-b3d7-d645a9cd0dd1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 11:08:14 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-236af0be-7f9d-4c80-b3d7-d645a9cd0dd1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898': None} {{(pid=87272) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 11:08:14 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-236af0be-7f9d-4c80-b3d7-d645a9cd0dd1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'] {{(pid=87272) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 11:08:14 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-236af0be-7f9d-4c80-b3d7-d645a9cd0dd1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 11:08:14 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-236af0be-7f9d-4c80-b3d7-d645a9cd0dd1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:08:14 devstack sudo[105511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1 Nov 04 11:08:14 devstack sudo[105511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:08:14 devstack sudo[105506]: pam_unix(sudo:session): session closed for user root Nov 04 11:08:14 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-f1464630-80e4-460e-bfda-921388bd59a6 tempest-ProjectReaderTests-1199121374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-fc27ad51-8147-4fe5-a3fa-4e4d8c421bcc 1073741824" returned: 0 in 0.415s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:08:14 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-f1464630-80e4-460e-bfda-921388bd59a6 tempest-ProjectReaderTests-1199121374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-fc27ad51-8147-4fe5-a3fa-4e4d8c421bcc {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:08:14 devstack sudo[105513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-fc27ad51-8147-4fe5-a3fa-4e4d8c421bcc Nov 04 11:08:14 devstack sudo[105513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:08:14 devstack sudo[105511]: pam_unix(sudo:session): session closed for user root Nov 04 11:08:14 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-236af0be-7f9d-4c80-b3d7-d645a9cd0dd1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1" returned: 0 in 0.245s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:08:14 devstack cinder-volume[87272]: DEBUG cinder.manager [None req-236af0be-7f9d-4c80-b3d7-d645a9cd0dd1 None None] Notifying Schedulers of capabilities ... {{(pid=87272) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 11:08:14 devstack cinder-volume[87272]: DEBUG oslo_service.periodic_task [None req-236af0be-7f9d-4c80-b3d7-d645a9cd0dd1 None None] Running periodic task VolumeManager._thread_info {{(pid=87272) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 04 11:08:14 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-236af0be-7f9d-4c80-b3d7-d645a9cd0dd1 None None] thread count: 28 {{(pid=87272) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 04 11:08:14 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-236af0be-7f9d-4c80-b3d7-d645a9cd0dd1 None None] thread info: [<_MainThread(MainThread, started 127085713244288)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87272) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 04 11:08:14 devstack sudo[105513]: pam_unix(sudo:session): session closed for user root Nov 04 11:08:14 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-f1464630-80e4-460e-bfda-921388bd59a6 tempest-ProjectReaderTests-1199121374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-fc27ad51-8147-4fe5-a3fa-4e4d8c421bcc" returned: 0 in 0.239s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:08:14 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-f1464630-80e4-460e-bfda-921388bd59a6 tempest-ProjectReaderTests-1199121374 None] <== create_volume: return (695ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'} {{(pid=87272) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 04 11:08:14 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-f1464630-80e4-460e-bfda-921388bd59a6 tempest-ProjectReaderTests-1199121374 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.698s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 11:08:14 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-f1464630-80e4-460e-bfda-921388bd59a6 tempest-ProjectReaderTests-1199121374 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a68d5ff5-52ce-46fa-815e-cba9c70cdf0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fc27ad51-8147-4fe5-a3fa-4e4d8c421bcc', 'volume_size': 1}' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:08:14 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-f1464630-80e4-460e-bfda-921388bd59a6 tempest-ProjectReaderTests-1199121374 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b89b393-e43d-4bd1-bf76-66ae0e2a99eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:08:14 devstack cinder-volume[87272]: INFO cinder.volume.flows.manager.create_volume [None req-f1464630-80e4-460e-bfda-921388bd59a6 tempest-ProjectReaderTests-1199121374 None] Volume volume-fc27ad51-8147-4fe5-a3fa-4e4d8c421bcc (fc27ad51-8147-4fe5-a3fa-4e4d8c421bcc): created successfully Nov 04 11:08:14 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-f1464630-80e4-460e-bfda-921388bd59a6 tempest-ProjectReaderTests-1199121374 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b89b393-e43d-4bd1-bf76-66ae0e2a99eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:08:14 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-f1464630-80e4-460e-bfda-921388bd59a6 tempest-ProjectReaderTests-1199121374 None] Flow 'volume_create_manager' (12b10a5a-2722-4314-8965-2360a7320061) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87272) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 11:08:14 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-f1464630-80e4-460e-bfda-921388bd59a6 tempest-ProjectReaderTests-1199121374 None] Created volume successfully. Nov 04 11:08:14 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-c1da37c3-2125-4ae8-8227-3284c71e13b4 tempest-ProjectReaderTests-1199121374 None] Acquiring lock "cinder-fc27ad51-8147-4fe5-a3fa-4e4d8c421bcc-delete_volume" by "delete_volume" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 11:08:14 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-c1da37c3-2125-4ae8-8227-3284c71e13b4 tempest-ProjectReaderTests-1199121374 None] Lock "cinder-fc27ad51-8147-4fe5-a3fa-4e4d8c421bcc-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 11:08:14 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-c1da37c3-2125-4ae8-8227-3284c71e13b4 tempest-ProjectReaderTests-1199121374 None] Acquiring lock "cinder-quobyte-fc27ad51-8147-4fe5-a3fa-4e4d8c421bcc" by "delete_volume" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 11:08:14 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-c1da37c3-2125-4ae8-8227-3284c71e13b4 tempest-ProjectReaderTests-1199121374 None] Lock "cinder-quobyte-fc27ad51-8147-4fe5-a3fa-4e4d8c421bcc" acquired by "delete_volume" :: waited 0.015s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 11:08:14 devstack cinder-volume[87272]: DEBUG oslo.privsep.daemon [-] privsep: reply[26f96a85-5786-4256-a70e-e4cfa6c73f4e]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 11:08:14 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-c1da37c3-2125-4ae8-8227-3284c71e13b4 tempest-ProjectReaderTests-1199121374 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-fc27ad51-8147-4fe5-a3fa-4e4d8c421bcc {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:08:15 devstack sudo[105517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-fc27ad51-8147-4fe5-a3fa-4e4d8c421bcc Nov 04 11:08:15 devstack sudo[105517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:08:15 devstack sudo[105517]: pam_unix(sudo:session): session closed for user root Nov 04 11:08:15 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-c1da37c3-2125-4ae8-8227-3284c71e13b4 tempest-ProjectReaderTests-1199121374 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-fc27ad51-8147-4fe5-a3fa-4e4d8c421bcc" returned: 0 in 0.381s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:08:15 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-c1da37c3-2125-4ae8-8227-3284c71e13b4 tempest-ProjectReaderTests-1199121374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-fc27ad51-8147-4fe5-a3fa-4e4d8c421bcc {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:08:15 devstack sudo[105523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-fc27ad51-8147-4fe5-a3fa-4e4d8c421bcc Nov 04 11:08:15 devstack sudo[105523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:08:15 devstack sudo[105523]: pam_unix(sudo:session): session closed for user root Nov 04 11:08:15 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-c1da37c3-2125-4ae8-8227-3284c71e13b4 tempest-ProjectReaderTests-1199121374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-fc27ad51-8147-4fe5-a3fa-4e4d8c421bcc" returned: 0 in 0.288s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:08:15 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-c1da37c3-2125-4ae8-8227-3284c71e13b4 tempest-ProjectReaderTests-1199121374 None] Lock "cinder-quobyte-fc27ad51-8147-4fe5-a3fa-4e4d8c421bcc" released by "delete_volume" :: held 0.710s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 11:08:15 devstack cinder-volume[87272]: DEBUG cinder.quota [None req-c1da37c3-2125-4ae8-8227-3284c71e13b4 tempest-ProjectReaderTests-1199121374 None] Created reservations ['1aaf5f28-bd41-44c2-93de-4103a3211547', 'af021f3e-bc35-4a81-aab3-37c53d09cd29', '837d4834-75a5-4ff1-b13a-9d2bd76a8b2b', 'af4614d2-d22c-4321-b492-e1c51a71e6cf'] {{(pid=87272) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 11:08:15 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-c1da37c3-2125-4ae8-8227-3284c71e13b4 tempest-ProjectReaderTests-1199121374 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 11:08:15 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-c1da37c3-2125-4ae8-8227-3284c71e13b4 tempest-ProjectReaderTests-1199121374 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 11:08:15 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-c1da37c3-2125-4ae8-8227-3284c71e13b4 tempest-ProjectReaderTests-1199121374 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898': None} {{(pid=87272) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 11:08:15 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-c1da37c3-2125-4ae8-8227-3284c71e13b4 tempest-ProjectReaderTests-1199121374 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'] {{(pid=87272) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 11:08:15 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-c1da37c3-2125-4ae8-8227-3284c71e13b4 tempest-ProjectReaderTests-1199121374 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 11:08:15 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-c1da37c3-2125-4ae8-8227-3284c71e13b4 tempest-ProjectReaderTests-1199121374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:08:15 devstack sudo[105526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1 Nov 04 11:08:15 devstack sudo[105526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:08:16 devstack sudo[105526]: pam_unix(sudo:session): session closed for user root Nov 04 11:08:16 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-c1da37c3-2125-4ae8-8227-3284c71e13b4 tempest-ProjectReaderTests-1199121374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1" returned: 0 in 0.243s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:08:16 devstack cinder-volume[87272]: DEBUG cinder.manager [None req-c1da37c3-2125-4ae8-8227-3284c71e13b4 tempest-ProjectReaderTests-1199121374 None] Notifying Schedulers of capabilities ... {{(pid=87272) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 11:08:16 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-c1da37c3-2125-4ae8-8227-3284c71e13b4 tempest-ProjectReaderTests-1199121374 None] Deleted volume successfully. Nov 04 11:08:16 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-c1da37c3-2125-4ae8-8227-3284c71e13b4 tempest-ProjectReaderTests-1199121374 None] Lock "cinder-fc27ad51-8147-4fe5-a3fa-4e4d8c421bcc-delete_volume" released by "delete_volume" :: held 1.225s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 11:08:16 devstack cinder-volume[87272]: DEBUG cinder.volume.flows.manager.create_volume [None req-174a79f3-2930-4be4-aeec-5199e668ae0a tempest-ProjectReaderTests-1199121374 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87272) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 11:08:16 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-174a79f3-2930-4be4-aeec-5199e668ae0a tempest-ProjectReaderTests-1199121374 None] Flow 'volume_create_manager' (1b42af5a-b17b-4420-99a0-3a6430c9b3a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 11:08:16 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-174a79f3-2930-4be4-aeec-5199e668ae0a tempest-ProjectReaderTests-1199121374 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a7f57c6-fd4e-4843-86f9-81ef510b1868) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:08:16 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-174a79f3-2930-4be4-aeec-5199e668ae0a tempest-ProjectReaderTests-1199121374 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a7f57c6-fd4e-4843-86f9-81ef510b1868) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T10:08:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-846644450',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f99f7223-2cfa-40ef-88fd-e4491ab7c4db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f0f270e780664abca07ae240b6467f0a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T10:08:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T10:08:16Z,use_quota=True,user_id='51968d55c36f456890731c00f7d5725b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8989e4f-21e3-4f0a-9584-0d818784e883),volume_type_id=f8989e4f-21e3-4f0a-9584-0d818784e883)' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:08:16 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-174a79f3-2930-4be4-aeec-5199e668ae0a tempest-ProjectReaderTests-1199121374 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (009483ff-453e-4c9b-80df-570b16a2cb98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:08:16 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-174a79f3-2930-4be4-aeec-5199e668ae0a tempest-ProjectReaderTests-1199121374 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (009483ff-453e-4c9b-80df-570b16a2cb98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:08:16 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-174a79f3-2930-4be4-aeec-5199e668ae0a tempest-ProjectReaderTests-1199121374 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cabaaf64-7bc4-4ad0-8063-0847bbb48ed3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:08:16 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-174a79f3-2930-4be4-aeec-5199e668ae0a tempest-ProjectReaderTests-1199121374 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cabaaf64-7bc4-4ad0-8063-0847bbb48ed3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f99f7223-2cfa-40ef-88fd-e4491ab7c4db', 'volume_name': 'volume-f99f7223-2cfa-40ef-88fd-e4491ab7c4db', 'volume_size': 1}' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:08:16 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-174a79f3-2930-4be4-aeec-5199e668ae0a tempest-ProjectReaderTests-1199121374 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d9e02f6c-a46f-44c1-ab4f-e4ab144b612e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:08:16 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-174a79f3-2930-4be4-aeec-5199e668ae0a tempest-ProjectReaderTests-1199121374 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d9e02f6c-a46f-44c1-ab4f-e4ab144b612e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:08:16 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-174a79f3-2930-4be4-aeec-5199e668ae0a tempest-ProjectReaderTests-1199121374 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d797a997-0994-4029-a3d9-3e246e3ee1dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:08:16 devstack cinder-volume[87272]: INFO cinder.volume.flows.manager.create_volume [None req-174a79f3-2930-4be4-aeec-5199e668ae0a tempest-ProjectReaderTests-1199121374 None] Volume f99f7223-2cfa-40ef-88fd-e4491ab7c4db: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f99f7223-2cfa-40ef-88fd-e4491ab7c4db', 'volume_size': 1} Nov 04 11:08:16 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-174a79f3-2930-4be4-aeec-5199e668ae0a tempest-ProjectReaderTests-1199121374 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 11:08:16 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-174a79f3-2930-4be4-aeec-5199e668ae0a tempest-ProjectReaderTests-1199121374 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 11:08:16 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-174a79f3-2930-4be4-aeec-5199e668ae0a tempest-ProjectReaderTests-1199121374 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T10:08:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-846644450',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f99f7223-2cfa-40ef-88fd-e4491ab7c4db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f0f270e780664abca07ae240b6467f0a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T10:08:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T10:08:16Z,use_quota=True,user_id='51968d55c36f456890731c00f7d5725b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8989e4f-21e3-4f0a-9584-0d818784e883),volume_type_id=f8989e4f-21e3-4f0a-9584-0d818784e883)}" {{(pid=87272) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 04 11:08:16 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.remotefs [None req-174a79f3-2930-4be4-aeec-5199e668ae0a tempest-ProjectReaderTests-1199121374 None] Creating volume f99f7223-2cfa-40ef-88fd-e4491ab7c4db {{(pid=87272) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 11:08:16 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-174a79f3-2930-4be4-aeec-5199e668ae0a tempest-ProjectReaderTests-1199121374 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 11:08:16 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-174a79f3-2930-4be4-aeec-5199e668ae0a tempest-ProjectReaderTests-1199121374 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 11:08:16 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-174a79f3-2930-4be4-aeec-5199e668ae0a tempest-ProjectReaderTests-1199121374 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898': None} {{(pid=87272) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 11:08:16 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-174a79f3-2930-4be4-aeec-5199e668ae0a tempest-ProjectReaderTests-1199121374 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'] {{(pid=87272) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 11:08:16 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-174a79f3-2930-4be4-aeec-5199e668ae0a tempest-ProjectReaderTests-1199121374 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 11:08:16 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-174a79f3-2930-4be4-aeec-5199e668ae0a tempest-ProjectReaderTests-1199121374 None] Selected osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898 as target Quobyte volume. {{(pid=87272) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 11:08:16 devstack cinder-volume[87272]: INFO cinder.volume.drivers.remotefs [None req-174a79f3-2930-4be4-aeec-5199e668ae0a tempest-ProjectReaderTests-1199121374 None] casted to osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898 Nov 04 11:08:16 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-174a79f3-2930-4be4-aeec-5199e668ae0a tempest-ProjectReaderTests-1199121374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-f99f7223-2cfa-40ef-88fd-e4491ab7c4db 1073741824 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:08:16 devstack sudo[105530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-f99f7223-2cfa-40ef-88fd-e4491ab7c4db 1073741824 Nov 04 11:08:16 devstack sudo[105530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:08:17 devstack sudo[105530]: pam_unix(sudo:session): session closed for user root Nov 04 11:08:17 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-174a79f3-2930-4be4-aeec-5199e668ae0a tempest-ProjectReaderTests-1199121374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-f99f7223-2cfa-40ef-88fd-e4491ab7c4db 1073741824" returned: 0 in 0.404s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:08:17 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-174a79f3-2930-4be4-aeec-5199e668ae0a tempest-ProjectReaderTests-1199121374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-f99f7223-2cfa-40ef-88fd-e4491ab7c4db {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:08:17 devstack sudo[105535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-f99f7223-2cfa-40ef-88fd-e4491ab7c4db Nov 04 11:08:17 devstack sudo[105535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:08:17 devstack sudo[105535]: pam_unix(sudo:session): session closed for user root Nov 04 11:08:17 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-174a79f3-2930-4be4-aeec-5199e668ae0a tempest-ProjectReaderTests-1199121374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-f99f7223-2cfa-40ef-88fd-e4491ab7c4db" returned: 0 in 0.241s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:08:17 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-174a79f3-2930-4be4-aeec-5199e668ae0a tempest-ProjectReaderTests-1199121374 None] <== create_volume: return (688ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'} {{(pid=87272) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 04 11:08:17 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-174a79f3-2930-4be4-aeec-5199e668ae0a tempest-ProjectReaderTests-1199121374 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.690s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 11:08:17 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-174a79f3-2930-4be4-aeec-5199e668ae0a tempest-ProjectReaderTests-1199121374 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d797a997-0994-4029-a3d9-3e246e3ee1dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f99f7223-2cfa-40ef-88fd-e4491ab7c4db', 'volume_size': 1}' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:08:17 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-174a79f3-2930-4be4-aeec-5199e668ae0a tempest-ProjectReaderTests-1199121374 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec5f8369-5a10-457c-a3f3-d469e500bf6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:08:17 devstack cinder-volume[87272]: INFO cinder.volume.flows.manager.create_volume [None req-174a79f3-2930-4be4-aeec-5199e668ae0a tempest-ProjectReaderTests-1199121374 None] Volume volume-f99f7223-2cfa-40ef-88fd-e4491ab7c4db (f99f7223-2cfa-40ef-88fd-e4491ab7c4db): created successfully Nov 04 11:08:17 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-174a79f3-2930-4be4-aeec-5199e668ae0a tempest-ProjectReaderTests-1199121374 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec5f8369-5a10-457c-a3f3-d469e500bf6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:08:17 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-174a79f3-2930-4be4-aeec-5199e668ae0a tempest-ProjectReaderTests-1199121374 None] Flow 'volume_create_manager' (1b42af5a-b17b-4420-99a0-3a6430c9b3a0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87272) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 11:08:17 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-174a79f3-2930-4be4-aeec-5199e668ae0a tempest-ProjectReaderTests-1199121374 None] Created volume successfully. Nov 04 11:08:17 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-a93ce5bb-b5a7-4c90-9ab6-79efdb21b652 tempest-ProjectReaderTests-1199121374 None] Acquiring lock "cinder-f99f7223-2cfa-40ef-88fd-e4491ab7c4db-delete_volume" by "delete_volume" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 11:08:17 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-a93ce5bb-b5a7-4c90-9ab6-79efdb21b652 tempest-ProjectReaderTests-1199121374 None] Lock "cinder-f99f7223-2cfa-40ef-88fd-e4491ab7c4db-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 11:08:17 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-a93ce5bb-b5a7-4c90-9ab6-79efdb21b652 tempest-ProjectReaderTests-1199121374 None] Acquiring lock "cinder-quobyte-f99f7223-2cfa-40ef-88fd-e4491ab7c4db" by "delete_volume" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 11:08:17 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-a93ce5bb-b5a7-4c90-9ab6-79efdb21b652 tempest-ProjectReaderTests-1199121374 None] Lock "cinder-quobyte-f99f7223-2cfa-40ef-88fd-e4491ab7c4db" acquired by "delete_volume" :: waited 0.015s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 11:08:17 devstack cinder-volume[87272]: DEBUG oslo.privsep.daemon [-] privsep: reply[09f4de8c-8c65-42c3-a012-9aa1552c4aea]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 11:08:17 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-a93ce5bb-b5a7-4c90-9ab6-79efdb21b652 tempest-ProjectReaderTests-1199121374 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-f99f7223-2cfa-40ef-88fd-e4491ab7c4db {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:08:17 devstack sudo[105538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-f99f7223-2cfa-40ef-88fd-e4491ab7c4db Nov 04 11:08:17 devstack sudo[105538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:08:18 devstack sudo[105538]: pam_unix(sudo:session): session closed for user root Nov 04 11:08:18 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-a93ce5bb-b5a7-4c90-9ab6-79efdb21b652 tempest-ProjectReaderTests-1199121374 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-f99f7223-2cfa-40ef-88fd-e4491ab7c4db" returned: 0 in 0.346s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:08:18 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-a93ce5bb-b5a7-4c90-9ab6-79efdb21b652 tempest-ProjectReaderTests-1199121374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-f99f7223-2cfa-40ef-88fd-e4491ab7c4db {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:08:18 devstack sudo[105543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-f99f7223-2cfa-40ef-88fd-e4491ab7c4db Nov 04 11:08:18 devstack sudo[105543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:08:18 devstack sudo[105543]: pam_unix(sudo:session): session closed for user root Nov 04 11:08:18 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-a93ce5bb-b5a7-4c90-9ab6-79efdb21b652 tempest-ProjectReaderTests-1199121374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-f99f7223-2cfa-40ef-88fd-e4491ab7c4db" returned: 0 in 0.244s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:08:18 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-a93ce5bb-b5a7-4c90-9ab6-79efdb21b652 tempest-ProjectReaderTests-1199121374 None] Lock "cinder-quobyte-f99f7223-2cfa-40ef-88fd-e4491ab7c4db" released by "delete_volume" :: held 0.632s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 11:08:18 devstack cinder-volume[87272]: DEBUG cinder.quota [None req-a93ce5bb-b5a7-4c90-9ab6-79efdb21b652 tempest-ProjectReaderTests-1199121374 None] Created reservations ['e3470b42-93c6-40ac-af33-83d5d954ad9e', '64cb2a5d-3de2-48df-812b-06b25f0f0b51', '8c9e7492-f195-457c-84d7-818289bfc8ec', '26006385-632d-45c7-837d-10072d6a3b07'] {{(pid=87272) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 11:08:18 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-a93ce5bb-b5a7-4c90-9ab6-79efdb21b652 tempest-ProjectReaderTests-1199121374 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 11:08:18 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-a93ce5bb-b5a7-4c90-9ab6-79efdb21b652 tempest-ProjectReaderTests-1199121374 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 11:08:18 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-a93ce5bb-b5a7-4c90-9ab6-79efdb21b652 tempest-ProjectReaderTests-1199121374 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898': None} {{(pid=87272) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 11:08:18 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-a93ce5bb-b5a7-4c90-9ab6-79efdb21b652 tempest-ProjectReaderTests-1199121374 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'] {{(pid=87272) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 11:08:18 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-a93ce5bb-b5a7-4c90-9ab6-79efdb21b652 tempest-ProjectReaderTests-1199121374 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 11:08:18 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-a93ce5bb-b5a7-4c90-9ab6-79efdb21b652 tempest-ProjectReaderTests-1199121374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:08:18 devstack sudo[105546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1 Nov 04 11:08:18 devstack sudo[105546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:08:18 devstack sudo[105546]: pam_unix(sudo:session): session closed for user root Nov 04 11:08:18 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-a93ce5bb-b5a7-4c90-9ab6-79efdb21b652 tempest-ProjectReaderTests-1199121374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1" returned: 0 in 0.235s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:08:18 devstack cinder-volume[87272]: DEBUG cinder.manager [None req-a93ce5bb-b5a7-4c90-9ab6-79efdb21b652 tempest-ProjectReaderTests-1199121374 None] Notifying Schedulers of capabilities ... {{(pid=87272) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 11:08:18 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-a93ce5bb-b5a7-4c90-9ab6-79efdb21b652 tempest-ProjectReaderTests-1199121374 None] Deleted volume successfully. Nov 04 11:08:18 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-a93ce5bb-b5a7-4c90-9ab6-79efdb21b652 tempest-ProjectReaderTests-1199121374 None] Lock "cinder-f99f7223-2cfa-40ef-88fd-e4491ab7c4db-delete_volume" released by "delete_volume" :: held 1.051s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 11:08:19 devstack cinder-volume[87272]: DEBUG cinder.volume.flows.manager.create_volume [None req-fe57afcc-c317-428f-ba23-4982e471472d tempest-ProjectReaderTests-1199121374 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87272) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 11:08:19 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-fe57afcc-c317-428f-ba23-4982e471472d tempest-ProjectReaderTests-1199121374 None] Flow 'volume_create_manager' (2b7187a4-e4c8-43ab-b1fc-9c99e0527f48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 11:08:19 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-fe57afcc-c317-428f-ba23-4982e471472d tempest-ProjectReaderTests-1199121374 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a59a3b05-c9b2-413b-b7aa-13e5346d67a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:08:19 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-fe57afcc-c317-428f-ba23-4982e471472d tempest-ProjectReaderTests-1199121374 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a59a3b05-c9b2-413b-b7aa-13e5346d67a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T10:08:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1346149036',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ba1660d-14ee-4588-805e-da21562a9b61,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f0f270e780664abca07ae240b6467f0a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T10:08:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T10:08:19Z,use_quota=True,user_id='51968d55c36f456890731c00f7d5725b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8989e4f-21e3-4f0a-9584-0d818784e883),volume_type_id=f8989e4f-21e3-4f0a-9584-0d818784e883)' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:08:19 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-fe57afcc-c317-428f-ba23-4982e471472d tempest-ProjectReaderTests-1199121374 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (486086e8-3ff6-455a-b8f4-1727dc2b6423) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:08:19 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-fe57afcc-c317-428f-ba23-4982e471472d tempest-ProjectReaderTests-1199121374 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (486086e8-3ff6-455a-b8f4-1727dc2b6423) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:08:19 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-fe57afcc-c317-428f-ba23-4982e471472d tempest-ProjectReaderTests-1199121374 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3366b9b3-8a0d-4634-9b02-ea54d646e817) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:08:19 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-fe57afcc-c317-428f-ba23-4982e471472d tempest-ProjectReaderTests-1199121374 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3366b9b3-8a0d-4634-9b02-ea54d646e817) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6ba1660d-14ee-4588-805e-da21562a9b61', 'volume_name': 'volume-6ba1660d-14ee-4588-805e-da21562a9b61', 'volume_size': 1}' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:08:19 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-fe57afcc-c317-428f-ba23-4982e471472d tempest-ProjectReaderTests-1199121374 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f39a74a-5499-41ba-89f4-1031bae68a6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:08:19 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-fe57afcc-c317-428f-ba23-4982e471472d tempest-ProjectReaderTests-1199121374 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f39a74a-5499-41ba-89f4-1031bae68a6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:08:19 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-fe57afcc-c317-428f-ba23-4982e471472d tempest-ProjectReaderTests-1199121374 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d098bec-1838-4d30-a28e-4cbc65928908) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:08:19 devstack cinder-volume[87272]: INFO cinder.volume.flows.manager.create_volume [None req-fe57afcc-c317-428f-ba23-4982e471472d tempest-ProjectReaderTests-1199121374 None] Volume 6ba1660d-14ee-4588-805e-da21562a9b61: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6ba1660d-14ee-4588-805e-da21562a9b61', 'volume_size': 1} Nov 04 11:08:19 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-fe57afcc-c317-428f-ba23-4982e471472d tempest-ProjectReaderTests-1199121374 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 11:08:19 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-fe57afcc-c317-428f-ba23-4982e471472d tempest-ProjectReaderTests-1199121374 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 11:08:19 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-fe57afcc-c317-428f-ba23-4982e471472d tempest-ProjectReaderTests-1199121374 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T10:08:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1346149036',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ba1660d-14ee-4588-805e-da21562a9b61,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f0f270e780664abca07ae240b6467f0a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T10:08:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T10:08:19Z,use_quota=True,user_id='51968d55c36f456890731c00f7d5725b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8989e4f-21e3-4f0a-9584-0d818784e883),volume_type_id=f8989e4f-21e3-4f0a-9584-0d818784e883)}" {{(pid=87272) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 04 11:08:19 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.remotefs [None req-fe57afcc-c317-428f-ba23-4982e471472d tempest-ProjectReaderTests-1199121374 None] Creating volume 6ba1660d-14ee-4588-805e-da21562a9b61 {{(pid=87272) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 11:08:19 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-fe57afcc-c317-428f-ba23-4982e471472d tempest-ProjectReaderTests-1199121374 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 11:08:19 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-fe57afcc-c317-428f-ba23-4982e471472d tempest-ProjectReaderTests-1199121374 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 11:08:19 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-fe57afcc-c317-428f-ba23-4982e471472d tempest-ProjectReaderTests-1199121374 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898': None} {{(pid=87272) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 11:08:19 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-fe57afcc-c317-428f-ba23-4982e471472d tempest-ProjectReaderTests-1199121374 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'] {{(pid=87272) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 11:08:19 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-fe57afcc-c317-428f-ba23-4982e471472d tempest-ProjectReaderTests-1199121374 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 11:08:19 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-fe57afcc-c317-428f-ba23-4982e471472d tempest-ProjectReaderTests-1199121374 None] Selected osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898 as target Quobyte volume. {{(pid=87272) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 11:08:19 devstack cinder-volume[87272]: INFO cinder.volume.drivers.remotefs [None req-fe57afcc-c317-428f-ba23-4982e471472d tempest-ProjectReaderTests-1199121374 None] casted to osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898 Nov 04 11:08:19 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-fe57afcc-c317-428f-ba23-4982e471472d tempest-ProjectReaderTests-1199121374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-6ba1660d-14ee-4588-805e-da21562a9b61 1073741824 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:08:19 devstack sudo[105549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-6ba1660d-14ee-4588-805e-da21562a9b61 1073741824 Nov 04 11:08:19 devstack sudo[105549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:08:19 devstack sudo[105549]: pam_unix(sudo:session): session closed for user root Nov 04 11:08:19 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-fe57afcc-c317-428f-ba23-4982e471472d tempest-ProjectReaderTests-1199121374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-6ba1660d-14ee-4588-805e-da21562a9b61 1073741824" returned: 0 in 0.393s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:08:19 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-fe57afcc-c317-428f-ba23-4982e471472d tempest-ProjectReaderTests-1199121374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-6ba1660d-14ee-4588-805e-da21562a9b61 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:08:19 devstack sudo[105555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-6ba1660d-14ee-4588-805e-da21562a9b61 Nov 04 11:08:19 devstack sudo[105555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:08:19 devstack sudo[105555]: pam_unix(sudo:session): session closed for user root Nov 04 11:08:19 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-fe57afcc-c317-428f-ba23-4982e471472d tempest-ProjectReaderTests-1199121374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-6ba1660d-14ee-4588-805e-da21562a9b61" returned: 0 in 0.254s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:08:19 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-fe57afcc-c317-428f-ba23-4982e471472d tempest-ProjectReaderTests-1199121374 None] <== create_volume: return (687ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'} {{(pid=87272) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 04 11:08:19 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-fe57afcc-c317-428f-ba23-4982e471472d tempest-ProjectReaderTests-1199121374 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.690s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 11:08:19 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-fe57afcc-c317-428f-ba23-4982e471472d tempest-ProjectReaderTests-1199121374 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d098bec-1838-4d30-a28e-4cbc65928908) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6ba1660d-14ee-4588-805e-da21562a9b61', 'volume_size': 1}' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:08:19 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-fe57afcc-c317-428f-ba23-4982e471472d tempest-ProjectReaderTests-1199121374 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e455d93b-19a0-41b3-802f-66504dbeb230) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:08:19 devstack cinder-volume[87272]: INFO cinder.volume.flows.manager.create_volume [None req-fe57afcc-c317-428f-ba23-4982e471472d tempest-ProjectReaderTests-1199121374 None] Volume volume-6ba1660d-14ee-4588-805e-da21562a9b61 (6ba1660d-14ee-4588-805e-da21562a9b61): created successfully Nov 04 11:08:20 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-fe57afcc-c317-428f-ba23-4982e471472d tempest-ProjectReaderTests-1199121374 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e455d93b-19a0-41b3-802f-66504dbeb230) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:08:20 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-fe57afcc-c317-428f-ba23-4982e471472d tempest-ProjectReaderTests-1199121374 None] Flow 'volume_create_manager' (2b7187a4-e4c8-43ab-b1fc-9c99e0527f48) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87272) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 11:08:20 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-fe57afcc-c317-428f-ba23-4982e471472d tempest-ProjectReaderTests-1199121374 None] Created volume successfully. Nov 04 11:08:20 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-de5501bf-a8fa-4345-b54a-0bf9f2bf03c8 tempest-ProjectReaderTests-1199121374 None] Acquiring lock "cinder-6ba1660d-14ee-4588-805e-da21562a9b61-delete_volume" by "delete_volume" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 11:08:20 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-de5501bf-a8fa-4345-b54a-0bf9f2bf03c8 tempest-ProjectReaderTests-1199121374 None] Lock "cinder-6ba1660d-14ee-4588-805e-da21562a9b61-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 11:08:20 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-de5501bf-a8fa-4345-b54a-0bf9f2bf03c8 tempest-ProjectReaderTests-1199121374 None] Acquiring lock "cinder-quobyte-6ba1660d-14ee-4588-805e-da21562a9b61" by "delete_volume" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 11:08:20 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-de5501bf-a8fa-4345-b54a-0bf9f2bf03c8 tempest-ProjectReaderTests-1199121374 None] Lock "cinder-quobyte-6ba1660d-14ee-4588-805e-da21562a9b61" acquired by "delete_volume" :: waited 0.016s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 11:08:20 devstack cinder-volume[87272]: DEBUG oslo.privsep.daemon [-] privsep: reply[39ceea30-06c7-4a3b-8a03-f63fbf03bf21]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 11:08:20 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-de5501bf-a8fa-4345-b54a-0bf9f2bf03c8 tempest-ProjectReaderTests-1199121374 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-6ba1660d-14ee-4588-805e-da21562a9b61 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:08:20 devstack sudo[105558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-6ba1660d-14ee-4588-805e-da21562a9b61 Nov 04 11:08:20 devstack sudo[105558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:08:20 devstack sudo[105558]: pam_unix(sudo:session): session closed for user root Nov 04 11:08:20 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-de5501bf-a8fa-4345-b54a-0bf9f2bf03c8 tempest-ProjectReaderTests-1199121374 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-6ba1660d-14ee-4588-805e-da21562a9b61" returned: 0 in 0.361s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:08:20 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-de5501bf-a8fa-4345-b54a-0bf9f2bf03c8 tempest-ProjectReaderTests-1199121374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-6ba1660d-14ee-4588-805e-da21562a9b61 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:08:20 devstack sudo[105563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-6ba1660d-14ee-4588-805e-da21562a9b61 Nov 04 11:08:20 devstack sudo[105563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:08:20 devstack sudo[105563]: pam_unix(sudo:session): session closed for user root Nov 04 11:08:20 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-de5501bf-a8fa-4345-b54a-0bf9f2bf03c8 tempest-ProjectReaderTests-1199121374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-6ba1660d-14ee-4588-805e-da21562a9b61" returned: 0 in 0.240s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:08:20 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-de5501bf-a8fa-4345-b54a-0bf9f2bf03c8 tempest-ProjectReaderTests-1199121374 None] Lock "cinder-quobyte-6ba1660d-14ee-4588-805e-da21562a9b61" released by "delete_volume" :: held 0.639s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 11:08:21 devstack cinder-volume[87272]: DEBUG cinder.quota [None req-de5501bf-a8fa-4345-b54a-0bf9f2bf03c8 tempest-ProjectReaderTests-1199121374 None] Created reservations ['28b5c7b2-4b57-42e4-9b04-e956b9dde1a8', '74191196-2024-45dd-8406-62db1d5e5a82', '6f6643ae-7ddd-421a-9f46-4b1d8ea98387', '66ee440e-9b9d-4c97-a591-b008e6b3b024'] {{(pid=87272) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 11:08:21 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-de5501bf-a8fa-4345-b54a-0bf9f2bf03c8 tempest-ProjectReaderTests-1199121374 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 11:08:21 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-de5501bf-a8fa-4345-b54a-0bf9f2bf03c8 tempest-ProjectReaderTests-1199121374 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 11:08:21 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-de5501bf-a8fa-4345-b54a-0bf9f2bf03c8 tempest-ProjectReaderTests-1199121374 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898': None} {{(pid=87272) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 11:08:21 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-de5501bf-a8fa-4345-b54a-0bf9f2bf03c8 tempest-ProjectReaderTests-1199121374 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'] {{(pid=87272) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 11:08:21 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-de5501bf-a8fa-4345-b54a-0bf9f2bf03c8 tempest-ProjectReaderTests-1199121374 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 11:08:21 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-de5501bf-a8fa-4345-b54a-0bf9f2bf03c8 tempest-ProjectReaderTests-1199121374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:08:21 devstack sudo[105566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1 Nov 04 11:08:21 devstack sudo[105566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:08:21 devstack sudo[105566]: pam_unix(sudo:session): session closed for user root Nov 04 11:08:21 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-de5501bf-a8fa-4345-b54a-0bf9f2bf03c8 tempest-ProjectReaderTests-1199121374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1" returned: 0 in 0.246s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:08:21 devstack cinder-volume[87272]: DEBUG cinder.manager [None req-de5501bf-a8fa-4345-b54a-0bf9f2bf03c8 tempest-ProjectReaderTests-1199121374 None] Notifying Schedulers of capabilities ... {{(pid=87272) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 11:08:21 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-de5501bf-a8fa-4345-b54a-0bf9f2bf03c8 tempest-ProjectReaderTests-1199121374 None] Deleted volume successfully. Nov 04 11:08:21 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-de5501bf-a8fa-4345-b54a-0bf9f2bf03c8 tempest-ProjectReaderTests-1199121374 None] Lock "cinder-6ba1660d-14ee-4588-805e-da21562a9b61-delete_volume" released by "delete_volume" :: held 1.074s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 11:08:21 devstack cinder-volume[87272]: DEBUG cinder.volume.flows.manager.create_volume [None req-5463fcd2-c98e-4eb8-9281-df95d906a477 tempest-ProjectReaderTests-1199121374 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87272) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 11:08:21 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-5463fcd2-c98e-4eb8-9281-df95d906a477 tempest-ProjectReaderTests-1199121374 None] Flow 'volume_create_manager' (0ba25712-2165-4839-b6d1-25c257ffcff8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 11:08:21 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-5463fcd2-c98e-4eb8-9281-df95d906a477 tempest-ProjectReaderTests-1199121374 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ac7c072-d80f-4558-986b-5307fde90d4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:08:21 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-5463fcd2-c98e-4eb8-9281-df95d906a477 tempest-ProjectReaderTests-1199121374 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ac7c072-d80f-4558-986b-5307fde90d4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T10:08:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1068266144',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fbdb590f-d1d0-4a62-943d-ad43ac86d43e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f0f270e780664abca07ae240b6467f0a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T10:08:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T10:08:22Z,use_quota=True,user_id='51968d55c36f456890731c00f7d5725b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8989e4f-21e3-4f0a-9584-0d818784e883),volume_type_id=f8989e4f-21e3-4f0a-9584-0d818784e883)' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:08:21 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-5463fcd2-c98e-4eb8-9281-df95d906a477 tempest-ProjectReaderTests-1199121374 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a97b2a62-fc23-4d91-9886-68d08c0bde76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:08:21 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-5463fcd2-c98e-4eb8-9281-df95d906a477 tempest-ProjectReaderTests-1199121374 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a97b2a62-fc23-4d91-9886-68d08c0bde76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:08:21 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-5463fcd2-c98e-4eb8-9281-df95d906a477 tempest-ProjectReaderTests-1199121374 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (39ffb999-476c-4e27-b2eb-47331a308d0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:08:21 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-5463fcd2-c98e-4eb8-9281-df95d906a477 tempest-ProjectReaderTests-1199121374 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (39ffb999-476c-4e27-b2eb-47331a308d0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fbdb590f-d1d0-4a62-943d-ad43ac86d43e', 'volume_name': 'volume-fbdb590f-d1d0-4a62-943d-ad43ac86d43e', 'volume_size': 1}' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:08:21 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-5463fcd2-c98e-4eb8-9281-df95d906a477 tempest-ProjectReaderTests-1199121374 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (26413256-0de8-4438-98ec-59abdd3c727b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:08:21 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-5463fcd2-c98e-4eb8-9281-df95d906a477 tempest-ProjectReaderTests-1199121374 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (26413256-0de8-4438-98ec-59abdd3c727b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:08:21 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-5463fcd2-c98e-4eb8-9281-df95d906a477 tempest-ProjectReaderTests-1199121374 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ff45914-3684-4e47-b70e-edec5d376a9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:08:21 devstack cinder-volume[87272]: INFO cinder.volume.flows.manager.create_volume [None req-5463fcd2-c98e-4eb8-9281-df95d906a477 tempest-ProjectReaderTests-1199121374 None] Volume fbdb590f-d1d0-4a62-943d-ad43ac86d43e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fbdb590f-d1d0-4a62-943d-ad43ac86d43e', 'volume_size': 1} Nov 04 11:08:21 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-5463fcd2-c98e-4eb8-9281-df95d906a477 tempest-ProjectReaderTests-1199121374 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 11:08:21 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-5463fcd2-c98e-4eb8-9281-df95d906a477 tempest-ProjectReaderTests-1199121374 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 11:08:21 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-5463fcd2-c98e-4eb8-9281-df95d906a477 tempest-ProjectReaderTests-1199121374 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T10:08:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1068266144',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fbdb590f-d1d0-4a62-943d-ad43ac86d43e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f0f270e780664abca07ae240b6467f0a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T10:08:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T10:08:22Z,use_quota=True,user_id='51968d55c36f456890731c00f7d5725b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8989e4f-21e3-4f0a-9584-0d818784e883),volume_type_id=f8989e4f-21e3-4f0a-9584-0d818784e883)}" {{(pid=87272) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 04 11:08:21 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.remotefs [None req-5463fcd2-c98e-4eb8-9281-df95d906a477 tempest-ProjectReaderTests-1199121374 None] Creating volume fbdb590f-d1d0-4a62-943d-ad43ac86d43e {{(pid=87272) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 11:08:21 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-5463fcd2-c98e-4eb8-9281-df95d906a477 tempest-ProjectReaderTests-1199121374 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 11:08:21 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-5463fcd2-c98e-4eb8-9281-df95d906a477 tempest-ProjectReaderTests-1199121374 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 11:08:21 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-5463fcd2-c98e-4eb8-9281-df95d906a477 tempest-ProjectReaderTests-1199121374 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898': None} {{(pid=87272) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 11:08:21 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-5463fcd2-c98e-4eb8-9281-df95d906a477 tempest-ProjectReaderTests-1199121374 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'] {{(pid=87272) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 11:08:21 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-5463fcd2-c98e-4eb8-9281-df95d906a477 tempest-ProjectReaderTests-1199121374 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 11:08:21 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-5463fcd2-c98e-4eb8-9281-df95d906a477 tempest-ProjectReaderTests-1199121374 None] Selected osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898 as target Quobyte volume. {{(pid=87272) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 11:08:21 devstack cinder-volume[87272]: INFO cinder.volume.drivers.remotefs [None req-5463fcd2-c98e-4eb8-9281-df95d906a477 tempest-ProjectReaderTests-1199121374 None] casted to osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898 Nov 04 11:08:21 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-5463fcd2-c98e-4eb8-9281-df95d906a477 tempest-ProjectReaderTests-1199121374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-fbdb590f-d1d0-4a62-943d-ad43ac86d43e 1073741824 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:08:21 devstack sudo[105575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-fbdb590f-d1d0-4a62-943d-ad43ac86d43e 1073741824 Nov 04 11:08:21 devstack sudo[105575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:08:22 devstack sudo[105575]: pam_unix(sudo:session): session closed for user root Nov 04 11:08:22 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-5463fcd2-c98e-4eb8-9281-df95d906a477 tempest-ProjectReaderTests-1199121374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-fbdb590f-d1d0-4a62-943d-ad43ac86d43e 1073741824" returned: 0 in 0.425s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:08:22 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-5463fcd2-c98e-4eb8-9281-df95d906a477 tempest-ProjectReaderTests-1199121374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-fbdb590f-d1d0-4a62-943d-ad43ac86d43e {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:08:22 devstack sudo[105580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-fbdb590f-d1d0-4a62-943d-ad43ac86d43e Nov 04 11:08:22 devstack sudo[105580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:08:22 devstack sudo[105580]: pam_unix(sudo:session): session closed for user root Nov 04 11:08:22 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-5463fcd2-c98e-4eb8-9281-df95d906a477 tempest-ProjectReaderTests-1199121374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-fbdb590f-d1d0-4a62-943d-ad43ac86d43e" returned: 0 in 0.232s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:08:22 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-5463fcd2-c98e-4eb8-9281-df95d906a477 tempest-ProjectReaderTests-1199121374 None] <== create_volume: return (702ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'} {{(pid=87272) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 04 11:08:22 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-5463fcd2-c98e-4eb8-9281-df95d906a477 tempest-ProjectReaderTests-1199121374 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.704s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 11:08:22 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-5463fcd2-c98e-4eb8-9281-df95d906a477 tempest-ProjectReaderTests-1199121374 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ff45914-3684-4e47-b70e-edec5d376a9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fbdb590f-d1d0-4a62-943d-ad43ac86d43e', 'volume_size': 1}' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:08:22 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-5463fcd2-c98e-4eb8-9281-df95d906a477 tempest-ProjectReaderTests-1199121374 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ddf64d6e-01b1-425d-b984-347b17662c40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:08:22 devstack cinder-volume[87272]: INFO cinder.volume.flows.manager.create_volume [None req-5463fcd2-c98e-4eb8-9281-df95d906a477 tempest-ProjectReaderTests-1199121374 None] Volume volume-fbdb590f-d1d0-4a62-943d-ad43ac86d43e (fbdb590f-d1d0-4a62-943d-ad43ac86d43e): created successfully Nov 04 11:08:22 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-5463fcd2-c98e-4eb8-9281-df95d906a477 tempest-ProjectReaderTests-1199121374 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ddf64d6e-01b1-425d-b984-347b17662c40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:08:22 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-5463fcd2-c98e-4eb8-9281-df95d906a477 tempest-ProjectReaderTests-1199121374 None] Flow 'volume_create_manager' (0ba25712-2165-4839-b6d1-25c257ffcff8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87272) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 11:08:22 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-5463fcd2-c98e-4eb8-9281-df95d906a477 tempest-ProjectReaderTests-1199121374 None] Created volume successfully. Nov 04 11:08:22 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-d99b086d-7bd6-4916-ab0f-5400949a9505 tempest-ProjectReaderTests-1199121374 None] Acquiring lock "cinder-fbdb590f-d1d0-4a62-943d-ad43ac86d43e-delete_volume" by "delete_volume" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 11:08:22 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-d99b086d-7bd6-4916-ab0f-5400949a9505 tempest-ProjectReaderTests-1199121374 None] Lock "cinder-fbdb590f-d1d0-4a62-943d-ad43ac86d43e-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 11:08:22 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-d99b086d-7bd6-4916-ab0f-5400949a9505 tempest-ProjectReaderTests-1199121374 None] Acquiring lock "cinder-quobyte-fbdb590f-d1d0-4a62-943d-ad43ac86d43e" by "delete_volume" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 11:08:22 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-d99b086d-7bd6-4916-ab0f-5400949a9505 tempest-ProjectReaderTests-1199121374 None] Lock "cinder-quobyte-fbdb590f-d1d0-4a62-943d-ad43ac86d43e" acquired by "delete_volume" :: waited 0.015s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 11:08:22 devstack cinder-volume[87272]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ad32ebb-8362-481f-9755-069e8d4a6ee1]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 11:08:22 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-d99b086d-7bd6-4916-ab0f-5400949a9505 tempest-ProjectReaderTests-1199121374 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-fbdb590f-d1d0-4a62-943d-ad43ac86d43e {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:08:23 devstack sudo[105584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-fbdb590f-d1d0-4a62-943d-ad43ac86d43e Nov 04 11:08:23 devstack sudo[105584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:08:23 devstack sudo[105584]: pam_unix(sudo:session): session closed for user root Nov 04 11:08:23 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-d99b086d-7bd6-4916-ab0f-5400949a9505 tempest-ProjectReaderTests-1199121374 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-fbdb590f-d1d0-4a62-943d-ad43ac86d43e" returned: 0 in 0.363s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:08:23 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-d99b086d-7bd6-4916-ab0f-5400949a9505 tempest-ProjectReaderTests-1199121374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-fbdb590f-d1d0-4a62-943d-ad43ac86d43e {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:08:23 devstack sudo[105589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-fbdb590f-d1d0-4a62-943d-ad43ac86d43e Nov 04 11:08:23 devstack sudo[105589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:08:23 devstack sudo[105589]: pam_unix(sudo:session): session closed for user root Nov 04 11:08:23 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-d99b086d-7bd6-4916-ab0f-5400949a9505 tempest-ProjectReaderTests-1199121374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-fbdb590f-d1d0-4a62-943d-ad43ac86d43e" returned: 0 in 0.243s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:08:23 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-d99b086d-7bd6-4916-ab0f-5400949a9505 tempest-ProjectReaderTests-1199121374 None] Lock "cinder-quobyte-fbdb590f-d1d0-4a62-943d-ad43ac86d43e" released by "delete_volume" :: held 0.644s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 11:08:23 devstack cinder-volume[87272]: DEBUG cinder.quota [None req-d99b086d-7bd6-4916-ab0f-5400949a9505 tempest-ProjectReaderTests-1199121374 None] Created reservations ['fba0526b-49c8-46f8-9cf6-05b4a2b2d107', '9942917c-c727-4112-b851-c5449f632956', '8db116bf-36ab-482b-be11-eda540b5f343', '6623131b-4f44-4786-bc02-ea486b4df7bc'] {{(pid=87272) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 11:08:23 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-d99b086d-7bd6-4916-ab0f-5400949a9505 tempest-ProjectReaderTests-1199121374 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 11:08:23 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-d99b086d-7bd6-4916-ab0f-5400949a9505 tempest-ProjectReaderTests-1199121374 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 11:08:23 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-d99b086d-7bd6-4916-ab0f-5400949a9505 tempest-ProjectReaderTests-1199121374 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898': None} {{(pid=87272) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 11:08:23 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-d99b086d-7bd6-4916-ab0f-5400949a9505 tempest-ProjectReaderTests-1199121374 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'] {{(pid=87272) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 11:08:23 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-d99b086d-7bd6-4916-ab0f-5400949a9505 tempest-ProjectReaderTests-1199121374 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 11:08:23 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-d99b086d-7bd6-4916-ab0f-5400949a9505 tempest-ProjectReaderTests-1199121374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:08:23 devstack sudo[105592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1 Nov 04 11:08:23 devstack sudo[105592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:08:23 devstack sudo[105592]: pam_unix(sudo:session): session closed for user root Nov 04 11:08:23 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-d99b086d-7bd6-4916-ab0f-5400949a9505 tempest-ProjectReaderTests-1199121374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1" returned: 0 in 0.240s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:08:23 devstack cinder-volume[87272]: DEBUG cinder.manager [None req-d99b086d-7bd6-4916-ab0f-5400949a9505 tempest-ProjectReaderTests-1199121374 None] Notifying Schedulers of capabilities ... {{(pid=87272) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 11:08:23 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-d99b086d-7bd6-4916-ab0f-5400949a9505 tempest-ProjectReaderTests-1199121374 None] Deleted volume successfully. Nov 04 11:08:24 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-d99b086d-7bd6-4916-ab0f-5400949a9505 tempest-ProjectReaderTests-1199121374 None] Lock "cinder-fbdb590f-d1d0-4a62-943d-ad43ac86d43e-delete_volume" released by "delete_volume" :: held 1.089s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 11:08:31 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [req-077e1d96-b793-413b-ba2f-4d91f9acc114 req-3b2eba70-1e27-4aac-941a-0719595576ab tempest-TestStampPattern-1122407784 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 11:08:31 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [req-077e1d96-b793-413b-ba2f-4d91f9acc114 req-3b2eba70-1e27-4aac-941a-0719595576ab tempest-TestStampPattern-1122407784 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 11:08:31 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [req-077e1d96-b793-413b-ba2f-4d91f9acc114 req-3b2eba70-1e27-4aac-941a-0719595576ab tempest-TestStampPattern-1122407784 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.013s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 11:08:31 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [req-077e1d96-b793-413b-ba2f-4d91f9acc114 req-3b2eba70-1e27-4aac-941a-0719595576ab tempest-TestStampPattern-1122407784 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898', 'name': 'volume-3b995b16-60e9-42bf-961b-d32fc2177ef7', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b027bf97-3b68-4d80-b390-b35b03f0a626', 'enforce_multipath': True} {{(pid=87272) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 04 11:08:31 devstack cinder-volume[87272]: INFO cinder.volume.manager [req-077e1d96-b793-413b-ba2f-4d91f9acc114 req-3b2eba70-1e27-4aac-941a-0719595576ab tempest-TestStampPattern-1122407784 None] attachment_update completed successfully. Nov 04 11:08:33 devstack cinder-volume[87272]: INFO cinder.volume.manager [req-cce2d8bf-1fc8-435a-938f-760dff5948c6 req-b320191f-6d48-4912-bad9-cee089ebc114 tempest-TestStampPattern-1122407784 None] Terminate volume connection completed successfully. Nov 04 11:08:33 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [req-cce2d8bf-1fc8-435a-938f-760dff5948c6 req-b320191f-6d48-4912-bad9-cee089ebc114 tempest-TestStampPattern-1122407784 None] Deleting attachment b027bf97-3b68-4d80-b390-b35b03f0a626. {{(pid=87272) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 04 11:08:37 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-4bde6e7f-f33e-4ded-9e6e-d2b11b33c513 tempest-TestStampPattern-1122407784 None] Acquiring lock "cinder-3b995b16-60e9-42bf-961b-d32fc2177ef7-delete_volume" by "delete_volume" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 11:08:37 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-4bde6e7f-f33e-4ded-9e6e-d2b11b33c513 tempest-TestStampPattern-1122407784 None] Lock "cinder-3b995b16-60e9-42bf-961b-d32fc2177ef7-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 11:08:37 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-4bde6e7f-f33e-4ded-9e6e-d2b11b33c513 tempest-TestStampPattern-1122407784 None] Acquiring lock "cinder-quobyte-3b995b16-60e9-42bf-961b-d32fc2177ef7" by "delete_volume" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 11:08:37 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-4bde6e7f-f33e-4ded-9e6e-d2b11b33c513 tempest-TestStampPattern-1122407784 None] Lock "cinder-quobyte-3b995b16-60e9-42bf-961b-d32fc2177ef7" acquired by "delete_volume" :: waited 0.015s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 11:08:37 devstack cinder-volume[87272]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d72e864-6010-43b1-8c2b-605ecb2eddc3]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 11:08:37 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-4bde6e7f-f33e-4ded-9e6e-d2b11b33c513 tempest-TestStampPattern-1122407784 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-3b995b16-60e9-42bf-961b-d32fc2177ef7 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:08:37 devstack sudo[106136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-3b995b16-60e9-42bf-961b-d32fc2177ef7 Nov 04 11:08:37 devstack sudo[106136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:08:38 devstack sudo[106136]: pam_unix(sudo:session): session closed for user root Nov 04 11:08:38 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-4bde6e7f-f33e-4ded-9e6e-d2b11b33c513 tempest-TestStampPattern-1122407784 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-3b995b16-60e9-42bf-961b-d32fc2177ef7" returned: 0 in 0.366s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:08:38 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-4bde6e7f-f33e-4ded-9e6e-d2b11b33c513 tempest-TestStampPattern-1122407784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-3b995b16-60e9-42bf-961b-d32fc2177ef7 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:08:38 devstack sudo[106141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-3b995b16-60e9-42bf-961b-d32fc2177ef7 Nov 04 11:08:38 devstack sudo[106141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:08:38 devstack sudo[106141]: pam_unix(sudo:session): session closed for user root Nov 04 11:08:38 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-4bde6e7f-f33e-4ded-9e6e-d2b11b33c513 tempest-TestStampPattern-1122407784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-3b995b16-60e9-42bf-961b-d32fc2177ef7" returned: 0 in 0.249s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:08:38 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-4bde6e7f-f33e-4ded-9e6e-d2b11b33c513 tempest-TestStampPattern-1122407784 None] Lock "cinder-quobyte-3b995b16-60e9-42bf-961b-d32fc2177ef7" released by "delete_volume" :: held 0.664s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 11:08:38 devstack cinder-volume[87272]: DEBUG cinder.quota [None req-4bde6e7f-f33e-4ded-9e6e-d2b11b33c513 tempest-TestStampPattern-1122407784 None] Created reservations ['6f93b4d5-9c46-471d-9da7-98b2851841e3', '20d9e17b-f6b7-4cda-988a-dbcf7fe0b9ae', '5fc70141-ab2f-4e9e-a03d-bf926a371ae8', '5b669261-65a9-4868-ac68-f925a4d40d15'] {{(pid=87272) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 11:08:38 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-4bde6e7f-f33e-4ded-9e6e-d2b11b33c513 tempest-TestStampPattern-1122407784 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 11:08:38 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-4bde6e7f-f33e-4ded-9e6e-d2b11b33c513 tempest-TestStampPattern-1122407784 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 11:08:38 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-4bde6e7f-f33e-4ded-9e6e-d2b11b33c513 tempest-TestStampPattern-1122407784 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898': None} {{(pid=87272) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 11:08:38 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-4bde6e7f-f33e-4ded-9e6e-d2b11b33c513 tempest-TestStampPattern-1122407784 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'] {{(pid=87272) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 11:08:38 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-4bde6e7f-f33e-4ded-9e6e-d2b11b33c513 tempest-TestStampPattern-1122407784 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 11:08:38 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-4bde6e7f-f33e-4ded-9e6e-d2b11b33c513 tempest-TestStampPattern-1122407784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:08:38 devstack sudo[106144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1 Nov 04 11:08:38 devstack sudo[106144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:08:38 devstack sudo[106144]: pam_unix(sudo:session): session closed for user root Nov 04 11:08:38 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-4bde6e7f-f33e-4ded-9e6e-d2b11b33c513 tempest-TestStampPattern-1122407784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1" returned: 0 in 0.243s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:08:38 devstack cinder-volume[87272]: DEBUG cinder.manager [None req-4bde6e7f-f33e-4ded-9e6e-d2b11b33c513 tempest-TestStampPattern-1122407784 None] Notifying Schedulers of capabilities ... {{(pid=87272) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 11:08:38 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-4bde6e7f-f33e-4ded-9e6e-d2b11b33c513 tempest-TestStampPattern-1122407784 None] Deleted volume successfully. Nov 04 11:08:38 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-4bde6e7f-f33e-4ded-9e6e-d2b11b33c513 tempest-TestStampPattern-1122407784 None] Lock "cinder-3b995b16-60e9-42bf-961b-d32fc2177ef7-delete_volume" released by "delete_volume" :: held 1.100s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 11:08:38 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-a0c84814-ce4c-4798-a423-bd78e7b8cc73 tempest-TestStampPattern-1122407784 None] Acquiring lock "cinder-60a94640-e77b-4f62-8006-e84f6c68c072-delete_snapshot" by "delete_snapshot" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 11:08:39 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-a0c84814-ce4c-4798-a423-bd78e7b8cc73 tempest-TestStampPattern-1122407784 None] Lock "cinder-60a94640-e77b-4f62-8006-e84f6c68c072-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 11:08:39 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-a0c84814-ce4c-4798-a423-bd78e7b8cc73 tempest-TestStampPattern-1122407784 None] Acquiring lock "cinder-quobyte-d8dbc52a-7d55-4220-af52-9d4db4cf33b3" by "delete_snapshot" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 11:08:39 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-a0c84814-ce4c-4798-a423-bd78e7b8cc73 tempest-TestStampPattern-1122407784 None] Lock "cinder-quobyte-d8dbc52a-7d55-4220-af52-9d4db4cf33b3" acquired by "delete_snapshot" :: waited 0.013s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 11:08:39 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-a0c84814-ce4c-4798-a423-bd78e7b8cc73 tempest-TestStampPattern-1122407784 None] Acquiring lock "cinder-quobyte-60a94640-e77b-4f62-8006-e84f6c68c072" by "_delete_snapshot" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 11:08:39 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-a0c84814-ce4c-4798-a423-bd78e7b8cc73 tempest-TestStampPattern-1122407784 None] Lock "cinder-quobyte-60a94640-e77b-4f62-8006-e84f6c68c072" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 11:08:39 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.remotefs [None req-a0c84814-ce4c-4798-a423-bd78e7b8cc73 tempest-TestStampPattern-1122407784 None] Deleting offline snapshot 60a94640-e77b-4f62-8006-e84f6c68c072 of volume d8dbc52a-7d55-4220-af52-9d4db4cf33b3 {{(pid=87272) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 04 11:08:39 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.remotefs [None req-a0c84814-ce4c-4798-a423-bd78e7b8cc73 tempest-TestStampPattern-1122407784 None] snapshot_file for this snap is: volume-d8dbc52a-7d55-4220-af52-9d4db4cf33b3.60a94640-e77b-4f62-8006-e84f6c68c072 {{(pid=87272) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 04 11:08:39 devstack cinder-volume[87272]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b94ad00-329d-4b09-a492-67bd231ddede]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 11:08:39 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-a0c84814-ce4c-4798-a423-bd78e7b8cc73 tempest-TestStampPattern-1122407784 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-d8dbc52a-7d55-4220-af52-9d4db4cf33b3.60a94640-e77b-4f62-8006-e84f6c68c072 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:08:39 devstack sudo[106147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-d8dbc52a-7d55-4220-af52-9d4db4cf33b3.60a94640-e77b-4f62-8006-e84f6c68c072 Nov 04 11:08:39 devstack sudo[106147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:08:39 devstack sudo[106147]: pam_unix(sudo:session): session closed for user root Nov 04 11:08:39 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-a0c84814-ce4c-4798-a423-bd78e7b8cc73 tempest-TestStampPattern-1122407784 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-d8dbc52a-7d55-4220-af52-9d4db4cf33b3.60a94640-e77b-4f62-8006-e84f6c68c072" returned: 0 in 0.358s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:08:39 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.remotefs [None req-a0c84814-ce4c-4798-a423-bd78e7b8cc73 tempest-TestStampPattern-1122407784 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d8dbc52a-7d55-4220-af52-9d4db4cf33b3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87272) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 11:08:39 devstack cinder-volume[87272]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ca56d13-3ccb-423f-93d3-2a615c5c6e29]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 11:08:39 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-a0c84814-ce4c-4798-a423-bd78e7b8cc73 tempest-TestStampPattern-1122407784 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-d8dbc52a-7d55-4220-af52-9d4db4cf33b3 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:08:39 devstack sudo[106152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-d8dbc52a-7d55-4220-af52-9d4db4cf33b3 Nov 04 11:08:39 devstack sudo[106152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:08:39 devstack sudo[106152]: pam_unix(sudo:session): session closed for user root Nov 04 11:08:39 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-a0c84814-ce4c-4798-a423-bd78e7b8cc73 tempest-TestStampPattern-1122407784 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-d8dbc52a-7d55-4220-af52-9d4db4cf33b3" returned: 0 in 0.498s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:08:39 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-a0c84814-ce4c-4798-a423-bd78e7b8cc73 tempest-TestStampPattern-1122407784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-d8dbc52a-7d55-4220-af52-9d4db4cf33b3.60a94640-e77b-4f62-8006-e84f6c68c072 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:08:39 devstack sudo[106157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-d8dbc52a-7d55-4220-af52-9d4db4cf33b3.60a94640-e77b-4f62-8006-e84f6c68c072 Nov 04 11:08:39 devstack sudo[106157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:08:40 devstack sudo[106157]: pam_unix(sudo:session): session closed for user root Nov 04 11:08:40 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-a0c84814-ce4c-4798-a423-bd78e7b8cc73 tempest-TestStampPattern-1122407784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-d8dbc52a-7d55-4220-af52-9d4db4cf33b3.60a94640-e77b-4f62-8006-e84f6c68c072" returned: 0 in 0.334s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:08:40 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-a0c84814-ce4c-4798-a423-bd78e7b8cc73 tempest-TestStampPattern-1122407784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-d8dbc52a-7d55-4220-af52-9d4db4cf33b3.60a94640-e77b-4f62-8006-e84f6c68c072 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:08:40 devstack sudo[106162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-d8dbc52a-7d55-4220-af52-9d4db4cf33b3.60a94640-e77b-4f62-8006-e84f6c68c072 Nov 04 11:08:40 devstack sudo[106162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:08:40 devstack sudo[106162]: pam_unix(sudo:session): session closed for user root Nov 04 11:08:40 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-a0c84814-ce4c-4798-a423-bd78e7b8cc73 tempest-TestStampPattern-1122407784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-d8dbc52a-7d55-4220-af52-9d4db4cf33b3.60a94640-e77b-4f62-8006-e84f6c68c072" returned: 0 in 0.232s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:08:40 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-a0c84814-ce4c-4798-a423-bd78e7b8cc73 tempest-TestStampPattern-1122407784 None] Lock "cinder-quobyte-60a94640-e77b-4f62-8006-e84f6c68c072" released by "_delete_snapshot" :: held 1.524s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 11:08:40 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-a0c84814-ce4c-4798-a423-bd78e7b8cc73 tempest-TestStampPattern-1122407784 None] Lock "cinder-quobyte-d8dbc52a-7d55-4220-af52-9d4db4cf33b3" released by "delete_snapshot" :: held 1.545s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 11:08:40 devstack cinder-volume[87272]: DEBUG cinder.quota [None req-a0c84814-ce4c-4798-a423-bd78e7b8cc73 tempest-TestStampPattern-1122407784 None] Created reservations ['89b2c040-9b09-4614-b4e8-e6c4d476c646', '83b3b26f-b7b7-434f-b1ac-cb23b2f87276', '78b889d6-c4bd-48b5-8f97-6a4e313132fb', '7bc6e61b-6ed2-4b61-a54e-9d729f60e318'] {{(pid=87272) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 11:08:40 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-a0c84814-ce4c-4798-a423-bd78e7b8cc73 tempest-TestStampPattern-1122407784 None] Delete snapshot completed successfully. Nov 04 11:08:40 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-a0c84814-ce4c-4798-a423-bd78e7b8cc73 tempest-TestStampPattern-1122407784 None] Lock "cinder-60a94640-e77b-4f62-8006-e84f6c68c072-delete_snapshot" released by "delete_snapshot" :: held 1.666s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 11:08:44 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-89c39af9-b123-414d-af1a-01622c1280aa tempest-TestStampPattern-1122407784 None] Acquiring lock "cinder-d8dbc52a-7d55-4220-af52-9d4db4cf33b3-delete_volume" by "delete_volume" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 11:08:44 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-89c39af9-b123-414d-af1a-01622c1280aa tempest-TestStampPattern-1122407784 None] Lock "cinder-d8dbc52a-7d55-4220-af52-9d4db4cf33b3-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 11:08:44 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-89c39af9-b123-414d-af1a-01622c1280aa tempest-TestStampPattern-1122407784 None] Acquiring lock "cinder-quobyte-d8dbc52a-7d55-4220-af52-9d4db4cf33b3" by "delete_volume" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 11:08:44 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-89c39af9-b123-414d-af1a-01622c1280aa tempest-TestStampPattern-1122407784 None] Lock "cinder-quobyte-d8dbc52a-7d55-4220-af52-9d4db4cf33b3" acquired by "delete_volume" :: waited 0.022s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 11:08:44 devstack cinder-volume[87272]: DEBUG oslo.privsep.daemon [-] privsep: reply[46d1b9e9-c3d8-4730-9cc7-2601e52a9fca]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 11:08:44 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-89c39af9-b123-414d-af1a-01622c1280aa tempest-TestStampPattern-1122407784 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-d8dbc52a-7d55-4220-af52-9d4db4cf33b3 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:08:44 devstack sudo[106191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-d8dbc52a-7d55-4220-af52-9d4db4cf33b3 Nov 04 11:08:44 devstack sudo[106191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:08:44 devstack sudo[106191]: pam_unix(sudo:session): session closed for user root Nov 04 11:08:44 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-89c39af9-b123-414d-af1a-01622c1280aa tempest-TestStampPattern-1122407784 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-d8dbc52a-7d55-4220-af52-9d4db4cf33b3" returned: 0 in 0.335s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:08:44 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-89c39af9-b123-414d-af1a-01622c1280aa tempest-TestStampPattern-1122407784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-d8dbc52a-7d55-4220-af52-9d4db4cf33b3 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:08:44 devstack sudo[106196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-d8dbc52a-7d55-4220-af52-9d4db4cf33b3 Nov 04 11:08:44 devstack sudo[106196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:08:45 devstack sudo[106196]: pam_unix(sudo:session): session closed for user root Nov 04 11:08:45 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-89c39af9-b123-414d-af1a-01622c1280aa tempest-TestStampPattern-1122407784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-d8dbc52a-7d55-4220-af52-9d4db4cf33b3" returned: 0 in 0.231s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:08:45 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-89c39af9-b123-414d-af1a-01622c1280aa tempest-TestStampPattern-1122407784 None] Lock "cinder-quobyte-d8dbc52a-7d55-4220-af52-9d4db4cf33b3" released by "delete_volume" :: held 0.622s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 11:08:45 devstack cinder-volume[87272]: DEBUG cinder.quota [None req-89c39af9-b123-414d-af1a-01622c1280aa tempest-TestStampPattern-1122407784 None] Created reservations ['d6bd4340-7895-4812-9642-1a87c481624d', '37f7c3e3-5a1f-4b92-b214-11c9b6b8b23a', '8c071d6f-b203-4ed5-8ffe-303a1857528b', '84ff17d7-9141-4544-810e-3152977cfef1'] {{(pid=87272) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 11:08:45 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-89c39af9-b123-414d-af1a-01622c1280aa tempest-TestStampPattern-1122407784 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 11:08:45 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-89c39af9-b123-414d-af1a-01622c1280aa tempest-TestStampPattern-1122407784 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 11:08:45 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-89c39af9-b123-414d-af1a-01622c1280aa tempest-TestStampPattern-1122407784 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898': None} {{(pid=87272) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 11:08:45 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-89c39af9-b123-414d-af1a-01622c1280aa tempest-TestStampPattern-1122407784 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'] {{(pid=87272) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 11:08:45 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-89c39af9-b123-414d-af1a-01622c1280aa tempest-TestStampPattern-1122407784 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 11:08:45 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-89c39af9-b123-414d-af1a-01622c1280aa tempest-TestStampPattern-1122407784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:08:45 devstack sudo[106199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1 Nov 04 11:08:45 devstack sudo[106199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:08:45 devstack sudo[106199]: pam_unix(sudo:session): session closed for user root Nov 04 11:08:45 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-89c39af9-b123-414d-af1a-01622c1280aa tempest-TestStampPattern-1122407784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1" returned: 0 in 0.229s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:08:45 devstack cinder-volume[87272]: DEBUG cinder.manager [None req-89c39af9-b123-414d-af1a-01622c1280aa tempest-TestStampPattern-1122407784 None] Notifying Schedulers of capabilities ... {{(pid=87272) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 11:08:45 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-89c39af9-b123-414d-af1a-01622c1280aa tempest-TestStampPattern-1122407784 None] Deleted volume successfully. Nov 04 11:08:45 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-89c39af9-b123-414d-af1a-01622c1280aa tempest-TestStampPattern-1122407784 None] Lock "cinder-d8dbc52a-7d55-4220-af52-9d4db4cf33b3-delete_volume" released by "delete_volume" :: held 1.036s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 11:08:55 devstack cinder-volume[87272]: DEBUG dbcounter [-] [87272] Writing DB stats cinder:UPDATE=110,cinder:SELECT=84,cinder:DELETE=10,cinder:INSERT=28 {{(pid=87272) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 11:08:56 devstack cinder-volume[87272]: DEBUG dbcounter [-] [87272] Writing DB stats cinder:SELECT=93,cinder:UPDATE=113,cinder:INSERT=34,cinder:DELETE=8 {{(pid=87272) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 11:08:56 devstack cinder-volume[87272]: DEBUG cinder.volume.flows.manager.create_volume [None req-6481cafd-7ff7-47ca-8b86-96864b910a0d tempest-CreateVolumesFromImageTest-979736255 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87272) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 11:08:56 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-6481cafd-7ff7-47ca-8b86-96864b910a0d tempest-CreateVolumesFromImageTest-979736255 None] Flow 'volume_create_manager' (95697ccd-84db-4fda-88cd-759f0baab88d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 11:08:56 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-6481cafd-7ff7-47ca-8b86-96864b910a0d tempest-CreateVolumesFromImageTest-979736255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0a1a1a0-634c-4aa1-98ca-311fb46342ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:08:56 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-6481cafd-7ff7-47ca-8b86-96864b910a0d tempest-CreateVolumesFromImageTest-979736255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0a1a1a0-634c-4aa1-98ca-311fb46342ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T10:08:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-813799786',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ede5fd71-cd5e-4d51-8c4e-f3e74c5c0a71,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ecb1473880d744bba7f82ae92bfe1fa7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T10:08:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T10:08:57Z,use_quota=True,user_id='83223782a4904dff89c2ae158a6e49e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8989e4f-21e3-4f0a-9584-0d818784e883),volume_type_id=f8989e4f-21e3-4f0a-9584-0d818784e883)' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:08:56 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-6481cafd-7ff7-47ca-8b86-96864b910a0d tempest-CreateVolumesFromImageTest-979736255 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (95523318-4562-4e92-9d5f-c69a2cadeb2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:08:56 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-6481cafd-7ff7-47ca-8b86-96864b910a0d tempest-CreateVolumesFromImageTest-979736255 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (95523318-4562-4e92-9d5f-c69a2cadeb2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:08:56 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-6481cafd-7ff7-47ca-8b86-96864b910a0d tempest-CreateVolumesFromImageTest-979736255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4e95b57-62a8-4e8e-b7bb-1286af2b184c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:08:56 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-6481cafd-7ff7-47ca-8b86-96864b910a0d tempest-CreateVolumesFromImageTest-979736255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4e95b57-62a8-4e8e-b7bb-1286af2b184c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ede5fd71-cd5e-4d51-8c4e-f3e74c5c0a71', 'volume_name': 'volume-ede5fd71-cd5e-4d51-8c4e-f3e74c5c0a71', 'volume_size': 1}' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:08:56 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-6481cafd-7ff7-47ca-8b86-96864b910a0d tempest-CreateVolumesFromImageTest-979736255 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8bf3ce68-1b52-4c47-a1dd-8bae3eb13955) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:08:56 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-6481cafd-7ff7-47ca-8b86-96864b910a0d tempest-CreateVolumesFromImageTest-979736255 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8bf3ce68-1b52-4c47-a1dd-8bae3eb13955) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:08:56 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-6481cafd-7ff7-47ca-8b86-96864b910a0d tempest-CreateVolumesFromImageTest-979736255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50a5af84-f31b-4f49-8182-38e830ad9ff0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:08:56 devstack cinder-volume[87272]: INFO cinder.volume.flows.manager.create_volume [None req-6481cafd-7ff7-47ca-8b86-96864b910a0d tempest-CreateVolumesFromImageTest-979736255 None] Volume ede5fd71-cd5e-4d51-8c4e-f3e74c5c0a71: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ede5fd71-cd5e-4d51-8c4e-f3e74c5c0a71', 'volume_size': 1} Nov 04 11:08:56 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-6481cafd-7ff7-47ca-8b86-96864b910a0d tempest-CreateVolumesFromImageTest-979736255 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 11:08:56 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-6481cafd-7ff7-47ca-8b86-96864b910a0d tempest-CreateVolumesFromImageTest-979736255 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 11:08:56 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-6481cafd-7ff7-47ca-8b86-96864b910a0d tempest-CreateVolumesFromImageTest-979736255 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T10:08:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-813799786',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ede5fd71-cd5e-4d51-8c4e-f3e74c5c0a71,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ecb1473880d744bba7f82ae92bfe1fa7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T10:08:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T10:08:57Z,use_quota=True,user_id='83223782a4904dff89c2ae158a6e49e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8989e4f-21e3-4f0a-9584-0d818784e883),volume_type_id=f8989e4f-21e3-4f0a-9584-0d818784e883)}" {{(pid=87272) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 04 11:08:56 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.remotefs [None req-6481cafd-7ff7-47ca-8b86-96864b910a0d tempest-CreateVolumesFromImageTest-979736255 None] Creating volume ede5fd71-cd5e-4d51-8c4e-f3e74c5c0a71 {{(pid=87272) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 11:08:56 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-6481cafd-7ff7-47ca-8b86-96864b910a0d tempest-CreateVolumesFromImageTest-979736255 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 11:08:56 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-6481cafd-7ff7-47ca-8b86-96864b910a0d tempest-CreateVolumesFromImageTest-979736255 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 11:08:56 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-6481cafd-7ff7-47ca-8b86-96864b910a0d tempest-CreateVolumesFromImageTest-979736255 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898': None} {{(pid=87272) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 11:08:56 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-6481cafd-7ff7-47ca-8b86-96864b910a0d tempest-CreateVolumesFromImageTest-979736255 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'] {{(pid=87272) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 11:08:56 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-6481cafd-7ff7-47ca-8b86-96864b910a0d tempest-CreateVolumesFromImageTest-979736255 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 11:08:56 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-6481cafd-7ff7-47ca-8b86-96864b910a0d tempest-CreateVolumesFromImageTest-979736255 None] Selected osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898 as target Quobyte volume. {{(pid=87272) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 11:08:56 devstack cinder-volume[87272]: INFO cinder.volume.drivers.remotefs [None req-6481cafd-7ff7-47ca-8b86-96864b910a0d tempest-CreateVolumesFromImageTest-979736255 None] casted to osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898 Nov 04 11:08:56 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-6481cafd-7ff7-47ca-8b86-96864b910a0d tempest-CreateVolumesFromImageTest-979736255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-ede5fd71-cd5e-4d51-8c4e-f3e74c5c0a71 1073741824 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:08:56 devstack sudo[106210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-ede5fd71-cd5e-4d51-8c4e-f3e74c5c0a71 1073741824 Nov 04 11:08:56 devstack sudo[106210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:08:57 devstack cinder-volume[87272]: DEBUG cinder.volume.flows.manager.create_volume [None req-2d9fd816-3807-4e5a-9792-68b48845866e tempest-CreateVolumesFromImageTest-979736255 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87272) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 11:08:57 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-2d9fd816-3807-4e5a-9792-68b48845866e tempest-CreateVolumesFromImageTest-979736255 None] Flow 'volume_create_manager' (a7acf7cb-30dc-4a6e-ae08-8a464ddb9e7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 11:08:57 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-2d9fd816-3807-4e5a-9792-68b48845866e tempest-CreateVolumesFromImageTest-979736255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a1f450ab-4ef2-4333-be34-f3e551fe89d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:08:57 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-2d9fd816-3807-4e5a-9792-68b48845866e tempest-CreateVolumesFromImageTest-979736255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a1f450ab-4ef2-4333-be34-f3e551fe89d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T10:08:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1037433382',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c668c778-69f2-4759-b7ad-a727bff2a051,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ecb1473880d744bba7f82ae92bfe1fa7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T10:08:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T10:08:57Z,use_quota=True,user_id='83223782a4904dff89c2ae158a6e49e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8989e4f-21e3-4f0a-9584-0d818784e883),volume_type_id=f8989e4f-21e3-4f0a-9584-0d818784e883)' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:08:57 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-2d9fd816-3807-4e5a-9792-68b48845866e tempest-CreateVolumesFromImageTest-979736255 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e8168921-acc1-4be2-b098-944948c30490) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:08:57 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-2d9fd816-3807-4e5a-9792-68b48845866e tempest-CreateVolumesFromImageTest-979736255 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e8168921-acc1-4be2-b098-944948c30490) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:08:57 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-2d9fd816-3807-4e5a-9792-68b48845866e tempest-CreateVolumesFromImageTest-979736255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4ea9795-5441-4120-97ff-c0f5bb4b25e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:08:57 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-2d9fd816-3807-4e5a-9792-68b48845866e tempest-CreateVolumesFromImageTest-979736255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4ea9795-5441-4120-97ff-c0f5bb4b25e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c668c778-69f2-4759-b7ad-a727bff2a051', 'volume_name': 'volume-c668c778-69f2-4759-b7ad-a727bff2a051', 'volume_size': 1}' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:08:57 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-2d9fd816-3807-4e5a-9792-68b48845866e tempest-CreateVolumesFromImageTest-979736255 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d710519-55a0-4323-a0d5-d4b5563376bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:08:57 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-2d9fd816-3807-4e5a-9792-68b48845866e tempest-CreateVolumesFromImageTest-979736255 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d710519-55a0-4323-a0d5-d4b5563376bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:08:57 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-2d9fd816-3807-4e5a-9792-68b48845866e tempest-CreateVolumesFromImageTest-979736255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd0038d6-50f4-42d7-b8b6-8aa0b6c7e668) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:08:57 devstack cinder-volume[87272]: INFO cinder.volume.flows.manager.create_volume [None req-2d9fd816-3807-4e5a-9792-68b48845866e tempest-CreateVolumesFromImageTest-979736255 None] Volume c668c778-69f2-4759-b7ad-a727bff2a051: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c668c778-69f2-4759-b7ad-a727bff2a051', 'volume_size': 1} Nov 04 11:08:57 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-2d9fd816-3807-4e5a-9792-68b48845866e tempest-CreateVolumesFromImageTest-979736255 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 11:08:57 devstack sudo[106210]: pam_unix(sudo:session): session closed for user root Nov 04 11:08:57 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-6481cafd-7ff7-47ca-8b86-96864b910a0d tempest-CreateVolumesFromImageTest-979736255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-ede5fd71-cd5e-4d51-8c4e-f3e74c5c0a71 1073741824" returned: 0 in 0.603s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:08:57 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-6481cafd-7ff7-47ca-8b86-96864b910a0d tempest-CreateVolumesFromImageTest-979736255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-ede5fd71-cd5e-4d51-8c4e-f3e74c5c0a71 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:08:57 devstack sudo[106217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-ede5fd71-cd5e-4d51-8c4e-f3e74c5c0a71 Nov 04 11:08:57 devstack sudo[106217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:08:57 devstack cinder-volume[87272]: DEBUG cinder.volume.flows.manager.create_volume [None req-1895ba18-e5e1-42f6-8e1f-2f45c6aaa599 tempest-CreateVolumesFromImageTest-979736255 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87272) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 11:08:57 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-1895ba18-e5e1-42f6-8e1f-2f45c6aaa599 tempest-CreateVolumesFromImageTest-979736255 None] Flow 'volume_create_manager' (1f8360cb-4592-44ed-9b00-7ad0a201480e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 11:08:57 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-1895ba18-e5e1-42f6-8e1f-2f45c6aaa599 tempest-CreateVolumesFromImageTest-979736255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b2a814cb-29c7-4ac9-b59f-b33f1e30b4fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:08:57 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-1895ba18-e5e1-42f6-8e1f-2f45c6aaa599 tempest-CreateVolumesFromImageTest-979736255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b2a814cb-29c7-4ac9-b59f-b33f1e30b4fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T10:08:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1753045422',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1379a55c-5df5-4842-8229-669247a77f70,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ecb1473880d744bba7f82ae92bfe1fa7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T10:08:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T10:08:58Z,use_quota=True,user_id='83223782a4904dff89c2ae158a6e49e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8989e4f-21e3-4f0a-9584-0d818784e883),volume_type_id=f8989e4f-21e3-4f0a-9584-0d818784e883)' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:08:57 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-1895ba18-e5e1-42f6-8e1f-2f45c6aaa599 tempest-CreateVolumesFromImageTest-979736255 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a112dbf5-ca81-4b98-8027-fc8dbd202e49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:08:57 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-1895ba18-e5e1-42f6-8e1f-2f45c6aaa599 tempest-CreateVolumesFromImageTest-979736255 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a112dbf5-ca81-4b98-8027-fc8dbd202e49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:08:57 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-1895ba18-e5e1-42f6-8e1f-2f45c6aaa599 tempest-CreateVolumesFromImageTest-979736255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fac2c4bb-41c7-437c-9745-4ec337714a5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:08:57 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-1895ba18-e5e1-42f6-8e1f-2f45c6aaa599 tempest-CreateVolumesFromImageTest-979736255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fac2c4bb-41c7-437c-9745-4ec337714a5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1379a55c-5df5-4842-8229-669247a77f70', 'volume_name': 'volume-1379a55c-5df5-4842-8229-669247a77f70', 'volume_size': 1}' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:08:57 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-1895ba18-e5e1-42f6-8e1f-2f45c6aaa599 tempest-CreateVolumesFromImageTest-979736255 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ccafdde3-4fc8-4ab4-8ab6-1f5a2aa0dd62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:08:57 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-1895ba18-e5e1-42f6-8e1f-2f45c6aaa599 tempest-CreateVolumesFromImageTest-979736255 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ccafdde3-4fc8-4ab4-8ab6-1f5a2aa0dd62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:08:57 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-1895ba18-e5e1-42f6-8e1f-2f45c6aaa599 tempest-CreateVolumesFromImageTest-979736255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (78f58e93-059e-4daf-97a7-ee53302ea3e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:08:57 devstack cinder-volume[87272]: INFO cinder.volume.flows.manager.create_volume [None req-1895ba18-e5e1-42f6-8e1f-2f45c6aaa599 tempest-CreateVolumesFromImageTest-979736255 None] Volume 1379a55c-5df5-4842-8229-669247a77f70: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1379a55c-5df5-4842-8229-669247a77f70', 'volume_size': 1} Nov 04 11:08:57 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-1895ba18-e5e1-42f6-8e1f-2f45c6aaa599 tempest-CreateVolumesFromImageTest-979736255 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 11:08:57 devstack sudo[106217]: pam_unix(sudo:session): session closed for user root Nov 04 11:08:57 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-6481cafd-7ff7-47ca-8b86-96864b910a0d tempest-CreateVolumesFromImageTest-979736255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-ede5fd71-cd5e-4d51-8c4e-f3e74c5c0a71" returned: 0 in 0.335s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:08:57 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-6481cafd-7ff7-47ca-8b86-96864b910a0d tempest-CreateVolumesFromImageTest-979736255 None] <== create_volume: return (1009ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'} {{(pid=87272) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 04 11:08:57 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-6481cafd-7ff7-47ca-8b86-96864b910a0d tempest-CreateVolumesFromImageTest-979736255 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.012s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 11:08:57 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-2d9fd816-3807-4e5a-9792-68b48845866e tempest-CreateVolumesFromImageTest-979736255 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.582s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 11:08:57 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-2d9fd816-3807-4e5a-9792-68b48845866e tempest-CreateVolumesFromImageTest-979736255 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T10:08:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1037433382',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c668c778-69f2-4759-b7ad-a727bff2a051,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ecb1473880d744bba7f82ae92bfe1fa7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T10:08:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T10:08:57Z,use_quota=True,user_id='83223782a4904dff89c2ae158a6e49e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8989e4f-21e3-4f0a-9584-0d818784e883),volume_type_id=f8989e4f-21e3-4f0a-9584-0d818784e883)}" {{(pid=87272) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 04 11:08:57 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.remotefs [None req-2d9fd816-3807-4e5a-9792-68b48845866e tempest-CreateVolumesFromImageTest-979736255 None] Creating volume c668c778-69f2-4759-b7ad-a727bff2a051 {{(pid=87272) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 11:08:57 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-2d9fd816-3807-4e5a-9792-68b48845866e tempest-CreateVolumesFromImageTest-979736255 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 11:08:57 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-2d9fd816-3807-4e5a-9792-68b48845866e tempest-CreateVolumesFromImageTest-979736255 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 11:08:57 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-2d9fd816-3807-4e5a-9792-68b48845866e tempest-CreateVolumesFromImageTest-979736255 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898': None} {{(pid=87272) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 11:08:57 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-2d9fd816-3807-4e5a-9792-68b48845866e tempest-CreateVolumesFromImageTest-979736255 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'] {{(pid=87272) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 11:08:57 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-2d9fd816-3807-4e5a-9792-68b48845866e tempest-CreateVolumesFromImageTest-979736255 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 11:08:57 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-2d9fd816-3807-4e5a-9792-68b48845866e tempest-CreateVolumesFromImageTest-979736255 None] Selected osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898 as target Quobyte volume. {{(pid=87272) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 11:08:57 devstack cinder-volume[87272]: INFO cinder.volume.drivers.remotefs [None req-2d9fd816-3807-4e5a-9792-68b48845866e tempest-CreateVolumesFromImageTest-979736255 None] casted to osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898 Nov 04 11:08:57 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-2d9fd816-3807-4e5a-9792-68b48845866e tempest-CreateVolumesFromImageTest-979736255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-c668c778-69f2-4759-b7ad-a727bff2a051 1073741824 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:08:57 devstack sudo[106220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-c668c778-69f2-4759-b7ad-a727bff2a051 1073741824 Nov 04 11:08:57 devstack sudo[106220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:08:57 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-6481cafd-7ff7-47ca-8b86-96864b910a0d tempest-CreateVolumesFromImageTest-979736255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50a5af84-f31b-4f49-8182-38e830ad9ff0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ede5fd71-cd5e-4d51-8c4e-f3e74c5c0a71', 'volume_size': 1}' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:08:57 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-6481cafd-7ff7-47ca-8b86-96864b910a0d tempest-CreateVolumesFromImageTest-979736255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9925d24a-e78f-4d3e-9cb5-3f8e50c5b28b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:08:57 devstack cinder-volume[87272]: INFO cinder.volume.flows.manager.create_volume [None req-6481cafd-7ff7-47ca-8b86-96864b910a0d tempest-CreateVolumesFromImageTest-979736255 None] Volume volume-ede5fd71-cd5e-4d51-8c4e-f3e74c5c0a71 (ede5fd71-cd5e-4d51-8c4e-f3e74c5c0a71): created successfully Nov 04 11:08:57 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-6481cafd-7ff7-47ca-8b86-96864b910a0d tempest-CreateVolumesFromImageTest-979736255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9925d24a-e78f-4d3e-9cb5-3f8e50c5b28b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:08:58 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-6481cafd-7ff7-47ca-8b86-96864b910a0d tempest-CreateVolumesFromImageTest-979736255 None] Flow 'volume_create_manager' (95697ccd-84db-4fda-88cd-759f0baab88d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87272) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 11:08:58 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-6481cafd-7ff7-47ca-8b86-96864b910a0d tempest-CreateVolumesFromImageTest-979736255 None] Created volume successfully. Nov 04 11:08:58 devstack cinder-volume[87272]: DEBUG cinder.volume.flows.manager.create_volume [None req-fa356373-eaef-44ba-99c7-342b009b54cb tempest-CreateVolumesFromImageTest-979736255 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87272) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 11:08:58 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-fa356373-eaef-44ba-99c7-342b009b54cb tempest-CreateVolumesFromImageTest-979736255 None] Flow 'volume_create_manager' (d2b1cd45-db27-4f3d-9ad2-10e7a5aa1a8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 11:08:58 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-fa356373-eaef-44ba-99c7-342b009b54cb tempest-CreateVolumesFromImageTest-979736255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8cd2dce6-573a-418d-b3dc-2d893f998c64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:08:58 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-fa356373-eaef-44ba-99c7-342b009b54cb tempest-CreateVolumesFromImageTest-979736255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8cd2dce6-573a-418d-b3dc-2d893f998c64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T10:08:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1716217649',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c1fcd9a2-84ca-467b-940d-ec02c6d7adf5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ecb1473880d744bba7f82ae92bfe1fa7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T10:08:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T10:08:58Z,use_quota=True,user_id='83223782a4904dff89c2ae158a6e49e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8989e4f-21e3-4f0a-9584-0d818784e883),volume_type_id=f8989e4f-21e3-4f0a-9584-0d818784e883)' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:08:58 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-fa356373-eaef-44ba-99c7-342b009b54cb tempest-CreateVolumesFromImageTest-979736255 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5052eab6-2972-4bc6-a6e4-4d0a366b323b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:08:58 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-fa356373-eaef-44ba-99c7-342b009b54cb tempest-CreateVolumesFromImageTest-979736255 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5052eab6-2972-4bc6-a6e4-4d0a366b323b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:08:58 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-fa356373-eaef-44ba-99c7-342b009b54cb tempest-CreateVolumesFromImageTest-979736255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8fde37ca-499b-449e-9237-b1ff3c84e01e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:08:58 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-fa356373-eaef-44ba-99c7-342b009b54cb tempest-CreateVolumesFromImageTest-979736255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8fde37ca-499b-449e-9237-b1ff3c84e01e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c1fcd9a2-84ca-467b-940d-ec02c6d7adf5', 'volume_name': 'volume-c1fcd9a2-84ca-467b-940d-ec02c6d7adf5', 'volume_size': 1}' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:08:58 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-fa356373-eaef-44ba-99c7-342b009b54cb tempest-CreateVolumesFromImageTest-979736255 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3528d711-f2ae-40cb-a630-bcf77f876830) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:08:58 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-fa356373-eaef-44ba-99c7-342b009b54cb tempest-CreateVolumesFromImageTest-979736255 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3528d711-f2ae-40cb-a630-bcf77f876830) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:08:58 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-fa356373-eaef-44ba-99c7-342b009b54cb tempest-CreateVolumesFromImageTest-979736255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (03eb411e-9637-4ab3-b0ba-b16ade7786e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:08:58 devstack cinder-volume[87272]: INFO cinder.volume.flows.manager.create_volume [None req-fa356373-eaef-44ba-99c7-342b009b54cb tempest-CreateVolumesFromImageTest-979736255 None] Volume c1fcd9a2-84ca-467b-940d-ec02c6d7adf5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c1fcd9a2-84ca-467b-940d-ec02c6d7adf5', 'volume_size': 1} Nov 04 11:08:58 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-fa356373-eaef-44ba-99c7-342b009b54cb tempest-CreateVolumesFromImageTest-979736255 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 11:08:58 devstack sudo[106220]: pam_unix(sudo:session): session closed for user root Nov 04 11:08:58 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-2d9fd816-3807-4e5a-9792-68b48845866e tempest-CreateVolumesFromImageTest-979736255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-c668c778-69f2-4759-b7ad-a727bff2a051 1073741824" returned: 0 in 0.497s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:08:58 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-2d9fd816-3807-4e5a-9792-68b48845866e tempest-CreateVolumesFromImageTest-979736255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-c668c778-69f2-4759-b7ad-a727bff2a051 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:08:58 devstack sudo[106226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-c668c778-69f2-4759-b7ad-a727bff2a051 Nov 04 11:08:58 devstack sudo[106226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:08:58 devstack cinder-volume[87272]: DEBUG cinder.volume.flows.manager.create_volume [None req-f56a41d6-85b3-4cc8-87f5-a320380ae68d tempest-CreateVolumesFromImageTest-979736255 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87272) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 11:08:58 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-f56a41d6-85b3-4cc8-87f5-a320380ae68d tempest-CreateVolumesFromImageTest-979736255 None] Flow 'volume_create_manager' (e1e79cef-1d99-49cd-9c7a-c44b84f9913f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 11:08:58 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-f56a41d6-85b3-4cc8-87f5-a320380ae68d tempest-CreateVolumesFromImageTest-979736255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5d1a342-6522-4391-92fb-866a7874eb64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:08:58 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-f56a41d6-85b3-4cc8-87f5-a320380ae68d tempest-CreateVolumesFromImageTest-979736255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5d1a342-6522-4391-92fb-866a7874eb64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T10:08:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1496391924',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b649792-356b-4f0c-aae7-4ca92289dc3a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ecb1473880d744bba7f82ae92bfe1fa7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T10:08:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T10:08:59Z,use_quota=True,user_id='83223782a4904dff89c2ae158a6e49e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8989e4f-21e3-4f0a-9584-0d818784e883),volume_type_id=f8989e4f-21e3-4f0a-9584-0d818784e883)' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:08:58 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-f56a41d6-85b3-4cc8-87f5-a320380ae68d tempest-CreateVolumesFromImageTest-979736255 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (05710c4f-7227-4468-82d0-f38aeb9f52a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:08:58 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-f56a41d6-85b3-4cc8-87f5-a320380ae68d tempest-CreateVolumesFromImageTest-979736255 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (05710c4f-7227-4468-82d0-f38aeb9f52a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:08:58 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-f56a41d6-85b3-4cc8-87f5-a320380ae68d tempest-CreateVolumesFromImageTest-979736255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (53dcf5f3-2997-43b7-a64c-b17f2f1b0d24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:08:58 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-f56a41d6-85b3-4cc8-87f5-a320380ae68d tempest-CreateVolumesFromImageTest-979736255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (53dcf5f3-2997-43b7-a64c-b17f2f1b0d24) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6b649792-356b-4f0c-aae7-4ca92289dc3a', 'volume_name': 'volume-6b649792-356b-4f0c-aae7-4ca92289dc3a', 'volume_size': 1}' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:08:58 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-f56a41d6-85b3-4cc8-87f5-a320380ae68d tempest-CreateVolumesFromImageTest-979736255 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8373e40-aa9d-4175-8509-e1fccc9b0bac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:08:58 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-f56a41d6-85b3-4cc8-87f5-a320380ae68d tempest-CreateVolumesFromImageTest-979736255 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8373e40-aa9d-4175-8509-e1fccc9b0bac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:08:58 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-f56a41d6-85b3-4cc8-87f5-a320380ae68d tempest-CreateVolumesFromImageTest-979736255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c1b94e3a-444b-4262-8253-2f27ef97e407) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:08:58 devstack cinder-volume[87272]: INFO cinder.volume.flows.manager.create_volume [None req-f56a41d6-85b3-4cc8-87f5-a320380ae68d tempest-CreateVolumesFromImageTest-979736255 None] Volume 6b649792-356b-4f0c-aae7-4ca92289dc3a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6b649792-356b-4f0c-aae7-4ca92289dc3a', 'volume_size': 1} Nov 04 11:08:58 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-f56a41d6-85b3-4cc8-87f5-a320380ae68d tempest-CreateVolumesFromImageTest-979736255 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 11:08:58 devstack sudo[106226]: pam_unix(sudo:session): session closed for user root Nov 04 11:08:58 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-2d9fd816-3807-4e5a-9792-68b48845866e tempest-CreateVolumesFromImageTest-979736255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-c668c778-69f2-4759-b7ad-a727bff2a051" returned: 0 in 0.261s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:08:58 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-2d9fd816-3807-4e5a-9792-68b48845866e tempest-CreateVolumesFromImageTest-979736255 None] <== create_volume: return (813ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'} {{(pid=87272) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 04 11:08:58 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-2d9fd816-3807-4e5a-9792-68b48845866e tempest-CreateVolumesFromImageTest-979736255 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.817s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 11:08:58 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-1895ba18-e5e1-42f6-8e1f-2f45c6aaa599 tempest-CreateVolumesFromImageTest-979736255 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.895s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 11:08:58 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-1895ba18-e5e1-42f6-8e1f-2f45c6aaa599 tempest-CreateVolumesFromImageTest-979736255 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T10:08:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1753045422',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1379a55c-5df5-4842-8229-669247a77f70,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ecb1473880d744bba7f82ae92bfe1fa7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T10:08:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T10:08:58Z,use_quota=True,user_id='83223782a4904dff89c2ae158a6e49e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8989e4f-21e3-4f0a-9584-0d818784e883),volume_type_id=f8989e4f-21e3-4f0a-9584-0d818784e883)}" {{(pid=87272) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 04 11:08:58 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.remotefs [None req-1895ba18-e5e1-42f6-8e1f-2f45c6aaa599 tempest-CreateVolumesFromImageTest-979736255 None] Creating volume 1379a55c-5df5-4842-8229-669247a77f70 {{(pid=87272) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 11:08:58 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-1895ba18-e5e1-42f6-8e1f-2f45c6aaa599 tempest-CreateVolumesFromImageTest-979736255 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 11:08:58 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-1895ba18-e5e1-42f6-8e1f-2f45c6aaa599 tempest-CreateVolumesFromImageTest-979736255 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 11:08:58 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-1895ba18-e5e1-42f6-8e1f-2f45c6aaa599 tempest-CreateVolumesFromImageTest-979736255 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898': None} {{(pid=87272) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 11:08:58 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-1895ba18-e5e1-42f6-8e1f-2f45c6aaa599 tempest-CreateVolumesFromImageTest-979736255 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'] {{(pid=87272) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 11:08:58 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-1895ba18-e5e1-42f6-8e1f-2f45c6aaa599 tempest-CreateVolumesFromImageTest-979736255 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 11:08:58 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-1895ba18-e5e1-42f6-8e1f-2f45c6aaa599 tempest-CreateVolumesFromImageTest-979736255 None] Selected osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898 as target Quobyte volume. {{(pid=87272) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 11:08:58 devstack cinder-volume[87272]: INFO cinder.volume.drivers.remotefs [None req-1895ba18-e5e1-42f6-8e1f-2f45c6aaa599 tempest-CreateVolumesFromImageTest-979736255 None] casted to osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898 Nov 04 11:08:58 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-1895ba18-e5e1-42f6-8e1f-2f45c6aaa599 tempest-CreateVolumesFromImageTest-979736255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-1379a55c-5df5-4842-8229-669247a77f70 1073741824 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:08:58 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-2d9fd816-3807-4e5a-9792-68b48845866e tempest-CreateVolumesFromImageTest-979736255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd0038d6-50f4-42d7-b8b6-8aa0b6c7e668) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c668c778-69f2-4759-b7ad-a727bff2a051', 'volume_size': 1}' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:08:58 devstack sudo[106229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-1379a55c-5df5-4842-8229-669247a77f70 1073741824 Nov 04 11:08:58 devstack sudo[106229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:08:58 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-2d9fd816-3807-4e5a-9792-68b48845866e tempest-CreateVolumesFromImageTest-979736255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb817878-9149-4dd2-a721-c2de7a742f28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:08:58 devstack cinder-volume[87272]: INFO cinder.volume.flows.manager.create_volume [None req-2d9fd816-3807-4e5a-9792-68b48845866e tempest-CreateVolumesFromImageTest-979736255 None] Volume volume-c668c778-69f2-4759-b7ad-a727bff2a051 (c668c778-69f2-4759-b7ad-a727bff2a051): created successfully Nov 04 11:08:58 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-2d9fd816-3807-4e5a-9792-68b48845866e tempest-CreateVolumesFromImageTest-979736255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb817878-9149-4dd2-a721-c2de7a742f28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:08:58 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-2d9fd816-3807-4e5a-9792-68b48845866e tempest-CreateVolumesFromImageTest-979736255 None] Flow 'volume_create_manager' (a7acf7cb-30dc-4a6e-ae08-8a464ddb9e7d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87272) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 11:08:58 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-2d9fd816-3807-4e5a-9792-68b48845866e tempest-CreateVolumesFromImageTest-979736255 None] Created volume successfully. Nov 04 11:08:59 devstack sudo[106229]: pam_unix(sudo:session): session closed for user root Nov 04 11:08:59 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-1895ba18-e5e1-42f6-8e1f-2f45c6aaa599 tempest-CreateVolumesFromImageTest-979736255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-1379a55c-5df5-4842-8229-669247a77f70 1073741824" returned: 0 in 0.426s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:08:59 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-1895ba18-e5e1-42f6-8e1f-2f45c6aaa599 tempest-CreateVolumesFromImageTest-979736255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-1379a55c-5df5-4842-8229-669247a77f70 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:08:59 devstack sudo[106234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-1379a55c-5df5-4842-8229-669247a77f70 Nov 04 11:08:59 devstack sudo[106234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:08:59 devstack sudo[106234]: pam_unix(sudo:session): session closed for user root Nov 04 11:08:59 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-1895ba18-e5e1-42f6-8e1f-2f45c6aaa599 tempest-CreateVolumesFromImageTest-979736255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-1379a55c-5df5-4842-8229-669247a77f70" returned: 0 in 0.236s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:08:59 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-1895ba18-e5e1-42f6-8e1f-2f45c6aaa599 tempest-CreateVolumesFromImageTest-979736255 None] <== create_volume: return (705ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'} {{(pid=87272) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 04 11:08:59 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-1895ba18-e5e1-42f6-8e1f-2f45c6aaa599 tempest-CreateVolumesFromImageTest-979736255 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.707s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 11:08:59 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-fa356373-eaef-44ba-99c7-342b009b54cb tempest-CreateVolumesFromImageTest-979736255 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.169s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 11:08:59 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-fa356373-eaef-44ba-99c7-342b009b54cb tempest-CreateVolumesFromImageTest-979736255 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T10:08:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1716217649',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c1fcd9a2-84ca-467b-940d-ec02c6d7adf5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ecb1473880d744bba7f82ae92bfe1fa7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T10:08:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T10:08:58Z,use_quota=True,user_id='83223782a4904dff89c2ae158a6e49e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8989e4f-21e3-4f0a-9584-0d818784e883),volume_type_id=f8989e4f-21e3-4f0a-9584-0d818784e883)}" {{(pid=87272) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 04 11:08:59 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.remotefs [None req-fa356373-eaef-44ba-99c7-342b009b54cb tempest-CreateVolumesFromImageTest-979736255 None] Creating volume c1fcd9a2-84ca-467b-940d-ec02c6d7adf5 {{(pid=87272) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 11:08:59 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-fa356373-eaef-44ba-99c7-342b009b54cb tempest-CreateVolumesFromImageTest-979736255 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 11:08:59 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-fa356373-eaef-44ba-99c7-342b009b54cb tempest-CreateVolumesFromImageTest-979736255 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 11:08:59 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-fa356373-eaef-44ba-99c7-342b009b54cb tempest-CreateVolumesFromImageTest-979736255 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898': None} {{(pid=87272) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 11:08:59 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-fa356373-eaef-44ba-99c7-342b009b54cb tempest-CreateVolumesFromImageTest-979736255 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'] {{(pid=87272) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 11:08:59 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-fa356373-eaef-44ba-99c7-342b009b54cb tempest-CreateVolumesFromImageTest-979736255 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 11:08:59 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-fa356373-eaef-44ba-99c7-342b009b54cb tempest-CreateVolumesFromImageTest-979736255 None] Selected osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898 as target Quobyte volume. {{(pid=87272) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 11:08:59 devstack cinder-volume[87272]: INFO cinder.volume.drivers.remotefs [None req-fa356373-eaef-44ba-99c7-342b009b54cb tempest-CreateVolumesFromImageTest-979736255 None] casted to osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898 Nov 04 11:08:59 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-fa356373-eaef-44ba-99c7-342b009b54cb tempest-CreateVolumesFromImageTest-979736255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-c1fcd9a2-84ca-467b-940d-ec02c6d7adf5 1073741824 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:08:59 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-1895ba18-e5e1-42f6-8e1f-2f45c6aaa599 tempest-CreateVolumesFromImageTest-979736255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (78f58e93-059e-4daf-97a7-ee53302ea3e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1379a55c-5df5-4842-8229-669247a77f70', 'volume_size': 1}' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:08:59 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-1895ba18-e5e1-42f6-8e1f-2f45c6aaa599 tempest-CreateVolumesFromImageTest-979736255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a1b1178-1515-43d2-96cb-0f75492abc99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:08:59 devstack sudo[106237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-c1fcd9a2-84ca-467b-940d-ec02c6d7adf5 1073741824 Nov 04 11:08:59 devstack sudo[106237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:08:59 devstack cinder-volume[87272]: INFO cinder.volume.flows.manager.create_volume [None req-1895ba18-e5e1-42f6-8e1f-2f45c6aaa599 tempest-CreateVolumesFromImageTest-979736255 None] Volume volume-1379a55c-5df5-4842-8229-669247a77f70 (1379a55c-5df5-4842-8229-669247a77f70): created successfully Nov 04 11:08:59 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-1895ba18-e5e1-42f6-8e1f-2f45c6aaa599 tempest-CreateVolumesFromImageTest-979736255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a1b1178-1515-43d2-96cb-0f75492abc99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:08:59 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-1895ba18-e5e1-42f6-8e1f-2f45c6aaa599 tempest-CreateVolumesFromImageTest-979736255 None] Flow 'volume_create_manager' (1f8360cb-4592-44ed-9b00-7ad0a201480e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87272) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 11:08:59 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-1895ba18-e5e1-42f6-8e1f-2f45c6aaa599 tempest-CreateVolumesFromImageTest-979736255 None] Created volume successfully. Nov 04 11:08:59 devstack sudo[106237]: pam_unix(sudo:session): session closed for user root Nov 04 11:08:59 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-fa356373-eaef-44ba-99c7-342b009b54cb tempest-CreateVolumesFromImageTest-979736255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-c1fcd9a2-84ca-467b-940d-ec02c6d7adf5 1073741824" returned: 0 in 0.442s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:08:59 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-fa356373-eaef-44ba-99c7-342b009b54cb tempest-CreateVolumesFromImageTest-979736255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-c1fcd9a2-84ca-467b-940d-ec02c6d7adf5 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:08:59 devstack sudo[106242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-c1fcd9a2-84ca-467b-940d-ec02c6d7adf5 Nov 04 11:08:59 devstack sudo[106242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:09:00 devstack sudo[106242]: pam_unix(sudo:session): session closed for user root Nov 04 11:09:00 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-fa356373-eaef-44ba-99c7-342b009b54cb tempest-CreateVolumesFromImageTest-979736255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-c1fcd9a2-84ca-467b-940d-ec02c6d7adf5" returned: 0 in 0.264s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:09:00 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-fa356373-eaef-44ba-99c7-342b009b54cb tempest-CreateVolumesFromImageTest-979736255 None] <== create_volume: return (747ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'} {{(pid=87272) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 04 11:09:00 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-fa356373-eaef-44ba-99c7-342b009b54cb tempest-CreateVolumesFromImageTest-979736255 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.750s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 11:09:00 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-f56a41d6-85b3-4cc8-87f5-a320380ae68d tempest-CreateVolumesFromImageTest-979736255 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.519s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 11:09:00 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-f56a41d6-85b3-4cc8-87f5-a320380ae68d tempest-CreateVolumesFromImageTest-979736255 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T10:08:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1496391924',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b649792-356b-4f0c-aae7-4ca92289dc3a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ecb1473880d744bba7f82ae92bfe1fa7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T10:08:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T10:08:59Z,use_quota=True,user_id='83223782a4904dff89c2ae158a6e49e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8989e4f-21e3-4f0a-9584-0d818784e883),volume_type_id=f8989e4f-21e3-4f0a-9584-0d818784e883)}" {{(pid=87272) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 04 11:09:00 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.remotefs [None req-f56a41d6-85b3-4cc8-87f5-a320380ae68d tempest-CreateVolumesFromImageTest-979736255 None] Creating volume 6b649792-356b-4f0c-aae7-4ca92289dc3a {{(pid=87272) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 11:09:00 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-f56a41d6-85b3-4cc8-87f5-a320380ae68d tempest-CreateVolumesFromImageTest-979736255 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 11:09:00 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-f56a41d6-85b3-4cc8-87f5-a320380ae68d tempest-CreateVolumesFromImageTest-979736255 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 11:09:00 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-f56a41d6-85b3-4cc8-87f5-a320380ae68d tempest-CreateVolumesFromImageTest-979736255 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898': None} {{(pid=87272) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 11:09:00 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-f56a41d6-85b3-4cc8-87f5-a320380ae68d tempest-CreateVolumesFromImageTest-979736255 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'] {{(pid=87272) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 11:09:00 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-f56a41d6-85b3-4cc8-87f5-a320380ae68d tempest-CreateVolumesFromImageTest-979736255 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 11:09:00 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-f56a41d6-85b3-4cc8-87f5-a320380ae68d tempest-CreateVolumesFromImageTest-979736255 None] Selected osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898 as target Quobyte volume. {{(pid=87272) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 11:09:00 devstack cinder-volume[87272]: INFO cinder.volume.drivers.remotefs [None req-f56a41d6-85b3-4cc8-87f5-a320380ae68d tempest-CreateVolumesFromImageTest-979736255 None] casted to osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898 Nov 04 11:09:00 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-f56a41d6-85b3-4cc8-87f5-a320380ae68d tempest-CreateVolumesFromImageTest-979736255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-6b649792-356b-4f0c-aae7-4ca92289dc3a 1073741824 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:09:00 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-fa356373-eaef-44ba-99c7-342b009b54cb tempest-CreateVolumesFromImageTest-979736255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (03eb411e-9637-4ab3-b0ba-b16ade7786e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c1fcd9a2-84ca-467b-940d-ec02c6d7adf5', 'volume_size': 1}' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:09:00 devstack sudo[106245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-6b649792-356b-4f0c-aae7-4ca92289dc3a 1073741824 Nov 04 11:09:00 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-fa356373-eaef-44ba-99c7-342b009b54cb tempest-CreateVolumesFromImageTest-979736255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d930a529-d362-49bd-ae65-510973ac8d96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:09:00 devstack sudo[106245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:09:00 devstack cinder-volume[87272]: INFO cinder.volume.flows.manager.create_volume [None req-fa356373-eaef-44ba-99c7-342b009b54cb tempest-CreateVolumesFromImageTest-979736255 None] Volume volume-c1fcd9a2-84ca-467b-940d-ec02c6d7adf5 (c1fcd9a2-84ca-467b-940d-ec02c6d7adf5): created successfully Nov 04 11:09:00 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-fa356373-eaef-44ba-99c7-342b009b54cb tempest-CreateVolumesFromImageTest-979736255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d930a529-d362-49bd-ae65-510973ac8d96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:09:00 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-fa356373-eaef-44ba-99c7-342b009b54cb tempest-CreateVolumesFromImageTest-979736255 None] Flow 'volume_create_manager' (d2b1cd45-db27-4f3d-9ad2-10e7a5aa1a8a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87272) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 11:09:00 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-fa356373-eaef-44ba-99c7-342b009b54cb tempest-CreateVolumesFromImageTest-979736255 None] Created volume successfully. Nov 04 11:09:00 devstack sudo[106245]: pam_unix(sudo:session): session closed for user root Nov 04 11:09:00 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-f56a41d6-85b3-4cc8-87f5-a320380ae68d tempest-CreateVolumesFromImageTest-979736255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-6b649792-356b-4f0c-aae7-4ca92289dc3a 1073741824" returned: 0 in 0.401s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:09:00 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-f56a41d6-85b3-4cc8-87f5-a320380ae68d tempest-CreateVolumesFromImageTest-979736255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-6b649792-356b-4f0c-aae7-4ca92289dc3a {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:09:00 devstack sudo[106251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-6b649792-356b-4f0c-aae7-4ca92289dc3a Nov 04 11:09:00 devstack sudo[106251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:09:00 devstack sudo[106251]: pam_unix(sudo:session): session closed for user root Nov 04 11:09:00 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-f56a41d6-85b3-4cc8-87f5-a320380ae68d tempest-CreateVolumesFromImageTest-979736255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-6b649792-356b-4f0c-aae7-4ca92289dc3a" returned: 0 in 0.235s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:09:00 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-f56a41d6-85b3-4cc8-87f5-a320380ae68d tempest-CreateVolumesFromImageTest-979736255 None] <== create_volume: return (675ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'} {{(pid=87272) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 04 11:09:00 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-f56a41d6-85b3-4cc8-87f5-a320380ae68d tempest-CreateVolumesFromImageTest-979736255 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.678s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 11:09:00 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-f56a41d6-85b3-4cc8-87f5-a320380ae68d tempest-CreateVolumesFromImageTest-979736255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c1b94e3a-444b-4262-8253-2f27ef97e407) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6b649792-356b-4f0c-aae7-4ca92289dc3a', 'volume_size': 1}' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:09:00 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-f56a41d6-85b3-4cc8-87f5-a320380ae68d tempest-CreateVolumesFromImageTest-979736255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d738e83c-cf80-4d41-a9c6-eb9164c6ba9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:09:00 devstack cinder-volume[87272]: INFO cinder.volume.flows.manager.create_volume [None req-f56a41d6-85b3-4cc8-87f5-a320380ae68d tempest-CreateVolumesFromImageTest-979736255 None] Volume volume-6b649792-356b-4f0c-aae7-4ca92289dc3a (6b649792-356b-4f0c-aae7-4ca92289dc3a): created successfully Nov 04 11:09:00 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-f56a41d6-85b3-4cc8-87f5-a320380ae68d tempest-CreateVolumesFromImageTest-979736255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d738e83c-cf80-4d41-a9c6-eb9164c6ba9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:09:00 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-f56a41d6-85b3-4cc8-87f5-a320380ae68d tempest-CreateVolumesFromImageTest-979736255 None] Flow 'volume_create_manager' (e1e79cef-1d99-49cd-9c7a-c44b84f9913f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87272) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 11:09:00 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-f56a41d6-85b3-4cc8-87f5-a320380ae68d tempest-CreateVolumesFromImageTest-979736255 None] Created volume successfully. Nov 04 11:09:01 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-7de33787-0d21-47a3-a1c0-267eb98e6215 tempest-CreateVolumesFromImageTest-979736255 None] Acquiring lock "cinder-6b649792-356b-4f0c-aae7-4ca92289dc3a-delete_volume" by "delete_volume" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 11:09:02 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-7de33787-0d21-47a3-a1c0-267eb98e6215 tempest-CreateVolumesFromImageTest-979736255 None] Lock "cinder-6b649792-356b-4f0c-aae7-4ca92289dc3a-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 11:09:02 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-7de33787-0d21-47a3-a1c0-267eb98e6215 tempest-CreateVolumesFromImageTest-979736255 None] Acquiring lock "cinder-quobyte-6b649792-356b-4f0c-aae7-4ca92289dc3a" by "delete_volume" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 11:09:02 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-7de33787-0d21-47a3-a1c0-267eb98e6215 tempest-CreateVolumesFromImageTest-979736255 None] Lock "cinder-quobyte-6b649792-356b-4f0c-aae7-4ca92289dc3a" acquired by "delete_volume" :: waited 0.020s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 11:09:02 devstack cinder-volume[87272]: DEBUG oslo.privsep.daemon [-] privsep: reply[e38e5fd9-8031-4ae1-8a61-1e80d5a84631]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 11:09:02 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-7de33787-0d21-47a3-a1c0-267eb98e6215 tempest-CreateVolumesFromImageTest-979736255 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-6b649792-356b-4f0c-aae7-4ca92289dc3a {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:09:02 devstack sudo[106254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-6b649792-356b-4f0c-aae7-4ca92289dc3a Nov 04 11:09:02 devstack sudo[106254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:09:02 devstack sudo[106254]: pam_unix(sudo:session): session closed for user root Nov 04 11:09:02 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-7de33787-0d21-47a3-a1c0-267eb98e6215 tempest-CreateVolumesFromImageTest-979736255 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-6b649792-356b-4f0c-aae7-4ca92289dc3a" returned: 0 in 0.388s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:09:02 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-7de33787-0d21-47a3-a1c0-267eb98e6215 tempest-CreateVolumesFromImageTest-979736255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-6b649792-356b-4f0c-aae7-4ca92289dc3a {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:09:02 devstack sudo[106259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-6b649792-356b-4f0c-aae7-4ca92289dc3a Nov 04 11:09:02 devstack sudo[106259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:09:02 devstack sudo[106259]: pam_unix(sudo:session): session closed for user root Nov 04 11:09:02 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-7de33787-0d21-47a3-a1c0-267eb98e6215 tempest-CreateVolumesFromImageTest-979736255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-6b649792-356b-4f0c-aae7-4ca92289dc3a" returned: 0 in 0.248s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:09:02 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-7de33787-0d21-47a3-a1c0-267eb98e6215 tempest-CreateVolumesFromImageTest-979736255 None] Lock "cinder-quobyte-6b649792-356b-4f0c-aae7-4ca92289dc3a" released by "delete_volume" :: held 0.676s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 11:09:02 devstack cinder-volume[87272]: DEBUG cinder.quota [None req-7de33787-0d21-47a3-a1c0-267eb98e6215 tempest-CreateVolumesFromImageTest-979736255 None] Created reservations ['e5017df1-53a8-4104-8657-0754adb8a4b0', '8e629e06-e621-43a1-b7f4-0936fbedaf35', 'a0fd70af-100b-4a76-9483-e22d12345a52', 'cfdaf1bf-6562-46d9-95cc-675a1daddf9f'] {{(pid=87272) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 11:09:02 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-7de33787-0d21-47a3-a1c0-267eb98e6215 tempest-CreateVolumesFromImageTest-979736255 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 11:09:02 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-7de33787-0d21-47a3-a1c0-267eb98e6215 tempest-CreateVolumesFromImageTest-979736255 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 11:09:02 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-7de33787-0d21-47a3-a1c0-267eb98e6215 tempest-CreateVolumesFromImageTest-979736255 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898': None} {{(pid=87272) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 11:09:02 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-7de33787-0d21-47a3-a1c0-267eb98e6215 tempest-CreateVolumesFromImageTest-979736255 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'] {{(pid=87272) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 11:09:02 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-7de33787-0d21-47a3-a1c0-267eb98e6215 tempest-CreateVolumesFromImageTest-979736255 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 11:09:02 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-7de33787-0d21-47a3-a1c0-267eb98e6215 tempest-CreateVolumesFromImageTest-979736255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:09:02 devstack sudo[106262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1 Nov 04 11:09:02 devstack sudo[106262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:09:03 devstack sudo[106262]: pam_unix(sudo:session): session closed for user root Nov 04 11:09:03 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-7de33787-0d21-47a3-a1c0-267eb98e6215 tempest-CreateVolumesFromImageTest-979736255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1" returned: 0 in 0.250s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:09:03 devstack cinder-volume[87272]: DEBUG cinder.manager [None req-7de33787-0d21-47a3-a1c0-267eb98e6215 tempest-CreateVolumesFromImageTest-979736255 None] Notifying Schedulers of capabilities ... {{(pid=87272) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 11:09:03 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-7de33787-0d21-47a3-a1c0-267eb98e6215 tempest-CreateVolumesFromImageTest-979736255 None] Deleted volume successfully. Nov 04 11:09:03 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-51a20ced-dcb8-4686-ad28-54f5d38f192c tempest-CreateVolumesFromImageTest-979736255 None] Acquiring lock "cinder-c1fcd9a2-84ca-467b-940d-ec02c6d7adf5-delete_volume" by "delete_volume" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 11:09:03 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-7de33787-0d21-47a3-a1c0-267eb98e6215 tempest-CreateVolumesFromImageTest-979736255 None] Lock "cinder-6b649792-356b-4f0c-aae7-4ca92289dc3a-delete_volume" released by "delete_volume" :: held 1.188s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 11:09:03 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-51a20ced-dcb8-4686-ad28-54f5d38f192c tempest-CreateVolumesFromImageTest-979736255 None] Lock "cinder-c1fcd9a2-84ca-467b-940d-ec02c6d7adf5-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 11:09:03 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-51a20ced-dcb8-4686-ad28-54f5d38f192c tempest-CreateVolumesFromImageTest-979736255 None] Acquiring lock "cinder-quobyte-c1fcd9a2-84ca-467b-940d-ec02c6d7adf5" by "delete_volume" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 11:09:03 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-51a20ced-dcb8-4686-ad28-54f5d38f192c tempest-CreateVolumesFromImageTest-979736255 None] Lock "cinder-quobyte-c1fcd9a2-84ca-467b-940d-ec02c6d7adf5" acquired by "delete_volume" :: waited 0.015s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 11:09:03 devstack cinder-volume[87272]: DEBUG oslo.privsep.daemon [-] privsep: reply[1acd15c9-c35d-40aa-8083-e5aae93a87db]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 11:09:03 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-51a20ced-dcb8-4686-ad28-54f5d38f192c tempest-CreateVolumesFromImageTest-979736255 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-c1fcd9a2-84ca-467b-940d-ec02c6d7adf5 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:09:03 devstack sudo[106265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-c1fcd9a2-84ca-467b-940d-ec02c6d7adf5 Nov 04 11:09:03 devstack sudo[106265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:09:03 devstack sudo[106265]: pam_unix(sudo:session): session closed for user root Nov 04 11:09:03 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-51a20ced-dcb8-4686-ad28-54f5d38f192c tempest-CreateVolumesFromImageTest-979736255 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-c1fcd9a2-84ca-467b-940d-ec02c6d7adf5" returned: 0 in 0.344s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:09:03 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-51a20ced-dcb8-4686-ad28-54f5d38f192c tempest-CreateVolumesFromImageTest-979736255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-c1fcd9a2-84ca-467b-940d-ec02c6d7adf5 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:09:03 devstack sudo[106270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-c1fcd9a2-84ca-467b-940d-ec02c6d7adf5 Nov 04 11:09:03 devstack sudo[106270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:09:03 devstack sudo[106270]: pam_unix(sudo:session): session closed for user root Nov 04 11:09:03 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-51a20ced-dcb8-4686-ad28-54f5d38f192c tempest-CreateVolumesFromImageTest-979736255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-c1fcd9a2-84ca-467b-940d-ec02c6d7adf5" returned: 0 in 0.248s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:09:03 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-51a20ced-dcb8-4686-ad28-54f5d38f192c tempest-CreateVolumesFromImageTest-979736255 None] Lock "cinder-quobyte-c1fcd9a2-84ca-467b-940d-ec02c6d7adf5" released by "delete_volume" :: held 0.631s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 11:09:03 devstack cinder-volume[87272]: DEBUG cinder.quota [None req-51a20ced-dcb8-4686-ad28-54f5d38f192c tempest-CreateVolumesFromImageTest-979736255 None] Created reservations ['bbc11e0e-7a9a-48d9-bf1e-6a346c79da0c', '61dfd760-64b6-4562-a899-604781947a96', 'e8392280-2130-498e-966a-42d3f945d662', '77291a95-d6dc-4847-9b44-f22616b6f111'] {{(pid=87272) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 11:09:03 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-51a20ced-dcb8-4686-ad28-54f5d38f192c tempest-CreateVolumesFromImageTest-979736255 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 11:09:03 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-51a20ced-dcb8-4686-ad28-54f5d38f192c tempest-CreateVolumesFromImageTest-979736255 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 11:09:03 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-51a20ced-dcb8-4686-ad28-54f5d38f192c tempest-CreateVolumesFromImageTest-979736255 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898': None} {{(pid=87272) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 11:09:03 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-51a20ced-dcb8-4686-ad28-54f5d38f192c tempest-CreateVolumesFromImageTest-979736255 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'] {{(pid=87272) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 11:09:03 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-51a20ced-dcb8-4686-ad28-54f5d38f192c tempest-CreateVolumesFromImageTest-979736255 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 11:09:03 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-51a20ced-dcb8-4686-ad28-54f5d38f192c tempest-CreateVolumesFromImageTest-979736255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:09:03 devstack sudo[106273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1 Nov 04 11:09:03 devstack sudo[106273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:09:04 devstack sudo[106273]: pam_unix(sudo:session): session closed for user root Nov 04 11:09:04 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-51a20ced-dcb8-4686-ad28-54f5d38f192c tempest-CreateVolumesFromImageTest-979736255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1" returned: 0 in 0.241s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:09:04 devstack cinder-volume[87272]: DEBUG cinder.manager [None req-51a20ced-dcb8-4686-ad28-54f5d38f192c tempest-CreateVolumesFromImageTest-979736255 None] Notifying Schedulers of capabilities ... {{(pid=87272) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 11:09:04 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-51a20ced-dcb8-4686-ad28-54f5d38f192c tempest-CreateVolumesFromImageTest-979736255 None] Deleted volume successfully. Nov 04 11:09:04 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-51a20ced-dcb8-4686-ad28-54f5d38f192c tempest-CreateVolumesFromImageTest-979736255 None] Lock "cinder-c1fcd9a2-84ca-467b-940d-ec02c6d7adf5-delete_volume" released by "delete_volume" :: held 1.054s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 11:09:04 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-28ca9304-81fc-48f7-b5aa-f188c3e69b52 tempest-CreateVolumesFromImageTest-979736255 None] Acquiring lock "cinder-1379a55c-5df5-4842-8229-669247a77f70-delete_volume" by "delete_volume" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 11:09:04 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-28ca9304-81fc-48f7-b5aa-f188c3e69b52 tempest-CreateVolumesFromImageTest-979736255 None] Lock "cinder-1379a55c-5df5-4842-8229-669247a77f70-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 11:09:04 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-28ca9304-81fc-48f7-b5aa-f188c3e69b52 tempest-CreateVolumesFromImageTest-979736255 None] Acquiring lock "cinder-quobyte-1379a55c-5df5-4842-8229-669247a77f70" by "delete_volume" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 11:09:04 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-28ca9304-81fc-48f7-b5aa-f188c3e69b52 tempest-CreateVolumesFromImageTest-979736255 None] Lock "cinder-quobyte-1379a55c-5df5-4842-8229-669247a77f70" acquired by "delete_volume" :: waited 0.016s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 11:09:04 devstack cinder-volume[87272]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a6d3a5f-f954-43e5-8fa8-44043334807d]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 11:09:04 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-28ca9304-81fc-48f7-b5aa-f188c3e69b52 tempest-CreateVolumesFromImageTest-979736255 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-1379a55c-5df5-4842-8229-669247a77f70 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:09:04 devstack sudo[106276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-1379a55c-5df5-4842-8229-669247a77f70 Nov 04 11:09:04 devstack sudo[106276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:09:04 devstack sudo[106276]: pam_unix(sudo:session): session closed for user root Nov 04 11:09:04 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-28ca9304-81fc-48f7-b5aa-f188c3e69b52 tempest-CreateVolumesFromImageTest-979736255 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-1379a55c-5df5-4842-8229-669247a77f70" returned: 0 in 0.341s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:09:04 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-28ca9304-81fc-48f7-b5aa-f188c3e69b52 tempest-CreateVolumesFromImageTest-979736255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-1379a55c-5df5-4842-8229-669247a77f70 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:09:04 devstack sudo[106281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-1379a55c-5df5-4842-8229-669247a77f70 Nov 04 11:09:04 devstack sudo[106281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:09:05 devstack sudo[106281]: pam_unix(sudo:session): session closed for user root Nov 04 11:09:05 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-28ca9304-81fc-48f7-b5aa-f188c3e69b52 tempest-CreateVolumesFromImageTest-979736255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-1379a55c-5df5-4842-8229-669247a77f70" returned: 0 in 0.236s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:09:05 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-28ca9304-81fc-48f7-b5aa-f188c3e69b52 tempest-CreateVolumesFromImageTest-979736255 None] Lock "cinder-quobyte-1379a55c-5df5-4842-8229-669247a77f70" released by "delete_volume" :: held 0.614s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 11:09:05 devstack cinder-volume[87272]: DEBUG cinder.quota [None req-28ca9304-81fc-48f7-b5aa-f188c3e69b52 tempest-CreateVolumesFromImageTest-979736255 None] Created reservations ['85fae103-4d1c-4e5a-b202-e0d4b6ad8c15', '432fd196-3619-4b59-af49-36fb0af8144f', '6a264278-f35d-4070-b68b-c00d17785368', '32b3922c-dca9-4133-9c8a-57918e2f1b53'] {{(pid=87272) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 11:09:05 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-28ca9304-81fc-48f7-b5aa-f188c3e69b52 tempest-CreateVolumesFromImageTest-979736255 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 11:09:05 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-28ca9304-81fc-48f7-b5aa-f188c3e69b52 tempest-CreateVolumesFromImageTest-979736255 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 11:09:05 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-28ca9304-81fc-48f7-b5aa-f188c3e69b52 tempest-CreateVolumesFromImageTest-979736255 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898': None} {{(pid=87272) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 11:09:05 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-28ca9304-81fc-48f7-b5aa-f188c3e69b52 tempest-CreateVolumesFromImageTest-979736255 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'] {{(pid=87272) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 11:09:05 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-28ca9304-81fc-48f7-b5aa-f188c3e69b52 tempest-CreateVolumesFromImageTest-979736255 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 11:09:05 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-28ca9304-81fc-48f7-b5aa-f188c3e69b52 tempest-CreateVolumesFromImageTest-979736255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:09:05 devstack sudo[106284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1 Nov 04 11:09:05 devstack sudo[106284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:09:05 devstack sudo[106284]: pam_unix(sudo:session): session closed for user root Nov 04 11:09:05 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-28ca9304-81fc-48f7-b5aa-f188c3e69b52 tempest-CreateVolumesFromImageTest-979736255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1" returned: 0 in 0.241s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:09:05 devstack cinder-volume[87272]: DEBUG cinder.manager [None req-28ca9304-81fc-48f7-b5aa-f188c3e69b52 tempest-CreateVolumesFromImageTest-979736255 None] Notifying Schedulers of capabilities ... {{(pid=87272) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 11:09:05 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-28ca9304-81fc-48f7-b5aa-f188c3e69b52 tempest-CreateVolumesFromImageTest-979736255 None] Deleted volume successfully. Nov 04 11:09:05 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-28ca9304-81fc-48f7-b5aa-f188c3e69b52 tempest-CreateVolumesFromImageTest-979736255 None] Lock "cinder-1379a55c-5df5-4842-8229-669247a77f70-delete_volume" released by "delete_volume" :: held 1.041s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 11:09:05 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-2d1c7113-c143-4685-9f8c-d7f64e57c0a1 tempest-CreateVolumesFromImageTest-979736255 None] Acquiring lock "cinder-c668c778-69f2-4759-b7ad-a727bff2a051-delete_volume" by "delete_volume" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 11:09:05 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-2d1c7113-c143-4685-9f8c-d7f64e57c0a1 tempest-CreateVolumesFromImageTest-979736255 None] Lock "cinder-c668c778-69f2-4759-b7ad-a727bff2a051-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 11:09:05 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-2d1c7113-c143-4685-9f8c-d7f64e57c0a1 tempest-CreateVolumesFromImageTest-979736255 None] Acquiring lock "cinder-quobyte-c668c778-69f2-4759-b7ad-a727bff2a051" by "delete_volume" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 11:09:05 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-2d1c7113-c143-4685-9f8c-d7f64e57c0a1 tempest-CreateVolumesFromImageTest-979736255 None] Lock "cinder-quobyte-c668c778-69f2-4759-b7ad-a727bff2a051" acquired by "delete_volume" :: waited 0.013s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 11:09:05 devstack cinder-volume[87272]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f255c24-7d9e-46ea-b73a-ed15b9a7c930]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 11:09:05 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-2d1c7113-c143-4685-9f8c-d7f64e57c0a1 tempest-CreateVolumesFromImageTest-979736255 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-c668c778-69f2-4759-b7ad-a727bff2a051 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:09:05 devstack sudo[106287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-c668c778-69f2-4759-b7ad-a727bff2a051 Nov 04 11:09:05 devstack sudo[106287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:09:05 devstack sudo[106287]: pam_unix(sudo:session): session closed for user root Nov 04 11:09:05 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-2d1c7113-c143-4685-9f8c-d7f64e57c0a1 tempest-CreateVolumesFromImageTest-979736255 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-c668c778-69f2-4759-b7ad-a727bff2a051" returned: 0 in 0.376s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:09:05 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-2d1c7113-c143-4685-9f8c-d7f64e57c0a1 tempest-CreateVolumesFromImageTest-979736255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-c668c778-69f2-4759-b7ad-a727bff2a051 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:09:05 devstack sudo[106292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-c668c778-69f2-4759-b7ad-a727bff2a051 Nov 04 11:09:05 devstack sudo[106292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:09:06 devstack sudo[106292]: pam_unix(sudo:session): session closed for user root Nov 04 11:09:06 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-2d1c7113-c143-4685-9f8c-d7f64e57c0a1 tempest-CreateVolumesFromImageTest-979736255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-c668c778-69f2-4759-b7ad-a727bff2a051" returned: 0 in 0.239s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:09:06 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-2d1c7113-c143-4685-9f8c-d7f64e57c0a1 tempest-CreateVolumesFromImageTest-979736255 None] Lock "cinder-quobyte-c668c778-69f2-4759-b7ad-a727bff2a051" released by "delete_volume" :: held 0.654s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 11:09:06 devstack cinder-volume[87272]: DEBUG cinder.quota [None req-2d1c7113-c143-4685-9f8c-d7f64e57c0a1 tempest-CreateVolumesFromImageTest-979736255 None] Created reservations ['f53ed2a8-5764-4db9-9b4a-db0b117964c8', 'c0f517b2-8529-4e25-86af-32390fd2ff5e', '9e5ae0a3-dae0-4f6c-89c1-7ccd199877cc', 'd9db5d97-eb7e-4f04-bf45-03755b9587b7'] {{(pid=87272) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 11:09:06 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-2d1c7113-c143-4685-9f8c-d7f64e57c0a1 tempest-CreateVolumesFromImageTest-979736255 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 11:09:06 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-2d1c7113-c143-4685-9f8c-d7f64e57c0a1 tempest-CreateVolumesFromImageTest-979736255 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 11:09:06 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-2d1c7113-c143-4685-9f8c-d7f64e57c0a1 tempest-CreateVolumesFromImageTest-979736255 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898': None} {{(pid=87272) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 11:09:06 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-2d1c7113-c143-4685-9f8c-d7f64e57c0a1 tempest-CreateVolumesFromImageTest-979736255 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'] {{(pid=87272) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 11:09:06 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-2d1c7113-c143-4685-9f8c-d7f64e57c0a1 tempest-CreateVolumesFromImageTest-979736255 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 11:09:06 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-2d1c7113-c143-4685-9f8c-d7f64e57c0a1 tempest-CreateVolumesFromImageTest-979736255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:09:06 devstack sudo[106295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1 Nov 04 11:09:06 devstack sudo[106295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:09:06 devstack sudo[106295]: pam_unix(sudo:session): session closed for user root Nov 04 11:09:06 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-2d1c7113-c143-4685-9f8c-d7f64e57c0a1 tempest-CreateVolumesFromImageTest-979736255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1" returned: 0 in 0.230s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:09:06 devstack cinder-volume[87272]: DEBUG cinder.manager [None req-2d1c7113-c143-4685-9f8c-d7f64e57c0a1 tempest-CreateVolumesFromImageTest-979736255 None] Notifying Schedulers of capabilities ... {{(pid=87272) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 11:09:06 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-2d1c7113-c143-4685-9f8c-d7f64e57c0a1 tempest-CreateVolumesFromImageTest-979736255 None] Deleted volume successfully. Nov 04 11:09:06 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-2d1c7113-c143-4685-9f8c-d7f64e57c0a1 tempest-CreateVolumesFromImageTest-979736255 None] Lock "cinder-c668c778-69f2-4759-b7ad-a727bff2a051-delete_volume" released by "delete_volume" :: held 1.082s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 11:09:06 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-340cfabf-b847-4cf3-aedd-e70ae6bff4bf tempest-CreateVolumesFromImageTest-979736255 None] Acquiring lock "cinder-ede5fd71-cd5e-4d51-8c4e-f3e74c5c0a71-delete_volume" by "delete_volume" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 11:09:06 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-340cfabf-b847-4cf3-aedd-e70ae6bff4bf tempest-CreateVolumesFromImageTest-979736255 None] Lock "cinder-ede5fd71-cd5e-4d51-8c4e-f3e74c5c0a71-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 11:09:06 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-340cfabf-b847-4cf3-aedd-e70ae6bff4bf tempest-CreateVolumesFromImageTest-979736255 None] Acquiring lock "cinder-quobyte-ede5fd71-cd5e-4d51-8c4e-f3e74c5c0a71" by "delete_volume" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 11:09:06 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-340cfabf-b847-4cf3-aedd-e70ae6bff4bf tempest-CreateVolumesFromImageTest-979736255 None] Lock "cinder-quobyte-ede5fd71-cd5e-4d51-8c4e-f3e74c5c0a71" acquired by "delete_volume" :: waited 0.015s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 11:09:06 devstack cinder-volume[87272]: DEBUG oslo.privsep.daemon [-] privsep: reply[718284bd-195b-496e-88f6-dcade4eaf045]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 11:09:06 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-340cfabf-b847-4cf3-aedd-e70ae6bff4bf tempest-CreateVolumesFromImageTest-979736255 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-ede5fd71-cd5e-4d51-8c4e-f3e74c5c0a71 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:09:06 devstack sudo[106299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-ede5fd71-cd5e-4d51-8c4e-f3e74c5c0a71 Nov 04 11:09:06 devstack sudo[106299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:09:07 devstack sudo[106299]: pam_unix(sudo:session): session closed for user root Nov 04 11:09:07 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-340cfabf-b847-4cf3-aedd-e70ae6bff4bf tempest-CreateVolumesFromImageTest-979736255 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-ede5fd71-cd5e-4d51-8c4e-f3e74c5c0a71" returned: 0 in 0.335s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:09:07 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-340cfabf-b847-4cf3-aedd-e70ae6bff4bf tempest-CreateVolumesFromImageTest-979736255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-ede5fd71-cd5e-4d51-8c4e-f3e74c5c0a71 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:09:07 devstack sudo[106304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-ede5fd71-cd5e-4d51-8c4e-f3e74c5c0a71 Nov 04 11:09:07 devstack sudo[106304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:09:07 devstack sudo[106304]: pam_unix(sudo:session): session closed for user root Nov 04 11:09:07 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-340cfabf-b847-4cf3-aedd-e70ae6bff4bf tempest-CreateVolumesFromImageTest-979736255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-ede5fd71-cd5e-4d51-8c4e-f3e74c5c0a71" returned: 0 in 0.235s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:09:07 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-340cfabf-b847-4cf3-aedd-e70ae6bff4bf tempest-CreateVolumesFromImageTest-979736255 None] Lock "cinder-quobyte-ede5fd71-cd5e-4d51-8c4e-f3e74c5c0a71" released by "delete_volume" :: held 0.609s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 11:09:07 devstack cinder-volume[87272]: DEBUG cinder.quota [None req-340cfabf-b847-4cf3-aedd-e70ae6bff4bf tempest-CreateVolumesFromImageTest-979736255 None] Created reservations ['4991ac43-828d-4e3d-a925-31db9dea1db3', 'dfba4425-96b5-4e1e-bda9-fa344df1017a', '6c108b38-cd57-4d06-86e3-6deabacf2c77', 'adb6b57a-487e-47fa-acaa-63763978a7ea'] {{(pid=87272) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 11:09:07 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-340cfabf-b847-4cf3-aedd-e70ae6bff4bf tempest-CreateVolumesFromImageTest-979736255 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 11:09:07 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-340cfabf-b847-4cf3-aedd-e70ae6bff4bf tempest-CreateVolumesFromImageTest-979736255 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 11:09:07 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-340cfabf-b847-4cf3-aedd-e70ae6bff4bf tempest-CreateVolumesFromImageTest-979736255 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898': None} {{(pid=87272) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 11:09:07 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-340cfabf-b847-4cf3-aedd-e70ae6bff4bf tempest-CreateVolumesFromImageTest-979736255 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'] {{(pid=87272) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 11:09:07 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-340cfabf-b847-4cf3-aedd-e70ae6bff4bf tempest-CreateVolumesFromImageTest-979736255 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 11:09:07 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-340cfabf-b847-4cf3-aedd-e70ae6bff4bf tempest-CreateVolumesFromImageTest-979736255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:09:07 devstack sudo[106307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1 Nov 04 11:09:07 devstack sudo[106307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:09:07 devstack sudo[106307]: pam_unix(sudo:session): session closed for user root Nov 04 11:09:07 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-340cfabf-b847-4cf3-aedd-e70ae6bff4bf tempest-CreateVolumesFromImageTest-979736255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1" returned: 0 in 0.230s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:09:07 devstack cinder-volume[87272]: DEBUG cinder.manager [None req-340cfabf-b847-4cf3-aedd-e70ae6bff4bf tempest-CreateVolumesFromImageTest-979736255 None] Notifying Schedulers of capabilities ... {{(pid=87272) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 11:09:07 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-340cfabf-b847-4cf3-aedd-e70ae6bff4bf tempest-CreateVolumesFromImageTest-979736255 None] Deleted volume successfully. Nov 04 11:09:07 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-340cfabf-b847-4cf3-aedd-e70ae6bff4bf tempest-CreateVolumesFromImageTest-979736255 None] Lock "cinder-ede5fd71-cd5e-4d51-8c4e-f3e74c5c0a71-delete_volume" released by "delete_volume" :: held 1.022s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 11:09:10 devstack cinder-volume[87272]: DEBUG cinder.volume.flows.manager.create_volume [None req-511d2fd0-7e74-4967-a607-cc35f589e204 tempest-CreateVolumesFromSourceVolumeTest-997908831 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87272) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 11:09:10 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-511d2fd0-7e74-4967-a607-cc35f589e204 tempest-CreateVolumesFromSourceVolumeTest-997908831 None] Flow 'volume_create_manager' (d81b42e8-f243-477d-9a01-422f8f878b72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 11:09:10 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-511d2fd0-7e74-4967-a607-cc35f589e204 tempest-CreateVolumesFromSourceVolumeTest-997908831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a62c1d92-11c9-4a4f-af34-a75dacbb2e6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:09:10 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-511d2fd0-7e74-4967-a607-cc35f589e204 tempest-CreateVolumesFromSourceVolumeTest-997908831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a62c1d92-11c9-4a4f-af34-a75dacbb2e6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T10:09:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1344053984',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=83b1550c-b2ed-4488-8e22-de641f57e903,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6f33f91e454437fa8e5174e4e2149b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T10:09:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T10:09:10Z,use_quota=True,user_id='185232856a5a4367b4afdaf5497dfdef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8989e4f-21e3-4f0a-9584-0d818784e883),volume_type_id=f8989e4f-21e3-4f0a-9584-0d818784e883)' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:09:10 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-511d2fd0-7e74-4967-a607-cc35f589e204 tempest-CreateVolumesFromSourceVolumeTest-997908831 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e260423-522d-4a08-8515-4b436ed297b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:09:10 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-511d2fd0-7e74-4967-a607-cc35f589e204 tempest-CreateVolumesFromSourceVolumeTest-997908831 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e260423-522d-4a08-8515-4b436ed297b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:09:10 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-511d2fd0-7e74-4967-a607-cc35f589e204 tempest-CreateVolumesFromSourceVolumeTest-997908831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dacb2f4b-c308-4b51-9f99-94baaf817c2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:09:10 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-511d2fd0-7e74-4967-a607-cc35f589e204 tempest-CreateVolumesFromSourceVolumeTest-997908831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dacb2f4b-c308-4b51-9f99-94baaf817c2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '83b1550c-b2ed-4488-8e22-de641f57e903', 'volume_name': 'volume-83b1550c-b2ed-4488-8e22-de641f57e903', 'volume_size': 1}' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:09:10 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-511d2fd0-7e74-4967-a607-cc35f589e204 tempest-CreateVolumesFromSourceVolumeTest-997908831 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b26781b-d7fa-4d7f-aa6c-57af0b9f1e40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:09:10 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-511d2fd0-7e74-4967-a607-cc35f589e204 tempest-CreateVolumesFromSourceVolumeTest-997908831 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b26781b-d7fa-4d7f-aa6c-57af0b9f1e40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:09:10 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-511d2fd0-7e74-4967-a607-cc35f589e204 tempest-CreateVolumesFromSourceVolumeTest-997908831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d85ca05-ce2f-48a5-9e5b-9d4628afb123) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:09:10 devstack cinder-volume[87272]: INFO cinder.volume.flows.manager.create_volume [None req-511d2fd0-7e74-4967-a607-cc35f589e204 tempest-CreateVolumesFromSourceVolumeTest-997908831 None] Volume 83b1550c-b2ed-4488-8e22-de641f57e903: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-83b1550c-b2ed-4488-8e22-de641f57e903', 'volume_size': 1} Nov 04 11:09:10 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-511d2fd0-7e74-4967-a607-cc35f589e204 tempest-CreateVolumesFromSourceVolumeTest-997908831 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 11:09:10 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-511d2fd0-7e74-4967-a607-cc35f589e204 tempest-CreateVolumesFromSourceVolumeTest-997908831 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 11:09:10 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-511d2fd0-7e74-4967-a607-cc35f589e204 tempest-CreateVolumesFromSourceVolumeTest-997908831 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T10:09:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1344053984',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=83b1550c-b2ed-4488-8e22-de641f57e903,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6f33f91e454437fa8e5174e4e2149b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T10:09:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T10:09:10Z,use_quota=True,user_id='185232856a5a4367b4afdaf5497dfdef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8989e4f-21e3-4f0a-9584-0d818784e883),volume_type_id=f8989e4f-21e3-4f0a-9584-0d818784e883)}" {{(pid=87272) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 04 11:09:10 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.remotefs [None req-511d2fd0-7e74-4967-a607-cc35f589e204 tempest-CreateVolumesFromSourceVolumeTest-997908831 None] Creating volume 83b1550c-b2ed-4488-8e22-de641f57e903 {{(pid=87272) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 11:09:10 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-511d2fd0-7e74-4967-a607-cc35f589e204 tempest-CreateVolumesFromSourceVolumeTest-997908831 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 11:09:10 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-511d2fd0-7e74-4967-a607-cc35f589e204 tempest-CreateVolumesFromSourceVolumeTest-997908831 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 11:09:10 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-511d2fd0-7e74-4967-a607-cc35f589e204 tempest-CreateVolumesFromSourceVolumeTest-997908831 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898': None} {{(pid=87272) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 11:09:10 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-511d2fd0-7e74-4967-a607-cc35f589e204 tempest-CreateVolumesFromSourceVolumeTest-997908831 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'] {{(pid=87272) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 11:09:10 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-511d2fd0-7e74-4967-a607-cc35f589e204 tempest-CreateVolumesFromSourceVolumeTest-997908831 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 11:09:10 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-511d2fd0-7e74-4967-a607-cc35f589e204 tempest-CreateVolumesFromSourceVolumeTest-997908831 None] Selected osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898 as target Quobyte volume. {{(pid=87272) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 11:09:10 devstack cinder-volume[87272]: INFO cinder.volume.drivers.remotefs [None req-511d2fd0-7e74-4967-a607-cc35f589e204 tempest-CreateVolumesFromSourceVolumeTest-997908831 None] casted to osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898 Nov 04 11:09:10 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-511d2fd0-7e74-4967-a607-cc35f589e204 tempest-CreateVolumesFromSourceVolumeTest-997908831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-83b1550c-b2ed-4488-8e22-de641f57e903 1073741824 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:09:10 devstack sudo[106311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-83b1550c-b2ed-4488-8e22-de641f57e903 1073741824 Nov 04 11:09:10 devstack sudo[106311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:09:10 devstack sudo[106311]: pam_unix(sudo:session): session closed for user root Nov 04 11:09:10 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-511d2fd0-7e74-4967-a607-cc35f589e204 tempest-CreateVolumesFromSourceVolumeTest-997908831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-83b1550c-b2ed-4488-8e22-de641f57e903 1073741824" returned: 0 in 0.411s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:09:10 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-511d2fd0-7e74-4967-a607-cc35f589e204 tempest-CreateVolumesFromSourceVolumeTest-997908831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-83b1550c-b2ed-4488-8e22-de641f57e903 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:09:10 devstack sudo[106316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-83b1550c-b2ed-4488-8e22-de641f57e903 Nov 04 11:09:10 devstack sudo[106316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:09:11 devstack sudo[106316]: pam_unix(sudo:session): session closed for user root Nov 04 11:09:11 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-511d2fd0-7e74-4967-a607-cc35f589e204 tempest-CreateVolumesFromSourceVolumeTest-997908831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-83b1550c-b2ed-4488-8e22-de641f57e903" returned: 0 in 0.236s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:09:11 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-511d2fd0-7e74-4967-a607-cc35f589e204 tempest-CreateVolumesFromSourceVolumeTest-997908831 None] <== create_volume: return (686ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'} {{(pid=87272) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 04 11:09:11 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-511d2fd0-7e74-4967-a607-cc35f589e204 tempest-CreateVolumesFromSourceVolumeTest-997908831 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.689s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 11:09:11 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-511d2fd0-7e74-4967-a607-cc35f589e204 tempest-CreateVolumesFromSourceVolumeTest-997908831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d85ca05-ce2f-48a5-9e5b-9d4628afb123) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-83b1550c-b2ed-4488-8e22-de641f57e903', 'volume_size': 1}' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:09:11 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-511d2fd0-7e74-4967-a607-cc35f589e204 tempest-CreateVolumesFromSourceVolumeTest-997908831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (776d4509-43e5-417b-bbb8-7e4795e3d7d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:09:11 devstack cinder-volume[87272]: INFO cinder.volume.flows.manager.create_volume [None req-511d2fd0-7e74-4967-a607-cc35f589e204 tempest-CreateVolumesFromSourceVolumeTest-997908831 None] Volume volume-83b1550c-b2ed-4488-8e22-de641f57e903 (83b1550c-b2ed-4488-8e22-de641f57e903): created successfully Nov 04 11:09:11 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-511d2fd0-7e74-4967-a607-cc35f589e204 tempest-CreateVolumesFromSourceVolumeTest-997908831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (776d4509-43e5-417b-bbb8-7e4795e3d7d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:09:11 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-511d2fd0-7e74-4967-a607-cc35f589e204 tempest-CreateVolumesFromSourceVolumeTest-997908831 None] Flow 'volume_create_manager' (d81b42e8-f243-477d-9a01-422f8f878b72) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87272) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 11:09:11 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-511d2fd0-7e74-4967-a607-cc35f589e204 tempest-CreateVolumesFromSourceVolumeTest-997908831 None] Created volume successfully. Nov 04 11:09:11 devstack cinder-volume[87272]: DEBUG cinder.volume.flows.manager.create_volume [None req-40b2648a-504d-4325-9e1f-22aee0d970e7 tempest-CreateVolumesFromSourceVolumeTest-997908831 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87272) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 11:09:11 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-40b2648a-504d-4325-9e1f-22aee0d970e7 tempest-CreateVolumesFromSourceVolumeTest-997908831 None] Flow 'volume_create_manager' (ccb1716f-7562-4676-9d86-c086e28ab78d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 11:09:11 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-40b2648a-504d-4325-9e1f-22aee0d970e7 tempest-CreateVolumesFromSourceVolumeTest-997908831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5651d7d1-8bbe-4d84-a674-5799bc347c19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:09:11 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-40b2648a-504d-4325-9e1f-22aee0d970e7 tempest-CreateVolumesFromSourceVolumeTest-997908831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5651d7d1-8bbe-4d84-a674-5799bc347c19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T10:09:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1332937411',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9db1ce07-b8e0-4bb7-a908-685e5ba6cb78,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6f33f91e454437fa8e5174e4e2149b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T10:09:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T10:09:12Z,use_quota=True,user_id='185232856a5a4367b4afdaf5497dfdef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8989e4f-21e3-4f0a-9584-0d818784e883),volume_type_id=f8989e4f-21e3-4f0a-9584-0d818784e883)' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:09:11 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-40b2648a-504d-4325-9e1f-22aee0d970e7 tempest-CreateVolumesFromSourceVolumeTest-997908831 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0168368-d2f8-4e51-8536-442ec5a6ac08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:09:11 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-40b2648a-504d-4325-9e1f-22aee0d970e7 tempest-CreateVolumesFromSourceVolumeTest-997908831 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0168368-d2f8-4e51-8536-442ec5a6ac08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:09:11 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-40b2648a-504d-4325-9e1f-22aee0d970e7 tempest-CreateVolumesFromSourceVolumeTest-997908831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e4b84b01-fd81-4b34-b7bd-545ec7563279) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:09:11 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-40b2648a-504d-4325-9e1f-22aee0d970e7 tempest-CreateVolumesFromSourceVolumeTest-997908831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e4b84b01-fd81-4b34-b7bd-545ec7563279) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9db1ce07-b8e0-4bb7-a908-685e5ba6cb78', 'volume_name': 'volume-9db1ce07-b8e0-4bb7-a908-685e5ba6cb78', 'volume_size': 1}' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:09:11 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-40b2648a-504d-4325-9e1f-22aee0d970e7 tempest-CreateVolumesFromSourceVolumeTest-997908831 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7069f60e-48b2-4b7f-a71f-ebc5b420714a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:09:11 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-40b2648a-504d-4325-9e1f-22aee0d970e7 tempest-CreateVolumesFromSourceVolumeTest-997908831 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7069f60e-48b2-4b7f-a71f-ebc5b420714a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:09:11 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-40b2648a-504d-4325-9e1f-22aee0d970e7 tempest-CreateVolumesFromSourceVolumeTest-997908831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf591486-a3c2-4dc5-a5d4-2cda058c261b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:09:11 devstack cinder-volume[87272]: INFO cinder.volume.flows.manager.create_volume [None req-40b2648a-504d-4325-9e1f-22aee0d970e7 tempest-CreateVolumesFromSourceVolumeTest-997908831 None] Volume 9db1ce07-b8e0-4bb7-a908-685e5ba6cb78: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9db1ce07-b8e0-4bb7-a908-685e5ba6cb78', 'volume_size': 1} Nov 04 11:09:11 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-40b2648a-504d-4325-9e1f-22aee0d970e7 tempest-CreateVolumesFromSourceVolumeTest-997908831 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 11:09:11 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-40b2648a-504d-4325-9e1f-22aee0d970e7 tempest-CreateVolumesFromSourceVolumeTest-997908831 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 11:09:11 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-40b2648a-504d-4325-9e1f-22aee0d970e7 tempest-CreateVolumesFromSourceVolumeTest-997908831 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T10:09:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1332937411',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9db1ce07-b8e0-4bb7-a908-685e5ba6cb78,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6f33f91e454437fa8e5174e4e2149b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T10:09:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T10:09:12Z,use_quota=True,user_id='185232856a5a4367b4afdaf5497dfdef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8989e4f-21e3-4f0a-9584-0d818784e883),volume_type_id=f8989e4f-21e3-4f0a-9584-0d818784e883)}" {{(pid=87272) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 04 11:09:11 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.remotefs [None req-40b2648a-504d-4325-9e1f-22aee0d970e7 tempest-CreateVolumesFromSourceVolumeTest-997908831 None] Creating volume 9db1ce07-b8e0-4bb7-a908-685e5ba6cb78 {{(pid=87272) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 11:09:11 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-40b2648a-504d-4325-9e1f-22aee0d970e7 tempest-CreateVolumesFromSourceVolumeTest-997908831 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 11:09:11 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-40b2648a-504d-4325-9e1f-22aee0d970e7 tempest-CreateVolumesFromSourceVolumeTest-997908831 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 11:09:11 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-40b2648a-504d-4325-9e1f-22aee0d970e7 tempest-CreateVolumesFromSourceVolumeTest-997908831 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898': None} {{(pid=87272) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 11:09:11 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-40b2648a-504d-4325-9e1f-22aee0d970e7 tempest-CreateVolumesFromSourceVolumeTest-997908831 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'] {{(pid=87272) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 11:09:11 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-40b2648a-504d-4325-9e1f-22aee0d970e7 tempest-CreateVolumesFromSourceVolumeTest-997908831 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 11:09:11 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-40b2648a-504d-4325-9e1f-22aee0d970e7 tempest-CreateVolumesFromSourceVolumeTest-997908831 None] Selected osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898 as target Quobyte volume. {{(pid=87272) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 11:09:11 devstack cinder-volume[87272]: INFO cinder.volume.drivers.remotefs [None req-40b2648a-504d-4325-9e1f-22aee0d970e7 tempest-CreateVolumesFromSourceVolumeTest-997908831 None] casted to osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898 Nov 04 11:09:11 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-40b2648a-504d-4325-9e1f-22aee0d970e7 tempest-CreateVolumesFromSourceVolumeTest-997908831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-9db1ce07-b8e0-4bb7-a908-685e5ba6cb78 1073741824 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:09:12 devstack sudo[106319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-9db1ce07-b8e0-4bb7-a908-685e5ba6cb78 1073741824 Nov 04 11:09:12 devstack sudo[106319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:09:12 devstack cinder-volume[87272]: DEBUG cinder.volume.flows.manager.create_volume [None req-ad512149-e7c3-4a73-8607-5a273fbcb662 tempest-CreateVolumesFromSourceVolumeTest-997908831 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87272) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 11:09:12 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-ad512149-e7c3-4a73-8607-5a273fbcb662 tempest-CreateVolumesFromSourceVolumeTest-997908831 None] Flow 'volume_create_manager' (d73b93ee-e8d2-461e-b811-48bb37001a14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 11:09:12 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-ad512149-e7c3-4a73-8607-5a273fbcb662 tempest-CreateVolumesFromSourceVolumeTest-997908831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (12f6da5c-a218-480c-9d2a-b4be0fd75a55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:09:12 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-ad512149-e7c3-4a73-8607-5a273fbcb662 tempest-CreateVolumesFromSourceVolumeTest-997908831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (12f6da5c-a218-480c-9d2a-b4be0fd75a55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T10:09:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1321323675',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a48134f-6f6a-4bac-9ef2-cd3314af48b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6f33f91e454437fa8e5174e4e2149b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T10:09:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T10:09:12Z,use_quota=True,user_id='185232856a5a4367b4afdaf5497dfdef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8989e4f-21e3-4f0a-9584-0d818784e883),volume_type_id=f8989e4f-21e3-4f0a-9584-0d818784e883)' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:09:12 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-ad512149-e7c3-4a73-8607-5a273fbcb662 tempest-CreateVolumesFromSourceVolumeTest-997908831 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb9cb238-160f-459e-9000-45d7a3c24bbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:09:12 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-ad512149-e7c3-4a73-8607-5a273fbcb662 tempest-CreateVolumesFromSourceVolumeTest-997908831 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb9cb238-160f-459e-9000-45d7a3c24bbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:09:12 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-ad512149-e7c3-4a73-8607-5a273fbcb662 tempest-CreateVolumesFromSourceVolumeTest-997908831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38abc447-4a3e-44d1-a72c-94b28286c9b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:09:12 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-ad512149-e7c3-4a73-8607-5a273fbcb662 tempest-CreateVolumesFromSourceVolumeTest-997908831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38abc447-4a3e-44d1-a72c-94b28286c9b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8a48134f-6f6a-4bac-9ef2-cd3314af48b8', 'volume_name': 'volume-8a48134f-6f6a-4bac-9ef2-cd3314af48b8', 'volume_size': 1}' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:09:12 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-ad512149-e7c3-4a73-8607-5a273fbcb662 tempest-CreateVolumesFromSourceVolumeTest-997908831 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d26fe303-fefa-40a6-93bd-28148436c064) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:09:12 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-ad512149-e7c3-4a73-8607-5a273fbcb662 tempest-CreateVolumesFromSourceVolumeTest-997908831 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d26fe303-fefa-40a6-93bd-28148436c064) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:09:12 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-ad512149-e7c3-4a73-8607-5a273fbcb662 tempest-CreateVolumesFromSourceVolumeTest-997908831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2bd50834-6b92-43f0-82e5-753520626c28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:09:12 devstack cinder-volume[87272]: INFO cinder.volume.flows.manager.create_volume [None req-ad512149-e7c3-4a73-8607-5a273fbcb662 tempest-CreateVolumesFromSourceVolumeTest-997908831 None] Volume 8a48134f-6f6a-4bac-9ef2-cd3314af48b8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8a48134f-6f6a-4bac-9ef2-cd3314af48b8', 'volume_size': 1} Nov 04 11:09:12 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-ad512149-e7c3-4a73-8607-5a273fbcb662 tempest-CreateVolumesFromSourceVolumeTest-997908831 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 11:09:12 devstack sudo[106319]: pam_unix(sudo:session): session closed for user root Nov 04 11:09:12 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-40b2648a-504d-4325-9e1f-22aee0d970e7 tempest-CreateVolumesFromSourceVolumeTest-997908831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-9db1ce07-b8e0-4bb7-a908-685e5ba6cb78 1073741824" returned: 0 in 0.539s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:09:12 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-40b2648a-504d-4325-9e1f-22aee0d970e7 tempest-CreateVolumesFromSourceVolumeTest-997908831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-9db1ce07-b8e0-4bb7-a908-685e5ba6cb78 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:09:12 devstack sudo[106324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-9db1ce07-b8e0-4bb7-a908-685e5ba6cb78 Nov 04 11:09:12 devstack sudo[106324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:09:12 devstack cinder-volume[87272]: DEBUG cinder.volume.flows.manager.create_volume [None req-a520078c-b5c2-45a9-be30-0a3fa9017fe3 tempest-CreateVolumesFromSourceVolumeTest-997908831 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87272) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 11:09:12 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-a520078c-b5c2-45a9-be30-0a3fa9017fe3 tempest-CreateVolumesFromSourceVolumeTest-997908831 None] Flow 'volume_create_manager' (aad42866-8a9d-4490-8e23-e51ea865942c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 11:09:12 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-a520078c-b5c2-45a9-be30-0a3fa9017fe3 tempest-CreateVolumesFromSourceVolumeTest-997908831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e4ceed6-f931-4738-9e5f-0aee5b83b2cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:09:12 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-a520078c-b5c2-45a9-be30-0a3fa9017fe3 tempest-CreateVolumesFromSourceVolumeTest-997908831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e4ceed6-f931-4738-9e5f-0aee5b83b2cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T10:09:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-290650116',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=97b0bf7f-ea84-4009-96c9-c88042941949,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6f33f91e454437fa8e5174e4e2149b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T10:09:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T10:09:13Z,use_quota=True,user_id='185232856a5a4367b4afdaf5497dfdef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8989e4f-21e3-4f0a-9584-0d818784e883),volume_type_id=f8989e4f-21e3-4f0a-9584-0d818784e883)' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:09:12 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-a520078c-b5c2-45a9-be30-0a3fa9017fe3 tempest-CreateVolumesFromSourceVolumeTest-997908831 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (455be127-ce38-45b6-b6df-bf331a234ef6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:09:12 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-a520078c-b5c2-45a9-be30-0a3fa9017fe3 tempest-CreateVolumesFromSourceVolumeTest-997908831 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (455be127-ce38-45b6-b6df-bf331a234ef6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:09:12 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-a520078c-b5c2-45a9-be30-0a3fa9017fe3 tempest-CreateVolumesFromSourceVolumeTest-997908831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b9b56e3-7b1b-41e8-948a-0b0190cb9742) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:09:12 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-a520078c-b5c2-45a9-be30-0a3fa9017fe3 tempest-CreateVolumesFromSourceVolumeTest-997908831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b9b56e3-7b1b-41e8-948a-0b0190cb9742) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '97b0bf7f-ea84-4009-96c9-c88042941949', 'volume_name': 'volume-97b0bf7f-ea84-4009-96c9-c88042941949', 'volume_size': 1}' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:09:12 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-a520078c-b5c2-45a9-be30-0a3fa9017fe3 tempest-CreateVolumesFromSourceVolumeTest-997908831 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c85d0c96-f1c0-4085-a512-30e66592aa88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:09:12 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-a520078c-b5c2-45a9-be30-0a3fa9017fe3 tempest-CreateVolumesFromSourceVolumeTest-997908831 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c85d0c96-f1c0-4085-a512-30e66592aa88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:09:12 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-a520078c-b5c2-45a9-be30-0a3fa9017fe3 tempest-CreateVolumesFromSourceVolumeTest-997908831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (14c9615b-8c46-4c66-b107-893019f2c5a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:09:12 devstack cinder-volume[87272]: INFO cinder.volume.flows.manager.create_volume [None req-a520078c-b5c2-45a9-be30-0a3fa9017fe3 tempest-CreateVolumesFromSourceVolumeTest-997908831 None] Volume 97b0bf7f-ea84-4009-96c9-c88042941949: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-97b0bf7f-ea84-4009-96c9-c88042941949', 'volume_size': 1} Nov 04 11:09:12 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-a520078c-b5c2-45a9-be30-0a3fa9017fe3 tempest-CreateVolumesFromSourceVolumeTest-997908831 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 11:09:12 devstack sudo[106324]: pam_unix(sudo:session): session closed for user root Nov 04 11:09:12 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-40b2648a-504d-4325-9e1f-22aee0d970e7 tempest-CreateVolumesFromSourceVolumeTest-997908831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-9db1ce07-b8e0-4bb7-a908-685e5ba6cb78" returned: 0 in 0.300s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:09:12 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-40b2648a-504d-4325-9e1f-22aee0d970e7 tempest-CreateVolumesFromSourceVolumeTest-997908831 None] <== create_volume: return (893ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'} {{(pid=87272) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 04 11:09:12 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-40b2648a-504d-4325-9e1f-22aee0d970e7 tempest-CreateVolumesFromSourceVolumeTest-997908831 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.896s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 11:09:12 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-ad512149-e7c3-4a73-8607-5a273fbcb662 tempest-CreateVolumesFromSourceVolumeTest-997908831 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.541s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 11:09:12 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-ad512149-e7c3-4a73-8607-5a273fbcb662 tempest-CreateVolumesFromSourceVolumeTest-997908831 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T10:09:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1321323675',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a48134f-6f6a-4bac-9ef2-cd3314af48b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6f33f91e454437fa8e5174e4e2149b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T10:09:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T10:09:12Z,use_quota=True,user_id='185232856a5a4367b4afdaf5497dfdef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8989e4f-21e3-4f0a-9584-0d818784e883),volume_type_id=f8989e4f-21e3-4f0a-9584-0d818784e883)}" {{(pid=87272) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 04 11:09:12 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.remotefs [None req-ad512149-e7c3-4a73-8607-5a273fbcb662 tempest-CreateVolumesFromSourceVolumeTest-997908831 None] Creating volume 8a48134f-6f6a-4bac-9ef2-cd3314af48b8 {{(pid=87272) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 11:09:12 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-ad512149-e7c3-4a73-8607-5a273fbcb662 tempest-CreateVolumesFromSourceVolumeTest-997908831 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 11:09:12 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-ad512149-e7c3-4a73-8607-5a273fbcb662 tempest-CreateVolumesFromSourceVolumeTest-997908831 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 11:09:12 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-ad512149-e7c3-4a73-8607-5a273fbcb662 tempest-CreateVolumesFromSourceVolumeTest-997908831 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898': None} {{(pid=87272) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 11:09:12 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-ad512149-e7c3-4a73-8607-5a273fbcb662 tempest-CreateVolumesFromSourceVolumeTest-997908831 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'] {{(pid=87272) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 11:09:12 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-ad512149-e7c3-4a73-8607-5a273fbcb662 tempest-CreateVolumesFromSourceVolumeTest-997908831 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 11:09:12 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-ad512149-e7c3-4a73-8607-5a273fbcb662 tempest-CreateVolumesFromSourceVolumeTest-997908831 None] Selected osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898 as target Quobyte volume. {{(pid=87272) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 11:09:12 devstack cinder-volume[87272]: INFO cinder.volume.drivers.remotefs [None req-ad512149-e7c3-4a73-8607-5a273fbcb662 tempest-CreateVolumesFromSourceVolumeTest-997908831 None] casted to osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898 Nov 04 11:09:12 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-ad512149-e7c3-4a73-8607-5a273fbcb662 tempest-CreateVolumesFromSourceVolumeTest-997908831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-8a48134f-6f6a-4bac-9ef2-cd3314af48b8 1073741824 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:09:12 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-40b2648a-504d-4325-9e1f-22aee0d970e7 tempest-CreateVolumesFromSourceVolumeTest-997908831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf591486-a3c2-4dc5-a5d4-2cda058c261b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9db1ce07-b8e0-4bb7-a908-685e5ba6cb78', 'volume_size': 1}' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:09:12 devstack sudo[106327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-8a48134f-6f6a-4bac-9ef2-cd3314af48b8 1073741824 Nov 04 11:09:12 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-40b2648a-504d-4325-9e1f-22aee0d970e7 tempest-CreateVolumesFromSourceVolumeTest-997908831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (26ef8961-c2ed-4a5a-8752-0ed5d7df3abc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:09:12 devstack sudo[106327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:09:12 devstack cinder-volume[87272]: INFO cinder.volume.flows.manager.create_volume [None req-40b2648a-504d-4325-9e1f-22aee0d970e7 tempest-CreateVolumesFromSourceVolumeTest-997908831 None] Volume volume-9db1ce07-b8e0-4bb7-a908-685e5ba6cb78 (9db1ce07-b8e0-4bb7-a908-685e5ba6cb78): created successfully Nov 04 11:09:12 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-40b2648a-504d-4325-9e1f-22aee0d970e7 tempest-CreateVolumesFromSourceVolumeTest-997908831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (26ef8961-c2ed-4a5a-8752-0ed5d7df3abc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:09:12 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-40b2648a-504d-4325-9e1f-22aee0d970e7 tempest-CreateVolumesFromSourceVolumeTest-997908831 None] Flow 'volume_create_manager' (ccb1716f-7562-4676-9d86-c086e28ab78d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87272) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 11:09:12 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-40b2648a-504d-4325-9e1f-22aee0d970e7 tempest-CreateVolumesFromSourceVolumeTest-997908831 None] Created volume successfully. Nov 04 11:09:13 devstack cinder-volume[87272]: DEBUG cinder.volume.flows.manager.create_volume [None req-7ab60328-1804-4312-99cd-a64583dc48a3 tempest-CreateVolumesFromSourceVolumeTest-997908831 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87272) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 11:09:13 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-7ab60328-1804-4312-99cd-a64583dc48a3 tempest-CreateVolumesFromSourceVolumeTest-997908831 None] Flow 'volume_create_manager' (bd3bd9be-9415-4052-8f24-441ff40c7f22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 11:09:13 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-7ab60328-1804-4312-99cd-a64583dc48a3 tempest-CreateVolumesFromSourceVolumeTest-997908831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a93aef55-3a05-4df6-a871-0e2b177c5d82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:09:13 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-7ab60328-1804-4312-99cd-a64583dc48a3 tempest-CreateVolumesFromSourceVolumeTest-997908831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a93aef55-3a05-4df6-a871-0e2b177c5d82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T10:09:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1209582955',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9a3ef7cc-dc64-4b32-99b9-9b7a8593a0cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6f33f91e454437fa8e5174e4e2149b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T10:09:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T10:09:13Z,use_quota=True,user_id='185232856a5a4367b4afdaf5497dfdef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8989e4f-21e3-4f0a-9584-0d818784e883),volume_type_id=f8989e4f-21e3-4f0a-9584-0d818784e883)' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:09:13 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-7ab60328-1804-4312-99cd-a64583dc48a3 tempest-CreateVolumesFromSourceVolumeTest-997908831 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (14fcb59a-9e71-4192-be3d-41f3af8c0198) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:09:13 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-7ab60328-1804-4312-99cd-a64583dc48a3 tempest-CreateVolumesFromSourceVolumeTest-997908831 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (14fcb59a-9e71-4192-be3d-41f3af8c0198) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:09:13 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-7ab60328-1804-4312-99cd-a64583dc48a3 tempest-CreateVolumesFromSourceVolumeTest-997908831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e3435aa5-8748-496b-8202-a40bed1cb82a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:09:13 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-7ab60328-1804-4312-99cd-a64583dc48a3 tempest-CreateVolumesFromSourceVolumeTest-997908831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e3435aa5-8748-496b-8202-a40bed1cb82a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9a3ef7cc-dc64-4b32-99b9-9b7a8593a0cb', 'volume_name': 'volume-9a3ef7cc-dc64-4b32-99b9-9b7a8593a0cb', 'volume_size': 1}' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:09:13 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-7ab60328-1804-4312-99cd-a64583dc48a3 tempest-CreateVolumesFromSourceVolumeTest-997908831 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb5293c7-1c61-497d-941b-a7192daea87b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:09:13 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-7ab60328-1804-4312-99cd-a64583dc48a3 tempest-CreateVolumesFromSourceVolumeTest-997908831 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb5293c7-1c61-497d-941b-a7192daea87b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:09:13 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-7ab60328-1804-4312-99cd-a64583dc48a3 tempest-CreateVolumesFromSourceVolumeTest-997908831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (492fea78-0a29-4d72-906d-500e48eaf7c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:09:13 devstack cinder-volume[87272]: INFO cinder.volume.flows.manager.create_volume [None req-7ab60328-1804-4312-99cd-a64583dc48a3 tempest-CreateVolumesFromSourceVolumeTest-997908831 None] Volume 9a3ef7cc-dc64-4b32-99b9-9b7a8593a0cb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9a3ef7cc-dc64-4b32-99b9-9b7a8593a0cb', 'volume_size': 1} Nov 04 11:09:13 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-7ab60328-1804-4312-99cd-a64583dc48a3 tempest-CreateVolumesFromSourceVolumeTest-997908831 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 11:09:13 devstack cinder-volume[87272]: DEBUG cinder.volume.flows.manager.create_volume [None req-76516351-8afc-435f-a5a0-ef9193fa4eb6 tempest-CreateVolumesFromSourceVolumeTest-997908831 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87272) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 11:09:13 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-76516351-8afc-435f-a5a0-ef9193fa4eb6 tempest-CreateVolumesFromSourceVolumeTest-997908831 None] Flow 'volume_create_manager' (83d456be-9913-4229-b178-bb342b4a943b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 11:09:13 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-76516351-8afc-435f-a5a0-ef9193fa4eb6 tempest-CreateVolumesFromSourceVolumeTest-997908831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b139973-6a2e-443a-9802-af940ee0f4e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:09:13 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-76516351-8afc-435f-a5a0-ef9193fa4eb6 tempest-CreateVolumesFromSourceVolumeTest-997908831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b139973-6a2e-443a-9802-af940ee0f4e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T10:09:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1687949261',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b8f175d3-8e66-4015-8397-ec340a2b262b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6f33f91e454437fa8e5174e4e2149b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T10:09:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T10:09:13Z,use_quota=True,user_id='185232856a5a4367b4afdaf5497dfdef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8989e4f-21e3-4f0a-9584-0d818784e883),volume_type_id=f8989e4f-21e3-4f0a-9584-0d818784e883)' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:09:13 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-76516351-8afc-435f-a5a0-ef9193fa4eb6 tempest-CreateVolumesFromSourceVolumeTest-997908831 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d457742-c493-421e-b4f2-fbc75b987e04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:09:13 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-76516351-8afc-435f-a5a0-ef9193fa4eb6 tempest-CreateVolumesFromSourceVolumeTest-997908831 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d457742-c493-421e-b4f2-fbc75b987e04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:09:13 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-76516351-8afc-435f-a5a0-ef9193fa4eb6 tempest-CreateVolumesFromSourceVolumeTest-997908831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cca6eadb-b429-4db2-9a4e-e7989fa71943) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:09:13 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-76516351-8afc-435f-a5a0-ef9193fa4eb6 tempest-CreateVolumesFromSourceVolumeTest-997908831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cca6eadb-b429-4db2-9a4e-e7989fa71943) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b8f175d3-8e66-4015-8397-ec340a2b262b', 'volume_name': 'volume-b8f175d3-8e66-4015-8397-ec340a2b262b', 'volume_size': 1}' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:09:13 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-76516351-8afc-435f-a5a0-ef9193fa4eb6 tempest-CreateVolumesFromSourceVolumeTest-997908831 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (88eaf831-b308-480e-888f-cfffea018436) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:09:13 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-76516351-8afc-435f-a5a0-ef9193fa4eb6 tempest-CreateVolumesFromSourceVolumeTest-997908831 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (88eaf831-b308-480e-888f-cfffea018436) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:09:13 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-76516351-8afc-435f-a5a0-ef9193fa4eb6 tempest-CreateVolumesFromSourceVolumeTest-997908831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1bd19602-fe23-4a3c-8780-5e59c509756c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:09:13 devstack cinder-volume[87272]: INFO cinder.volume.flows.manager.create_volume [None req-76516351-8afc-435f-a5a0-ef9193fa4eb6 tempest-CreateVolumesFromSourceVolumeTest-997908831 None] Volume b8f175d3-8e66-4015-8397-ec340a2b262b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b8f175d3-8e66-4015-8397-ec340a2b262b', 'volume_size': 1} Nov 04 11:09:13 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-76516351-8afc-435f-a5a0-ef9193fa4eb6 tempest-CreateVolumesFromSourceVolumeTest-997908831 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 11:09:13 devstack sudo[106327]: pam_unix(sudo:session): session closed for user root Nov 04 11:09:13 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-ad512149-e7c3-4a73-8607-5a273fbcb662 tempest-CreateVolumesFromSourceVolumeTest-997908831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-8a48134f-6f6a-4bac-9ef2-cd3314af48b8 1073741824" returned: 0 in 0.574s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:09:13 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-ad512149-e7c3-4a73-8607-5a273fbcb662 tempest-CreateVolumesFromSourceVolumeTest-997908831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-8a48134f-6f6a-4bac-9ef2-cd3314af48b8 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:09:13 devstack sudo[106333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-8a48134f-6f6a-4bac-9ef2-cd3314af48b8 Nov 04 11:09:13 devstack sudo[106333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:09:13 devstack sudo[106333]: pam_unix(sudo:session): session closed for user root Nov 04 11:09:13 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-ad512149-e7c3-4a73-8607-5a273fbcb662 tempest-CreateVolumesFromSourceVolumeTest-997908831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-8a48134f-6f6a-4bac-9ef2-cd3314af48b8" returned: 0 in 0.257s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:09:13 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-ad512149-e7c3-4a73-8607-5a273fbcb662 tempest-CreateVolumesFromSourceVolumeTest-997908831 None] <== create_volume: return (874ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'} {{(pid=87272) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 04 11:09:13 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-ad512149-e7c3-4a73-8607-5a273fbcb662 tempest-CreateVolumesFromSourceVolumeTest-997908831 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.877s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 11:09:13 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-a520078c-b5c2-45a9-be30-0a3fa9017fe3 tempest-CreateVolumesFromSourceVolumeTest-997908831 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.014s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 11:09:13 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-a520078c-b5c2-45a9-be30-0a3fa9017fe3 tempest-CreateVolumesFromSourceVolumeTest-997908831 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T10:09:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-290650116',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=97b0bf7f-ea84-4009-96c9-c88042941949,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6f33f91e454437fa8e5174e4e2149b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T10:09:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T10:09:13Z,use_quota=True,user_id='185232856a5a4367b4afdaf5497dfdef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8989e4f-21e3-4f0a-9584-0d818784e883),volume_type_id=f8989e4f-21e3-4f0a-9584-0d818784e883)}" {{(pid=87272) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 04 11:09:13 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.remotefs [None req-a520078c-b5c2-45a9-be30-0a3fa9017fe3 tempest-CreateVolumesFromSourceVolumeTest-997908831 None] Creating volume 97b0bf7f-ea84-4009-96c9-c88042941949 {{(pid=87272) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 11:09:13 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-a520078c-b5c2-45a9-be30-0a3fa9017fe3 tempest-CreateVolumesFromSourceVolumeTest-997908831 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 11:09:13 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-a520078c-b5c2-45a9-be30-0a3fa9017fe3 tempest-CreateVolumesFromSourceVolumeTest-997908831 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 11:09:13 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-a520078c-b5c2-45a9-be30-0a3fa9017fe3 tempest-CreateVolumesFromSourceVolumeTest-997908831 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898': None} {{(pid=87272) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 11:09:13 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-a520078c-b5c2-45a9-be30-0a3fa9017fe3 tempest-CreateVolumesFromSourceVolumeTest-997908831 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'] {{(pid=87272) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 11:09:13 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-a520078c-b5c2-45a9-be30-0a3fa9017fe3 tempest-CreateVolumesFromSourceVolumeTest-997908831 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 11:09:13 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-a520078c-b5c2-45a9-be30-0a3fa9017fe3 tempest-CreateVolumesFromSourceVolumeTest-997908831 None] Selected osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898 as target Quobyte volume. {{(pid=87272) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 11:09:13 devstack cinder-volume[87272]: INFO cinder.volume.drivers.remotefs [None req-a520078c-b5c2-45a9-be30-0a3fa9017fe3 tempest-CreateVolumesFromSourceVolumeTest-997908831 None] casted to osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898 Nov 04 11:09:13 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-a520078c-b5c2-45a9-be30-0a3fa9017fe3 tempest-CreateVolumesFromSourceVolumeTest-997908831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-97b0bf7f-ea84-4009-96c9-c88042941949 1073741824 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:09:13 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-ad512149-e7c3-4a73-8607-5a273fbcb662 tempest-CreateVolumesFromSourceVolumeTest-997908831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2bd50834-6b92-43f0-82e5-753520626c28) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8a48134f-6f6a-4bac-9ef2-cd3314af48b8', 'volume_size': 1}' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:09:13 devstack sudo[106336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-97b0bf7f-ea84-4009-96c9-c88042941949 1073741824 Nov 04 11:09:13 devstack sudo[106336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:09:13 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-ad512149-e7c3-4a73-8607-5a273fbcb662 tempest-CreateVolumesFromSourceVolumeTest-997908831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a05c23c4-cc0d-464c-92b3-10ef538b855a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:09:13 devstack cinder-volume[87272]: INFO cinder.volume.flows.manager.create_volume [None req-ad512149-e7c3-4a73-8607-5a273fbcb662 tempest-CreateVolumesFromSourceVolumeTest-997908831 None] Volume volume-8a48134f-6f6a-4bac-9ef2-cd3314af48b8 (8a48134f-6f6a-4bac-9ef2-cd3314af48b8): created successfully Nov 04 11:09:13 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-ad512149-e7c3-4a73-8607-5a273fbcb662 tempest-CreateVolumesFromSourceVolumeTest-997908831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a05c23c4-cc0d-464c-92b3-10ef538b855a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:09:13 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-ad512149-e7c3-4a73-8607-5a273fbcb662 tempest-CreateVolumesFromSourceVolumeTest-997908831 None] Flow 'volume_create_manager' (d73b93ee-e8d2-461e-b811-48bb37001a14) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87272) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 11:09:13 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-ad512149-e7c3-4a73-8607-5a273fbcb662 tempest-CreateVolumesFromSourceVolumeTest-997908831 None] Created volume successfully. Nov 04 11:09:14 devstack cinder-volume[87272]: DEBUG oslo_service.periodic_task [None req-236af0be-7f9d-4c80-b3d7-d645a9cd0dd1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87272) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 04 11:09:14 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-236af0be-7f9d-4c80-b3d7-d645a9cd0dd1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 11:09:14 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-236af0be-7f9d-4c80-b3d7-d645a9cd0dd1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 11:09:14 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-236af0be-7f9d-4c80-b3d7-d645a9cd0dd1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898': None} {{(pid=87272) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 11:09:14 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-236af0be-7f9d-4c80-b3d7-d645a9cd0dd1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'] {{(pid=87272) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 11:09:14 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-236af0be-7f9d-4c80-b3d7-d645a9cd0dd1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 11:09:14 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-236af0be-7f9d-4c80-b3d7-d645a9cd0dd1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:09:14 devstack sudo[106341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1 Nov 04 11:09:14 devstack sudo[106341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:09:14 devstack sudo[106336]: pam_unix(sudo:session): session closed for user root Nov 04 11:09:14 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-a520078c-b5c2-45a9-be30-0a3fa9017fe3 tempest-CreateVolumesFromSourceVolumeTest-997908831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-97b0bf7f-ea84-4009-96c9-c88042941949 1073741824" returned: 0 in 0.431s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:09:14 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-a520078c-b5c2-45a9-be30-0a3fa9017fe3 tempest-CreateVolumesFromSourceVolumeTest-997908831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-97b0bf7f-ea84-4009-96c9-c88042941949 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:09:14 devstack sudo[106343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-97b0bf7f-ea84-4009-96c9-c88042941949 Nov 04 11:09:14 devstack sudo[106343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:09:14 devstack sudo[106341]: pam_unix(sudo:session): session closed for user root Nov 04 11:09:14 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-236af0be-7f9d-4c80-b3d7-d645a9cd0dd1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1" returned: 0 in 0.277s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:09:14 devstack cinder-volume[87272]: DEBUG cinder.manager [None req-236af0be-7f9d-4c80-b3d7-d645a9cd0dd1 None None] Notifying Schedulers of capabilities ... {{(pid=87272) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 11:09:14 devstack cinder-volume[87272]: DEBUG oslo_service.periodic_task [None req-236af0be-7f9d-4c80-b3d7-d645a9cd0dd1 None None] Running periodic task VolumeManager._thread_info {{(pid=87272) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 04 11:09:14 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-236af0be-7f9d-4c80-b3d7-d645a9cd0dd1 None None] thread count: 28 {{(pid=87272) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 04 11:09:14 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-236af0be-7f9d-4c80-b3d7-d645a9cd0dd1 None None] thread info: [<_MainThread(MainThread, started 127085713244288)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87272) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 04 11:09:14 devstack sudo[106343]: pam_unix(sudo:session): session closed for user root Nov 04 11:09:14 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-a520078c-b5c2-45a9-be30-0a3fa9017fe3 tempest-CreateVolumesFromSourceVolumeTest-997908831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-97b0bf7f-ea84-4009-96c9-c88042941949" returned: 0 in 0.268s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:09:14 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-a520078c-b5c2-45a9-be30-0a3fa9017fe3 tempest-CreateVolumesFromSourceVolumeTest-997908831 None] <== create_volume: return (741ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'} {{(pid=87272) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 04 11:09:14 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-a520078c-b5c2-45a9-be30-0a3fa9017fe3 tempest-CreateVolumesFromSourceVolumeTest-997908831 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.745s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 11:09:14 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-7ab60328-1804-4312-99cd-a64583dc48a3 tempest-CreateVolumesFromSourceVolumeTest-997908831 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.380s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 11:09:14 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-7ab60328-1804-4312-99cd-a64583dc48a3 tempest-CreateVolumesFromSourceVolumeTest-997908831 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T10:09:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1209582955',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9a3ef7cc-dc64-4b32-99b9-9b7a8593a0cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6f33f91e454437fa8e5174e4e2149b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T10:09:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T10:09:13Z,use_quota=True,user_id='185232856a5a4367b4afdaf5497dfdef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8989e4f-21e3-4f0a-9584-0d818784e883),volume_type_id=f8989e4f-21e3-4f0a-9584-0d818784e883)}" {{(pid=87272) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 04 11:09:14 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.remotefs [None req-7ab60328-1804-4312-99cd-a64583dc48a3 tempest-CreateVolumesFromSourceVolumeTest-997908831 None] Creating volume 9a3ef7cc-dc64-4b32-99b9-9b7a8593a0cb {{(pid=87272) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 11:09:14 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-7ab60328-1804-4312-99cd-a64583dc48a3 tempest-CreateVolumesFromSourceVolumeTest-997908831 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 11:09:14 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-7ab60328-1804-4312-99cd-a64583dc48a3 tempest-CreateVolumesFromSourceVolumeTest-997908831 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 11:09:14 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-7ab60328-1804-4312-99cd-a64583dc48a3 tempest-CreateVolumesFromSourceVolumeTest-997908831 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898': None} {{(pid=87272) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 11:09:14 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-7ab60328-1804-4312-99cd-a64583dc48a3 tempest-CreateVolumesFromSourceVolumeTest-997908831 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'] {{(pid=87272) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 11:09:14 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-7ab60328-1804-4312-99cd-a64583dc48a3 tempest-CreateVolumesFromSourceVolumeTest-997908831 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 11:09:14 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-7ab60328-1804-4312-99cd-a64583dc48a3 tempest-CreateVolumesFromSourceVolumeTest-997908831 None] Selected osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898 as target Quobyte volume. {{(pid=87272) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 11:09:14 devstack cinder-volume[87272]: INFO cinder.volume.drivers.remotefs [None req-7ab60328-1804-4312-99cd-a64583dc48a3 tempest-CreateVolumesFromSourceVolumeTest-997908831 None] casted to osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898 Nov 04 11:09:14 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-7ab60328-1804-4312-99cd-a64583dc48a3 tempest-CreateVolumesFromSourceVolumeTest-997908831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-9a3ef7cc-dc64-4b32-99b9-9b7a8593a0cb 1073741824 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:09:14 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-a520078c-b5c2-45a9-be30-0a3fa9017fe3 tempest-CreateVolumesFromSourceVolumeTest-997908831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (14c9615b-8c46-4c66-b107-893019f2c5a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-97b0bf7f-ea84-4009-96c9-c88042941949', 'volume_size': 1}' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:09:14 devstack sudo[106347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-9a3ef7cc-dc64-4b32-99b9-9b7a8593a0cb 1073741824 Nov 04 11:09:14 devstack sudo[106347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:09:14 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-a520078c-b5c2-45a9-be30-0a3fa9017fe3 tempest-CreateVolumesFromSourceVolumeTest-997908831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c09400f-d84f-4996-a9df-191675421c73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:09:14 devstack cinder-volume[87272]: INFO cinder.volume.flows.manager.create_volume [None req-a520078c-b5c2-45a9-be30-0a3fa9017fe3 tempest-CreateVolumesFromSourceVolumeTest-997908831 None] Volume volume-97b0bf7f-ea84-4009-96c9-c88042941949 (97b0bf7f-ea84-4009-96c9-c88042941949): created successfully Nov 04 11:09:14 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-a520078c-b5c2-45a9-be30-0a3fa9017fe3 tempest-CreateVolumesFromSourceVolumeTest-997908831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c09400f-d84f-4996-a9df-191675421c73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:09:14 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-a520078c-b5c2-45a9-be30-0a3fa9017fe3 tempest-CreateVolumesFromSourceVolumeTest-997908831 None] Flow 'volume_create_manager' (aad42866-8a9d-4490-8e23-e51ea865942c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87272) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 11:09:14 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-a520078c-b5c2-45a9-be30-0a3fa9017fe3 tempest-CreateVolumesFromSourceVolumeTest-997908831 None] Created volume successfully. Nov 04 11:09:14 devstack sudo[106347]: pam_unix(sudo:session): session closed for user root Nov 04 11:09:14 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-7ab60328-1804-4312-99cd-a64583dc48a3 tempest-CreateVolumesFromSourceVolumeTest-997908831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-9a3ef7cc-dc64-4b32-99b9-9b7a8593a0cb 1073741824" returned: 0 in 0.438s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:09:14 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-7ab60328-1804-4312-99cd-a64583dc48a3 tempest-CreateVolumesFromSourceVolumeTest-997908831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-9a3ef7cc-dc64-4b32-99b9-9b7a8593a0cb {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:09:15 devstack sudo[106352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-9a3ef7cc-dc64-4b32-99b9-9b7a8593a0cb Nov 04 11:09:15 devstack sudo[106352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:09:15 devstack sudo[106352]: pam_unix(sudo:session): session closed for user root Nov 04 11:09:15 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-7ab60328-1804-4312-99cd-a64583dc48a3 tempest-CreateVolumesFromSourceVolumeTest-997908831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-9a3ef7cc-dc64-4b32-99b9-9b7a8593a0cb" returned: 0 in 0.246s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:09:15 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-7ab60328-1804-4312-99cd-a64583dc48a3 tempest-CreateVolumesFromSourceVolumeTest-997908831 None] <== create_volume: return (722ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'} {{(pid=87272) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 04 11:09:15 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-7ab60328-1804-4312-99cd-a64583dc48a3 tempest-CreateVolumesFromSourceVolumeTest-997908831 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.724s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 11:09:15 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-76516351-8afc-435f-a5a0-ef9193fa4eb6 tempest-CreateVolumesFromSourceVolumeTest-997908831 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.779s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 11:09:15 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-76516351-8afc-435f-a5a0-ef9193fa4eb6 tempest-CreateVolumesFromSourceVolumeTest-997908831 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T10:09:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1687949261',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b8f175d3-8e66-4015-8397-ec340a2b262b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6f33f91e454437fa8e5174e4e2149b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T10:09:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T10:09:13Z,use_quota=True,user_id='185232856a5a4367b4afdaf5497dfdef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8989e4f-21e3-4f0a-9584-0d818784e883),volume_type_id=f8989e4f-21e3-4f0a-9584-0d818784e883)}" {{(pid=87272) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 04 11:09:15 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.remotefs [None req-76516351-8afc-435f-a5a0-ef9193fa4eb6 tempest-CreateVolumesFromSourceVolumeTest-997908831 None] Creating volume b8f175d3-8e66-4015-8397-ec340a2b262b {{(pid=87272) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 11:09:15 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-76516351-8afc-435f-a5a0-ef9193fa4eb6 tempest-CreateVolumesFromSourceVolumeTest-997908831 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 11:09:15 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-76516351-8afc-435f-a5a0-ef9193fa4eb6 tempest-CreateVolumesFromSourceVolumeTest-997908831 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 11:09:15 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-76516351-8afc-435f-a5a0-ef9193fa4eb6 tempest-CreateVolumesFromSourceVolumeTest-997908831 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898': None} {{(pid=87272) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 11:09:15 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-76516351-8afc-435f-a5a0-ef9193fa4eb6 tempest-CreateVolumesFromSourceVolumeTest-997908831 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'] {{(pid=87272) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 11:09:15 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-76516351-8afc-435f-a5a0-ef9193fa4eb6 tempest-CreateVolumesFromSourceVolumeTest-997908831 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 11:09:15 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-76516351-8afc-435f-a5a0-ef9193fa4eb6 tempest-CreateVolumesFromSourceVolumeTest-997908831 None] Selected osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898 as target Quobyte volume. {{(pid=87272) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 11:09:15 devstack cinder-volume[87272]: INFO cinder.volume.drivers.remotefs [None req-76516351-8afc-435f-a5a0-ef9193fa4eb6 tempest-CreateVolumesFromSourceVolumeTest-997908831 None] casted to osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898 Nov 04 11:09:15 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-76516351-8afc-435f-a5a0-ef9193fa4eb6 tempest-CreateVolumesFromSourceVolumeTest-997908831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-b8f175d3-8e66-4015-8397-ec340a2b262b 1073741824 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:09:15 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-7ab60328-1804-4312-99cd-a64583dc48a3 tempest-CreateVolumesFromSourceVolumeTest-997908831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (492fea78-0a29-4d72-906d-500e48eaf7c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9a3ef7cc-dc64-4b32-99b9-9b7a8593a0cb', 'volume_size': 1}' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:09:15 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-7ab60328-1804-4312-99cd-a64583dc48a3 tempest-CreateVolumesFromSourceVolumeTest-997908831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a2a7142-82d5-4532-b0c7-049289d979d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:09:15 devstack sudo[106355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-b8f175d3-8e66-4015-8397-ec340a2b262b 1073741824 Nov 04 11:09:15 devstack sudo[106355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:09:15 devstack cinder-volume[87272]: INFO cinder.volume.flows.manager.create_volume [None req-7ab60328-1804-4312-99cd-a64583dc48a3 tempest-CreateVolumesFromSourceVolumeTest-997908831 None] Volume volume-9a3ef7cc-dc64-4b32-99b9-9b7a8593a0cb (9a3ef7cc-dc64-4b32-99b9-9b7a8593a0cb): created successfully Nov 04 11:09:15 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-7ab60328-1804-4312-99cd-a64583dc48a3 tempest-CreateVolumesFromSourceVolumeTest-997908831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a2a7142-82d5-4532-b0c7-049289d979d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:09:15 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-7ab60328-1804-4312-99cd-a64583dc48a3 tempest-CreateVolumesFromSourceVolumeTest-997908831 None] Flow 'volume_create_manager' (bd3bd9be-9415-4052-8f24-441ff40c7f22) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87272) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 11:09:15 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-7ab60328-1804-4312-99cd-a64583dc48a3 tempest-CreateVolumesFromSourceVolumeTest-997908831 None] Created volume successfully. Nov 04 11:09:15 devstack sudo[106355]: pam_unix(sudo:session): session closed for user root Nov 04 11:09:15 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-76516351-8afc-435f-a5a0-ef9193fa4eb6 tempest-CreateVolumesFromSourceVolumeTest-997908831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-b8f175d3-8e66-4015-8397-ec340a2b262b 1073741824" returned: 0 in 0.460s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:09:15 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-76516351-8afc-435f-a5a0-ef9193fa4eb6 tempest-CreateVolumesFromSourceVolumeTest-997908831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-b8f175d3-8e66-4015-8397-ec340a2b262b {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:09:15 devstack sudo[106360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-b8f175d3-8e66-4015-8397-ec340a2b262b Nov 04 11:09:15 devstack sudo[106360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:09:15 devstack sudo[106360]: pam_unix(sudo:session): session closed for user root Nov 04 11:09:15 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-76516351-8afc-435f-a5a0-ef9193fa4eb6 tempest-CreateVolumesFromSourceVolumeTest-997908831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-b8f175d3-8e66-4015-8397-ec340a2b262b" returned: 0 in 0.240s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:09:15 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-76516351-8afc-435f-a5a0-ef9193fa4eb6 tempest-CreateVolumesFromSourceVolumeTest-997908831 None] <== create_volume: return (743ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'} {{(pid=87272) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 04 11:09:15 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-76516351-8afc-435f-a5a0-ef9193fa4eb6 tempest-CreateVolumesFromSourceVolumeTest-997908831 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.746s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 11:09:15 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-76516351-8afc-435f-a5a0-ef9193fa4eb6 tempest-CreateVolumesFromSourceVolumeTest-997908831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1bd19602-fe23-4a3c-8780-5e59c509756c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b8f175d3-8e66-4015-8397-ec340a2b262b', 'volume_size': 1}' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:09:16 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-76516351-8afc-435f-a5a0-ef9193fa4eb6 tempest-CreateVolumesFromSourceVolumeTest-997908831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e431758-c9f2-402d-8068-511ccc291763) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:09:16 devstack cinder-volume[87272]: INFO cinder.volume.flows.manager.create_volume [None req-76516351-8afc-435f-a5a0-ef9193fa4eb6 tempest-CreateVolumesFromSourceVolumeTest-997908831 None] Volume volume-b8f175d3-8e66-4015-8397-ec340a2b262b (b8f175d3-8e66-4015-8397-ec340a2b262b): created successfully Nov 04 11:09:16 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-76516351-8afc-435f-a5a0-ef9193fa4eb6 tempest-CreateVolumesFromSourceVolumeTest-997908831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e431758-c9f2-402d-8068-511ccc291763) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:09:16 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-76516351-8afc-435f-a5a0-ef9193fa4eb6 tempest-CreateVolumesFromSourceVolumeTest-997908831 None] Flow 'volume_create_manager' (83d456be-9913-4229-b178-bb342b4a943b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87272) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 11:09:16 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-76516351-8afc-435f-a5a0-ef9193fa4eb6 tempest-CreateVolumesFromSourceVolumeTest-997908831 None] Created volume successfully. Nov 04 11:09:16 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-c9143923-4754-413c-93b4-5794b922be97 tempest-CreateVolumesFromSourceVolumeTest-997908831 None] Acquiring lock "cinder-b8f175d3-8e66-4015-8397-ec340a2b262b-delete_volume" by "delete_volume" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 11:09:16 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-c9143923-4754-413c-93b4-5794b922be97 tempest-CreateVolumesFromSourceVolumeTest-997908831 None] Lock "cinder-b8f175d3-8e66-4015-8397-ec340a2b262b-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 11:09:16 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-c9143923-4754-413c-93b4-5794b922be97 tempest-CreateVolumesFromSourceVolumeTest-997908831 None] Acquiring lock "cinder-quobyte-b8f175d3-8e66-4015-8397-ec340a2b262b" by "delete_volume" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 11:09:16 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-c9143923-4754-413c-93b4-5794b922be97 tempest-CreateVolumesFromSourceVolumeTest-997908831 None] Lock "cinder-quobyte-b8f175d3-8e66-4015-8397-ec340a2b262b" acquired by "delete_volume" :: waited 0.016s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 11:09:16 devstack cinder-volume[87272]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d041738-41f2-464a-94a6-51699985b277]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 11:09:16 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-c9143923-4754-413c-93b4-5794b922be97 tempest-CreateVolumesFromSourceVolumeTest-997908831 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-b8f175d3-8e66-4015-8397-ec340a2b262b {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:09:16 devstack sudo[106364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-b8f175d3-8e66-4015-8397-ec340a2b262b Nov 04 11:09:16 devstack sudo[106364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:09:17 devstack sudo[106364]: pam_unix(sudo:session): session closed for user root Nov 04 11:09:17 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-c9143923-4754-413c-93b4-5794b922be97 tempest-CreateVolumesFromSourceVolumeTest-997908831 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-b8f175d3-8e66-4015-8397-ec340a2b262b" returned: 0 in 0.351s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:09:17 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-c9143923-4754-413c-93b4-5794b922be97 tempest-CreateVolumesFromSourceVolumeTest-997908831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-b8f175d3-8e66-4015-8397-ec340a2b262b {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:09:17 devstack sudo[106369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-b8f175d3-8e66-4015-8397-ec340a2b262b Nov 04 11:09:17 devstack sudo[106369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:09:17 devstack sudo[106369]: pam_unix(sudo:session): session closed for user root Nov 04 11:09:17 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-c9143923-4754-413c-93b4-5794b922be97 tempest-CreateVolumesFromSourceVolumeTest-997908831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-b8f175d3-8e66-4015-8397-ec340a2b262b" returned: 0 in 0.247s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:09:17 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-c9143923-4754-413c-93b4-5794b922be97 tempest-CreateVolumesFromSourceVolumeTest-997908831 None] Lock "cinder-quobyte-b8f175d3-8e66-4015-8397-ec340a2b262b" released by "delete_volume" :: held 0.639s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 11:09:17 devstack cinder-volume[87272]: DEBUG cinder.quota [None req-c9143923-4754-413c-93b4-5794b922be97 tempest-CreateVolumesFromSourceVolumeTest-997908831 None] Created reservations ['ad7a4633-56f1-460e-ac23-0ba3dfeaf52b', '454c46fd-56e0-418a-a949-db7f6f351098', '64de704e-b21a-4ee7-9fbd-a2512669c765', 'be02ebcd-8a2e-406b-88b0-295a74dd46fe'] {{(pid=87272) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 11:09:17 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-c9143923-4754-413c-93b4-5794b922be97 tempest-CreateVolumesFromSourceVolumeTest-997908831 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 11:09:17 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-c9143923-4754-413c-93b4-5794b922be97 tempest-CreateVolumesFromSourceVolumeTest-997908831 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 11:09:17 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-c9143923-4754-413c-93b4-5794b922be97 tempest-CreateVolumesFromSourceVolumeTest-997908831 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898': None} {{(pid=87272) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 11:09:17 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-c9143923-4754-413c-93b4-5794b922be97 tempest-CreateVolumesFromSourceVolumeTest-997908831 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'] {{(pid=87272) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 11:09:17 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-c9143923-4754-413c-93b4-5794b922be97 tempest-CreateVolumesFromSourceVolumeTest-997908831 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 11:09:17 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-c9143923-4754-413c-93b4-5794b922be97 tempest-CreateVolumesFromSourceVolumeTest-997908831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:09:17 devstack sudo[106372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1 Nov 04 11:09:17 devstack sudo[106372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:09:17 devstack sudo[106372]: pam_unix(sudo:session): session closed for user root Nov 04 11:09:17 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-c9143923-4754-413c-93b4-5794b922be97 tempest-CreateVolumesFromSourceVolumeTest-997908831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1" returned: 0 in 0.240s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:09:17 devstack cinder-volume[87272]: DEBUG cinder.manager [None req-c9143923-4754-413c-93b4-5794b922be97 tempest-CreateVolumesFromSourceVolumeTest-997908831 None] Notifying Schedulers of capabilities ... {{(pid=87272) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 11:09:17 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-c9143923-4754-413c-93b4-5794b922be97 tempest-CreateVolumesFromSourceVolumeTest-997908831 None] Deleted volume successfully. Nov 04 11:09:17 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-c9143923-4754-413c-93b4-5794b922be97 tempest-CreateVolumesFromSourceVolumeTest-997908831 None] Lock "cinder-b8f175d3-8e66-4015-8397-ec340a2b262b-delete_volume" released by "delete_volume" :: held 1.086s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 11:09:17 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-706d6b8e-8c94-4b39-83ad-d694815038b9 tempest-CreateVolumesFromSourceVolumeTest-997908831 None] Acquiring lock "cinder-9a3ef7cc-dc64-4b32-99b9-9b7a8593a0cb-delete_volume" by "delete_volume" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 11:09:17 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-706d6b8e-8c94-4b39-83ad-d694815038b9 tempest-CreateVolumesFromSourceVolumeTest-997908831 None] Lock "cinder-9a3ef7cc-dc64-4b32-99b9-9b7a8593a0cb-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 11:09:17 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-706d6b8e-8c94-4b39-83ad-d694815038b9 tempest-CreateVolumesFromSourceVolumeTest-997908831 None] Acquiring lock "cinder-quobyte-9a3ef7cc-dc64-4b32-99b9-9b7a8593a0cb" by "delete_volume" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 11:09:17 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-706d6b8e-8c94-4b39-83ad-d694815038b9 tempest-CreateVolumesFromSourceVolumeTest-997908831 None] Lock "cinder-quobyte-9a3ef7cc-dc64-4b32-99b9-9b7a8593a0cb" acquired by "delete_volume" :: waited 0.019s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 11:09:18 devstack cinder-volume[87272]: DEBUG oslo.privsep.daemon [-] privsep: reply[1203d85b-7997-4ea7-a1b3-41be4b5ca202]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 11:09:18 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-706d6b8e-8c94-4b39-83ad-d694815038b9 tempest-CreateVolumesFromSourceVolumeTest-997908831 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-9a3ef7cc-dc64-4b32-99b9-9b7a8593a0cb {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:09:18 devstack sudo[106375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-9a3ef7cc-dc64-4b32-99b9-9b7a8593a0cb Nov 04 11:09:18 devstack sudo[106375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:09:18 devstack sudo[106375]: pam_unix(sudo:session): session closed for user root Nov 04 11:09:18 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-706d6b8e-8c94-4b39-83ad-d694815038b9 tempest-CreateVolumesFromSourceVolumeTest-997908831 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-9a3ef7cc-dc64-4b32-99b9-9b7a8593a0cb" returned: 0 in 0.376s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:09:18 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-706d6b8e-8c94-4b39-83ad-d694815038b9 tempest-CreateVolumesFromSourceVolumeTest-997908831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-9a3ef7cc-dc64-4b32-99b9-9b7a8593a0cb {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:09:18 devstack sudo[106380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-9a3ef7cc-dc64-4b32-99b9-9b7a8593a0cb Nov 04 11:09:18 devstack sudo[106380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:09:18 devstack sudo[106380]: pam_unix(sudo:session): session closed for user root Nov 04 11:09:18 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-706d6b8e-8c94-4b39-83ad-d694815038b9 tempest-CreateVolumesFromSourceVolumeTest-997908831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-9a3ef7cc-dc64-4b32-99b9-9b7a8593a0cb" returned: 0 in 0.260s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:09:18 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-706d6b8e-8c94-4b39-83ad-d694815038b9 tempest-CreateVolumesFromSourceVolumeTest-997908831 None] Lock "cinder-quobyte-9a3ef7cc-dc64-4b32-99b9-9b7a8593a0cb" released by "delete_volume" :: held 0.683s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 11:09:18 devstack cinder-volume[87272]: DEBUG cinder.quota [None req-706d6b8e-8c94-4b39-83ad-d694815038b9 tempest-CreateVolumesFromSourceVolumeTest-997908831 None] Created reservations ['ead8d622-d1c3-4908-9fc8-f0d969e6285b', 'd0273a45-6c8f-41e7-9dac-1ebf9a62a308', '024cb3e4-492f-42f0-b809-d7d7acbf5c1e', 'ff0285a2-ff40-4567-8b53-08b1075c6d55'] {{(pid=87272) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 11:09:18 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-706d6b8e-8c94-4b39-83ad-d694815038b9 tempest-CreateVolumesFromSourceVolumeTest-997908831 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 11:09:18 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-706d6b8e-8c94-4b39-83ad-d694815038b9 tempest-CreateVolumesFromSourceVolumeTest-997908831 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 11:09:18 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-706d6b8e-8c94-4b39-83ad-d694815038b9 tempest-CreateVolumesFromSourceVolumeTest-997908831 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898': None} {{(pid=87272) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 11:09:18 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-706d6b8e-8c94-4b39-83ad-d694815038b9 tempest-CreateVolumesFromSourceVolumeTest-997908831 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'] {{(pid=87272) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 11:09:18 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-706d6b8e-8c94-4b39-83ad-d694815038b9 tempest-CreateVolumesFromSourceVolumeTest-997908831 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 11:09:18 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-706d6b8e-8c94-4b39-83ad-d694815038b9 tempest-CreateVolumesFromSourceVolumeTest-997908831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:09:18 devstack sudo[106383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1 Nov 04 11:09:18 devstack sudo[106383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:09:19 devstack sudo[106383]: pam_unix(sudo:session): session closed for user root Nov 04 11:09:19 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-706d6b8e-8c94-4b39-83ad-d694815038b9 tempest-CreateVolumesFromSourceVolumeTest-997908831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1" returned: 0 in 0.256s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:09:19 devstack cinder-volume[87272]: DEBUG cinder.manager [None req-706d6b8e-8c94-4b39-83ad-d694815038b9 tempest-CreateVolumesFromSourceVolumeTest-997908831 None] Notifying Schedulers of capabilities ... {{(pid=87272) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 11:09:19 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-706d6b8e-8c94-4b39-83ad-d694815038b9 tempest-CreateVolumesFromSourceVolumeTest-997908831 None] Deleted volume successfully. Nov 04 11:09:19 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-706d6b8e-8c94-4b39-83ad-d694815038b9 tempest-CreateVolumesFromSourceVolumeTest-997908831 None] Lock "cinder-9a3ef7cc-dc64-4b32-99b9-9b7a8593a0cb-delete_volume" released by "delete_volume" :: held 1.153s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 11:09:19 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-b3b0e117-a36a-482f-883f-5a2c2b0fce0f tempest-CreateVolumesFromSourceVolumeTest-997908831 None] Acquiring lock "cinder-97b0bf7f-ea84-4009-96c9-c88042941949-delete_volume" by "delete_volume" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 11:09:19 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-b3b0e117-a36a-482f-883f-5a2c2b0fce0f tempest-CreateVolumesFromSourceVolumeTest-997908831 None] Lock "cinder-97b0bf7f-ea84-4009-96c9-c88042941949-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 11:09:19 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-b3b0e117-a36a-482f-883f-5a2c2b0fce0f tempest-CreateVolumesFromSourceVolumeTest-997908831 None] Acquiring lock "cinder-quobyte-97b0bf7f-ea84-4009-96c9-c88042941949" by "delete_volume" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 11:09:19 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-b3b0e117-a36a-482f-883f-5a2c2b0fce0f tempest-CreateVolumesFromSourceVolumeTest-997908831 None] Lock "cinder-quobyte-97b0bf7f-ea84-4009-96c9-c88042941949" acquired by "delete_volume" :: waited 0.024s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 11:09:19 devstack cinder-volume[87272]: DEBUG oslo.privsep.daemon [-] privsep: reply[be20d9d5-b894-4529-b245-799c0b27e261]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 11:09:19 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-b3b0e117-a36a-482f-883f-5a2c2b0fce0f tempest-CreateVolumesFromSourceVolumeTest-997908831 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-97b0bf7f-ea84-4009-96c9-c88042941949 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:09:19 devstack sudo[106386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-97b0bf7f-ea84-4009-96c9-c88042941949 Nov 04 11:09:19 devstack sudo[106386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:09:19 devstack sudo[106386]: pam_unix(sudo:session): session closed for user root Nov 04 11:09:19 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-b3b0e117-a36a-482f-883f-5a2c2b0fce0f tempest-CreateVolumesFromSourceVolumeTest-997908831 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-97b0bf7f-ea84-4009-96c9-c88042941949" returned: 0 in 0.355s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:09:19 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-b3b0e117-a36a-482f-883f-5a2c2b0fce0f tempest-CreateVolumesFromSourceVolumeTest-997908831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-97b0bf7f-ea84-4009-96c9-c88042941949 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:09:19 devstack sudo[106391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-97b0bf7f-ea84-4009-96c9-c88042941949 Nov 04 11:09:19 devstack sudo[106391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:09:19 devstack sudo[106391]: pam_unix(sudo:session): session closed for user root Nov 04 11:09:19 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-b3b0e117-a36a-482f-883f-5a2c2b0fce0f tempest-CreateVolumesFromSourceVolumeTest-997908831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-97b0bf7f-ea84-4009-96c9-c88042941949" returned: 0 in 0.252s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:09:19 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-b3b0e117-a36a-482f-883f-5a2c2b0fce0f tempest-CreateVolumesFromSourceVolumeTest-997908831 None] Lock "cinder-quobyte-97b0bf7f-ea84-4009-96c9-c88042941949" released by "delete_volume" :: held 0.650s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 11:09:19 devstack cinder-volume[87272]: DEBUG cinder.quota [None req-b3b0e117-a36a-482f-883f-5a2c2b0fce0f tempest-CreateVolumesFromSourceVolumeTest-997908831 None] Created reservations ['867adc91-da37-4d56-8d6c-522207159556', '95423e6b-2744-462d-a268-b511dd52a2f2', '0aff412c-2cac-4f3d-8829-29841a0f99c9', '266e94e7-c088-4613-9eaf-151284df8e82'] {{(pid=87272) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 11:09:19 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-b3b0e117-a36a-482f-883f-5a2c2b0fce0f tempest-CreateVolumesFromSourceVolumeTest-997908831 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 11:09:19 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-b3b0e117-a36a-482f-883f-5a2c2b0fce0f tempest-CreateVolumesFromSourceVolumeTest-997908831 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 11:09:19 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-b3b0e117-a36a-482f-883f-5a2c2b0fce0f tempest-CreateVolumesFromSourceVolumeTest-997908831 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898': None} {{(pid=87272) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 11:09:19 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-b3b0e117-a36a-482f-883f-5a2c2b0fce0f tempest-CreateVolumesFromSourceVolumeTest-997908831 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'] {{(pid=87272) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 11:09:19 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-b3b0e117-a36a-482f-883f-5a2c2b0fce0f tempest-CreateVolumesFromSourceVolumeTest-997908831 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 11:09:19 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-b3b0e117-a36a-482f-883f-5a2c2b0fce0f tempest-CreateVolumesFromSourceVolumeTest-997908831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:09:19 devstack sudo[106394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1 Nov 04 11:09:19 devstack sudo[106394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:09:20 devstack sudo[106394]: pam_unix(sudo:session): session closed for user root Nov 04 11:09:20 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-b3b0e117-a36a-482f-883f-5a2c2b0fce0f tempest-CreateVolumesFromSourceVolumeTest-997908831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1" returned: 0 in 0.252s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:09:20 devstack cinder-volume[87272]: DEBUG cinder.manager [None req-b3b0e117-a36a-482f-883f-5a2c2b0fce0f tempest-CreateVolumesFromSourceVolumeTest-997908831 None] Notifying Schedulers of capabilities ... {{(pid=87272) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 11:09:20 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-b3b0e117-a36a-482f-883f-5a2c2b0fce0f tempest-CreateVolumesFromSourceVolumeTest-997908831 None] Deleted volume successfully. Nov 04 11:09:20 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-b3b0e117-a36a-482f-883f-5a2c2b0fce0f tempest-CreateVolumesFromSourceVolumeTest-997908831 None] Lock "cinder-97b0bf7f-ea84-4009-96c9-c88042941949-delete_volume" released by "delete_volume" :: held 1.118s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 11:09:20 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-cacf28b3-c38b-46a5-b5a2-50ce2f030818 tempest-CreateVolumesFromSourceVolumeTest-997908831 None] Acquiring lock "cinder-8a48134f-6f6a-4bac-9ef2-cd3314af48b8-delete_volume" by "delete_volume" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 11:09:20 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-cacf28b3-c38b-46a5-b5a2-50ce2f030818 tempest-CreateVolumesFromSourceVolumeTest-997908831 None] Lock "cinder-8a48134f-6f6a-4bac-9ef2-cd3314af48b8-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 11:09:20 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-cacf28b3-c38b-46a5-b5a2-50ce2f030818 tempest-CreateVolumesFromSourceVolumeTest-997908831 None] Acquiring lock "cinder-quobyte-8a48134f-6f6a-4bac-9ef2-cd3314af48b8" by "delete_volume" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 11:09:20 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-cacf28b3-c38b-46a5-b5a2-50ce2f030818 tempest-CreateVolumesFromSourceVolumeTest-997908831 None] Lock "cinder-quobyte-8a48134f-6f6a-4bac-9ef2-cd3314af48b8" acquired by "delete_volume" :: waited 0.014s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 11:09:20 devstack cinder-volume[87272]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b9270cf-8e35-4e28-8bd5-8364a7fa8067]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 11:09:20 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-cacf28b3-c38b-46a5-b5a2-50ce2f030818 tempest-CreateVolumesFromSourceVolumeTest-997908831 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-8a48134f-6f6a-4bac-9ef2-cd3314af48b8 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:09:20 devstack sudo[106397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-8a48134f-6f6a-4bac-9ef2-cd3314af48b8 Nov 04 11:09:20 devstack sudo[106397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:09:20 devstack sudo[106397]: pam_unix(sudo:session): session closed for user root Nov 04 11:09:20 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-cacf28b3-c38b-46a5-b5a2-50ce2f030818 tempest-CreateVolumesFromSourceVolumeTest-997908831 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-8a48134f-6f6a-4bac-9ef2-cd3314af48b8" returned: 0 in 0.391s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:09:20 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-cacf28b3-c38b-46a5-b5a2-50ce2f030818 tempest-CreateVolumesFromSourceVolumeTest-997908831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-8a48134f-6f6a-4bac-9ef2-cd3314af48b8 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:09:20 devstack sudo[106402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-8a48134f-6f6a-4bac-9ef2-cd3314af48b8 Nov 04 11:09:20 devstack sudo[106402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:09:21 devstack sudo[106402]: pam_unix(sudo:session): session closed for user root Nov 04 11:09:21 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-cacf28b3-c38b-46a5-b5a2-50ce2f030818 tempest-CreateVolumesFromSourceVolumeTest-997908831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-8a48134f-6f6a-4bac-9ef2-cd3314af48b8" returned: 0 in 0.264s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:09:21 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-cacf28b3-c38b-46a5-b5a2-50ce2f030818 tempest-CreateVolumesFromSourceVolumeTest-997908831 None] Lock "cinder-quobyte-8a48134f-6f6a-4bac-9ef2-cd3314af48b8" released by "delete_volume" :: held 0.694s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 11:09:21 devstack cinder-volume[87272]: DEBUG cinder.quota [None req-cacf28b3-c38b-46a5-b5a2-50ce2f030818 tempest-CreateVolumesFromSourceVolumeTest-997908831 None] Created reservations ['13252527-1025-4849-8cfb-971f737196e3', '9d4275c5-e702-46d9-8f09-6824ecb5cfb5', '1b80570e-4383-4258-b246-10d1ea237cb1', 'fed48112-cb66-47c7-b390-f7fd8677fb6d'] {{(pid=87272) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 11:09:21 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-cacf28b3-c38b-46a5-b5a2-50ce2f030818 tempest-CreateVolumesFromSourceVolumeTest-997908831 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 11:09:21 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-cacf28b3-c38b-46a5-b5a2-50ce2f030818 tempest-CreateVolumesFromSourceVolumeTest-997908831 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 11:09:21 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-cacf28b3-c38b-46a5-b5a2-50ce2f030818 tempest-CreateVolumesFromSourceVolumeTest-997908831 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898': None} {{(pid=87272) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 11:09:21 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-cacf28b3-c38b-46a5-b5a2-50ce2f030818 tempest-CreateVolumesFromSourceVolumeTest-997908831 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'] {{(pid=87272) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 11:09:21 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-cacf28b3-c38b-46a5-b5a2-50ce2f030818 tempest-CreateVolumesFromSourceVolumeTest-997908831 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 11:09:21 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-cacf28b3-c38b-46a5-b5a2-50ce2f030818 tempest-CreateVolumesFromSourceVolumeTest-997908831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:09:21 devstack sudo[106405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1 Nov 04 11:09:21 devstack sudo[106405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:09:21 devstack sudo[106405]: pam_unix(sudo:session): session closed for user root Nov 04 11:09:21 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-cacf28b3-c38b-46a5-b5a2-50ce2f030818 tempest-CreateVolumesFromSourceVolumeTest-997908831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1" returned: 0 in 0.247s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:09:21 devstack cinder-volume[87272]: DEBUG cinder.manager [None req-cacf28b3-c38b-46a5-b5a2-50ce2f030818 tempest-CreateVolumesFromSourceVolumeTest-997908831 None] Notifying Schedulers of capabilities ... {{(pid=87272) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 11:09:21 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-cacf28b3-c38b-46a5-b5a2-50ce2f030818 tempest-CreateVolumesFromSourceVolumeTest-997908831 None] Deleted volume successfully. Nov 04 11:09:21 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-cacf28b3-c38b-46a5-b5a2-50ce2f030818 tempest-CreateVolumesFromSourceVolumeTest-997908831 None] Lock "cinder-8a48134f-6f6a-4bac-9ef2-cd3314af48b8-delete_volume" released by "delete_volume" :: held 1.134s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 11:09:21 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-234c2cba-3bcf-41a1-8081-6b7330b32b29 tempest-CreateVolumesFromSourceVolumeTest-997908831 None] Acquiring lock "cinder-9db1ce07-b8e0-4bb7-a908-685e5ba6cb78-delete_volume" by "delete_volume" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 11:09:21 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-234c2cba-3bcf-41a1-8081-6b7330b32b29 tempest-CreateVolumesFromSourceVolumeTest-997908831 None] Lock "cinder-9db1ce07-b8e0-4bb7-a908-685e5ba6cb78-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 11:09:21 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-234c2cba-3bcf-41a1-8081-6b7330b32b29 tempest-CreateVolumesFromSourceVolumeTest-997908831 None] Acquiring lock "cinder-quobyte-9db1ce07-b8e0-4bb7-a908-685e5ba6cb78" by "delete_volume" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 11:09:21 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-234c2cba-3bcf-41a1-8081-6b7330b32b29 tempest-CreateVolumesFromSourceVolumeTest-997908831 None] Lock "cinder-quobyte-9db1ce07-b8e0-4bb7-a908-685e5ba6cb78" acquired by "delete_volume" :: waited 0.018s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 11:09:21 devstack cinder-volume[87272]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cfcbe86-dad0-47b8-bbe2-1c28f66bbd20]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 11:09:21 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-234c2cba-3bcf-41a1-8081-6b7330b32b29 tempest-CreateVolumesFromSourceVolumeTest-997908831 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-9db1ce07-b8e0-4bb7-a908-685e5ba6cb78 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:09:21 devstack sudo[106409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-9db1ce07-b8e0-4bb7-a908-685e5ba6cb78 Nov 04 11:09:21 devstack sudo[106409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:09:21 devstack sudo[106409]: pam_unix(sudo:session): session closed for user root Nov 04 11:09:21 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-234c2cba-3bcf-41a1-8081-6b7330b32b29 tempest-CreateVolumesFromSourceVolumeTest-997908831 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-9db1ce07-b8e0-4bb7-a908-685e5ba6cb78" returned: 0 in 0.367s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:09:21 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-234c2cba-3bcf-41a1-8081-6b7330b32b29 tempest-CreateVolumesFromSourceVolumeTest-997908831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-9db1ce07-b8e0-4bb7-a908-685e5ba6cb78 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:09:21 devstack sudo[106419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-9db1ce07-b8e0-4bb7-a908-685e5ba6cb78 Nov 04 11:09:21 devstack sudo[106419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:09:22 devstack sudo[106419]: pam_unix(sudo:session): session closed for user root Nov 04 11:09:22 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-234c2cba-3bcf-41a1-8081-6b7330b32b29 tempest-CreateVolumesFromSourceVolumeTest-997908831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-9db1ce07-b8e0-4bb7-a908-685e5ba6cb78" returned: 0 in 0.246s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:09:22 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-234c2cba-3bcf-41a1-8081-6b7330b32b29 tempest-CreateVolumesFromSourceVolumeTest-997908831 None] Lock "cinder-quobyte-9db1ce07-b8e0-4bb7-a908-685e5ba6cb78" released by "delete_volume" :: held 0.658s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 11:09:22 devstack cinder-volume[87272]: DEBUG cinder.quota [None req-234c2cba-3bcf-41a1-8081-6b7330b32b29 tempest-CreateVolumesFromSourceVolumeTest-997908831 None] Created reservations ['77891885-6690-4ebd-9dab-08a1b5b5ebab', 'c890ffb3-e765-4518-8bb8-ee1316eb16d3', 'f8af496a-8961-4aee-ac44-d13c92f41c52', 'ea3dd542-fb29-4c71-a75f-2427c881a15e'] {{(pid=87272) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 11:09:22 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-234c2cba-3bcf-41a1-8081-6b7330b32b29 tempest-CreateVolumesFromSourceVolumeTest-997908831 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 11:09:22 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-234c2cba-3bcf-41a1-8081-6b7330b32b29 tempest-CreateVolumesFromSourceVolumeTest-997908831 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 11:09:22 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-234c2cba-3bcf-41a1-8081-6b7330b32b29 tempest-CreateVolumesFromSourceVolumeTest-997908831 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898': None} {{(pid=87272) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 11:09:22 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-234c2cba-3bcf-41a1-8081-6b7330b32b29 tempest-CreateVolumesFromSourceVolumeTest-997908831 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'] {{(pid=87272) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 11:09:22 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-234c2cba-3bcf-41a1-8081-6b7330b32b29 tempest-CreateVolumesFromSourceVolumeTest-997908831 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 11:09:22 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-234c2cba-3bcf-41a1-8081-6b7330b32b29 tempest-CreateVolumesFromSourceVolumeTest-997908831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:09:22 devstack sudo[106422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1 Nov 04 11:09:22 devstack sudo[106422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:09:22 devstack sudo[106422]: pam_unix(sudo:session): session closed for user root Nov 04 11:09:22 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-234c2cba-3bcf-41a1-8081-6b7330b32b29 tempest-CreateVolumesFromSourceVolumeTest-997908831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1" returned: 0 in 0.231s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:09:22 devstack cinder-volume[87272]: DEBUG cinder.manager [None req-234c2cba-3bcf-41a1-8081-6b7330b32b29 tempest-CreateVolumesFromSourceVolumeTest-997908831 None] Notifying Schedulers of capabilities ... {{(pid=87272) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 11:09:22 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-234c2cba-3bcf-41a1-8081-6b7330b32b29 tempest-CreateVolumesFromSourceVolumeTest-997908831 None] Deleted volume successfully. Nov 04 11:09:22 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-234c2cba-3bcf-41a1-8081-6b7330b32b29 tempest-CreateVolumesFromSourceVolumeTest-997908831 None] Lock "cinder-9db1ce07-b8e0-4bb7-a908-685e5ba6cb78-delete_volume" released by "delete_volume" :: held 1.139s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 11:09:22 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-243d141f-9dbf-45e7-8226-9e2f8d984e6a tempest-CreateVolumesFromSourceVolumeTest-997908831 None] Acquiring lock "cinder-83b1550c-b2ed-4488-8e22-de641f57e903-delete_volume" by "delete_volume" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 11:09:22 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-243d141f-9dbf-45e7-8226-9e2f8d984e6a tempest-CreateVolumesFromSourceVolumeTest-997908831 None] Lock "cinder-83b1550c-b2ed-4488-8e22-de641f57e903-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 11:09:22 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-243d141f-9dbf-45e7-8226-9e2f8d984e6a tempest-CreateVolumesFromSourceVolumeTest-997908831 None] Acquiring lock "cinder-quobyte-83b1550c-b2ed-4488-8e22-de641f57e903" by "delete_volume" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 11:09:22 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-243d141f-9dbf-45e7-8226-9e2f8d984e6a tempest-CreateVolumesFromSourceVolumeTest-997908831 None] Lock "cinder-quobyte-83b1550c-b2ed-4488-8e22-de641f57e903" acquired by "delete_volume" :: waited 0.014s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 11:09:22 devstack cinder-volume[87272]: DEBUG oslo.privsep.daemon [-] privsep: reply[75b0b5c3-d166-4257-b8e5-f8d7b8a9fa58]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 11:09:22 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-243d141f-9dbf-45e7-8226-9e2f8d984e6a tempest-CreateVolumesFromSourceVolumeTest-997908831 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-83b1550c-b2ed-4488-8e22-de641f57e903 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:09:22 devstack sudo[106425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-83b1550c-b2ed-4488-8e22-de641f57e903 Nov 04 11:09:22 devstack sudo[106425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:09:23 devstack sudo[106425]: pam_unix(sudo:session): session closed for user root Nov 04 11:09:23 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-243d141f-9dbf-45e7-8226-9e2f8d984e6a tempest-CreateVolumesFromSourceVolumeTest-997908831 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-83b1550c-b2ed-4488-8e22-de641f57e903" returned: 0 in 0.369s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:09:23 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-243d141f-9dbf-45e7-8226-9e2f8d984e6a tempest-CreateVolumesFromSourceVolumeTest-997908831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-83b1550c-b2ed-4488-8e22-de641f57e903 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:09:23 devstack sudo[106431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-83b1550c-b2ed-4488-8e22-de641f57e903 Nov 04 11:09:23 devstack sudo[106431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:09:23 devstack sudo[106431]: pam_unix(sudo:session): session closed for user root Nov 04 11:09:23 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-243d141f-9dbf-45e7-8226-9e2f8d984e6a tempest-CreateVolumesFromSourceVolumeTest-997908831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-83b1550c-b2ed-4488-8e22-de641f57e903" returned: 0 in 0.246s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:09:23 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-243d141f-9dbf-45e7-8226-9e2f8d984e6a tempest-CreateVolumesFromSourceVolumeTest-997908831 None] Lock "cinder-quobyte-83b1550c-b2ed-4488-8e22-de641f57e903" released by "delete_volume" :: held 0.655s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 11:09:23 devstack cinder-volume[87272]: DEBUG cinder.quota [None req-243d141f-9dbf-45e7-8226-9e2f8d984e6a tempest-CreateVolumesFromSourceVolumeTest-997908831 None] Created reservations ['f864c365-6346-4148-ab69-d54f0a472fb0', '0460cb15-2e53-453b-b30c-5a290fd003f0', '59f6d74f-589f-4dc3-9090-c4a2a877f425', '45b46eea-6128-4a3e-8dfa-67c5ecf1eb60'] {{(pid=87272) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 11:09:23 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-243d141f-9dbf-45e7-8226-9e2f8d984e6a tempest-CreateVolumesFromSourceVolumeTest-997908831 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 11:09:23 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-243d141f-9dbf-45e7-8226-9e2f8d984e6a tempest-CreateVolumesFromSourceVolumeTest-997908831 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 11:09:23 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-243d141f-9dbf-45e7-8226-9e2f8d984e6a tempest-CreateVolumesFromSourceVolumeTest-997908831 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898': None} {{(pid=87272) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 11:09:23 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-243d141f-9dbf-45e7-8226-9e2f8d984e6a tempest-CreateVolumesFromSourceVolumeTest-997908831 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'] {{(pid=87272) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 11:09:23 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-243d141f-9dbf-45e7-8226-9e2f8d984e6a tempest-CreateVolumesFromSourceVolumeTest-997908831 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 11:09:23 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-243d141f-9dbf-45e7-8226-9e2f8d984e6a tempest-CreateVolumesFromSourceVolumeTest-997908831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:09:23 devstack sudo[106434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1 Nov 04 11:09:23 devstack sudo[106434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:09:23 devstack sudo[106434]: pam_unix(sudo:session): session closed for user root Nov 04 11:09:23 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-243d141f-9dbf-45e7-8226-9e2f8d984e6a tempest-CreateVolumesFromSourceVolumeTest-997908831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1" returned: 0 in 0.278s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:09:23 devstack cinder-volume[87272]: DEBUG cinder.manager [None req-243d141f-9dbf-45e7-8226-9e2f8d984e6a tempest-CreateVolumesFromSourceVolumeTest-997908831 None] Notifying Schedulers of capabilities ... {{(pid=87272) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 11:09:23 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-243d141f-9dbf-45e7-8226-9e2f8d984e6a tempest-CreateVolumesFromSourceVolumeTest-997908831 None] Deleted volume successfully. Nov 04 11:09:23 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-243d141f-9dbf-45e7-8226-9e2f8d984e6a tempest-CreateVolumesFromSourceVolumeTest-997908831 None] Lock "cinder-83b1550c-b2ed-4488-8e22-de641f57e903-delete_volume" released by "delete_volume" :: held 1.138s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 11:09:27 devstack cinder-volume[87272]: DEBUG cinder.volume.flows.manager.create_volume [None req-82dca2c4-4279-4481-b72f-cf333bb36cad tempest-ProjectReaderTests-54936427 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87272) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 11:09:27 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-82dca2c4-4279-4481-b72f-cf333bb36cad tempest-ProjectReaderTests-54936427 None] Flow 'volume_create_manager' (d6a0fd54-32ae-42e0-ba7f-ef1393eaa5ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 11:09:27 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-82dca2c4-4279-4481-b72f-cf333bb36cad tempest-ProjectReaderTests-54936427 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9410665e-22ca-4907-a3ed-0b838da3d7fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:09:27 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-82dca2c4-4279-4481-b72f-cf333bb36cad tempest-ProjectReaderTests-54936427 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9410665e-22ca-4907-a3ed-0b838da3d7fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T10:09:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1423047586',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d0dad767-34be-41a3-8dca-33fcbfdec578,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0efe5ab44c1344b6b7bb6aa1fd28a48f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T10:09:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T10:09:27Z,use_quota=True,user_id='0b50e3f8fd474307a951aaebaf872d4f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8989e4f-21e3-4f0a-9584-0d818784e883),volume_type_id=f8989e4f-21e3-4f0a-9584-0d818784e883)' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:09:27 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-82dca2c4-4279-4481-b72f-cf333bb36cad tempest-ProjectReaderTests-54936427 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b22d50a1-c660-4b59-9649-8cad1a9d29e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:09:27 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-82dca2c4-4279-4481-b72f-cf333bb36cad tempest-ProjectReaderTests-54936427 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b22d50a1-c660-4b59-9649-8cad1a9d29e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:09:27 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-82dca2c4-4279-4481-b72f-cf333bb36cad tempest-ProjectReaderTests-54936427 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4fbfcc3f-31b4-41da-b582-4c2dd4cbd7e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:09:27 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-82dca2c4-4279-4481-b72f-cf333bb36cad tempest-ProjectReaderTests-54936427 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4fbfcc3f-31b4-41da-b582-4c2dd4cbd7e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd0dad767-34be-41a3-8dca-33fcbfdec578', 'volume_name': 'volume-d0dad767-34be-41a3-8dca-33fcbfdec578', 'volume_size': 1}' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:09:27 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-82dca2c4-4279-4481-b72f-cf333bb36cad tempest-ProjectReaderTests-54936427 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01ea896d-46fd-479e-8f0b-b375c98f9b72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:09:27 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-82dca2c4-4279-4481-b72f-cf333bb36cad tempest-ProjectReaderTests-54936427 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01ea896d-46fd-479e-8f0b-b375c98f9b72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:09:27 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-82dca2c4-4279-4481-b72f-cf333bb36cad tempest-ProjectReaderTests-54936427 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13c8cc3b-42b6-436b-8fd4-9e0e60ab6851) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:09:27 devstack cinder-volume[87272]: INFO cinder.volume.flows.manager.create_volume [None req-82dca2c4-4279-4481-b72f-cf333bb36cad tempest-ProjectReaderTests-54936427 None] Volume d0dad767-34be-41a3-8dca-33fcbfdec578: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d0dad767-34be-41a3-8dca-33fcbfdec578', 'volume_size': 1} Nov 04 11:09:27 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-82dca2c4-4279-4481-b72f-cf333bb36cad tempest-ProjectReaderTests-54936427 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 11:09:27 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-82dca2c4-4279-4481-b72f-cf333bb36cad tempest-ProjectReaderTests-54936427 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 11:09:27 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-82dca2c4-4279-4481-b72f-cf333bb36cad tempest-ProjectReaderTests-54936427 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T10:09:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1423047586',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d0dad767-34be-41a3-8dca-33fcbfdec578,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0efe5ab44c1344b6b7bb6aa1fd28a48f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T10:09:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T10:09:27Z,use_quota=True,user_id='0b50e3f8fd474307a951aaebaf872d4f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8989e4f-21e3-4f0a-9584-0d818784e883),volume_type_id=f8989e4f-21e3-4f0a-9584-0d818784e883)}" {{(pid=87272) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 04 11:09:27 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.remotefs [None req-82dca2c4-4279-4481-b72f-cf333bb36cad tempest-ProjectReaderTests-54936427 None] Creating volume d0dad767-34be-41a3-8dca-33fcbfdec578 {{(pid=87272) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 11:09:27 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-82dca2c4-4279-4481-b72f-cf333bb36cad tempest-ProjectReaderTests-54936427 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 11:09:27 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-82dca2c4-4279-4481-b72f-cf333bb36cad tempest-ProjectReaderTests-54936427 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 11:09:27 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-82dca2c4-4279-4481-b72f-cf333bb36cad tempest-ProjectReaderTests-54936427 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898': None} {{(pid=87272) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 11:09:27 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-82dca2c4-4279-4481-b72f-cf333bb36cad tempest-ProjectReaderTests-54936427 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'] {{(pid=87272) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 11:09:27 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-82dca2c4-4279-4481-b72f-cf333bb36cad tempest-ProjectReaderTests-54936427 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 11:09:27 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-82dca2c4-4279-4481-b72f-cf333bb36cad tempest-ProjectReaderTests-54936427 None] Selected osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898 as target Quobyte volume. {{(pid=87272) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 11:09:27 devstack cinder-volume[87272]: INFO cinder.volume.drivers.remotefs [None req-82dca2c4-4279-4481-b72f-cf333bb36cad tempest-ProjectReaderTests-54936427 None] casted to osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898 Nov 04 11:09:27 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-82dca2c4-4279-4481-b72f-cf333bb36cad tempest-ProjectReaderTests-54936427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-d0dad767-34be-41a3-8dca-33fcbfdec578 1073741824 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:09:27 devstack sudo[106441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-d0dad767-34be-41a3-8dca-33fcbfdec578 1073741824 Nov 04 11:09:27 devstack sudo[106441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:09:27 devstack sudo[106441]: pam_unix(sudo:session): session closed for user root Nov 04 11:09:27 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-82dca2c4-4279-4481-b72f-cf333bb36cad tempest-ProjectReaderTests-54936427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-d0dad767-34be-41a3-8dca-33fcbfdec578 1073741824" returned: 0 in 0.405s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:09:27 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-82dca2c4-4279-4481-b72f-cf333bb36cad tempest-ProjectReaderTests-54936427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-d0dad767-34be-41a3-8dca-33fcbfdec578 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:09:27 devstack sudo[106447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-d0dad767-34be-41a3-8dca-33fcbfdec578 Nov 04 11:09:27 devstack sudo[106447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:09:27 devstack sudo[106447]: pam_unix(sudo:session): session closed for user root Nov 04 11:09:27 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-82dca2c4-4279-4481-b72f-cf333bb36cad tempest-ProjectReaderTests-54936427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-d0dad767-34be-41a3-8dca-33fcbfdec578" returned: 0 in 0.254s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:09:27 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-82dca2c4-4279-4481-b72f-cf333bb36cad tempest-ProjectReaderTests-54936427 None] <== create_volume: return (699ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'} {{(pid=87272) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 04 11:09:27 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-82dca2c4-4279-4481-b72f-cf333bb36cad tempest-ProjectReaderTests-54936427 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.702s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 11:09:27 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-82dca2c4-4279-4481-b72f-cf333bb36cad tempest-ProjectReaderTests-54936427 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13c8cc3b-42b6-436b-8fd4-9e0e60ab6851) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d0dad767-34be-41a3-8dca-33fcbfdec578', 'volume_size': 1}' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:09:27 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-82dca2c4-4279-4481-b72f-cf333bb36cad tempest-ProjectReaderTests-54936427 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd10c55b-4e1a-45ac-9218-ea1f088b5027) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:09:27 devstack cinder-volume[87272]: INFO cinder.volume.flows.manager.create_volume [None req-82dca2c4-4279-4481-b72f-cf333bb36cad tempest-ProjectReaderTests-54936427 None] Volume volume-d0dad767-34be-41a3-8dca-33fcbfdec578 (d0dad767-34be-41a3-8dca-33fcbfdec578): created successfully Nov 04 11:09:27 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-82dca2c4-4279-4481-b72f-cf333bb36cad tempest-ProjectReaderTests-54936427 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd10c55b-4e1a-45ac-9218-ea1f088b5027) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:09:27 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-82dca2c4-4279-4481-b72f-cf333bb36cad tempest-ProjectReaderTests-54936427 None] Flow 'volume_create_manager' (d6a0fd54-32ae-42e0-ba7f-ef1393eaa5ae) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87272) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 11:09:27 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-82dca2c4-4279-4481-b72f-cf333bb36cad tempest-ProjectReaderTests-54936427 None] Created volume successfully. Nov 04 11:09:28 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-ed0cd096-13f9-433f-9aa8-d807b52a9237 tempest-ProjectReaderTests-54936427 None] Acquiring lock "cinder-d0dad767-34be-41a3-8dca-33fcbfdec578-delete_volume" by "delete_volume" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 11:09:28 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-ed0cd096-13f9-433f-9aa8-d807b52a9237 tempest-ProjectReaderTests-54936427 None] Lock "cinder-d0dad767-34be-41a3-8dca-33fcbfdec578-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 11:09:28 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-ed0cd096-13f9-433f-9aa8-d807b52a9237 tempest-ProjectReaderTests-54936427 None] Acquiring lock "cinder-quobyte-d0dad767-34be-41a3-8dca-33fcbfdec578" by "delete_volume" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 11:09:28 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-ed0cd096-13f9-433f-9aa8-d807b52a9237 tempest-ProjectReaderTests-54936427 None] Lock "cinder-quobyte-d0dad767-34be-41a3-8dca-33fcbfdec578" acquired by "delete_volume" :: waited 0.017s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 11:09:28 devstack cinder-volume[87272]: DEBUG oslo.privsep.daemon [-] privsep: reply[4285c20b-abc6-436a-809d-095bd92a5f25]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 11:09:28 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-ed0cd096-13f9-433f-9aa8-d807b52a9237 tempest-ProjectReaderTests-54936427 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-d0dad767-34be-41a3-8dca-33fcbfdec578 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:09:28 devstack sudo[106450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-d0dad767-34be-41a3-8dca-33fcbfdec578 Nov 04 11:09:28 devstack sudo[106450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:09:28 devstack sudo[106450]: pam_unix(sudo:session): session closed for user root Nov 04 11:09:28 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-ed0cd096-13f9-433f-9aa8-d807b52a9237 tempest-ProjectReaderTests-54936427 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-d0dad767-34be-41a3-8dca-33fcbfdec578" returned: 0 in 0.369s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:09:28 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-ed0cd096-13f9-433f-9aa8-d807b52a9237 tempest-ProjectReaderTests-54936427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-d0dad767-34be-41a3-8dca-33fcbfdec578 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:09:28 devstack sudo[106455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-d0dad767-34be-41a3-8dca-33fcbfdec578 Nov 04 11:09:28 devstack sudo[106455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:09:29 devstack sudo[106455]: pam_unix(sudo:session): session closed for user root Nov 04 11:09:29 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-ed0cd096-13f9-433f-9aa8-d807b52a9237 tempest-ProjectReaderTests-54936427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-d0dad767-34be-41a3-8dca-33fcbfdec578" returned: 0 in 0.243s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:09:29 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-ed0cd096-13f9-433f-9aa8-d807b52a9237 tempest-ProjectReaderTests-54936427 None] Lock "cinder-quobyte-d0dad767-34be-41a3-8dca-33fcbfdec578" released by "delete_volume" :: held 0.666s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 11:09:29 devstack cinder-volume[87272]: DEBUG cinder.quota [None req-ed0cd096-13f9-433f-9aa8-d807b52a9237 tempest-ProjectReaderTests-54936427 None] Created reservations ['ea091650-96db-4570-a619-b7b349fc0654', '5c0cd5a6-f3bf-492a-86c1-ef1470992aa8', '3dfee8cd-b646-4dd6-84f9-f69d23b1958b', '4c42e322-4923-4599-aedb-7138211f820d'] {{(pid=87272) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 11:09:29 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-ed0cd096-13f9-433f-9aa8-d807b52a9237 tempest-ProjectReaderTests-54936427 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 11:09:29 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-ed0cd096-13f9-433f-9aa8-d807b52a9237 tempest-ProjectReaderTests-54936427 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 11:09:29 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-ed0cd096-13f9-433f-9aa8-d807b52a9237 tempest-ProjectReaderTests-54936427 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898': None} {{(pid=87272) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 11:09:29 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-ed0cd096-13f9-433f-9aa8-d807b52a9237 tempest-ProjectReaderTests-54936427 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'] {{(pid=87272) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 11:09:29 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-ed0cd096-13f9-433f-9aa8-d807b52a9237 tempest-ProjectReaderTests-54936427 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 11:09:29 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-ed0cd096-13f9-433f-9aa8-d807b52a9237 tempest-ProjectReaderTests-54936427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:09:29 devstack sudo[106458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1 Nov 04 11:09:29 devstack sudo[106458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:09:29 devstack sudo[106458]: pam_unix(sudo:session): session closed for user root Nov 04 11:09:29 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-ed0cd096-13f9-433f-9aa8-d807b52a9237 tempest-ProjectReaderTests-54936427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1" returned: 0 in 0.253s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:09:29 devstack cinder-volume[87272]: DEBUG cinder.manager [None req-ed0cd096-13f9-433f-9aa8-d807b52a9237 tempest-ProjectReaderTests-54936427 None] Notifying Schedulers of capabilities ... {{(pid=87272) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 11:09:29 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-ed0cd096-13f9-433f-9aa8-d807b52a9237 tempest-ProjectReaderTests-54936427 None] Deleted volume successfully. Nov 04 11:09:29 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-ed0cd096-13f9-433f-9aa8-d807b52a9237 tempest-ProjectReaderTests-54936427 None] Lock "cinder-d0dad767-34be-41a3-8dca-33fcbfdec578-delete_volume" released by "delete_volume" :: held 1.144s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 11:09:29 devstack cinder-volume[87272]: DEBUG cinder.volume.flows.manager.create_volume [None req-8ab4a8e1-2100-4a06-b26c-e52a11429afb tempest-ProjectReaderTests-54936427 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87272) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 11:09:29 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-8ab4a8e1-2100-4a06-b26c-e52a11429afb tempest-ProjectReaderTests-54936427 None] Flow 'volume_create_manager' (658d8078-33d5-42af-a7c2-56e530793ee3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 11:09:29 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-8ab4a8e1-2100-4a06-b26c-e52a11429afb tempest-ProjectReaderTests-54936427 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (372dd196-4caf-4b6a-a2aa-3fd3bd3ddf42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:09:29 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-8ab4a8e1-2100-4a06-b26c-e52a11429afb tempest-ProjectReaderTests-54936427 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (372dd196-4caf-4b6a-a2aa-3fd3bd3ddf42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T10:09:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1877044615',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f7832834-80a4-406a-90ee-1490bd855ad8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0efe5ab44c1344b6b7bb6aa1fd28a48f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T10:09:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T10:09:30Z,use_quota=True,user_id='0b50e3f8fd474307a951aaebaf872d4f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8989e4f-21e3-4f0a-9584-0d818784e883),volume_type_id=f8989e4f-21e3-4f0a-9584-0d818784e883)' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:09:29 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-8ab4a8e1-2100-4a06-b26c-e52a11429afb tempest-ProjectReaderTests-54936427 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (620365b8-69c9-44a9-89c8-4182d70aeac4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:09:29 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-8ab4a8e1-2100-4a06-b26c-e52a11429afb tempest-ProjectReaderTests-54936427 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (620365b8-69c9-44a9-89c8-4182d70aeac4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:09:29 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-8ab4a8e1-2100-4a06-b26c-e52a11429afb tempest-ProjectReaderTests-54936427 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (91c7a8ed-55f4-4ece-b93d-cceabda2d99d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:09:29 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-8ab4a8e1-2100-4a06-b26c-e52a11429afb tempest-ProjectReaderTests-54936427 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (91c7a8ed-55f4-4ece-b93d-cceabda2d99d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f7832834-80a4-406a-90ee-1490bd855ad8', 'volume_name': 'volume-f7832834-80a4-406a-90ee-1490bd855ad8', 'volume_size': 1}' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:09:29 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-8ab4a8e1-2100-4a06-b26c-e52a11429afb tempest-ProjectReaderTests-54936427 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1111b19-2074-4d40-bca8-d5ca6192bf5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:09:29 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-8ab4a8e1-2100-4a06-b26c-e52a11429afb tempest-ProjectReaderTests-54936427 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1111b19-2074-4d40-bca8-d5ca6192bf5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:09:30 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-8ab4a8e1-2100-4a06-b26c-e52a11429afb tempest-ProjectReaderTests-54936427 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7ed25c2-eb6c-4884-abd7-bb864ae34b78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:09:30 devstack cinder-volume[87272]: INFO cinder.volume.flows.manager.create_volume [None req-8ab4a8e1-2100-4a06-b26c-e52a11429afb tempest-ProjectReaderTests-54936427 None] Volume f7832834-80a4-406a-90ee-1490bd855ad8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f7832834-80a4-406a-90ee-1490bd855ad8', 'volume_size': 1} Nov 04 11:09:30 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-8ab4a8e1-2100-4a06-b26c-e52a11429afb tempest-ProjectReaderTests-54936427 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 11:09:30 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-8ab4a8e1-2100-4a06-b26c-e52a11429afb tempest-ProjectReaderTests-54936427 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 11:09:30 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-8ab4a8e1-2100-4a06-b26c-e52a11429afb tempest-ProjectReaderTests-54936427 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T10:09:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1877044615',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f7832834-80a4-406a-90ee-1490bd855ad8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0efe5ab44c1344b6b7bb6aa1fd28a48f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T10:09:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T10:09:30Z,use_quota=True,user_id='0b50e3f8fd474307a951aaebaf872d4f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8989e4f-21e3-4f0a-9584-0d818784e883),volume_type_id=f8989e4f-21e3-4f0a-9584-0d818784e883)}" {{(pid=87272) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 04 11:09:30 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.remotefs [None req-8ab4a8e1-2100-4a06-b26c-e52a11429afb tempest-ProjectReaderTests-54936427 None] Creating volume f7832834-80a4-406a-90ee-1490bd855ad8 {{(pid=87272) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 11:09:30 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-8ab4a8e1-2100-4a06-b26c-e52a11429afb tempest-ProjectReaderTests-54936427 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 11:09:30 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-8ab4a8e1-2100-4a06-b26c-e52a11429afb tempest-ProjectReaderTests-54936427 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 11:09:30 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-8ab4a8e1-2100-4a06-b26c-e52a11429afb tempest-ProjectReaderTests-54936427 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898': None} {{(pid=87272) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 11:09:30 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-8ab4a8e1-2100-4a06-b26c-e52a11429afb tempest-ProjectReaderTests-54936427 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'] {{(pid=87272) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 11:09:30 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-8ab4a8e1-2100-4a06-b26c-e52a11429afb tempest-ProjectReaderTests-54936427 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 11:09:30 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-8ab4a8e1-2100-4a06-b26c-e52a11429afb tempest-ProjectReaderTests-54936427 None] Selected osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898 as target Quobyte volume. {{(pid=87272) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 11:09:30 devstack cinder-volume[87272]: INFO cinder.volume.drivers.remotefs [None req-8ab4a8e1-2100-4a06-b26c-e52a11429afb tempest-ProjectReaderTests-54936427 None] casted to osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898 Nov 04 11:09:30 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-8ab4a8e1-2100-4a06-b26c-e52a11429afb tempest-ProjectReaderTests-54936427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-f7832834-80a4-406a-90ee-1490bd855ad8 1073741824 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:09:30 devstack sudo[106461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-f7832834-80a4-406a-90ee-1490bd855ad8 1073741824 Nov 04 11:09:30 devstack sudo[106461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:09:30 devstack sudo[106461]: pam_unix(sudo:session): session closed for user root Nov 04 11:09:30 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-8ab4a8e1-2100-4a06-b26c-e52a11429afb tempest-ProjectReaderTests-54936427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-f7832834-80a4-406a-90ee-1490bd855ad8 1073741824" returned: 0 in 0.422s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:09:30 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-8ab4a8e1-2100-4a06-b26c-e52a11429afb tempest-ProjectReaderTests-54936427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-f7832834-80a4-406a-90ee-1490bd855ad8 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:09:30 devstack sudo[106466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-f7832834-80a4-406a-90ee-1490bd855ad8 Nov 04 11:09:30 devstack sudo[106466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:09:30 devstack sudo[106466]: pam_unix(sudo:session): session closed for user root Nov 04 11:09:30 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-8ab4a8e1-2100-4a06-b26c-e52a11429afb tempest-ProjectReaderTests-54936427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-f7832834-80a4-406a-90ee-1490bd855ad8" returned: 0 in 0.231s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:09:30 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-8ab4a8e1-2100-4a06-b26c-e52a11429afb tempest-ProjectReaderTests-54936427 None] <== create_volume: return (694ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'} {{(pid=87272) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 04 11:09:30 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-8ab4a8e1-2100-4a06-b26c-e52a11429afb tempest-ProjectReaderTests-54936427 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.697s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 11:09:30 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-8ab4a8e1-2100-4a06-b26c-e52a11429afb tempest-ProjectReaderTests-54936427 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7ed25c2-eb6c-4884-abd7-bb864ae34b78) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f7832834-80a4-406a-90ee-1490bd855ad8', 'volume_size': 1}' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:09:30 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-8ab4a8e1-2100-4a06-b26c-e52a11429afb tempest-ProjectReaderTests-54936427 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71620624-4fcb-450e-b171-61e1f44c8687) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:09:30 devstack cinder-volume[87272]: INFO cinder.volume.flows.manager.create_volume [None req-8ab4a8e1-2100-4a06-b26c-e52a11429afb tempest-ProjectReaderTests-54936427 None] Volume volume-f7832834-80a4-406a-90ee-1490bd855ad8 (f7832834-80a4-406a-90ee-1490bd855ad8): created successfully Nov 04 11:09:30 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-8ab4a8e1-2100-4a06-b26c-e52a11429afb tempest-ProjectReaderTests-54936427 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71620624-4fcb-450e-b171-61e1f44c8687) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:09:30 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-8ab4a8e1-2100-4a06-b26c-e52a11429afb tempest-ProjectReaderTests-54936427 None] Flow 'volume_create_manager' (658d8078-33d5-42af-a7c2-56e530793ee3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87272) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 11:09:30 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-8ab4a8e1-2100-4a06-b26c-e52a11429afb tempest-ProjectReaderTests-54936427 None] Created volume successfully. Nov 04 11:09:30 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-1e919ac6-8177-48c5-b73e-24bcddbaf8b1 tempest-ProjectReaderTests-54936427 None] Acquiring lock "cinder-f7832834-80a4-406a-90ee-1490bd855ad8-delete_volume" by "delete_volume" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 11:09:30 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-1e919ac6-8177-48c5-b73e-24bcddbaf8b1 tempest-ProjectReaderTests-54936427 None] Lock "cinder-f7832834-80a4-406a-90ee-1490bd855ad8-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 11:09:31 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-1e919ac6-8177-48c5-b73e-24bcddbaf8b1 tempest-ProjectReaderTests-54936427 None] Acquiring lock "cinder-quobyte-f7832834-80a4-406a-90ee-1490bd855ad8" by "delete_volume" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 11:09:31 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-1e919ac6-8177-48c5-b73e-24bcddbaf8b1 tempest-ProjectReaderTests-54936427 None] Lock "cinder-quobyte-f7832834-80a4-406a-90ee-1490bd855ad8" acquired by "delete_volume" :: waited 0.015s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 11:09:31 devstack cinder-volume[87272]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ba76abf-05aa-4099-910c-d22e3f0c2e04]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 11:09:31 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-1e919ac6-8177-48c5-b73e-24bcddbaf8b1 tempest-ProjectReaderTests-54936427 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-f7832834-80a4-406a-90ee-1490bd855ad8 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:09:31 devstack sudo[106469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-f7832834-80a4-406a-90ee-1490bd855ad8 Nov 04 11:09:31 devstack sudo[106469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:09:31 devstack sudo[106469]: pam_unix(sudo:session): session closed for user root Nov 04 11:09:31 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-1e919ac6-8177-48c5-b73e-24bcddbaf8b1 tempest-ProjectReaderTests-54936427 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-f7832834-80a4-406a-90ee-1490bd855ad8" returned: 0 in 0.364s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:09:31 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-1e919ac6-8177-48c5-b73e-24bcddbaf8b1 tempest-ProjectReaderTests-54936427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-f7832834-80a4-406a-90ee-1490bd855ad8 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:09:31 devstack sudo[106474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-f7832834-80a4-406a-90ee-1490bd855ad8 Nov 04 11:09:31 devstack sudo[106474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:09:31 devstack sudo[106474]: pam_unix(sudo:session): session closed for user root Nov 04 11:09:31 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-1e919ac6-8177-48c5-b73e-24bcddbaf8b1 tempest-ProjectReaderTests-54936427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-f7832834-80a4-406a-90ee-1490bd855ad8" returned: 0 in 0.249s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:09:31 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-1e919ac6-8177-48c5-b73e-24bcddbaf8b1 tempest-ProjectReaderTests-54936427 None] Lock "cinder-quobyte-f7832834-80a4-406a-90ee-1490bd855ad8" released by "delete_volume" :: held 0.653s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 11:09:31 devstack cinder-volume[87272]: DEBUG cinder.quota [None req-1e919ac6-8177-48c5-b73e-24bcddbaf8b1 tempest-ProjectReaderTests-54936427 None] Created reservations ['79d6f2a4-d4a9-4f48-ad58-73964e056302', '1120257e-0dd2-4f63-b556-a00fc541015c', '7ca3e323-c9be-40c2-972c-27b2ce3fdd83', '7da0e33c-40d7-4470-8558-0e3c34f80de5'] {{(pid=87272) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 11:09:31 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-1e919ac6-8177-48c5-b73e-24bcddbaf8b1 tempest-ProjectReaderTests-54936427 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 11:09:31 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-1e919ac6-8177-48c5-b73e-24bcddbaf8b1 tempest-ProjectReaderTests-54936427 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 11:09:31 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-1e919ac6-8177-48c5-b73e-24bcddbaf8b1 tempest-ProjectReaderTests-54936427 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898': None} {{(pid=87272) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 11:09:31 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-1e919ac6-8177-48c5-b73e-24bcddbaf8b1 tempest-ProjectReaderTests-54936427 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'] {{(pid=87272) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 11:09:31 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-1e919ac6-8177-48c5-b73e-24bcddbaf8b1 tempest-ProjectReaderTests-54936427 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 11:09:31 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-1e919ac6-8177-48c5-b73e-24bcddbaf8b1 tempest-ProjectReaderTests-54936427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:09:31 devstack sudo[106477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1 Nov 04 11:09:31 devstack sudo[106477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:09:32 devstack sudo[106477]: pam_unix(sudo:session): session closed for user root Nov 04 11:09:32 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-1e919ac6-8177-48c5-b73e-24bcddbaf8b1 tempest-ProjectReaderTests-54936427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1" returned: 0 in 0.243s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:09:32 devstack cinder-volume[87272]: DEBUG cinder.manager [None req-1e919ac6-8177-48c5-b73e-24bcddbaf8b1 tempest-ProjectReaderTests-54936427 None] Notifying Schedulers of capabilities ... {{(pid=87272) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 11:09:32 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-1e919ac6-8177-48c5-b73e-24bcddbaf8b1 tempest-ProjectReaderTests-54936427 None] Deleted volume successfully. Nov 04 11:09:32 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-1e919ac6-8177-48c5-b73e-24bcddbaf8b1 tempest-ProjectReaderTests-54936427 None] Lock "cinder-f7832834-80a4-406a-90ee-1490bd855ad8-delete_volume" released by "delete_volume" :: held 1.091s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 11:09:41 devstack cinder-volume[87272]: DEBUG dbcounter [-] [87272] Writing DB stats cinder:SELECT=94,cinder:INSERT=31,cinder:UPDATE=146,cinder:DELETE=13 {{(pid=87272) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 11:09:42 devstack cinder-volume[87272]: DEBUG dbcounter [-] [87272] Writing DB stats cinder:UPDATE=140,cinder:SELECT=88,cinder:DELETE=13,cinder:INSERT=34 {{(pid=87272) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 11:09:47 devstack cinder-volume[87272]: DEBUG cinder.volume.flows.manager.create_volume [None req-6329fcc2-563b-4a9e-94c1-ad3b9b142730 tempest-CreateVolumesFromSnapshotTest-2009706975 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87272) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 11:09:47 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-6329fcc2-563b-4a9e-94c1-ad3b9b142730 tempest-CreateVolumesFromSnapshotTest-2009706975 None] Flow 'volume_create_manager' (1b2ea39c-66ae-4c6a-85c0-403bee0fb67d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 11:09:47 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-6329fcc2-563b-4a9e-94c1-ad3b9b142730 tempest-CreateVolumesFromSnapshotTest-2009706975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a708d60b-152b-4e3c-979a-80148654a096) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:09:47 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-6329fcc2-563b-4a9e-94c1-ad3b9b142730 tempest-CreateVolumesFromSnapshotTest-2009706975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a708d60b-152b-4e3c-979a-80148654a096) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T10:09:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1739213786',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=734fb143-2aba-48e6-9cc7-b27c6a66552f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a7cf076311674eb4ae990d0029f6b92e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T10:09:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T10:09:48Z,use_quota=True,user_id='79baf402f53c43fc86365839709ab62e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8989e4f-21e3-4f0a-9584-0d818784e883),volume_type_id=f8989e4f-21e3-4f0a-9584-0d818784e883)' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:09:47 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-6329fcc2-563b-4a9e-94c1-ad3b9b142730 tempest-CreateVolumesFromSnapshotTest-2009706975 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (05457906-3b1c-4c54-9cfb-545142290e87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:09:47 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-6329fcc2-563b-4a9e-94c1-ad3b9b142730 tempest-CreateVolumesFromSnapshotTest-2009706975 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (05457906-3b1c-4c54-9cfb-545142290e87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:09:47 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-6329fcc2-563b-4a9e-94c1-ad3b9b142730 tempest-CreateVolumesFromSnapshotTest-2009706975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5cb0deab-bc4d-4157-b609-42591e71d057) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:09:47 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-6329fcc2-563b-4a9e-94c1-ad3b9b142730 tempest-CreateVolumesFromSnapshotTest-2009706975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5cb0deab-bc4d-4157-b609-42591e71d057) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '734fb143-2aba-48e6-9cc7-b27c6a66552f', 'volume_name': 'volume-734fb143-2aba-48e6-9cc7-b27c6a66552f', 'volume_size': 1}' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:09:47 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-6329fcc2-563b-4a9e-94c1-ad3b9b142730 tempest-CreateVolumesFromSnapshotTest-2009706975 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aea3fe76-2d79-46c1-a6a3-f65bc35f7bfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:09:47 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-6329fcc2-563b-4a9e-94c1-ad3b9b142730 tempest-CreateVolumesFromSnapshotTest-2009706975 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aea3fe76-2d79-46c1-a6a3-f65bc35f7bfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:09:47 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-6329fcc2-563b-4a9e-94c1-ad3b9b142730 tempest-CreateVolumesFromSnapshotTest-2009706975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0805a3b8-1c6c-4c25-86a3-f93a5e7db139) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:09:47 devstack cinder-volume[87272]: INFO cinder.volume.flows.manager.create_volume [None req-6329fcc2-563b-4a9e-94c1-ad3b9b142730 tempest-CreateVolumesFromSnapshotTest-2009706975 None] Volume 734fb143-2aba-48e6-9cc7-b27c6a66552f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-734fb143-2aba-48e6-9cc7-b27c6a66552f', 'volume_size': 1} Nov 04 11:09:47 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-6329fcc2-563b-4a9e-94c1-ad3b9b142730 tempest-CreateVolumesFromSnapshotTest-2009706975 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 11:09:47 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-6329fcc2-563b-4a9e-94c1-ad3b9b142730 tempest-CreateVolumesFromSnapshotTest-2009706975 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 11:09:47 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-6329fcc2-563b-4a9e-94c1-ad3b9b142730 tempest-CreateVolumesFromSnapshotTest-2009706975 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T10:09:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1739213786',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=734fb143-2aba-48e6-9cc7-b27c6a66552f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a7cf076311674eb4ae990d0029f6b92e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T10:09:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T10:09:48Z,use_quota=True,user_id='79baf402f53c43fc86365839709ab62e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8989e4f-21e3-4f0a-9584-0d818784e883),volume_type_id=f8989e4f-21e3-4f0a-9584-0d818784e883)}" {{(pid=87272) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 04 11:09:47 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.remotefs [None req-6329fcc2-563b-4a9e-94c1-ad3b9b142730 tempest-CreateVolumesFromSnapshotTest-2009706975 None] Creating volume 734fb143-2aba-48e6-9cc7-b27c6a66552f {{(pid=87272) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 11:09:47 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-6329fcc2-563b-4a9e-94c1-ad3b9b142730 tempest-CreateVolumesFromSnapshotTest-2009706975 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 11:09:47 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-6329fcc2-563b-4a9e-94c1-ad3b9b142730 tempest-CreateVolumesFromSnapshotTest-2009706975 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 11:09:47 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-6329fcc2-563b-4a9e-94c1-ad3b9b142730 tempest-CreateVolumesFromSnapshotTest-2009706975 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898': None} {{(pid=87272) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 11:09:47 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-6329fcc2-563b-4a9e-94c1-ad3b9b142730 tempest-CreateVolumesFromSnapshotTest-2009706975 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'] {{(pid=87272) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 11:09:47 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-6329fcc2-563b-4a9e-94c1-ad3b9b142730 tempest-CreateVolumesFromSnapshotTest-2009706975 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 11:09:47 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-6329fcc2-563b-4a9e-94c1-ad3b9b142730 tempest-CreateVolumesFromSnapshotTest-2009706975 None] Selected osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898 as target Quobyte volume. {{(pid=87272) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 11:09:47 devstack cinder-volume[87272]: INFO cinder.volume.drivers.remotefs [None req-6329fcc2-563b-4a9e-94c1-ad3b9b142730 tempest-CreateVolumesFromSnapshotTest-2009706975 None] casted to osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898 Nov 04 11:09:47 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-6329fcc2-563b-4a9e-94c1-ad3b9b142730 tempest-CreateVolumesFromSnapshotTest-2009706975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-734fb143-2aba-48e6-9cc7-b27c6a66552f 1073741824 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:09:47 devstack sudo[106554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-734fb143-2aba-48e6-9cc7-b27c6a66552f 1073741824 Nov 04 11:09:47 devstack sudo[106554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:09:48 devstack cinder-volume[87272]: DEBUG cinder.volume.flows.manager.create_volume [None req-4b8a0baf-7f1a-4b05-b0f4-3ccd151a768b tempest-CreateVolumesFromImageTest-1429238948 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87272) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 11:09:48 devstack sudo[106554]: pam_unix(sudo:session): session closed for user root Nov 04 11:09:48 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-4b8a0baf-7f1a-4b05-b0f4-3ccd151a768b tempest-CreateVolumesFromImageTest-1429238948 None] Flow 'volume_create_manager' (8100c73b-b6e8-40ed-bd41-359e47df4ae7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 11:09:48 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-4b8a0baf-7f1a-4b05-b0f4-3ccd151a768b tempest-CreateVolumesFromImageTest-1429238948 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9146c451-4807-40f7-86d3-10fca3c42357) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:09:48 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-6329fcc2-563b-4a9e-94c1-ad3b9b142730 tempest-CreateVolumesFromSnapshotTest-2009706975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-734fb143-2aba-48e6-9cc7-b27c6a66552f 1073741824" returned: 0 in 0.643s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:09:48 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-4b8a0baf-7f1a-4b05-b0f4-3ccd151a768b tempest-CreateVolumesFromImageTest-1429238948 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9146c451-4807-40f7-86d3-10fca3c42357) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T10:09:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-934268835',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d7fd27b-d4a8-4a74-abc6-d772655476f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='31ee92f1f76e41bdb12fcd3dbad5951d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T10:09:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T10:09:48Z,use_quota=True,user_id='1715714a5a004c4caca73a2a220a40fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8989e4f-21e3-4f0a-9584-0d818784e883),volume_type_id=f8989e4f-21e3-4f0a-9584-0d818784e883)' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:09:48 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-4b8a0baf-7f1a-4b05-b0f4-3ccd151a768b tempest-CreateVolumesFromImageTest-1429238948 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2556c042-99e7-4bbd-9ce0-91ae30623c0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:09:48 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-4b8a0baf-7f1a-4b05-b0f4-3ccd151a768b tempest-CreateVolumesFromImageTest-1429238948 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2556c042-99e7-4bbd-9ce0-91ae30623c0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:09:48 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-4b8a0baf-7f1a-4b05-b0f4-3ccd151a768b tempest-CreateVolumesFromImageTest-1429238948 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aef46b95-e070-45d2-ad58-010dab429571) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:09:48 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-4b8a0baf-7f1a-4b05-b0f4-3ccd151a768b tempest-CreateVolumesFromImageTest-1429238948 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aef46b95-e070-45d2-ad58-010dab429571) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7d7fd27b-d4a8-4a74-abc6-d772655476f5', 'volume_name': 'volume-7d7fd27b-d4a8-4a74-abc6-d772655476f5', 'volume_size': 1}' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:09:48 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-4b8a0baf-7f1a-4b05-b0f4-3ccd151a768b tempest-CreateVolumesFromImageTest-1429238948 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0af4e5f5-4571-448c-8d67-22933d37b9ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:09:48 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-4b8a0baf-7f1a-4b05-b0f4-3ccd151a768b tempest-CreateVolumesFromImageTest-1429238948 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0af4e5f5-4571-448c-8d67-22933d37b9ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:09:48 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-4b8a0baf-7f1a-4b05-b0f4-3ccd151a768b tempest-CreateVolumesFromImageTest-1429238948 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (806bbed6-b67a-4ccb-ae2d-0a42c9a19046) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:09:48 devstack cinder-volume[87272]: INFO cinder.volume.flows.manager.create_volume [None req-4b8a0baf-7f1a-4b05-b0f4-3ccd151a768b tempest-CreateVolumesFromImageTest-1429238948 None] Volume 7d7fd27b-d4a8-4a74-abc6-d772655476f5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7d7fd27b-d4a8-4a74-abc6-d772655476f5', 'volume_size': 1} Nov 04 11:09:48 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-4b8a0baf-7f1a-4b05-b0f4-3ccd151a768b tempest-CreateVolumesFromImageTest-1429238948 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 11:09:48 devstack cinder-volume[87272]: DEBUG cinder.volume.flows.manager.create_volume [None req-0a71bffd-d422-4a32-99cd-e955f5fb7c2a tempest-CreateVolumesFromSourceVolumeTest-29009867 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87272) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 11:09:48 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-0a71bffd-d422-4a32-99cd-e955f5fb7c2a tempest-CreateVolumesFromSourceVolumeTest-29009867 None] Flow 'volume_create_manager' (eefa50f4-215e-4d79-bcd4-d1a8e5078125) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 11:09:48 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-0a71bffd-d422-4a32-99cd-e955f5fb7c2a tempest-CreateVolumesFromSourceVolumeTest-29009867 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a31a5c49-e7d3-4015-8aae-cbf24314782e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:09:48 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-0a71bffd-d422-4a32-99cd-e955f5fb7c2a tempest-CreateVolumesFromSourceVolumeTest-29009867 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a31a5c49-e7d3-4015-8aae-cbf24314782e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T10:09:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-39457202',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4774cf70-877c-48fd-9665-d5cdf99ecf22,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='147901517b8c4f76939552d314ca24cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T10:09:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T10:09:49Z,use_quota=True,user_id='786d418577bc457585572c60157f6545',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8989e4f-21e3-4f0a-9584-0d818784e883),volume_type_id=f8989e4f-21e3-4f0a-9584-0d818784e883)' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:09:48 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-0a71bffd-d422-4a32-99cd-e955f5fb7c2a tempest-CreateVolumesFromSourceVolumeTest-29009867 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e6cec1ca-196b-4d17-870d-454ed2b8d943) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:09:48 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-0a71bffd-d422-4a32-99cd-e955f5fb7c2a tempest-CreateVolumesFromSourceVolumeTest-29009867 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e6cec1ca-196b-4d17-870d-454ed2b8d943) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:09:48 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-0a71bffd-d422-4a32-99cd-e955f5fb7c2a tempest-CreateVolumesFromSourceVolumeTest-29009867 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9bbe6c61-0a46-4725-a4f9-92d0eead19b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:09:48 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-0a71bffd-d422-4a32-99cd-e955f5fb7c2a tempest-CreateVolumesFromSourceVolumeTest-29009867 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9bbe6c61-0a46-4725-a4f9-92d0eead19b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4774cf70-877c-48fd-9665-d5cdf99ecf22', 'volume_name': 'volume-4774cf70-877c-48fd-9665-d5cdf99ecf22', 'volume_size': 1}' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:09:48 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-0a71bffd-d422-4a32-99cd-e955f5fb7c2a tempest-CreateVolumesFromSourceVolumeTest-29009867 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d06baba-bd0c-46d6-88b6-8133e75cee53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:09:48 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-0a71bffd-d422-4a32-99cd-e955f5fb7c2a tempest-CreateVolumesFromSourceVolumeTest-29009867 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d06baba-bd0c-46d6-88b6-8133e75cee53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:09:48 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-0a71bffd-d422-4a32-99cd-e955f5fb7c2a tempest-CreateVolumesFromSourceVolumeTest-29009867 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1777d45-2108-456f-bb3c-6c4a34421491) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:09:48 devstack cinder-volume[87272]: INFO cinder.volume.flows.manager.create_volume [None req-0a71bffd-d422-4a32-99cd-e955f5fb7c2a tempest-CreateVolumesFromSourceVolumeTest-29009867 None] Volume 4774cf70-877c-48fd-9665-d5cdf99ecf22: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4774cf70-877c-48fd-9665-d5cdf99ecf22', 'volume_size': 1} Nov 04 11:09:48 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-0a71bffd-d422-4a32-99cd-e955f5fb7c2a tempest-CreateVolumesFromSourceVolumeTest-29009867 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 11:09:48 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-6329fcc2-563b-4a9e-94c1-ad3b9b142730 tempest-CreateVolumesFromSnapshotTest-2009706975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-734fb143-2aba-48e6-9cc7-b27c6a66552f {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:09:48 devstack sudo[106560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-734fb143-2aba-48e6-9cc7-b27c6a66552f Nov 04 11:09:48 devstack sudo[106560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:09:48 devstack cinder-volume[87272]: DEBUG cinder.volume.flows.manager.create_volume [None req-55714085-2467-41dc-8720-bed8c985300c tempest-CreateVolumesFromImageTest-1429238948 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87272) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 11:09:49 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-55714085-2467-41dc-8720-bed8c985300c tempest-CreateVolumesFromImageTest-1429238948 None] Flow 'volume_create_manager' (8644af0e-bd3c-4280-8bcf-3e5355273754) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 11:09:49 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-55714085-2467-41dc-8720-bed8c985300c tempest-CreateVolumesFromImageTest-1429238948 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (29b71078-9abd-4cea-8984-9ef63facddc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:09:49 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-55714085-2467-41dc-8720-bed8c985300c tempest-CreateVolumesFromImageTest-1429238948 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (29b71078-9abd-4cea-8984-9ef63facddc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T10:09:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1002400292',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=332477cf-a829-4acf-981b-cb281b84afa4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='31ee92f1f76e41bdb12fcd3dbad5951d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T10:09:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T10:09:49Z,use_quota=True,user_id='1715714a5a004c4caca73a2a220a40fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8989e4f-21e3-4f0a-9584-0d818784e883),volume_type_id=f8989e4f-21e3-4f0a-9584-0d818784e883)' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:09:49 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-55714085-2467-41dc-8720-bed8c985300c tempest-CreateVolumesFromImageTest-1429238948 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7b5767d-1e69-463f-8187-be60daf1db14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:09:49 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-55714085-2467-41dc-8720-bed8c985300c tempest-CreateVolumesFromImageTest-1429238948 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7b5767d-1e69-463f-8187-be60daf1db14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:09:49 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-55714085-2467-41dc-8720-bed8c985300c tempest-CreateVolumesFromImageTest-1429238948 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a015867c-a5be-4df7-a8eb-4d3a8d7f9b84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:09:49 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-55714085-2467-41dc-8720-bed8c985300c tempest-CreateVolumesFromImageTest-1429238948 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a015867c-a5be-4df7-a8eb-4d3a8d7f9b84) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '332477cf-a829-4acf-981b-cb281b84afa4', 'volume_name': 'volume-332477cf-a829-4acf-981b-cb281b84afa4', 'volume_size': 1}' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:09:49 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-55714085-2467-41dc-8720-bed8c985300c tempest-CreateVolumesFromImageTest-1429238948 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (516e12f4-3c2a-4358-a61c-0d3122defaaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:09:49 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-55714085-2467-41dc-8720-bed8c985300c tempest-CreateVolumesFromImageTest-1429238948 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (516e12f4-3c2a-4358-a61c-0d3122defaaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:09:49 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-55714085-2467-41dc-8720-bed8c985300c tempest-CreateVolumesFromImageTest-1429238948 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bedad5b8-5692-4869-8ea8-af18a23c0791) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:09:49 devstack cinder-volume[87272]: INFO cinder.volume.flows.manager.create_volume [None req-55714085-2467-41dc-8720-bed8c985300c tempest-CreateVolumesFromImageTest-1429238948 None] Volume 332477cf-a829-4acf-981b-cb281b84afa4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-332477cf-a829-4acf-981b-cb281b84afa4', 'volume_size': 1} Nov 04 11:09:49 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-55714085-2467-41dc-8720-bed8c985300c tempest-CreateVolumesFromImageTest-1429238948 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 11:09:49 devstack sudo[106560]: pam_unix(sudo:session): session closed for user root Nov 04 11:09:49 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-6329fcc2-563b-4a9e-94c1-ad3b9b142730 tempest-CreateVolumesFromSnapshotTest-2009706975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-734fb143-2aba-48e6-9cc7-b27c6a66552f" returned: 0 in 0.360s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:09:49 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-6329fcc2-563b-4a9e-94c1-ad3b9b142730 tempest-CreateVolumesFromSnapshotTest-2009706975 None] <== create_volume: return (1222ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'} {{(pid=87272) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 04 11:09:49 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-6329fcc2-563b-4a9e-94c1-ad3b9b142730 tempest-CreateVolumesFromSnapshotTest-2009706975 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.225s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 11:09:49 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-4b8a0baf-7f1a-4b05-b0f4-3ccd151a768b tempest-CreateVolumesFromImageTest-1429238948 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.501s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 11:09:49 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-4b8a0baf-7f1a-4b05-b0f4-3ccd151a768b tempest-CreateVolumesFromImageTest-1429238948 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T10:09:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-934268835',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d7fd27b-d4a8-4a74-abc6-d772655476f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='31ee92f1f76e41bdb12fcd3dbad5951d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T10:09:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T10:09:48Z,use_quota=True,user_id='1715714a5a004c4caca73a2a220a40fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8989e4f-21e3-4f0a-9584-0d818784e883),volume_type_id=f8989e4f-21e3-4f0a-9584-0d818784e883)}" {{(pid=87272) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 04 11:09:49 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.remotefs [None req-4b8a0baf-7f1a-4b05-b0f4-3ccd151a768b tempest-CreateVolumesFromImageTest-1429238948 None] Creating volume 7d7fd27b-d4a8-4a74-abc6-d772655476f5 {{(pid=87272) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 11:09:49 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-4b8a0baf-7f1a-4b05-b0f4-3ccd151a768b tempest-CreateVolumesFromImageTest-1429238948 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 11:09:49 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-4b8a0baf-7f1a-4b05-b0f4-3ccd151a768b tempest-CreateVolumesFromImageTest-1429238948 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 11:09:49 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-4b8a0baf-7f1a-4b05-b0f4-3ccd151a768b tempest-CreateVolumesFromImageTest-1429238948 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898': None} {{(pid=87272) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 11:09:49 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-4b8a0baf-7f1a-4b05-b0f4-3ccd151a768b tempest-CreateVolumesFromImageTest-1429238948 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'] {{(pid=87272) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 11:09:49 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-4b8a0baf-7f1a-4b05-b0f4-3ccd151a768b tempest-CreateVolumesFromImageTest-1429238948 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 11:09:49 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-4b8a0baf-7f1a-4b05-b0f4-3ccd151a768b tempest-CreateVolumesFromImageTest-1429238948 None] Selected osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898 as target Quobyte volume. {{(pid=87272) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 11:09:49 devstack cinder-volume[87272]: INFO cinder.volume.drivers.remotefs [None req-4b8a0baf-7f1a-4b05-b0f4-3ccd151a768b tempest-CreateVolumesFromImageTest-1429238948 None] casted to osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898 Nov 04 11:09:49 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-4b8a0baf-7f1a-4b05-b0f4-3ccd151a768b tempest-CreateVolumesFromImageTest-1429238948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-7d7fd27b-d4a8-4a74-abc6-d772655476f5 1073741824 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:09:49 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-6329fcc2-563b-4a9e-94c1-ad3b9b142730 tempest-CreateVolumesFromSnapshotTest-2009706975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0805a3b8-1c6c-4c25-86a3-f93a5e7db139) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-734fb143-2aba-48e6-9cc7-b27c6a66552f', 'volume_size': 1}' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:09:49 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-6329fcc2-563b-4a9e-94c1-ad3b9b142730 tempest-CreateVolumesFromSnapshotTest-2009706975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (488c2858-07e3-48fc-b8f5-9b2ea9f01dd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:09:49 devstack sudo[106563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-7d7fd27b-d4a8-4a74-abc6-d772655476f5 1073741824 Nov 04 11:09:49 devstack sudo[106563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:09:49 devstack cinder-volume[87272]: INFO cinder.volume.flows.manager.create_volume [None req-6329fcc2-563b-4a9e-94c1-ad3b9b142730 tempest-CreateVolumesFromSnapshotTest-2009706975 None] Volume volume-734fb143-2aba-48e6-9cc7-b27c6a66552f (734fb143-2aba-48e6-9cc7-b27c6a66552f): created successfully Nov 04 11:09:49 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-6329fcc2-563b-4a9e-94c1-ad3b9b142730 tempest-CreateVolumesFromSnapshotTest-2009706975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (488c2858-07e3-48fc-b8f5-9b2ea9f01dd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:09:49 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-6329fcc2-563b-4a9e-94c1-ad3b9b142730 tempest-CreateVolumesFromSnapshotTest-2009706975 None] Flow 'volume_create_manager' (1b2ea39c-66ae-4c6a-85c0-403bee0fb67d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87272) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 11:09:49 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-6329fcc2-563b-4a9e-94c1-ad3b9b142730 tempest-CreateVolumesFromSnapshotTest-2009706975 None] Created volume successfully. Nov 04 11:09:49 devstack cinder-volume[87272]: DEBUG cinder.volume.flows.manager.create_volume [None req-fe32c04f-e16e-4d3d-8673-286dcde12757 tempest-CreateVolumesFromImageTest-1429238948 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87272) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 11:09:49 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-fe32c04f-e16e-4d3d-8673-286dcde12757 tempest-CreateVolumesFromImageTest-1429238948 None] Flow 'volume_create_manager' (49e8cf1d-ef36-469f-831f-56e4585f9fcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 11:09:49 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-fe32c04f-e16e-4d3d-8673-286dcde12757 tempest-CreateVolumesFromImageTest-1429238948 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e6665241-6914-4bef-a049-94fbba9e3c11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:09:49 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-fe32c04f-e16e-4d3d-8673-286dcde12757 tempest-CreateVolumesFromImageTest-1429238948 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e6665241-6914-4bef-a049-94fbba9e3c11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T10:09:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1979738273',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e484ed5f-3e8a-4d10-9a20-8601a96f3ce3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='31ee92f1f76e41bdb12fcd3dbad5951d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T10:09:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T10:09:49Z,use_quota=True,user_id='1715714a5a004c4caca73a2a220a40fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8989e4f-21e3-4f0a-9584-0d818784e883),volume_type_id=f8989e4f-21e3-4f0a-9584-0d818784e883)' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:09:49 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-fe32c04f-e16e-4d3d-8673-286dcde12757 tempest-CreateVolumesFromImageTest-1429238948 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2cd478c-34a8-47c4-8d43-2fb1981216e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:09:49 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-fe32c04f-e16e-4d3d-8673-286dcde12757 tempest-CreateVolumesFromImageTest-1429238948 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2cd478c-34a8-47c4-8d43-2fb1981216e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:09:49 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-fe32c04f-e16e-4d3d-8673-286dcde12757 tempest-CreateVolumesFromImageTest-1429238948 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0545c410-7218-48b2-8de5-1385484e6753) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:09:49 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-fe32c04f-e16e-4d3d-8673-286dcde12757 tempest-CreateVolumesFromImageTest-1429238948 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0545c410-7218-48b2-8de5-1385484e6753) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e484ed5f-3e8a-4d10-9a20-8601a96f3ce3', 'volume_name': 'volume-e484ed5f-3e8a-4d10-9a20-8601a96f3ce3', 'volume_size': 1}' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:09:49 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-fe32c04f-e16e-4d3d-8673-286dcde12757 tempest-CreateVolumesFromImageTest-1429238948 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (454d5d71-3ceb-46bc-852e-b676fb2eb698) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:09:49 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-fe32c04f-e16e-4d3d-8673-286dcde12757 tempest-CreateVolumesFromImageTest-1429238948 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (454d5d71-3ceb-46bc-852e-b676fb2eb698) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:09:49 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-fe32c04f-e16e-4d3d-8673-286dcde12757 tempest-CreateVolumesFromImageTest-1429238948 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d913c437-1b6e-463c-9de9-7f4a86cd26be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:09:49 devstack cinder-volume[87272]: INFO cinder.volume.flows.manager.create_volume [None req-fe32c04f-e16e-4d3d-8673-286dcde12757 tempest-CreateVolumesFromImageTest-1429238948 None] Volume e484ed5f-3e8a-4d10-9a20-8601a96f3ce3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e484ed5f-3e8a-4d10-9a20-8601a96f3ce3', 'volume_size': 1} Nov 04 11:09:49 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-fe32c04f-e16e-4d3d-8673-286dcde12757 tempest-CreateVolumesFromImageTest-1429238948 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 11:09:49 devstack sudo[106563]: pam_unix(sudo:session): session closed for user root Nov 04 11:09:49 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-4b8a0baf-7f1a-4b05-b0f4-3ccd151a768b tempest-CreateVolumesFromImageTest-1429238948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-7d7fd27b-d4a8-4a74-abc6-d772655476f5 1073741824" returned: 0 in 0.638s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:09:49 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-4b8a0baf-7f1a-4b05-b0f4-3ccd151a768b tempest-CreateVolumesFromImageTest-1429238948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-7d7fd27b-d4a8-4a74-abc6-d772655476f5 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:09:49 devstack sudo[106569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-7d7fd27b-d4a8-4a74-abc6-d772655476f5 Nov 04 11:09:49 devstack sudo[106569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:09:50 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-d2a682fd-1a78-4488-86d4-9d3685cea705 tempest-CreateVolumesFromSnapshotTest-2009706975 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 11:09:50 devstack cinder-volume[87272]: DEBUG cinder.volume.flows.manager.create_volume [None req-fb870596-0505-4752-8c63-33dd533c5eb4 tempest-CreateVolumesFromImageTest-1429238948 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87272) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 11:09:50 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-fb870596-0505-4752-8c63-33dd533c5eb4 tempest-CreateVolumesFromImageTest-1429238948 None] Flow 'volume_create_manager' (708e432d-d257-4df3-9408-b353a8ef2a7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 11:09:50 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-fb870596-0505-4752-8c63-33dd533c5eb4 tempest-CreateVolumesFromImageTest-1429238948 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d881823b-b3d3-48e7-b615-5b79b6d823ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:09:50 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-fb870596-0505-4752-8c63-33dd533c5eb4 tempest-CreateVolumesFromImageTest-1429238948 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d881823b-b3d3-48e7-b615-5b79b6d823ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T10:09:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1283289526',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c9ce2469-e95c-478d-b06c-faadab825310,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='31ee92f1f76e41bdb12fcd3dbad5951d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T10:09:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T10:09:50Z,use_quota=True,user_id='1715714a5a004c4caca73a2a220a40fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8989e4f-21e3-4f0a-9584-0d818784e883),volume_type_id=f8989e4f-21e3-4f0a-9584-0d818784e883)' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:09:50 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-fb870596-0505-4752-8c63-33dd533c5eb4 tempest-CreateVolumesFromImageTest-1429238948 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f7e563f-bca8-432a-bd23-6a76eb8fa751) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:09:50 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-fb870596-0505-4752-8c63-33dd533c5eb4 tempest-CreateVolumesFromImageTest-1429238948 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f7e563f-bca8-432a-bd23-6a76eb8fa751) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:09:50 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-fb870596-0505-4752-8c63-33dd533c5eb4 tempest-CreateVolumesFromImageTest-1429238948 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e16cd62-37c3-4502-a15a-4fe10749fad6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:09:50 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-fb870596-0505-4752-8c63-33dd533c5eb4 tempest-CreateVolumesFromImageTest-1429238948 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e16cd62-37c3-4502-a15a-4fe10749fad6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c9ce2469-e95c-478d-b06c-faadab825310', 'volume_name': 'volume-c9ce2469-e95c-478d-b06c-faadab825310', 'volume_size': 1}' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:09:50 devstack sudo[106569]: pam_unix(sudo:session): session closed for user root Nov 04 11:09:50 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-fb870596-0505-4752-8c63-33dd533c5eb4 tempest-CreateVolumesFromImageTest-1429238948 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1151d54-320e-4e44-b3b4-c2e939948cc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:09:50 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-fb870596-0505-4752-8c63-33dd533c5eb4 tempest-CreateVolumesFromImageTest-1429238948 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1151d54-320e-4e44-b3b4-c2e939948cc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:09:50 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-fb870596-0505-4752-8c63-33dd533c5eb4 tempest-CreateVolumesFromImageTest-1429238948 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c071ac59-42a3-4aaf-aeb9-4a45f249784e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:09:50 devstack cinder-volume[87272]: INFO cinder.volume.flows.manager.create_volume [None req-fb870596-0505-4752-8c63-33dd533c5eb4 tempest-CreateVolumesFromImageTest-1429238948 None] Volume c9ce2469-e95c-478d-b06c-faadab825310: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c9ce2469-e95c-478d-b06c-faadab825310', 'volume_size': 1} Nov 04 11:09:50 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-fb870596-0505-4752-8c63-33dd533c5eb4 tempest-CreateVolumesFromImageTest-1429238948 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 11:09:50 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-4b8a0baf-7f1a-4b05-b0f4-3ccd151a768b tempest-CreateVolumesFromImageTest-1429238948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-7d7fd27b-d4a8-4a74-abc6-d772655476f5" returned: 0 in 0.348s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:09:50 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-4b8a0baf-7f1a-4b05-b0f4-3ccd151a768b tempest-CreateVolumesFromImageTest-1429238948 None] <== create_volume: return (1058ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'} {{(pid=87272) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 04 11:09:50 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-4b8a0baf-7f1a-4b05-b0f4-3ccd151a768b tempest-CreateVolumesFromImageTest-1429238948 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.061s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 11:09:50 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-0a71bffd-d422-4a32-99cd-e955f5fb7c2a tempest-CreateVolumesFromSourceVolumeTest-29009867 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.432s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 11:09:50 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-0a71bffd-d422-4a32-99cd-e955f5fb7c2a tempest-CreateVolumesFromSourceVolumeTest-29009867 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T10:09:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-39457202',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4774cf70-877c-48fd-9665-d5cdf99ecf22,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='147901517b8c4f76939552d314ca24cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T10:09:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T10:09:49Z,use_quota=True,user_id='786d418577bc457585572c60157f6545',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8989e4f-21e3-4f0a-9584-0d818784e883),volume_type_id=f8989e4f-21e3-4f0a-9584-0d818784e883)}" {{(pid=87272) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 04 11:09:50 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.remotefs [None req-0a71bffd-d422-4a32-99cd-e955f5fb7c2a tempest-CreateVolumesFromSourceVolumeTest-29009867 None] Creating volume 4774cf70-877c-48fd-9665-d5cdf99ecf22 {{(pid=87272) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 11:09:50 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-0a71bffd-d422-4a32-99cd-e955f5fb7c2a tempest-CreateVolumesFromSourceVolumeTest-29009867 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 11:09:50 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-0a71bffd-d422-4a32-99cd-e955f5fb7c2a tempest-CreateVolumesFromSourceVolumeTest-29009867 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 11:09:50 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-0a71bffd-d422-4a32-99cd-e955f5fb7c2a tempest-CreateVolumesFromSourceVolumeTest-29009867 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898': None} {{(pid=87272) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 11:09:50 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-0a71bffd-d422-4a32-99cd-e955f5fb7c2a tempest-CreateVolumesFromSourceVolumeTest-29009867 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'] {{(pid=87272) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 11:09:50 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-0a71bffd-d422-4a32-99cd-e955f5fb7c2a tempest-CreateVolumesFromSourceVolumeTest-29009867 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 11:09:50 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-0a71bffd-d422-4a32-99cd-e955f5fb7c2a tempest-CreateVolumesFromSourceVolumeTest-29009867 None] Selected osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898 as target Quobyte volume. {{(pid=87272) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 11:09:50 devstack cinder-volume[87272]: INFO cinder.volume.drivers.remotefs [None req-0a71bffd-d422-4a32-99cd-e955f5fb7c2a tempest-CreateVolumesFromSourceVolumeTest-29009867 None] casted to osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898 Nov 04 11:09:50 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-0a71bffd-d422-4a32-99cd-e955f5fb7c2a tempest-CreateVolumesFromSourceVolumeTest-29009867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-4774cf70-877c-48fd-9665-d5cdf99ecf22 1073741824 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:09:50 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-4b8a0baf-7f1a-4b05-b0f4-3ccd151a768b tempest-CreateVolumesFromImageTest-1429238948 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (806bbed6-b67a-4ccb-ae2d-0a42c9a19046) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7d7fd27b-d4a8-4a74-abc6-d772655476f5', 'volume_size': 1}' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:09:50 devstack sudo[106572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-4774cf70-877c-48fd-9665-d5cdf99ecf22 1073741824 Nov 04 11:09:50 devstack sudo[106572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:09:50 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-4b8a0baf-7f1a-4b05-b0f4-3ccd151a768b tempest-CreateVolumesFromImageTest-1429238948 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (853dd086-bdbc-45b5-bf9c-3de3c1d7ba04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:09:50 devstack cinder-volume[87272]: INFO cinder.volume.flows.manager.create_volume [None req-4b8a0baf-7f1a-4b05-b0f4-3ccd151a768b tempest-CreateVolumesFromImageTest-1429238948 None] Volume volume-7d7fd27b-d4a8-4a74-abc6-d772655476f5 (7d7fd27b-d4a8-4a74-abc6-d772655476f5): created successfully Nov 04 11:09:50 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-4b8a0baf-7f1a-4b05-b0f4-3ccd151a768b tempest-CreateVolumesFromImageTest-1429238948 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (853dd086-bdbc-45b5-bf9c-3de3c1d7ba04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:09:50 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-4b8a0baf-7f1a-4b05-b0f4-3ccd151a768b tempest-CreateVolumesFromImageTest-1429238948 None] Flow 'volume_create_manager' (8100c73b-b6e8-40ed-bd41-359e47df4ae7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87272) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 11:09:50 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-4b8a0baf-7f1a-4b05-b0f4-3ccd151a768b tempest-CreateVolumesFromImageTest-1429238948 None] Created volume successfully. Nov 04 11:09:50 devstack cinder-volume[87272]: DEBUG cinder.volume.flows.manager.create_volume [None req-adb4bef8-3b45-450b-8a4e-fb8406f3ceac tempest-CreateVolumesFromImageTest-1429238948 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87272) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 11:09:50 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-adb4bef8-3b45-450b-8a4e-fb8406f3ceac tempest-CreateVolumesFromImageTest-1429238948 None] Flow 'volume_create_manager' (ab8d37d2-a7e5-4f3d-b888-8638acc6b3aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 11:09:50 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-adb4bef8-3b45-450b-8a4e-fb8406f3ceac tempest-CreateVolumesFromImageTest-1429238948 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b9baabc7-0abf-4fa4-be9f-b0855a8371b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:09:50 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-adb4bef8-3b45-450b-8a4e-fb8406f3ceac tempest-CreateVolumesFromImageTest-1429238948 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b9baabc7-0abf-4fa4-be9f-b0855a8371b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T10:09:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1716795770',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=21026a90-b2fd-4024-9496-b09e0accdf55,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='31ee92f1f76e41bdb12fcd3dbad5951d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T10:09:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T10:09:50Z,use_quota=True,user_id='1715714a5a004c4caca73a2a220a40fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8989e4f-21e3-4f0a-9584-0d818784e883),volume_type_id=f8989e4f-21e3-4f0a-9584-0d818784e883)' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:09:50 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-adb4bef8-3b45-450b-8a4e-fb8406f3ceac tempest-CreateVolumesFromImageTest-1429238948 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f5817f7-85be-4733-8a45-bc8f371d003f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:09:50 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-adb4bef8-3b45-450b-8a4e-fb8406f3ceac tempest-CreateVolumesFromImageTest-1429238948 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f5817f7-85be-4733-8a45-bc8f371d003f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:09:50 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-adb4bef8-3b45-450b-8a4e-fb8406f3ceac tempest-CreateVolumesFromImageTest-1429238948 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71759418-3278-4435-947f-7995534da90a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:09:50 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-adb4bef8-3b45-450b-8a4e-fb8406f3ceac tempest-CreateVolumesFromImageTest-1429238948 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71759418-3278-4435-947f-7995534da90a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '21026a90-b2fd-4024-9496-b09e0accdf55', 'volume_name': 'volume-21026a90-b2fd-4024-9496-b09e0accdf55', 'volume_size': 1}' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:09:50 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-adb4bef8-3b45-450b-8a4e-fb8406f3ceac tempest-CreateVolumesFromImageTest-1429238948 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc640fd1-8121-4160-a846-9f8bfef924da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:09:50 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-adb4bef8-3b45-450b-8a4e-fb8406f3ceac tempest-CreateVolumesFromImageTest-1429238948 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc640fd1-8121-4160-a846-9f8bfef924da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:09:50 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-adb4bef8-3b45-450b-8a4e-fb8406f3ceac tempest-CreateVolumesFromImageTest-1429238948 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (16d60f32-14c1-4498-9f30-6df6952f18ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:09:50 devstack cinder-volume[87272]: INFO cinder.volume.flows.manager.create_volume [None req-adb4bef8-3b45-450b-8a4e-fb8406f3ceac tempest-CreateVolumesFromImageTest-1429238948 None] Volume 21026a90-b2fd-4024-9496-b09e0accdf55: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-21026a90-b2fd-4024-9496-b09e0accdf55', 'volume_size': 1} Nov 04 11:09:50 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-adb4bef8-3b45-450b-8a4e-fb8406f3ceac tempest-CreateVolumesFromImageTest-1429238948 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 11:09:50 devstack sudo[106572]: pam_unix(sudo:session): session closed for user root Nov 04 11:09:50 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-0a71bffd-d422-4a32-99cd-e955f5fb7c2a tempest-CreateVolumesFromSourceVolumeTest-29009867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-4774cf70-877c-48fd-9665-d5cdf99ecf22 1073741824" returned: 0 in 0.498s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:09:50 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-0a71bffd-d422-4a32-99cd-e955f5fb7c2a tempest-CreateVolumesFromSourceVolumeTest-29009867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-4774cf70-877c-48fd-9665-d5cdf99ecf22 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:09:50 devstack sudo[106577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-4774cf70-877c-48fd-9665-d5cdf99ecf22 Nov 04 11:09:50 devstack sudo[106577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:09:51 devstack sudo[106577]: pam_unix(sudo:session): session closed for user root Nov 04 11:09:51 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-0a71bffd-d422-4a32-99cd-e955f5fb7c2a tempest-CreateVolumesFromSourceVolumeTest-29009867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-4774cf70-877c-48fd-9665-d5cdf99ecf22" returned: 0 in 0.253s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:09:51 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-0a71bffd-d422-4a32-99cd-e955f5fb7c2a tempest-CreateVolumesFromSourceVolumeTest-29009867 None] <== create_volume: return (800ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'} {{(pid=87272) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 04 11:09:51 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-0a71bffd-d422-4a32-99cd-e955f5fb7c2a tempest-CreateVolumesFromSourceVolumeTest-29009867 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.817s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 11:09:51 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-55714085-2467-41dc-8720-bed8c985300c tempest-CreateVolumesFromImageTest-1429238948 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.960s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 11:09:51 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-55714085-2467-41dc-8720-bed8c985300c tempest-CreateVolumesFromImageTest-1429238948 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T10:09:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1002400292',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=332477cf-a829-4acf-981b-cb281b84afa4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='31ee92f1f76e41bdb12fcd3dbad5951d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T10:09:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T10:09:49Z,use_quota=True,user_id='1715714a5a004c4caca73a2a220a40fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8989e4f-21e3-4f0a-9584-0d818784e883),volume_type_id=f8989e4f-21e3-4f0a-9584-0d818784e883)}" {{(pid=87272) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 04 11:09:51 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.remotefs [None req-55714085-2467-41dc-8720-bed8c985300c tempest-CreateVolumesFromImageTest-1429238948 None] Creating volume 332477cf-a829-4acf-981b-cb281b84afa4 {{(pid=87272) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 11:09:51 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-55714085-2467-41dc-8720-bed8c985300c tempest-CreateVolumesFromImageTest-1429238948 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 11:09:51 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-55714085-2467-41dc-8720-bed8c985300c tempest-CreateVolumesFromImageTest-1429238948 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 11:09:51 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-55714085-2467-41dc-8720-bed8c985300c tempest-CreateVolumesFromImageTest-1429238948 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898': None} {{(pid=87272) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 11:09:51 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-55714085-2467-41dc-8720-bed8c985300c tempest-CreateVolumesFromImageTest-1429238948 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'] {{(pid=87272) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 11:09:51 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-55714085-2467-41dc-8720-bed8c985300c tempest-CreateVolumesFromImageTest-1429238948 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 11:09:51 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-55714085-2467-41dc-8720-bed8c985300c tempest-CreateVolumesFromImageTest-1429238948 None] Selected osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898 as target Quobyte volume. {{(pid=87272) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 11:09:51 devstack cinder-volume[87272]: INFO cinder.volume.drivers.remotefs [None req-55714085-2467-41dc-8720-bed8c985300c tempest-CreateVolumesFromImageTest-1429238948 None] casted to osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898 Nov 04 11:09:51 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-55714085-2467-41dc-8720-bed8c985300c tempest-CreateVolumesFromImageTest-1429238948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-332477cf-a829-4acf-981b-cb281b84afa4 1073741824 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:09:51 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-0a71bffd-d422-4a32-99cd-e955f5fb7c2a tempest-CreateVolumesFromSourceVolumeTest-29009867 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1777d45-2108-456f-bb3c-6c4a34421491) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4774cf70-877c-48fd-9665-d5cdf99ecf22', 'volume_size': 1}' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:09:51 devstack sudo[106580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-332477cf-a829-4acf-981b-cb281b84afa4 1073741824 Nov 04 11:09:51 devstack sudo[106580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:09:51 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-0a71bffd-d422-4a32-99cd-e955f5fb7c2a tempest-CreateVolumesFromSourceVolumeTest-29009867 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ea81e40-2ceb-4377-bced-318ab575df92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:09:51 devstack cinder-volume[87272]: INFO cinder.volume.flows.manager.create_volume [None req-0a71bffd-d422-4a32-99cd-e955f5fb7c2a tempest-CreateVolumesFromSourceVolumeTest-29009867 None] Volume volume-4774cf70-877c-48fd-9665-d5cdf99ecf22 (4774cf70-877c-48fd-9665-d5cdf99ecf22): created successfully Nov 04 11:09:51 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-0a71bffd-d422-4a32-99cd-e955f5fb7c2a tempest-CreateVolumesFromSourceVolumeTest-29009867 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ea81e40-2ceb-4377-bced-318ab575df92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:09:51 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-0a71bffd-d422-4a32-99cd-e955f5fb7c2a tempest-CreateVolumesFromSourceVolumeTest-29009867 None] Flow 'volume_create_manager' (eefa50f4-215e-4d79-bcd4-d1a8e5078125) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87272) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 11:09:51 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-0a71bffd-d422-4a32-99cd-e955f5fb7c2a tempest-CreateVolumesFromSourceVolumeTest-29009867 None] Created volume successfully. Nov 04 11:09:51 devstack sudo[106580]: pam_unix(sudo:session): session closed for user root Nov 04 11:09:51 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-55714085-2467-41dc-8720-bed8c985300c tempest-CreateVolumesFromImageTest-1429238948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-332477cf-a829-4acf-981b-cb281b84afa4 1073741824" returned: 0 in 0.483s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:09:51 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-55714085-2467-41dc-8720-bed8c985300c tempest-CreateVolumesFromImageTest-1429238948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-332477cf-a829-4acf-981b-cb281b84afa4 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:09:51 devstack sudo[106585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-332477cf-a829-4acf-981b-cb281b84afa4 Nov 04 11:09:51 devstack sudo[106585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:09:51 devstack sudo[106585]: pam_unix(sudo:session): session closed for user root Nov 04 11:09:51 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-55714085-2467-41dc-8720-bed8c985300c tempest-CreateVolumesFromImageTest-1429238948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-332477cf-a829-4acf-981b-cb281b84afa4" returned: 0 in 0.260s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:09:51 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-55714085-2467-41dc-8720-bed8c985300c tempest-CreateVolumesFromImageTest-1429238948 None] <== create_volume: return (790ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'} {{(pid=87272) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 04 11:09:51 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-55714085-2467-41dc-8720-bed8c985300c tempest-CreateVolumesFromImageTest-1429238948 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.793s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 11:09:51 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-fe32c04f-e16e-4d3d-8673-286dcde12757 tempest-CreateVolumesFromImageTest-1429238948 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.195s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 11:09:51 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-fe32c04f-e16e-4d3d-8673-286dcde12757 tempest-CreateVolumesFromImageTest-1429238948 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T10:09:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1979738273',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e484ed5f-3e8a-4d10-9a20-8601a96f3ce3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='31ee92f1f76e41bdb12fcd3dbad5951d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T10:09:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T10:09:49Z,use_quota=True,user_id='1715714a5a004c4caca73a2a220a40fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8989e4f-21e3-4f0a-9584-0d818784e883),volume_type_id=f8989e4f-21e3-4f0a-9584-0d818784e883)}" {{(pid=87272) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 04 11:09:51 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.remotefs [None req-fe32c04f-e16e-4d3d-8673-286dcde12757 tempest-CreateVolumesFromImageTest-1429238948 None] Creating volume e484ed5f-3e8a-4d10-9a20-8601a96f3ce3 {{(pid=87272) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 11:09:51 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-fe32c04f-e16e-4d3d-8673-286dcde12757 tempest-CreateVolumesFromImageTest-1429238948 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 11:09:51 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-fe32c04f-e16e-4d3d-8673-286dcde12757 tempest-CreateVolumesFromImageTest-1429238948 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 11:09:51 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-fe32c04f-e16e-4d3d-8673-286dcde12757 tempest-CreateVolumesFromImageTest-1429238948 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898': None} {{(pid=87272) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 11:09:51 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-fe32c04f-e16e-4d3d-8673-286dcde12757 tempest-CreateVolumesFromImageTest-1429238948 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'] {{(pid=87272) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 11:09:51 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-fe32c04f-e16e-4d3d-8673-286dcde12757 tempest-CreateVolumesFromImageTest-1429238948 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 11:09:51 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-fe32c04f-e16e-4d3d-8673-286dcde12757 tempest-CreateVolumesFromImageTest-1429238948 None] Selected osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898 as target Quobyte volume. {{(pid=87272) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 11:09:51 devstack cinder-volume[87272]: INFO cinder.volume.drivers.remotefs [None req-fe32c04f-e16e-4d3d-8673-286dcde12757 tempest-CreateVolumesFromImageTest-1429238948 None] casted to osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898 Nov 04 11:09:51 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-fe32c04f-e16e-4d3d-8673-286dcde12757 tempest-CreateVolumesFromImageTest-1429238948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-e484ed5f-3e8a-4d10-9a20-8601a96f3ce3 1073741824 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:09:51 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-55714085-2467-41dc-8720-bed8c985300c tempest-CreateVolumesFromImageTest-1429238948 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bedad5b8-5692-4869-8ea8-af18a23c0791) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-332477cf-a829-4acf-981b-cb281b84afa4', 'volume_size': 1}' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:09:51 devstack sudo[106588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-e484ed5f-3e8a-4d10-9a20-8601a96f3ce3 1073741824 Nov 04 11:09:51 devstack sudo[106588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:09:51 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-55714085-2467-41dc-8720-bed8c985300c tempest-CreateVolumesFromImageTest-1429238948 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (459f4fe9-03fc-483c-9182-b0ea7a706dbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:09:51 devstack cinder-volume[87272]: INFO cinder.volume.flows.manager.create_volume [None req-55714085-2467-41dc-8720-bed8c985300c tempest-CreateVolumesFromImageTest-1429238948 None] Volume volume-332477cf-a829-4acf-981b-cb281b84afa4 (332477cf-a829-4acf-981b-cb281b84afa4): created successfully Nov 04 11:09:51 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-55714085-2467-41dc-8720-bed8c985300c tempest-CreateVolumesFromImageTest-1429238948 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (459f4fe9-03fc-483c-9182-b0ea7a706dbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:09:51 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-55714085-2467-41dc-8720-bed8c985300c tempest-CreateVolumesFromImageTest-1429238948 None] Flow 'volume_create_manager' (8644af0e-bd3c-4280-8bcf-3e5355273754) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87272) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 11:09:51 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-55714085-2467-41dc-8720-bed8c985300c tempest-CreateVolumesFromImageTest-1429238948 None] Created volume successfully. Nov 04 11:09:52 devstack cinder-volume[87272]: DEBUG cinder.volume.flows.manager.create_volume [None req-0f9461c3-98bf-46ca-859e-d0359c7be80d tempest-CreateVolumesFromSourceVolumeTest-29009867 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87272) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 11:09:52 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-0f9461c3-98bf-46ca-859e-d0359c7be80d tempest-CreateVolumesFromSourceVolumeTest-29009867 None] Flow 'volume_create_manager' (3075db37-3a49-4870-8cab-875aec7a2692) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 11:09:52 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-0f9461c3-98bf-46ca-859e-d0359c7be80d tempest-CreateVolumesFromSourceVolumeTest-29009867 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (38278239-21b9-48ed-8d57-8e01d5bb78e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:09:52 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-0f9461c3-98bf-46ca-859e-d0359c7be80d tempest-CreateVolumesFromSourceVolumeTest-29009867 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (38278239-21b9-48ed-8d57-8e01d5bb78e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T10:09:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-363171533',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a9ab4ec4-e6d5-4c2c-b54a-503afcb9f77f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='147901517b8c4f76939552d314ca24cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T10:09:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T10:09:52Z,use_quota=True,user_id='786d418577bc457585572c60157f6545',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8989e4f-21e3-4f0a-9584-0d818784e883),volume_type_id=f8989e4f-21e3-4f0a-9584-0d818784e883)' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:09:52 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-0f9461c3-98bf-46ca-859e-d0359c7be80d tempest-CreateVolumesFromSourceVolumeTest-29009867 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8dc3e330-ac4b-4932-bfdd-09ddab628b81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:09:52 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-0f9461c3-98bf-46ca-859e-d0359c7be80d tempest-CreateVolumesFromSourceVolumeTest-29009867 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8dc3e330-ac4b-4932-bfdd-09ddab628b81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:09:52 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-0f9461c3-98bf-46ca-859e-d0359c7be80d tempest-CreateVolumesFromSourceVolumeTest-29009867 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (779d63b9-34b7-4705-9b8e-2553e347f6d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:09:52 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-0f9461c3-98bf-46ca-859e-d0359c7be80d tempest-CreateVolumesFromSourceVolumeTest-29009867 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (779d63b9-34b7-4705-9b8e-2553e347f6d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a9ab4ec4-e6d5-4c2c-b54a-503afcb9f77f', 'volume_name': 'volume-a9ab4ec4-e6d5-4c2c-b54a-503afcb9f77f', 'volume_size': 1}' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:09:52 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-0f9461c3-98bf-46ca-859e-d0359c7be80d tempest-CreateVolumesFromSourceVolumeTest-29009867 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (87fd3cc4-b4fe-44a4-85da-ac2cf6ea5ee5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:09:52 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-0f9461c3-98bf-46ca-859e-d0359c7be80d tempest-CreateVolumesFromSourceVolumeTest-29009867 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (87fd3cc4-b4fe-44a4-85da-ac2cf6ea5ee5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:09:52 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-0f9461c3-98bf-46ca-859e-d0359c7be80d tempest-CreateVolumesFromSourceVolumeTest-29009867 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c32b053f-f53e-40b7-9651-63741fb6a32e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:09:52 devstack sudo[106588]: pam_unix(sudo:session): session closed for user root Nov 04 11:09:52 devstack cinder-volume[87272]: INFO cinder.volume.flows.manager.create_volume [None req-0f9461c3-98bf-46ca-859e-d0359c7be80d tempest-CreateVolumesFromSourceVolumeTest-29009867 None] Volume a9ab4ec4-e6d5-4c2c-b54a-503afcb9f77f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a9ab4ec4-e6d5-4c2c-b54a-503afcb9f77f', 'volume_size': 1} Nov 04 11:09:52 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-0f9461c3-98bf-46ca-859e-d0359c7be80d tempest-CreateVolumesFromSourceVolumeTest-29009867 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 11:09:52 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-fe32c04f-e16e-4d3d-8673-286dcde12757 tempest-CreateVolumesFromImageTest-1429238948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-e484ed5f-3e8a-4d10-9a20-8601a96f3ce3 1073741824" returned: 0 in 0.571s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:09:52 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-fe32c04f-e16e-4d3d-8673-286dcde12757 tempest-CreateVolumesFromImageTest-1429238948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-e484ed5f-3e8a-4d10-9a20-8601a96f3ce3 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:09:52 devstack sudo[106594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-e484ed5f-3e8a-4d10-9a20-8601a96f3ce3 Nov 04 11:09:52 devstack sudo[106594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:09:52 devstack sudo[106594]: pam_unix(sudo:session): session closed for user root Nov 04 11:09:52 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-fe32c04f-e16e-4d3d-8673-286dcde12757 tempest-CreateVolumesFromImageTest-1429238948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-e484ed5f-3e8a-4d10-9a20-8601a96f3ce3" returned: 0 in 0.307s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:09:52 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-fe32c04f-e16e-4d3d-8673-286dcde12757 tempest-CreateVolumesFromImageTest-1429238948 None] <== create_volume: return (924ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'} {{(pid=87272) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 04 11:09:52 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-fe32c04f-e16e-4d3d-8673-286dcde12757 tempest-CreateVolumesFromImageTest-1429238948 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.930s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 11:09:52 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-d2a682fd-1a78-4488-86d4-9d3685cea705 tempest-CreateVolumesFromSnapshotTest-2009706975 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.714s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 11:09:52 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.remotefs [None req-d2a682fd-1a78-4488-86d4-9d3685cea705 tempest-CreateVolumesFromSnapshotTest-2009706975 None] Creating offline snapshot 00126f67-e5f6-4037-8780-966009a161ef of volume 734fb143-2aba-48e6-9cc7-b27c6a66552f {{(pid=87272) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 04 11:09:52 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-fe32c04f-e16e-4d3d-8673-286dcde12757 tempest-CreateVolumesFromImageTest-1429238948 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d913c437-1b6e-463c-9de9-7f4a86cd26be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e484ed5f-3e8a-4d10-9a20-8601a96f3ce3', 'volume_size': 1}' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:09:52 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-fe32c04f-e16e-4d3d-8673-286dcde12757 tempest-CreateVolumesFromImageTest-1429238948 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2214e3dc-5a3a-4710-875c-48de73f3a79e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:09:52 devstack cinder-volume[87272]: DEBUG oslo.privsep.daemon [-] privsep: reply[09473758-699c-4c61-92d9-a336e8cee054]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 11:09:52 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-d2a682fd-1a78-4488-86d4-9d3685cea705 tempest-CreateVolumesFromSnapshotTest-2009706975 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-734fb143-2aba-48e6-9cc7-b27c6a66552f {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:09:52 devstack cinder-volume[87272]: INFO cinder.volume.flows.manager.create_volume [None req-fe32c04f-e16e-4d3d-8673-286dcde12757 tempest-CreateVolumesFromImageTest-1429238948 None] Volume volume-e484ed5f-3e8a-4d10-9a20-8601a96f3ce3 (e484ed5f-3e8a-4d10-9a20-8601a96f3ce3): created successfully Nov 04 11:09:52 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-fe32c04f-e16e-4d3d-8673-286dcde12757 tempest-CreateVolumesFromImageTest-1429238948 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2214e3dc-5a3a-4710-875c-48de73f3a79e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:09:52 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-fe32c04f-e16e-4d3d-8673-286dcde12757 tempest-CreateVolumesFromImageTest-1429238948 None] Flow 'volume_create_manager' (49e8cf1d-ef36-469f-831f-56e4585f9fcb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87272) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 11:09:52 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-fe32c04f-e16e-4d3d-8673-286dcde12757 tempest-CreateVolumesFromImageTest-1429238948 None] Created volume successfully. Nov 04 11:09:52 devstack cinder-volume[87272]: DEBUG cinder.volume.flows.manager.create_volume [None req-4af0e188-0c25-4c43-8a0e-09e15e97de6c tempest-VolumeAndVolumeTypeFromImageTest-181192630 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87272) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 11:09:52 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-4af0e188-0c25-4c43-8a0e-09e15e97de6c tempest-VolumeAndVolumeTypeFromImageTest-181192630 None] Flow 'volume_create_manager' (41392dc4-d8cf-4aba-8fe7-dd958eb20039) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 11:09:52 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-4af0e188-0c25-4c43-8a0e-09e15e97de6c tempest-VolumeAndVolumeTypeFromImageTest-181192630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (67721812-1684-47f8-9e15-a6dd706a6cc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:09:52 devstack sudo[106597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-734fb143-2aba-48e6-9cc7-b27c6a66552f Nov 04 11:09:52 devstack sudo[106597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:09:52 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-4af0e188-0c25-4c43-8a0e-09e15e97de6c tempest-VolumeAndVolumeTypeFromImageTest-181192630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (67721812-1684-47f8-9e15-a6dd706a6cc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T10:09:52Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ed48d05-b3e7-4004-9adf-2c9e87e451e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='59ad281d78de4fadbc15ce7984e0240c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T10:09:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T10:09:53Z,use_quota=True,user_id='7c679f0692594e46b24274f5ad69fee5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d4572b4a-c8e3-496f-ad9c-3306c724b03f),volume_type_id=d4572b4a-c8e3-496f-ad9c-3306c724b03f)' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:09:53 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-4af0e188-0c25-4c43-8a0e-09e15e97de6c tempest-VolumeAndVolumeTypeFromImageTest-181192630 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (249e17e4-7354-4d4c-9b93-23b9c9754cd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:09:53 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-4af0e188-0c25-4c43-8a0e-09e15e97de6c tempest-VolumeAndVolumeTypeFromImageTest-181192630 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (249e17e4-7354-4d4c-9b93-23b9c9754cd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:09:53 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-4af0e188-0c25-4c43-8a0e-09e15e97de6c tempest-VolumeAndVolumeTypeFromImageTest-181192630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f104874-5f19-4e3f-a9af-991363a27a1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:09:53 devstack cinder-volume[87272]: DEBUG cinder.image.glance [None req-4af0e188-0c25-4c43-8a0e-09e15e97de6c tempest-VolumeAndVolumeTypeFromImageTest-181192630 None] Creating Keystone auth plugin from conf {{(pid=87272) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 04 11:09:53 devstack cinder-volume[87272]: DEBUG cinder.volume.flows.manager.create_volume [None req-b00f6c87-14fb-4c3a-9e65-3a48b46a0a24 tempest-CreateVolumesFromSourceVolumeTest-29009867 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87272) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 11:09:53 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-b00f6c87-14fb-4c3a-9e65-3a48b46a0a24 tempest-CreateVolumesFromSourceVolumeTest-29009867 None] Flow 'volume_create_manager' (beaeaa67-f3c9-48be-906d-b7a332dc78bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 11:09:53 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-b00f6c87-14fb-4c3a-9e65-3a48b46a0a24 tempest-CreateVolumesFromSourceVolumeTest-29009867 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f47cade5-de90-4ea2-9bd8-15361cae0b53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:09:53 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-b00f6c87-14fb-4c3a-9e65-3a48b46a0a24 tempest-CreateVolumesFromSourceVolumeTest-29009867 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f47cade5-de90-4ea2-9bd8-15361cae0b53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T10:09:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-798483620',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=61e9533f-44fe-4e24-bd4e-5b00d89db96a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='147901517b8c4f76939552d314ca24cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T10:09:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T10:09:53Z,use_quota=True,user_id='786d418577bc457585572c60157f6545',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8989e4f-21e3-4f0a-9584-0d818784e883),volume_type_id=f8989e4f-21e3-4f0a-9584-0d818784e883)' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:09:53 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-b00f6c87-14fb-4c3a-9e65-3a48b46a0a24 tempest-CreateVolumesFromSourceVolumeTest-29009867 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (efedb77e-19a4-43d3-ad20-a2c160050315) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:09:53 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-b00f6c87-14fb-4c3a-9e65-3a48b46a0a24 tempest-CreateVolumesFromSourceVolumeTest-29009867 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (efedb77e-19a4-43d3-ad20-a2c160050315) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:09:53 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-b00f6c87-14fb-4c3a-9e65-3a48b46a0a24 tempest-CreateVolumesFromSourceVolumeTest-29009867 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb7531b7-4df6-4f19-b4b9-bb800c859b75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:09:53 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-b00f6c87-14fb-4c3a-9e65-3a48b46a0a24 tempest-CreateVolumesFromSourceVolumeTest-29009867 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb7531b7-4df6-4f19-b4b9-bb800c859b75) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '61e9533f-44fe-4e24-bd4e-5b00d89db96a', 'volume_name': 'volume-61e9533f-44fe-4e24-bd4e-5b00d89db96a', 'volume_size': 1}' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:09:53 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-b00f6c87-14fb-4c3a-9e65-3a48b46a0a24 tempest-CreateVolumesFromSourceVolumeTest-29009867 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1cb938a-1d99-4f4f-b3b1-d93c71a93ed8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:09:53 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-b00f6c87-14fb-4c3a-9e65-3a48b46a0a24 tempest-CreateVolumesFromSourceVolumeTest-29009867 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1cb938a-1d99-4f4f-b3b1-d93c71a93ed8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:09:53 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-b00f6c87-14fb-4c3a-9e65-3a48b46a0a24 tempest-CreateVolumesFromSourceVolumeTest-29009867 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f166600-8177-4f19-8e9e-2813c4ec2e2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:09:53 devstack cinder-volume[87272]: INFO cinder.volume.flows.manager.create_volume [None req-b00f6c87-14fb-4c3a-9e65-3a48b46a0a24 tempest-CreateVolumesFromSourceVolumeTest-29009867 None] Volume 61e9533f-44fe-4e24-bd4e-5b00d89db96a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-61e9533f-44fe-4e24-bd4e-5b00d89db96a', 'volume_size': 1} Nov 04 11:09:53 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-b00f6c87-14fb-4c3a-9e65-3a48b46a0a24 tempest-CreateVolumesFromSourceVolumeTest-29009867 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 11:09:53 devstack cinder-volume[87272]: DEBUG cinder.volume.flows.manager.create_volume [None req-7e2f18a7-9e6d-45ce-b08e-88dbc5903008 tempest-CreateVolumesFromSourceVolumeTest-29009867 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87272) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 11:09:53 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-7e2f18a7-9e6d-45ce-b08e-88dbc5903008 tempest-CreateVolumesFromSourceVolumeTest-29009867 None] Flow 'volume_create_manager' (60a25e60-624a-44a4-9cf7-1b71caa7efbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 11:09:53 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-7e2f18a7-9e6d-45ce-b08e-88dbc5903008 tempest-CreateVolumesFromSourceVolumeTest-29009867 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb4d32a4-13f5-455d-90c5-aad8dfe05206) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:09:53 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-7e2f18a7-9e6d-45ce-b08e-88dbc5903008 tempest-CreateVolumesFromSourceVolumeTest-29009867 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb4d32a4-13f5-455d-90c5-aad8dfe05206) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T10:09:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-858625388',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=945c4150-ab0c-4fbb-8b13-12c3460c66a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='147901517b8c4f76939552d314ca24cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T10:09:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T10:09:53Z,use_quota=True,user_id='786d418577bc457585572c60157f6545',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8989e4f-21e3-4f0a-9584-0d818784e883),volume_type_id=f8989e4f-21e3-4f0a-9584-0d818784e883)' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:09:53 devstack sudo[106597]: pam_unix(sudo:session): session closed for user root Nov 04 11:09:53 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-7e2f18a7-9e6d-45ce-b08e-88dbc5903008 tempest-CreateVolumesFromSourceVolumeTest-29009867 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e382c0fe-edd1-403d-a02e-8dec65c96dff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:09:53 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-7e2f18a7-9e6d-45ce-b08e-88dbc5903008 tempest-CreateVolumesFromSourceVolumeTest-29009867 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e382c0fe-edd1-403d-a02e-8dec65c96dff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:09:53 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-7e2f18a7-9e6d-45ce-b08e-88dbc5903008 tempest-CreateVolumesFromSourceVolumeTest-29009867 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (58e924fa-e0f7-47c0-b087-d208bb13bef4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:09:53 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-7e2f18a7-9e6d-45ce-b08e-88dbc5903008 tempest-CreateVolumesFromSourceVolumeTest-29009867 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (58e924fa-e0f7-47c0-b087-d208bb13bef4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '945c4150-ab0c-4fbb-8b13-12c3460c66a2', 'volume_name': 'volume-945c4150-ab0c-4fbb-8b13-12c3460c66a2', 'volume_size': 1}' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:09:53 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-7e2f18a7-9e6d-45ce-b08e-88dbc5903008 tempest-CreateVolumesFromSourceVolumeTest-29009867 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (205f0634-4f27-49f9-95f4-491587774b18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:09:53 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-7e2f18a7-9e6d-45ce-b08e-88dbc5903008 tempest-CreateVolumesFromSourceVolumeTest-29009867 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (205f0634-4f27-49f9-95f4-491587774b18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:09:53 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-7e2f18a7-9e6d-45ce-b08e-88dbc5903008 tempest-CreateVolumesFromSourceVolumeTest-29009867 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db4877a2-0023-480b-8cd4-e0699d4eab82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:09:53 devstack cinder-volume[87272]: INFO cinder.volume.flows.manager.create_volume [None req-7e2f18a7-9e6d-45ce-b08e-88dbc5903008 tempest-CreateVolumesFromSourceVolumeTest-29009867 None] Volume 945c4150-ab0c-4fbb-8b13-12c3460c66a2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-945c4150-ab0c-4fbb-8b13-12c3460c66a2', 'volume_size': 1} Nov 04 11:09:53 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-7e2f18a7-9e6d-45ce-b08e-88dbc5903008 tempest-CreateVolumesFromSourceVolumeTest-29009867 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 11:09:53 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-d2a682fd-1a78-4488-86d4-9d3685cea705 tempest-CreateVolumesFromSnapshotTest-2009706975 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-734fb143-2aba-48e6-9cc7-b27c6a66552f" returned: 0 in 0.546s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:09:53 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-d2a682fd-1a78-4488-86d4-9d3685cea705 tempest-CreateVolumesFromSnapshotTest-2009706975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-734fb143-2aba-48e6-9cc7-b27c6a66552f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-734fb143-2aba-48e6-9cc7-b27c6a66552f.00126f67-e5f6-4037-8780-966009a161ef 1G {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:09:53 devstack sudo[106603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-734fb143-2aba-48e6-9cc7-b27c6a66552f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-734fb143-2aba-48e6-9cc7-b27c6a66552f.00126f67-e5f6-4037-8780-966009a161ef 1G Nov 04 11:09:53 devstack sudo[106603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:09:53 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-4af0e188-0c25-4c43-8a0e-09e15e97de6c tempest-VolumeAndVolumeTypeFromImageTest-181192630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f104874-5f19-4e3f-a9af-991363a27a1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '9ed48d05-b3e7-4004-9adf-2c9e87e451e5', 'volume_name': 'volume-9ed48d05-b3e7-4004-9adf-2c9e87e451e5', 'volume_size': 1, 'image_id': '5a613177-e9d9-4719-b439-f26d96cda456', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5a613177-e9d9-4719-b439-f26d96cda456', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'e337bf427b2173615745fa4f7ac72eab', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '59ad281d78de4fadbc15ce7984e0240c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'f108e06aed15fc6dbb6f12d02a14f13b305480590dd44a787ee8549330815b5cc94279ac4cd196b480bd3ba5e61ab3b903bf86af5ae79ee4d96a2f4a1eb72fb1', 'id': '5a613177-e9d9-4719-b439-f26d96cda456', 'created_at': datetime.datetime(2026, 11, 4, 10, 9, 50, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 4, 10, 9, 51, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5a613177-e9d9-4719-b439-f26d96cda456/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:09:53 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-4af0e188-0c25-4c43-8a0e-09e15e97de6c tempest-VolumeAndVolumeTypeFromImageTest-181192630 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e1aa058-254f-4fac-b36f-7f547e6308ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:09:53 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-4af0e188-0c25-4c43-8a0e-09e15e97de6c tempest-VolumeAndVolumeTypeFromImageTest-181192630 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e1aa058-254f-4fac-b36f-7f547e6308ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:09:53 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-4af0e188-0c25-4c43-8a0e-09e15e97de6c tempest-VolumeAndVolumeTypeFromImageTest-181192630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (596aa7ac-6808-4681-b211-a5f950089bff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:09:53 devstack cinder-volume[87272]: INFO cinder.volume.flows.manager.create_volume [None req-4af0e188-0c25-4c43-8a0e-09e15e97de6c tempest-VolumeAndVolumeTypeFromImageTest-181192630 None] Volume 9ed48d05-b3e7-4004-9adf-2c9e87e451e5: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-9ed48d05-b3e7-4004-9adf-2c9e87e451e5', 'volume_size': 1, 'image_id': '5a613177-e9d9-4719-b439-f26d96cda456', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5a613177-e9d9-4719-b439-f26d96cda456', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'e337bf427b2173615745fa4f7ac72eab', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '59ad281d78de4fadbc15ce7984e0240c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'f108e06aed15fc6dbb6f12d02a14f13b305480590dd44a787ee8549330815b5cc94279ac4cd196b480bd3ba5e61ab3b903bf86af5ae79ee4d96a2f4a1eb72fb1', 'id': '5a613177-e9d9-4719-b439-f26d96cda456', 'created_at': datetime.datetime(2026, 11, 4, 10, 9, 50, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 4, 10, 9, 51, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5a613177-e9d9-4719-b439-f26d96cda456/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Nov 04 11:09:53 devstack cinder-volume[87272]: DEBUG cinder.volume.flows.manager.create_volume [None req-4af0e188-0c25-4c43-8a0e-09e15e97de6c tempest-VolumeAndVolumeTypeFromImageTest-181192630 None] Trying to clone 9ed48d05-b3e7-4004-9adf-2c9e87e451e5 from image 5a613177-e9d9-4719-b439-f26d96cda456 at location (None, [{'url': 'file:///opt/stack/data/glance/images/5a613177-e9d9-4719-b439-f26d96cda456', 'metadata': {}}]). {{(pid=87272) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 04 11:09:53 devstack cinder-volume[87272]: DEBUG cinder.volume.flows.manager.create_volume [None req-044b373f-3f2e-4861-b1be-81b2d1c1a122 tempest-CreateVolumesFromSourceVolumeTest-29009867 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87272) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 11:09:53 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-044b373f-3f2e-4861-b1be-81b2d1c1a122 tempest-CreateVolumesFromSourceVolumeTest-29009867 None] Flow 'volume_create_manager' (9493f26d-e535-41fb-9fb4-3231f7d99775) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 11:09:53 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-044b373f-3f2e-4861-b1be-81b2d1c1a122 tempest-CreateVolumesFromSourceVolumeTest-29009867 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d761e619-fdd1-4f6d-a987-8208768c9a3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:09:53 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-044b373f-3f2e-4861-b1be-81b2d1c1a122 tempest-CreateVolumesFromSourceVolumeTest-29009867 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d761e619-fdd1-4f6d-a987-8208768c9a3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T10:09:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1069102828',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dfa48361-b513-4484-bb70-a0698e7c50ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='147901517b8c4f76939552d314ca24cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T10:09:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T10:09:53Z,use_quota=True,user_id='786d418577bc457585572c60157f6545',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8989e4f-21e3-4f0a-9584-0d818784e883),volume_type_id=f8989e4f-21e3-4f0a-9584-0d818784e883)' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:09:53 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-044b373f-3f2e-4861-b1be-81b2d1c1a122 tempest-CreateVolumesFromSourceVolumeTest-29009867 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c24ff0a-29c1-466c-b363-ca47e4350a88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:09:53 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-044b373f-3f2e-4861-b1be-81b2d1c1a122 tempest-CreateVolumesFromSourceVolumeTest-29009867 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c24ff0a-29c1-466c-b363-ca47e4350a88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:09:53 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-044b373f-3f2e-4861-b1be-81b2d1c1a122 tempest-CreateVolumesFromSourceVolumeTest-29009867 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6986e90a-d739-4da8-8da8-83ac1b44e9af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:09:53 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-044b373f-3f2e-4861-b1be-81b2d1c1a122 tempest-CreateVolumesFromSourceVolumeTest-29009867 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6986e90a-d739-4da8-8da8-83ac1b44e9af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dfa48361-b513-4484-bb70-a0698e7c50ec', 'volume_name': 'volume-dfa48361-b513-4484-bb70-a0698e7c50ec', 'volume_size': 1}' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:09:53 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-044b373f-3f2e-4861-b1be-81b2d1c1a122 tempest-CreateVolumesFromSourceVolumeTest-29009867 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e96d3c28-ad55-43ea-9006-0cf01a25d21b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:09:53 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-044b373f-3f2e-4861-b1be-81b2d1c1a122 tempest-CreateVolumesFromSourceVolumeTest-29009867 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e96d3c28-ad55-43ea-9006-0cf01a25d21b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:09:53 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-044b373f-3f2e-4861-b1be-81b2d1c1a122 tempest-CreateVolumesFromSourceVolumeTest-29009867 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc2f82de-4cf3-49a2-8ba4-4b27045a4fa4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:09:53 devstack cinder-volume[87272]: INFO cinder.volume.flows.manager.create_volume [None req-044b373f-3f2e-4861-b1be-81b2d1c1a122 tempest-CreateVolumesFromSourceVolumeTest-29009867 None] Volume dfa48361-b513-4484-bb70-a0698e7c50ec: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dfa48361-b513-4484-bb70-a0698e7c50ec', 'volume_size': 1} Nov 04 11:09:53 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-044b373f-3f2e-4861-b1be-81b2d1c1a122 tempest-CreateVolumesFromSourceVolumeTest-29009867 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 11:09:53 devstack cinder-volume[87272]: DEBUG cinder.image.image_utils [None req-4af0e188-0c25-4c43-8a0e-09e15e97de6c tempest-VolumeAndVolumeTypeFromImageTest-181192630 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_5a613177-e9d9-4719-b439-f26d96cda456_6n75ml1idevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87272) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Nov 04 11:09:53 devstack cinder-volume[87272]: INFO cinder.image.image_utils [None req-4af0e188-0c25-4c43-8a0e-09e15e97de6c tempest-VolumeAndVolumeTypeFromImageTest-181192630 None] Image download 0.00 MB at 0.00 MB/s Nov 04 11:09:53 devstack cinder-volume[87272]: DEBUG oslo.privsep.daemon [-] privsep: reply[062a9b79-e5e8-458c-9792-fac6c400b9f8]: (4, 'raw') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 11:09:53 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-4af0e188-0c25-4c43-8a0e-09e15e97de6c tempest-VolumeAndVolumeTypeFromImageTest-181192630 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5a613177-e9d9-4719-b439-f26d96cda456_6n75ml1idevstack@QuobyteHD {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:09:53 devstack sudo[106609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5a613177-e9d9-4719-b439-f26d96cda456_6n75ml1idevstack@QuobyteHD Nov 04 11:09:53 devstack sudo[106609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:09:53 devstack sudo[106603]: pam_unix(sudo:session): session closed for user root Nov 04 11:09:53 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-d2a682fd-1a78-4488-86d4-9d3685cea705 tempest-CreateVolumesFromSnapshotTest-2009706975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-734fb143-2aba-48e6-9cc7-b27c6a66552f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-734fb143-2aba-48e6-9cc7-b27c6a66552f.00126f67-e5f6-4037-8780-966009a161ef 1G" returned: 0 in 0.575s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:09:53 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-d2a682fd-1a78-4488-86d4-9d3685cea705 tempest-CreateVolumesFromSnapshotTest-2009706975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-734fb143-2aba-48e6-9cc7-b27c6a66552f -F qcow2 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-734fb143-2aba-48e6-9cc7-b27c6a66552f.00126f67-e5f6-4037-8780-966009a161ef {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:09:53 devstack sudo[106611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-734fb143-2aba-48e6-9cc7-b27c6a66552f -F qcow2 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-734fb143-2aba-48e6-9cc7-b27c6a66552f.00126f67-e5f6-4037-8780-966009a161ef Nov 04 11:09:53 devstack sudo[106611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:09:54 devstack cinder-volume[87272]: DEBUG cinder.volume.flows.manager.create_volume [None req-8fce7fb5-6f79-4713-b083-aa21022ccc15 tempest-CreateVolumesFromSourceVolumeTest-29009867 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87272) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 11:09:54 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-8fce7fb5-6f79-4713-b083-aa21022ccc15 tempest-CreateVolumesFromSourceVolumeTest-29009867 None] Flow 'volume_create_manager' (e15540d0-e2d1-4c42-ab6d-7184b8962475) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 11:09:54 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-8fce7fb5-6f79-4713-b083-aa21022ccc15 tempest-CreateVolumesFromSourceVolumeTest-29009867 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (351395b9-aad9-4d3e-a414-df7987a22e7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:09:54 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-8fce7fb5-6f79-4713-b083-aa21022ccc15 tempest-CreateVolumesFromSourceVolumeTest-29009867 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (351395b9-aad9-4d3e-a414-df7987a22e7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T10:09:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2062402276',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=87ba91b7-949b-4433-819c-c796f0ac0ab1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='147901517b8c4f76939552d314ca24cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T10:09:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T10:09:54Z,use_quota=True,user_id='786d418577bc457585572c60157f6545',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8989e4f-21e3-4f0a-9584-0d818784e883),volume_type_id=f8989e4f-21e3-4f0a-9584-0d818784e883)' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:09:54 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-8fce7fb5-6f79-4713-b083-aa21022ccc15 tempest-CreateVolumesFromSourceVolumeTest-29009867 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (edbb78d4-2f49-40ee-a794-732ff6f74902) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:09:54 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-8fce7fb5-6f79-4713-b083-aa21022ccc15 tempest-CreateVolumesFromSourceVolumeTest-29009867 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (edbb78d4-2f49-40ee-a794-732ff6f74902) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:09:54 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-8fce7fb5-6f79-4713-b083-aa21022ccc15 tempest-CreateVolumesFromSourceVolumeTest-29009867 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac7cfef4-8876-4a85-8afd-13d341b8057d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:09:54 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-8fce7fb5-6f79-4713-b083-aa21022ccc15 tempest-CreateVolumesFromSourceVolumeTest-29009867 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac7cfef4-8876-4a85-8afd-13d341b8057d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '87ba91b7-949b-4433-819c-c796f0ac0ab1', 'volume_name': 'volume-87ba91b7-949b-4433-819c-c796f0ac0ab1', 'volume_size': 1}' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:09:54 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-8fce7fb5-6f79-4713-b083-aa21022ccc15 tempest-CreateVolumesFromSourceVolumeTest-29009867 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5acac72c-a519-4ea0-9863-77f00ee9a9a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:09:54 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-8fce7fb5-6f79-4713-b083-aa21022ccc15 tempest-CreateVolumesFromSourceVolumeTest-29009867 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5acac72c-a519-4ea0-9863-77f00ee9a9a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:09:54 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-8fce7fb5-6f79-4713-b083-aa21022ccc15 tempest-CreateVolumesFromSourceVolumeTest-29009867 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a6e9d4c-fecd-4913-bcee-cc5b9c69f75b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:09:54 devstack cinder-volume[87272]: INFO cinder.volume.flows.manager.create_volume [None req-8fce7fb5-6f79-4713-b083-aa21022ccc15 tempest-CreateVolumesFromSourceVolumeTest-29009867 None] Volume 87ba91b7-949b-4433-819c-c796f0ac0ab1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-87ba91b7-949b-4433-819c-c796f0ac0ab1', 'volume_size': 1} Nov 04 11:09:54 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-8fce7fb5-6f79-4713-b083-aa21022ccc15 tempest-CreateVolumesFromSourceVolumeTest-29009867 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 11:09:54 devstack sudo[106609]: pam_unix(sudo:session): session closed for user root Nov 04 11:09:54 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-4af0e188-0c25-4c43-8a0e-09e15e97de6c tempest-VolumeAndVolumeTypeFromImageTest-181192630 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5a613177-e9d9-4719-b439-f26d96cda456_6n75ml1idevstack@QuobyteHD" returned: 0 in 0.421s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:09:54 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-4af0e188-0c25-4c43-8a0e-09e15e97de6c tempest-VolumeAndVolumeTypeFromImageTest-181192630 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5a613177-e9d9-4719-b439-f26d96cda456_6n75ml1idevstack@QuobyteHD {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:09:54 devstack sudo[106615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5a613177-e9d9-4719-b439-f26d96cda456_6n75ml1idevstack@QuobyteHD Nov 04 11:09:54 devstack sudo[106615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:09:54 devstack sudo[106611]: pam_unix(sudo:session): session closed for user root Nov 04 11:09:54 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-d2a682fd-1a78-4488-86d4-9d3685cea705 tempest-CreateVolumesFromSnapshotTest-2009706975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-734fb143-2aba-48e6-9cc7-b27c6a66552f -F qcow2 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-734fb143-2aba-48e6-9cc7-b27c6a66552f.00126f67-e5f6-4037-8780-966009a161ef" returned: 0 in 0.350s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:09:54 devstack cinder-volume[87272]: WARNING cinder.volume.drivers.remotefs [None req-d2a682fd-1a78-4488-86d4-9d3685cea705 tempest-CreateVolumesFromSnapshotTest-2009706975 None] /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-734fb143-2aba-48e6-9cc7-b27c6a66552f.00126f67-e5f6-4037-8780-966009a161ef is being set with open permissions: ugo+rw Nov 04 11:09:54 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-d2a682fd-1a78-4488-86d4-9d3685cea705 tempest-CreateVolumesFromSnapshotTest-2009706975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-734fb143-2aba-48e6-9cc7-b27c6a66552f.00126f67-e5f6-4037-8780-966009a161ef {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:09:54 devstack sudo[106621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-734fb143-2aba-48e6-9cc7-b27c6a66552f.00126f67-e5f6-4037-8780-966009a161ef Nov 04 11:09:54 devstack sudo[106621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:09:54 devstack sudo[106615]: pam_unix(sudo:session): session closed for user root Nov 04 11:09:54 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-4af0e188-0c25-4c43-8a0e-09e15e97de6c tempest-VolumeAndVolumeTypeFromImageTest-181192630 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5a613177-e9d9-4719-b439-f26d96cda456_6n75ml1idevstack@QuobyteHD" returned: 1 in 0.350s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:09:54 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-4af0e188-0c25-4c43-8a0e-09e15e97de6c tempest-VolumeAndVolumeTypeFromImageTest-181192630 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5a613177-e9d9-4719-b439-f26d96cda456_6n75ml1idevstack@QuobyteHD' failed. Not Retrying. {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 04 11:09:54 devstack cinder-volume[87272]: DEBUG cinder.image.image_utils [None req-4af0e188-0c25-4c43-8a0e-09e15e97de6c tempest-VolumeAndVolumeTypeFromImageTest-181192630 None] Temporary image 5a613177-e9d9-4719-b439-f26d96cda456 is fetched for user 7c679f0692594e46b24274f5ad69fee5. {{(pid=87272) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Nov 04 11:09:54 devstack cinder-volume[87272]: DEBUG oslo.privsep.daemon [-] privsep: reply[06370847-c522-416f-8d57-baaa567fb5e4]: (4, 'raw') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 11:09:54 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-4af0e188-0c25-4c43-8a0e-09e15e97de6c tempest-VolumeAndVolumeTypeFromImageTest-181192630 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5a613177-e9d9-4719-b439-f26d96cda456_6n75ml1idevstack@QuobyteHD {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:09:54 devstack sudo[106621]: pam_unix(sudo:session): session closed for user root Nov 04 11:09:54 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-d2a682fd-1a78-4488-86d4-9d3685cea705 tempest-CreateVolumesFromSnapshotTest-2009706975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-734fb143-2aba-48e6-9cc7-b27c6a66552f.00126f67-e5f6-4037-8780-966009a161ef" returned: 0 in 0.272s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:09:54 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-d2a682fd-1a78-4488-86d4-9d3685cea705 tempest-CreateVolumesFromSnapshotTest-2009706975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-734fb143-2aba-48e6-9cc7-b27c6a66552f.info {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:09:54 devstack sudo[106628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-734fb143-2aba-48e6-9cc7-b27c6a66552f.info Nov 04 11:09:54 devstack sudo[106628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:09:54 devstack sudo[106627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5a613177-e9d9-4719-b439-f26d96cda456_6n75ml1idevstack@QuobyteHD Nov 04 11:09:54 devstack sudo[106627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:09:54 devstack sudo[106628]: pam_unix(sudo:session): session closed for user root Nov 04 11:09:54 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-d2a682fd-1a78-4488-86d4-9d3685cea705 tempest-CreateVolumesFromSnapshotTest-2009706975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-734fb143-2aba-48e6-9cc7-b27c6a66552f.info" returned: 0 in 0.272s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:09:54 devstack cinder-volume[87272]: WARNING cinder.volume.drivers.remotefs [None req-d2a682fd-1a78-4488-86d4-9d3685cea705 tempest-CreateVolumesFromSnapshotTest-2009706975 None] /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-734fb143-2aba-48e6-9cc7-b27c6a66552f.info is being set with open permissions: ugo+rw Nov 04 11:09:54 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-d2a682fd-1a78-4488-86d4-9d3685cea705 tempest-CreateVolumesFromSnapshotTest-2009706975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-734fb143-2aba-48e6-9cc7-b27c6a66552f.info {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:09:54 devstack sudo[106627]: pam_unix(sudo:session): session closed for user root Nov 04 11:09:54 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-4af0e188-0c25-4c43-8a0e-09e15e97de6c tempest-VolumeAndVolumeTypeFromImageTest-181192630 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5a613177-e9d9-4719-b439-f26d96cda456_6n75ml1idevstack@QuobyteHD" returned: 0 in 0.324s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:09:54 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-4af0e188-0c25-4c43-8a0e-09e15e97de6c tempest-VolumeAndVolumeTypeFromImageTest-181192630 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5a613177-e9d9-4719-b439-f26d96cda456_6n75ml1idevstack@QuobyteHD {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:09:54 devstack sudo[106634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-734fb143-2aba-48e6-9cc7-b27c6a66552f.info Nov 04 11:09:54 devstack sudo[106634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:09:54 devstack sudo[106635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5a613177-e9d9-4719-b439-f26d96cda456_6n75ml1idevstack@QuobyteHD Nov 04 11:09:54 devstack sudo[106635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:09:55 devstack sudo[106634]: pam_unix(sudo:session): session closed for user root Nov 04 11:09:55 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-d2a682fd-1a78-4488-86d4-9d3685cea705 tempest-CreateVolumesFromSnapshotTest-2009706975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-734fb143-2aba-48e6-9cc7-b27c6a66552f.info" returned: 0 in 0.237s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:09:55 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-d2a682fd-1a78-4488-86d4-9d3685cea705 tempest-CreateVolumesFromSnapshotTest-2009706975 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.383s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 11:09:55 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-fb870596-0505-4752-8c63-33dd533c5eb4 tempest-CreateVolumesFromImageTest-1429238948 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.957s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 11:09:55 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-fb870596-0505-4752-8c63-33dd533c5eb4 tempest-CreateVolumesFromImageTest-1429238948 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T10:09:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1283289526',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c9ce2469-e95c-478d-b06c-faadab825310,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='31ee92f1f76e41bdb12fcd3dbad5951d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T10:09:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T10:09:50Z,use_quota=True,user_id='1715714a5a004c4caca73a2a220a40fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8989e4f-21e3-4f0a-9584-0d818784e883),volume_type_id=f8989e4f-21e3-4f0a-9584-0d818784e883)}" {{(pid=87272) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 04 11:09:55 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.remotefs [None req-fb870596-0505-4752-8c63-33dd533c5eb4 tempest-CreateVolumesFromImageTest-1429238948 None] Creating volume c9ce2469-e95c-478d-b06c-faadab825310 {{(pid=87272) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 11:09:55 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-fb870596-0505-4752-8c63-33dd533c5eb4 tempest-CreateVolumesFromImageTest-1429238948 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 11:09:55 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-fb870596-0505-4752-8c63-33dd533c5eb4 tempest-CreateVolumesFromImageTest-1429238948 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 11:09:55 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-fb870596-0505-4752-8c63-33dd533c5eb4 tempest-CreateVolumesFromImageTest-1429238948 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898': None} {{(pid=87272) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 11:09:55 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-fb870596-0505-4752-8c63-33dd533c5eb4 tempest-CreateVolumesFromImageTest-1429238948 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'] {{(pid=87272) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 11:09:55 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-fb870596-0505-4752-8c63-33dd533c5eb4 tempest-CreateVolumesFromImageTest-1429238948 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 11:09:55 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-fb870596-0505-4752-8c63-33dd533c5eb4 tempest-CreateVolumesFromImageTest-1429238948 None] Selected osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898 as target Quobyte volume. {{(pid=87272) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 11:09:55 devstack cinder-volume[87272]: INFO cinder.volume.drivers.remotefs [None req-fb870596-0505-4752-8c63-33dd533c5eb4 tempest-CreateVolumesFromImageTest-1429238948 None] casted to osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898 Nov 04 11:09:55 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-fb870596-0505-4752-8c63-33dd533c5eb4 tempest-CreateVolumesFromImageTest-1429238948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-c9ce2469-e95c-478d-b06c-faadab825310 1073741824 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:09:55 devstack sudo[106642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-c9ce2469-e95c-478d-b06c-faadab825310 1073741824 Nov 04 11:09:55 devstack sudo[106642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:09:55 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-d2a682fd-1a78-4488-86d4-9d3685cea705 tempest-CreateVolumesFromSnapshotTest-2009706975 None] Create snapshot completed successfully Nov 04 11:09:55 devstack sudo[106635]: pam_unix(sudo:session): session closed for user root Nov 04 11:09:55 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-4af0e188-0c25-4c43-8a0e-09e15e97de6c tempest-VolumeAndVolumeTypeFromImageTest-181192630 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5a613177-e9d9-4719-b439-f26d96cda456_6n75ml1idevstack@QuobyteHD" returned: 1 in 0.329s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:09:55 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-4af0e188-0c25-4c43-8a0e-09e15e97de6c tempest-VolumeAndVolumeTypeFromImageTest-181192630 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5a613177-e9d9-4719-b439-f26d96cda456_6n75ml1idevstack@QuobyteHD' failed. Not Retrying. {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 04 11:09:55 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-4af0e188-0c25-4c43-8a0e-09e15e97de6c tempest-VolumeAndVolumeTypeFromImageTest-181192630 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 11:09:55 devstack sudo[106642]: pam_unix(sudo:session): session closed for user root Nov 04 11:09:55 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-fb870596-0505-4752-8c63-33dd533c5eb4 tempest-CreateVolumesFromImageTest-1429238948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-c9ce2469-e95c-478d-b06c-faadab825310 1073741824" returned: 0 in 0.411s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:09:55 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-fb870596-0505-4752-8c63-33dd533c5eb4 tempest-CreateVolumesFromImageTest-1429238948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-c9ce2469-e95c-478d-b06c-faadab825310 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:09:55 devstack sudo[106647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-c9ce2469-e95c-478d-b06c-faadab825310 Nov 04 11:09:55 devstack sudo[106647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:09:55 devstack sudo[106647]: pam_unix(sudo:session): session closed for user root Nov 04 11:09:55 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-fb870596-0505-4752-8c63-33dd533c5eb4 tempest-CreateVolumesFromImageTest-1429238948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-c9ce2469-e95c-478d-b06c-faadab825310" returned: 0 in 0.246s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:09:55 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-fb870596-0505-4752-8c63-33dd533c5eb4 tempest-CreateVolumesFromImageTest-1429238948 None] <== create_volume: return (697ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'} {{(pid=87272) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 04 11:09:55 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-fb870596-0505-4752-8c63-33dd533c5eb4 tempest-CreateVolumesFromImageTest-1429238948 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.700s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 11:09:55 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-adb4bef8-3b45-450b-8a4e-fb8406f3ceac tempest-CreateVolumesFromImageTest-1429238948 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.365s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 11:09:55 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-adb4bef8-3b45-450b-8a4e-fb8406f3ceac tempest-CreateVolumesFromImageTest-1429238948 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T10:09:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1716795770',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=21026a90-b2fd-4024-9496-b09e0accdf55,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='31ee92f1f76e41bdb12fcd3dbad5951d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T10:09:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T10:09:50Z,use_quota=True,user_id='1715714a5a004c4caca73a2a220a40fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8989e4f-21e3-4f0a-9584-0d818784e883),volume_type_id=f8989e4f-21e3-4f0a-9584-0d818784e883)}" {{(pid=87272) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 04 11:09:55 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.remotefs [None req-adb4bef8-3b45-450b-8a4e-fb8406f3ceac tempest-CreateVolumesFromImageTest-1429238948 None] Creating volume 21026a90-b2fd-4024-9496-b09e0accdf55 {{(pid=87272) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 11:09:55 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-adb4bef8-3b45-450b-8a4e-fb8406f3ceac tempest-CreateVolumesFromImageTest-1429238948 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 11:09:55 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-adb4bef8-3b45-450b-8a4e-fb8406f3ceac tempest-CreateVolumesFromImageTest-1429238948 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 11:09:55 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-adb4bef8-3b45-450b-8a4e-fb8406f3ceac tempest-CreateVolumesFromImageTest-1429238948 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898': None} {{(pid=87272) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 11:09:55 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-adb4bef8-3b45-450b-8a4e-fb8406f3ceac tempest-CreateVolumesFromImageTest-1429238948 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'] {{(pid=87272) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 11:09:55 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-adb4bef8-3b45-450b-8a4e-fb8406f3ceac tempest-CreateVolumesFromImageTest-1429238948 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 11:09:55 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-adb4bef8-3b45-450b-8a4e-fb8406f3ceac tempest-CreateVolumesFromImageTest-1429238948 None] Selected osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898 as target Quobyte volume. {{(pid=87272) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 11:09:55 devstack cinder-volume[87272]: INFO cinder.volume.drivers.remotefs [None req-adb4bef8-3b45-450b-8a4e-fb8406f3ceac tempest-CreateVolumesFromImageTest-1429238948 None] casted to osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898 Nov 04 11:09:55 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-adb4bef8-3b45-450b-8a4e-fb8406f3ceac tempest-CreateVolumesFromImageTest-1429238948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-21026a90-b2fd-4024-9496-b09e0accdf55 1073741824 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:09:55 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-fb870596-0505-4752-8c63-33dd533c5eb4 tempest-CreateVolumesFromImageTest-1429238948 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c071ac59-42a3-4aaf-aeb9-4a45f249784e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c9ce2469-e95c-478d-b06c-faadab825310', 'volume_size': 1}' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:09:55 devstack sudo[106650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-21026a90-b2fd-4024-9496-b09e0accdf55 1073741824 Nov 04 11:09:55 devstack sudo[106650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:09:55 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-fb870596-0505-4752-8c63-33dd533c5eb4 tempest-CreateVolumesFromImageTest-1429238948 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e89379f8-7ee6-43f8-9c98-18a4e2ca7d27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:09:55 devstack cinder-volume[87272]: INFO cinder.volume.flows.manager.create_volume [None req-fb870596-0505-4752-8c63-33dd533c5eb4 tempest-CreateVolumesFromImageTest-1429238948 None] Volume volume-c9ce2469-e95c-478d-b06c-faadab825310 (c9ce2469-e95c-478d-b06c-faadab825310): created successfully Nov 04 11:09:55 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-fb870596-0505-4752-8c63-33dd533c5eb4 tempest-CreateVolumesFromImageTest-1429238948 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e89379f8-7ee6-43f8-9c98-18a4e2ca7d27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:09:55 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-fb870596-0505-4752-8c63-33dd533c5eb4 tempest-CreateVolumesFromImageTest-1429238948 None] Flow 'volume_create_manager' (708e432d-d257-4df3-9408-b353a8ef2a7e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87272) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 11:09:55 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-fb870596-0505-4752-8c63-33dd533c5eb4 tempest-CreateVolumesFromImageTest-1429238948 None] Created volume successfully. Nov 04 11:09:56 devstack sudo[106650]: pam_unix(sudo:session): session closed for user root Nov 04 11:09:56 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-adb4bef8-3b45-450b-8a4e-fb8406f3ceac tempest-CreateVolumesFromImageTest-1429238948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-21026a90-b2fd-4024-9496-b09e0accdf55 1073741824" returned: 0 in 0.423s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:09:56 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-adb4bef8-3b45-450b-8a4e-fb8406f3ceac tempest-CreateVolumesFromImageTest-1429238948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-21026a90-b2fd-4024-9496-b09e0accdf55 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:09:56 devstack sudo[106655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-21026a90-b2fd-4024-9496-b09e0accdf55 Nov 04 11:09:56 devstack sudo[106655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:09:56 devstack sudo[106655]: pam_unix(sudo:session): session closed for user root Nov 04 11:09:56 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-adb4bef8-3b45-450b-8a4e-fb8406f3ceac tempest-CreateVolumesFromImageTest-1429238948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-21026a90-b2fd-4024-9496-b09e0accdf55" returned: 0 in 0.258s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:09:56 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-adb4bef8-3b45-450b-8a4e-fb8406f3ceac tempest-CreateVolumesFromImageTest-1429238948 None] <== create_volume: return (719ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'} {{(pid=87272) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 04 11:09:56 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-adb4bef8-3b45-450b-8a4e-fb8406f3ceac tempest-CreateVolumesFromImageTest-1429238948 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.723s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 11:09:56 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-0f9461c3-98bf-46ca-859e-d0359c7be80d tempest-CreateVolumesFromSourceVolumeTest-29009867 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.179s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 11:09:56 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-0f9461c3-98bf-46ca-859e-d0359c7be80d tempest-CreateVolumesFromSourceVolumeTest-29009867 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T10:09:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-363171533',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a9ab4ec4-e6d5-4c2c-b54a-503afcb9f77f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='147901517b8c4f76939552d314ca24cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T10:09:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T10:09:52Z,use_quota=True,user_id='786d418577bc457585572c60157f6545',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8989e4f-21e3-4f0a-9584-0d818784e883),volume_type_id=f8989e4f-21e3-4f0a-9584-0d818784e883)}" {{(pid=87272) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 04 11:09:56 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.remotefs [None req-0f9461c3-98bf-46ca-859e-d0359c7be80d tempest-CreateVolumesFromSourceVolumeTest-29009867 None] Creating volume a9ab4ec4-e6d5-4c2c-b54a-503afcb9f77f {{(pid=87272) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 11:09:56 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-0f9461c3-98bf-46ca-859e-d0359c7be80d tempest-CreateVolumesFromSourceVolumeTest-29009867 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 11:09:56 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-0f9461c3-98bf-46ca-859e-d0359c7be80d tempest-CreateVolumesFromSourceVolumeTest-29009867 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 11:09:56 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-0f9461c3-98bf-46ca-859e-d0359c7be80d tempest-CreateVolumesFromSourceVolumeTest-29009867 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898': None} {{(pid=87272) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 11:09:56 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-0f9461c3-98bf-46ca-859e-d0359c7be80d tempest-CreateVolumesFromSourceVolumeTest-29009867 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'] {{(pid=87272) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 11:09:56 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-0f9461c3-98bf-46ca-859e-d0359c7be80d tempest-CreateVolumesFromSourceVolumeTest-29009867 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 11:09:56 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-0f9461c3-98bf-46ca-859e-d0359c7be80d tempest-CreateVolumesFromSourceVolumeTest-29009867 None] Selected osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898 as target Quobyte volume. {{(pid=87272) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 11:09:56 devstack cinder-volume[87272]: INFO cinder.volume.drivers.remotefs [None req-0f9461c3-98bf-46ca-859e-d0359c7be80d tempest-CreateVolumesFromSourceVolumeTest-29009867 None] casted to osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898 Nov 04 11:09:56 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-0f9461c3-98bf-46ca-859e-d0359c7be80d tempest-CreateVolumesFromSourceVolumeTest-29009867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-a9ab4ec4-e6d5-4c2c-b54a-503afcb9f77f 1073741824 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:09:56 devstack sudo[106658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-a9ab4ec4-e6d5-4c2c-b54a-503afcb9f77f 1073741824 Nov 04 11:09:56 devstack sudo[106658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:09:56 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-adb4bef8-3b45-450b-8a4e-fb8406f3ceac tempest-CreateVolumesFromImageTest-1429238948 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (16d60f32-14c1-4498-9f30-6df6952f18ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-21026a90-b2fd-4024-9496-b09e0accdf55', 'volume_size': 1}' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:09:56 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-adb4bef8-3b45-450b-8a4e-fb8406f3ceac tempest-CreateVolumesFromImageTest-1429238948 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ba45d6f-729f-47c1-b396-e0b0b2e07081) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:09:56 devstack cinder-volume[87272]: INFO cinder.volume.flows.manager.create_volume [None req-adb4bef8-3b45-450b-8a4e-fb8406f3ceac tempest-CreateVolumesFromImageTest-1429238948 None] Volume volume-21026a90-b2fd-4024-9496-b09e0accdf55 (21026a90-b2fd-4024-9496-b09e0accdf55): created successfully Nov 04 11:09:56 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-adb4bef8-3b45-450b-8a4e-fb8406f3ceac tempest-CreateVolumesFromImageTest-1429238948 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ba45d6f-729f-47c1-b396-e0b0b2e07081) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:09:56 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-adb4bef8-3b45-450b-8a4e-fb8406f3ceac tempest-CreateVolumesFromImageTest-1429238948 None] Flow 'volume_create_manager' (ab8d37d2-a7e5-4f3d-b888-8638acc6b3aa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87272) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 11:09:56 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-adb4bef8-3b45-450b-8a4e-fb8406f3ceac tempest-CreateVolumesFromImageTest-1429238948 None] Created volume successfully. Nov 04 11:09:56 devstack cinder-volume[87272]: DEBUG cinder.volume.flows.manager.create_volume [None req-1133ff15-9bca-4e2f-8b42-f69ab6dad2ee tempest-CreateVolumesFromSnapshotTest-2009706975 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87272) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 11:09:56 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-1133ff15-9bca-4e2f-8b42-f69ab6dad2ee tempest-CreateVolumesFromSnapshotTest-2009706975 None] Flow 'volume_create_manager' (7bfa97d6-05e7-4de4-b2bc-6cebcc0913f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 11:09:56 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-1133ff15-9bca-4e2f-8b42-f69ab6dad2ee tempest-CreateVolumesFromSnapshotTest-2009706975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dfbf24a3-56fd-4933-a003-1e2ead453ced) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:09:56 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-1133ff15-9bca-4e2f-8b42-f69ab6dad2ee tempest-CreateVolumesFromSnapshotTest-2009706975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dfbf24a3-56fd-4933-a003-1e2ead453ced) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T10:09:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-305909338',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=69925c2f-f55e-4250-a97d-bb5e9656efb6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a7cf076311674eb4ae990d0029f6b92e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T10:09:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T10:09:57Z,use_quota=True,user_id='79baf402f53c43fc86365839709ab62e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8989e4f-21e3-4f0a-9584-0d818784e883),volume_type_id=f8989e4f-21e3-4f0a-9584-0d818784e883)' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:09:56 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-1133ff15-9bca-4e2f-8b42-f69ab6dad2ee tempest-CreateVolumesFromSnapshotTest-2009706975 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (30faf73a-7f3d-442c-8d5c-f7f784e7abdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:09:56 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-1133ff15-9bca-4e2f-8b42-f69ab6dad2ee tempest-CreateVolumesFromSnapshotTest-2009706975 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (30faf73a-7f3d-442c-8d5c-f7f784e7abdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:09:56 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-1133ff15-9bca-4e2f-8b42-f69ab6dad2ee tempest-CreateVolumesFromSnapshotTest-2009706975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94332e02-d8ae-4cf5-9611-dbad3e95a7b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:09:56 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-1133ff15-9bca-4e2f-8b42-f69ab6dad2ee tempest-CreateVolumesFromSnapshotTest-2009706975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94332e02-d8ae-4cf5-9611-dbad3e95a7b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '69925c2f-f55e-4250-a97d-bb5e9656efb6', 'volume_name': 'volume-69925c2f-f55e-4250-a97d-bb5e9656efb6', 'volume_size': 1}' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:09:56 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-1133ff15-9bca-4e2f-8b42-f69ab6dad2ee tempest-CreateVolumesFromSnapshotTest-2009706975 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a68d5f9-ecfb-4147-ae8b-b4f5b445bd4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:09:56 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-1133ff15-9bca-4e2f-8b42-f69ab6dad2ee tempest-CreateVolumesFromSnapshotTest-2009706975 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a68d5f9-ecfb-4147-ae8b-b4f5b445bd4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:09:56 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-1133ff15-9bca-4e2f-8b42-f69ab6dad2ee tempest-CreateVolumesFromSnapshotTest-2009706975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (745b2358-77c7-4fd7-bab0-7d3fa13ed713) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:09:56 devstack cinder-volume[87272]: INFO cinder.volume.flows.manager.create_volume [None req-1133ff15-9bca-4e2f-8b42-f69ab6dad2ee tempest-CreateVolumesFromSnapshotTest-2009706975 None] Volume 69925c2f-f55e-4250-a97d-bb5e9656efb6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-69925c2f-f55e-4250-a97d-bb5e9656efb6', 'volume_size': 1} Nov 04 11:09:56 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-1133ff15-9bca-4e2f-8b42-f69ab6dad2ee tempest-CreateVolumesFromSnapshotTest-2009706975 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 11:09:57 devstack sudo[106658]: pam_unix(sudo:session): session closed for user root Nov 04 11:09:57 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-0f9461c3-98bf-46ca-859e-d0359c7be80d tempest-CreateVolumesFromSourceVolumeTest-29009867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-a9ab4ec4-e6d5-4c2c-b54a-503afcb9f77f 1073741824" returned: 0 in 0.516s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:09:57 devstack cinder-volume[87272]: DEBUG cinder.volume.flows.manager.create_volume [None req-60a46cc7-adf2-41ec-902b-baa47f9fe94c tempest-CreateVolumesFromSnapshotTest-2009706975 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87272) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 11:09:57 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-60a46cc7-adf2-41ec-902b-baa47f9fe94c tempest-CreateVolumesFromSnapshotTest-2009706975 None] Flow 'volume_create_manager' (3b6a7bc4-52ee-469a-ade8-59872897f2a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 11:09:57 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-60a46cc7-adf2-41ec-902b-baa47f9fe94c tempest-CreateVolumesFromSnapshotTest-2009706975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb44640d-8449-4311-8c90-5cf4921b74cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:09:57 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-60a46cc7-adf2-41ec-902b-baa47f9fe94c tempest-CreateVolumesFromSnapshotTest-2009706975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb44640d-8449-4311-8c90-5cf4921b74cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T10:09:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1151559369',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9bd59a55-ae43-4637-ad94-fe9be4b24b2c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a7cf076311674eb4ae990d0029f6b92e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T10:09:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T10:09:57Z,use_quota=True,user_id='79baf402f53c43fc86365839709ab62e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8989e4f-21e3-4f0a-9584-0d818784e883),volume_type_id=f8989e4f-21e3-4f0a-9584-0d818784e883)' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:09:57 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-60a46cc7-adf2-41ec-902b-baa47f9fe94c tempest-CreateVolumesFromSnapshotTest-2009706975 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7fc56be9-fbde-474d-a57e-dfdef09867e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:09:57 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-60a46cc7-adf2-41ec-902b-baa47f9fe94c tempest-CreateVolumesFromSnapshotTest-2009706975 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7fc56be9-fbde-474d-a57e-dfdef09867e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:09:57 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-60a46cc7-adf2-41ec-902b-baa47f9fe94c tempest-CreateVolumesFromSnapshotTest-2009706975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f445d91-d43e-4c25-8aad-77c01fc7e333) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:09:57 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-60a46cc7-adf2-41ec-902b-baa47f9fe94c tempest-CreateVolumesFromSnapshotTest-2009706975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f445d91-d43e-4c25-8aad-77c01fc7e333) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9bd59a55-ae43-4637-ad94-fe9be4b24b2c', 'volume_name': 'volume-9bd59a55-ae43-4637-ad94-fe9be4b24b2c', 'volume_size': 1}' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:09:57 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-60a46cc7-adf2-41ec-902b-baa47f9fe94c tempest-CreateVolumesFromSnapshotTest-2009706975 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e878747-ce72-44a9-8744-2520f59342b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:09:57 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-60a46cc7-adf2-41ec-902b-baa47f9fe94c tempest-CreateVolumesFromSnapshotTest-2009706975 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e878747-ce72-44a9-8744-2520f59342b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:09:57 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-60a46cc7-adf2-41ec-902b-baa47f9fe94c tempest-CreateVolumesFromSnapshotTest-2009706975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (777f6b73-768c-4ea6-9e64-128e923b0027) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:09:57 devstack cinder-volume[87272]: INFO cinder.volume.flows.manager.create_volume [None req-60a46cc7-adf2-41ec-902b-baa47f9fe94c tempest-CreateVolumesFromSnapshotTest-2009706975 None] Volume 9bd59a55-ae43-4637-ad94-fe9be4b24b2c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9bd59a55-ae43-4637-ad94-fe9be4b24b2c', 'volume_size': 1} Nov 04 11:09:57 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-60a46cc7-adf2-41ec-902b-baa47f9fe94c tempest-CreateVolumesFromSnapshotTest-2009706975 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 11:09:57 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-1ff608c6-6514-4f08-bd56-6bc2ff360847 tempest-CreateVolumesFromImageTest-1429238948 None] Acquiring lock "cinder-21026a90-b2fd-4024-9496-b09e0accdf55-delete_volume" by "delete_volume" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 11:09:57 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-0f9461c3-98bf-46ca-859e-d0359c7be80d tempest-CreateVolumesFromSourceVolumeTest-29009867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-a9ab4ec4-e6d5-4c2c-b54a-503afcb9f77f {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:09:57 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-1ff608c6-6514-4f08-bd56-6bc2ff360847 tempest-CreateVolumesFromImageTest-1429238948 None] Lock "cinder-21026a90-b2fd-4024-9496-b09e0accdf55-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 11:09:57 devstack sudo[106665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-a9ab4ec4-e6d5-4c2c-b54a-503afcb9f77f Nov 04 11:09:57 devstack sudo[106665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:09:57 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-1ff608c6-6514-4f08-bd56-6bc2ff360847 tempest-CreateVolumesFromImageTest-1429238948 None] Acquiring lock "cinder-quobyte-21026a90-b2fd-4024-9496-b09e0accdf55" by "delete_volume" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 11:09:57 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-1ff608c6-6514-4f08-bd56-6bc2ff360847 tempest-CreateVolumesFromImageTest-1429238948 None] Lock "cinder-quobyte-21026a90-b2fd-4024-9496-b09e0accdf55" acquired by "delete_volume" :: waited 0.028s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 11:09:57 devstack cinder-volume[87272]: DEBUG oslo.privsep.daemon [-] privsep: reply[945d5e86-de28-48b2-b8d9-85d9b539c2c1]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 11:09:57 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-1ff608c6-6514-4f08-bd56-6bc2ff360847 tempest-CreateVolumesFromImageTest-1429238948 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-21026a90-b2fd-4024-9496-b09e0accdf55 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:09:57 devstack sudo[106667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-21026a90-b2fd-4024-9496-b09e0accdf55 Nov 04 11:09:57 devstack sudo[106667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:09:57 devstack cinder-volume[87272]: DEBUG cinder.volume.flows.manager.create_volume [None req-6d6581fc-61e3-49e0-ba53-173132966962 tempest-CreateVolumesFromSnapshotTest-2009706975 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87272) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 11:09:57 devstack sudo[106665]: pam_unix(sudo:session): session closed for user root Nov 04 11:09:57 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-6d6581fc-61e3-49e0-ba53-173132966962 tempest-CreateVolumesFromSnapshotTest-2009706975 None] Flow 'volume_create_manager' (dc435f36-bb0c-4490-b7ea-5ad585b7d3e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 11:09:57 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-6d6581fc-61e3-49e0-ba53-173132966962 tempest-CreateVolumesFromSnapshotTest-2009706975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a63bbfb3-c7e0-46a7-87a9-70062e327e9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:09:57 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-0f9461c3-98bf-46ca-859e-d0359c7be80d tempest-CreateVolumesFromSourceVolumeTest-29009867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-a9ab4ec4-e6d5-4c2c-b54a-503afcb9f77f" returned: 0 in 0.337s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:09:57 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-0f9461c3-98bf-46ca-859e-d0359c7be80d tempest-CreateVolumesFromSourceVolumeTest-29009867 None] <== create_volume: return (1008ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'} {{(pid=87272) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 04 11:09:57 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-0f9461c3-98bf-46ca-859e-d0359c7be80d tempest-CreateVolumesFromSourceVolumeTest-29009867 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.012s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 11:09:57 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-b00f6c87-14fb-4c3a-9e65-3a48b46a0a24 tempest-CreateVolumesFromSourceVolumeTest-29009867 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.433s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 11:09:57 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-b00f6c87-14fb-4c3a-9e65-3a48b46a0a24 tempest-CreateVolumesFromSourceVolumeTest-29009867 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T10:09:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-798483620',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=61e9533f-44fe-4e24-bd4e-5b00d89db96a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='147901517b8c4f76939552d314ca24cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T10:09:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T10:09:53Z,use_quota=True,user_id='786d418577bc457585572c60157f6545',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8989e4f-21e3-4f0a-9584-0d818784e883),volume_type_id=f8989e4f-21e3-4f0a-9584-0d818784e883)}" {{(pid=87272) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 04 11:09:57 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.remotefs [None req-b00f6c87-14fb-4c3a-9e65-3a48b46a0a24 tempest-CreateVolumesFromSourceVolumeTest-29009867 None] Creating volume 61e9533f-44fe-4e24-bd4e-5b00d89db96a {{(pid=87272) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 11:09:57 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-b00f6c87-14fb-4c3a-9e65-3a48b46a0a24 tempest-CreateVolumesFromSourceVolumeTest-29009867 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 11:09:57 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-b00f6c87-14fb-4c3a-9e65-3a48b46a0a24 tempest-CreateVolumesFromSourceVolumeTest-29009867 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 11:09:57 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-b00f6c87-14fb-4c3a-9e65-3a48b46a0a24 tempest-CreateVolumesFromSourceVolumeTest-29009867 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898': None} {{(pid=87272) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 11:09:57 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-b00f6c87-14fb-4c3a-9e65-3a48b46a0a24 tempest-CreateVolumesFromSourceVolumeTest-29009867 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'] {{(pid=87272) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 11:09:57 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-b00f6c87-14fb-4c3a-9e65-3a48b46a0a24 tempest-CreateVolumesFromSourceVolumeTest-29009867 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 11:09:57 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-b00f6c87-14fb-4c3a-9e65-3a48b46a0a24 tempest-CreateVolumesFromSourceVolumeTest-29009867 None] Selected osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898 as target Quobyte volume. {{(pid=87272) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 11:09:57 devstack cinder-volume[87272]: INFO cinder.volume.drivers.remotefs [None req-b00f6c87-14fb-4c3a-9e65-3a48b46a0a24 tempest-CreateVolumesFromSourceVolumeTest-29009867 None] casted to osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898 Nov 04 11:09:57 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-b00f6c87-14fb-4c3a-9e65-3a48b46a0a24 tempest-CreateVolumesFromSourceVolumeTest-29009867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-61e9533f-44fe-4e24-bd4e-5b00d89db96a 1073741824 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:09:57 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-6d6581fc-61e3-49e0-ba53-173132966962 tempest-CreateVolumesFromSnapshotTest-2009706975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a63bbfb3-c7e0-46a7-87a9-70062e327e9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T10:09:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1104389421',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e30b71ed-a798-48e4-972b-eebf8bb82bc2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a7cf076311674eb4ae990d0029f6b92e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T10:09:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T10:09:58Z,use_quota=True,user_id='79baf402f53c43fc86365839709ab62e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8989e4f-21e3-4f0a-9584-0d818784e883),volume_type_id=f8989e4f-21e3-4f0a-9584-0d818784e883)' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:09:57 devstack sudo[106670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-61e9533f-44fe-4e24-bd4e-5b00d89db96a 1073741824 Nov 04 11:09:57 devstack sudo[106670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:09:57 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-6d6581fc-61e3-49e0-ba53-173132966962 tempest-CreateVolumesFromSnapshotTest-2009706975 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f50297b2-b1a0-48ef-8630-59f918aa0ed7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:09:57 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-6d6581fc-61e3-49e0-ba53-173132966962 tempest-CreateVolumesFromSnapshotTest-2009706975 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f50297b2-b1a0-48ef-8630-59f918aa0ed7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:09:57 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-6d6581fc-61e3-49e0-ba53-173132966962 tempest-CreateVolumesFromSnapshotTest-2009706975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a899646-325d-410c-94f9-703d919ccfdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:09:57 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-6d6581fc-61e3-49e0-ba53-173132966962 tempest-CreateVolumesFromSnapshotTest-2009706975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a899646-325d-410c-94f9-703d919ccfdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e30b71ed-a798-48e4-972b-eebf8bb82bc2', 'volume_name': 'volume-e30b71ed-a798-48e4-972b-eebf8bb82bc2', 'volume_size': 1}' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:09:57 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-6d6581fc-61e3-49e0-ba53-173132966962 tempest-CreateVolumesFromSnapshotTest-2009706975 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c009504-3d45-49f4-95ae-b67c35d471cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:09:57 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-6d6581fc-61e3-49e0-ba53-173132966962 tempest-CreateVolumesFromSnapshotTest-2009706975 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c009504-3d45-49f4-95ae-b67c35d471cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:09:57 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-6d6581fc-61e3-49e0-ba53-173132966962 tempest-CreateVolumesFromSnapshotTest-2009706975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d88fde4-d53b-4a04-9ef8-b0fceb37f558) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:09:57 devstack cinder-volume[87272]: INFO cinder.volume.flows.manager.create_volume [None req-6d6581fc-61e3-49e0-ba53-173132966962 tempest-CreateVolumesFromSnapshotTest-2009706975 None] Volume e30b71ed-a798-48e4-972b-eebf8bb82bc2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e30b71ed-a798-48e4-972b-eebf8bb82bc2', 'volume_size': 1} Nov 04 11:09:57 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-6d6581fc-61e3-49e0-ba53-173132966962 tempest-CreateVolumesFromSnapshotTest-2009706975 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 11:09:57 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-0f9461c3-98bf-46ca-859e-d0359c7be80d tempest-CreateVolumesFromSourceVolumeTest-29009867 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c32b053f-f53e-40b7-9651-63741fb6a32e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a9ab4ec4-e6d5-4c2c-b54a-503afcb9f77f', 'volume_size': 1}' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:09:57 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-0f9461c3-98bf-46ca-859e-d0359c7be80d tempest-CreateVolumesFromSourceVolumeTest-29009867 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db2bb5af-60b7-4c4c-badd-c20342d85451) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:09:57 devstack cinder-volume[87272]: INFO cinder.volume.flows.manager.create_volume [None req-0f9461c3-98bf-46ca-859e-d0359c7be80d tempest-CreateVolumesFromSourceVolumeTest-29009867 None] Volume volume-a9ab4ec4-e6d5-4c2c-b54a-503afcb9f77f (a9ab4ec4-e6d5-4c2c-b54a-503afcb9f77f): created successfully Nov 04 11:09:57 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-0f9461c3-98bf-46ca-859e-d0359c7be80d tempest-CreateVolumesFromSourceVolumeTest-29009867 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db2bb5af-60b7-4c4c-badd-c20342d85451) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:09:57 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-0f9461c3-98bf-46ca-859e-d0359c7be80d tempest-CreateVolumesFromSourceVolumeTest-29009867 None] Flow 'volume_create_manager' (3075db37-3a49-4870-8cab-875aec7a2692) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87272) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 11:09:57 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-0f9461c3-98bf-46ca-859e-d0359c7be80d tempest-CreateVolumesFromSourceVolumeTest-29009867 None] Created volume successfully. Nov 04 11:09:57 devstack sudo[106667]: pam_unix(sudo:session): session closed for user root Nov 04 11:09:57 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-1ff608c6-6514-4f08-bd56-6bc2ff360847 tempest-CreateVolumesFromImageTest-1429238948 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-21026a90-b2fd-4024-9496-b09e0accdf55" returned: 0 in 0.522s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:09:57 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-1ff608c6-6514-4f08-bd56-6bc2ff360847 tempest-CreateVolumesFromImageTest-1429238948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-21026a90-b2fd-4024-9496-b09e0accdf55 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:09:57 devstack sudo[106679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-21026a90-b2fd-4024-9496-b09e0accdf55 Nov 04 11:09:57 devstack sudo[106679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:09:58 devstack cinder-volume[87272]: DEBUG cinder.volume.flows.manager.create_volume [None req-e4b82bdf-4f39-4f38-a82b-6e5dc9439e74 tempest-CreateVolumesFromSnapshotTest-2009706975 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87272) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 11:09:58 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-e4b82bdf-4f39-4f38-a82b-6e5dc9439e74 tempest-CreateVolumesFromSnapshotTest-2009706975 None] Flow 'volume_create_manager' (0e22f2c5-0c7d-4474-917c-6a35f75ddfd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 11:09:58 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-e4b82bdf-4f39-4f38-a82b-6e5dc9439e74 tempest-CreateVolumesFromSnapshotTest-2009706975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (298ddcd0-2098-491c-b195-5494b3a2fc13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:09:58 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-e4b82bdf-4f39-4f38-a82b-6e5dc9439e74 tempest-CreateVolumesFromSnapshotTest-2009706975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (298ddcd0-2098-491c-b195-5494b3a2fc13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T10:09:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1776861982',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=29e2cdd8-0ddd-4bf9-9c06-f49655bcd28b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a7cf076311674eb4ae990d0029f6b92e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T10:09:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T10:09:58Z,use_quota=True,user_id='79baf402f53c43fc86365839709ab62e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8989e4f-21e3-4f0a-9584-0d818784e883),volume_type_id=f8989e4f-21e3-4f0a-9584-0d818784e883)' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:09:58 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-e4b82bdf-4f39-4f38-a82b-6e5dc9439e74 tempest-CreateVolumesFromSnapshotTest-2009706975 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2db3a9ec-63d6-4099-bd07-4d26d6caae1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:09:58 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-e4b82bdf-4f39-4f38-a82b-6e5dc9439e74 tempest-CreateVolumesFromSnapshotTest-2009706975 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2db3a9ec-63d6-4099-bd07-4d26d6caae1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:09:58 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-e4b82bdf-4f39-4f38-a82b-6e5dc9439e74 tempest-CreateVolumesFromSnapshotTest-2009706975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (717f8842-0a83-468a-86a6-85936e99a565) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:09:58 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-e4b82bdf-4f39-4f38-a82b-6e5dc9439e74 tempest-CreateVolumesFromSnapshotTest-2009706975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (717f8842-0a83-468a-86a6-85936e99a565) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '29e2cdd8-0ddd-4bf9-9c06-f49655bcd28b', 'volume_name': 'volume-29e2cdd8-0ddd-4bf9-9c06-f49655bcd28b', 'volume_size': 1}' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:09:58 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-e4b82bdf-4f39-4f38-a82b-6e5dc9439e74 tempest-CreateVolumesFromSnapshotTest-2009706975 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95595e16-7ea2-4822-96df-bc2f04a2cef2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:09:58 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-e4b82bdf-4f39-4f38-a82b-6e5dc9439e74 tempest-CreateVolumesFromSnapshotTest-2009706975 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95595e16-7ea2-4822-96df-bc2f04a2cef2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:09:58 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-e4b82bdf-4f39-4f38-a82b-6e5dc9439e74 tempest-CreateVolumesFromSnapshotTest-2009706975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (53b78abd-05d8-475f-9e96-8f343b5a3423) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:09:58 devstack cinder-volume[87272]: INFO cinder.volume.flows.manager.create_volume [None req-e4b82bdf-4f39-4f38-a82b-6e5dc9439e74 tempest-CreateVolumesFromSnapshotTest-2009706975 None] Volume 29e2cdd8-0ddd-4bf9-9c06-f49655bcd28b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-29e2cdd8-0ddd-4bf9-9c06-f49655bcd28b', 'volume_size': 1} Nov 04 11:09:58 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-e4b82bdf-4f39-4f38-a82b-6e5dc9439e74 tempest-CreateVolumesFromSnapshotTest-2009706975 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 11:09:58 devstack sudo[106679]: pam_unix(sudo:session): session closed for user root Nov 04 11:09:58 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-1ff608c6-6514-4f08-bd56-6bc2ff360847 tempest-CreateVolumesFromImageTest-1429238948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-21026a90-b2fd-4024-9496-b09e0accdf55" returned: 0 in 0.418s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:09:58 devstack sudo[106670]: pam_unix(sudo:session): session closed for user root Nov 04 11:09:58 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-1ff608c6-6514-4f08-bd56-6bc2ff360847 tempest-CreateVolumesFromImageTest-1429238948 None] Lock "cinder-quobyte-21026a90-b2fd-4024-9496-b09e0accdf55" released by "delete_volume" :: held 1.009s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 11:09:58 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-b00f6c87-14fb-4c3a-9e65-3a48b46a0a24 tempest-CreateVolumesFromSourceVolumeTest-29009867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-61e9533f-44fe-4e24-bd4e-5b00d89db96a 1073741824" returned: 0 in 0.755s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:09:58 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-b00f6c87-14fb-4c3a-9e65-3a48b46a0a24 tempest-CreateVolumesFromSourceVolumeTest-29009867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-61e9533f-44fe-4e24-bd4e-5b00d89db96a {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:09:58 devstack cinder-volume[87272]: DEBUG cinder.quota [None req-1ff608c6-6514-4f08-bd56-6bc2ff360847 tempest-CreateVolumesFromImageTest-1429238948 None] Created reservations ['c994ebfc-8d40-4d75-bc4a-e9ecce0657dc', 'b4ccc863-ae40-45d6-9c6e-112d040fa901', '5cd857e2-1ceb-41ad-9aef-5ac67fa10707', '96792026-4b94-4461-93c2-f63a3497c04e'] {{(pid=87272) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 11:09:58 devstack sudo[106684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-61e9533f-44fe-4e24-bd4e-5b00d89db96a Nov 04 11:09:58 devstack sudo[106684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:09:58 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-1ff608c6-6514-4f08-bd56-6bc2ff360847 tempest-CreateVolumesFromImageTest-1429238948 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 11:09:58 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-1ff608c6-6514-4f08-bd56-6bc2ff360847 tempest-CreateVolumesFromImageTest-1429238948 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 11:09:58 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-1ff608c6-6514-4f08-bd56-6bc2ff360847 tempest-CreateVolumesFromImageTest-1429238948 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898': None} {{(pid=87272) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 11:09:58 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-1ff608c6-6514-4f08-bd56-6bc2ff360847 tempest-CreateVolumesFromImageTest-1429238948 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'] {{(pid=87272) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 11:09:58 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-1ff608c6-6514-4f08-bd56-6bc2ff360847 tempest-CreateVolumesFromImageTest-1429238948 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 11:09:58 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-1ff608c6-6514-4f08-bd56-6bc2ff360847 tempest-CreateVolumesFromImageTest-1429238948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:09:58 devstack cinder-volume[87272]: DEBUG cinder.volume.flows.manager.create_volume [None req-3ea6e76e-0907-46e1-af78-8afc8e46b06b tempest-CreateVolumesFromSnapshotTest-2009706975 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87272) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 11:09:58 devstack sudo[106686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1 Nov 04 11:09:58 devstack sudo[106686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:09:58 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-3ea6e76e-0907-46e1-af78-8afc8e46b06b tempest-CreateVolumesFromSnapshotTest-2009706975 None] Flow 'volume_create_manager' (2c8d8352-cdc8-461f-85f3-a1737f3faf1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 11:09:58 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-3ea6e76e-0907-46e1-af78-8afc8e46b06b tempest-CreateVolumesFromSnapshotTest-2009706975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (33dc0135-1cf9-4089-8cee-4db937734099) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:09:58 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-3ea6e76e-0907-46e1-af78-8afc8e46b06b tempest-CreateVolumesFromSnapshotTest-2009706975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (33dc0135-1cf9-4089-8cee-4db937734099) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T10:09:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1076944953',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f8f004d-1ffd-43f5-8a44-03c824ce75d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a7cf076311674eb4ae990d0029f6b92e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T10:09:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T10:09:58Z,use_quota=True,user_id='79baf402f53c43fc86365839709ab62e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8989e4f-21e3-4f0a-9584-0d818784e883),volume_type_id=f8989e4f-21e3-4f0a-9584-0d818784e883)' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:09:58 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-3ea6e76e-0907-46e1-af78-8afc8e46b06b tempest-CreateVolumesFromSnapshotTest-2009706975 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dbc0776a-b5b8-468e-92aa-4ea6ec8e4364) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:09:58 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-3ea6e76e-0907-46e1-af78-8afc8e46b06b tempest-CreateVolumesFromSnapshotTest-2009706975 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dbc0776a-b5b8-468e-92aa-4ea6ec8e4364) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:09:58 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-3ea6e76e-0907-46e1-af78-8afc8e46b06b tempest-CreateVolumesFromSnapshotTest-2009706975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ed6770c-b43e-4b51-a7fe-991e58636edb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:09:58 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-3ea6e76e-0907-46e1-af78-8afc8e46b06b tempest-CreateVolumesFromSnapshotTest-2009706975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ed6770c-b43e-4b51-a7fe-991e58636edb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2f8f004d-1ffd-43f5-8a44-03c824ce75d6', 'volume_name': 'volume-2f8f004d-1ffd-43f5-8a44-03c824ce75d6', 'volume_size': 1}' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:09:58 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-3ea6e76e-0907-46e1-af78-8afc8e46b06b tempest-CreateVolumesFromSnapshotTest-2009706975 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51cd4752-2e59-4974-a475-8280626119c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:09:58 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-3ea6e76e-0907-46e1-af78-8afc8e46b06b tempest-CreateVolumesFromSnapshotTest-2009706975 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51cd4752-2e59-4974-a475-8280626119c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:09:58 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-3ea6e76e-0907-46e1-af78-8afc8e46b06b tempest-CreateVolumesFromSnapshotTest-2009706975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec205afd-50ae-4c3e-9c8a-ff7d21a959bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:09:58 devstack cinder-volume[87272]: INFO cinder.volume.flows.manager.create_volume [None req-3ea6e76e-0907-46e1-af78-8afc8e46b06b tempest-CreateVolumesFromSnapshotTest-2009706975 None] Volume 2f8f004d-1ffd-43f5-8a44-03c824ce75d6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2f8f004d-1ffd-43f5-8a44-03c824ce75d6', 'volume_size': 1} Nov 04 11:09:58 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-3ea6e76e-0907-46e1-af78-8afc8e46b06b tempest-CreateVolumesFromSnapshotTest-2009706975 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 11:09:58 devstack sudo[106684]: pam_unix(sudo:session): session closed for user root Nov 04 11:09:58 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-b00f6c87-14fb-4c3a-9e65-3a48b46a0a24 tempest-CreateVolumesFromSourceVolumeTest-29009867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-61e9533f-44fe-4e24-bd4e-5b00d89db96a" returned: 0 in 0.266s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:09:58 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-b00f6c87-14fb-4c3a-9e65-3a48b46a0a24 tempest-CreateVolumesFromSourceVolumeTest-29009867 None] <== create_volume: return (1074ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'} {{(pid=87272) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 04 11:09:58 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-b00f6c87-14fb-4c3a-9e65-3a48b46a0a24 tempest-CreateVolumesFromSourceVolumeTest-29009867 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.076s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 11:09:58 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-7e2f18a7-9e6d-45ce-b08e-88dbc5903008 tempest-CreateVolumesFromSourceVolumeTest-29009867 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.323s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 11:09:58 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-7e2f18a7-9e6d-45ce-b08e-88dbc5903008 tempest-CreateVolumesFromSourceVolumeTest-29009867 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T10:09:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-858625388',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=945c4150-ab0c-4fbb-8b13-12c3460c66a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='147901517b8c4f76939552d314ca24cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T10:09:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T10:09:53Z,use_quota=True,user_id='786d418577bc457585572c60157f6545',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8989e4f-21e3-4f0a-9584-0d818784e883),volume_type_id=f8989e4f-21e3-4f0a-9584-0d818784e883)}" {{(pid=87272) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 04 11:09:58 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.remotefs [None req-7e2f18a7-9e6d-45ce-b08e-88dbc5903008 tempest-CreateVolumesFromSourceVolumeTest-29009867 None] Creating volume 945c4150-ab0c-4fbb-8b13-12c3460c66a2 {{(pid=87272) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 11:09:58 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-7e2f18a7-9e6d-45ce-b08e-88dbc5903008 tempest-CreateVolumesFromSourceVolumeTest-29009867 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 11:09:58 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-7e2f18a7-9e6d-45ce-b08e-88dbc5903008 tempest-CreateVolumesFromSourceVolumeTest-29009867 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 11:09:58 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-7e2f18a7-9e6d-45ce-b08e-88dbc5903008 tempest-CreateVolumesFromSourceVolumeTest-29009867 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898': None} {{(pid=87272) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 11:09:58 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-7e2f18a7-9e6d-45ce-b08e-88dbc5903008 tempest-CreateVolumesFromSourceVolumeTest-29009867 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'] {{(pid=87272) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 11:09:58 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-7e2f18a7-9e6d-45ce-b08e-88dbc5903008 tempest-CreateVolumesFromSourceVolumeTest-29009867 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 11:09:58 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-7e2f18a7-9e6d-45ce-b08e-88dbc5903008 tempest-CreateVolumesFromSourceVolumeTest-29009867 None] Selected osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898 as target Quobyte volume. {{(pid=87272) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 11:09:58 devstack cinder-volume[87272]: INFO cinder.volume.drivers.remotefs [None req-7e2f18a7-9e6d-45ce-b08e-88dbc5903008 tempest-CreateVolumesFromSourceVolumeTest-29009867 None] casted to osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898 Nov 04 11:09:58 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-7e2f18a7-9e6d-45ce-b08e-88dbc5903008 tempest-CreateVolumesFromSourceVolumeTest-29009867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-945c4150-ab0c-4fbb-8b13-12c3460c66a2 1073741824 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:09:58 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-b00f6c87-14fb-4c3a-9e65-3a48b46a0a24 tempest-CreateVolumesFromSourceVolumeTest-29009867 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f166600-8177-4f19-8e9e-2813c4ec2e2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-61e9533f-44fe-4e24-bd4e-5b00d89db96a', 'volume_size': 1}' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:09:58 devstack sudo[106689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-945c4150-ab0c-4fbb-8b13-12c3460c66a2 1073741824 Nov 04 11:09:58 devstack sudo[106689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:09:58 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-b00f6c87-14fb-4c3a-9e65-3a48b46a0a24 tempest-CreateVolumesFromSourceVolumeTest-29009867 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8642632e-15ea-4f99-89dc-857d594ef2e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:09:58 devstack cinder-volume[87272]: INFO cinder.volume.flows.manager.create_volume [None req-b00f6c87-14fb-4c3a-9e65-3a48b46a0a24 tempest-CreateVolumesFromSourceVolumeTest-29009867 None] Volume volume-61e9533f-44fe-4e24-bd4e-5b00d89db96a (61e9533f-44fe-4e24-bd4e-5b00d89db96a): created successfully Nov 04 11:09:58 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-b00f6c87-14fb-4c3a-9e65-3a48b46a0a24 tempest-CreateVolumesFromSourceVolumeTest-29009867 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8642632e-15ea-4f99-89dc-857d594ef2e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:09:58 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-b00f6c87-14fb-4c3a-9e65-3a48b46a0a24 tempest-CreateVolumesFromSourceVolumeTest-29009867 None] Flow 'volume_create_manager' (beaeaa67-f3c9-48be-906d-b7a332dc78bc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87272) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 11:09:58 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-b00f6c87-14fb-4c3a-9e65-3a48b46a0a24 tempest-CreateVolumesFromSourceVolumeTest-29009867 None] Created volume successfully. Nov 04 11:09:58 devstack sudo[106686]: pam_unix(sudo:session): session closed for user root Nov 04 11:09:58 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-1ff608c6-6514-4f08-bd56-6bc2ff360847 tempest-CreateVolumesFromImageTest-1429238948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1" returned: 0 in 0.266s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:09:58 devstack cinder-volume[87272]: DEBUG cinder.manager [None req-1ff608c6-6514-4f08-bd56-6bc2ff360847 tempest-CreateVolumesFromImageTest-1429238948 None] Notifying Schedulers of capabilities ... {{(pid=87272) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 11:09:58 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-1ff608c6-6514-4f08-bd56-6bc2ff360847 tempest-CreateVolumesFromImageTest-1429238948 None] Deleted volume successfully. Nov 04 11:09:58 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-1ff608c6-6514-4f08-bd56-6bc2ff360847 tempest-CreateVolumesFromImageTest-1429238948 None] Lock "cinder-21026a90-b2fd-4024-9496-b09e0accdf55-delete_volume" released by "delete_volume" :: held 1.545s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 11:09:59 devstack sudo[106689]: pam_unix(sudo:session): session closed for user root Nov 04 11:09:59 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-7e2f18a7-9e6d-45ce-b08e-88dbc5903008 tempest-CreateVolumesFromSourceVolumeTest-29009867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-945c4150-ab0c-4fbb-8b13-12c3460c66a2 1073741824" returned: 0 in 0.414s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:09:59 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-7e2f18a7-9e6d-45ce-b08e-88dbc5903008 tempest-CreateVolumesFromSourceVolumeTest-29009867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-945c4150-ab0c-4fbb-8b13-12c3460c66a2 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:09:59 devstack sudo[106696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-945c4150-ab0c-4fbb-8b13-12c3460c66a2 Nov 04 11:09:59 devstack sudo[106696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:09:59 devstack sudo[106696]: pam_unix(sudo:session): session closed for user root Nov 04 11:09:59 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-7e2f18a7-9e6d-45ce-b08e-88dbc5903008 tempest-CreateVolumesFromSourceVolumeTest-29009867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-945c4150-ab0c-4fbb-8b13-12c3460c66a2" returned: 0 in 0.251s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:09:59 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-7e2f18a7-9e6d-45ce-b08e-88dbc5903008 tempest-CreateVolumesFromSourceVolumeTest-29009867 None] <== create_volume: return (707ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'} {{(pid=87272) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 04 11:09:59 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-7e2f18a7-9e6d-45ce-b08e-88dbc5903008 tempest-CreateVolumesFromSourceVolumeTest-29009867 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.711s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 11:09:59 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-044b373f-3f2e-4861-b1be-81b2d1c1a122 tempest-CreateVolumesFromSourceVolumeTest-29009867 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.775s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 11:09:59 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-044b373f-3f2e-4861-b1be-81b2d1c1a122 tempest-CreateVolumesFromSourceVolumeTest-29009867 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T10:09:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1069102828',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dfa48361-b513-4484-bb70-a0698e7c50ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='147901517b8c4f76939552d314ca24cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T10:09:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T10:09:53Z,use_quota=True,user_id='786d418577bc457585572c60157f6545',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8989e4f-21e3-4f0a-9584-0d818784e883),volume_type_id=f8989e4f-21e3-4f0a-9584-0d818784e883)}" {{(pid=87272) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 04 11:09:59 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.remotefs [None req-044b373f-3f2e-4861-b1be-81b2d1c1a122 tempest-CreateVolumesFromSourceVolumeTest-29009867 None] Creating volume dfa48361-b513-4484-bb70-a0698e7c50ec {{(pid=87272) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 11:09:59 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-044b373f-3f2e-4861-b1be-81b2d1c1a122 tempest-CreateVolumesFromSourceVolumeTest-29009867 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 11:09:59 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-044b373f-3f2e-4861-b1be-81b2d1c1a122 tempest-CreateVolumesFromSourceVolumeTest-29009867 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 11:09:59 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-044b373f-3f2e-4861-b1be-81b2d1c1a122 tempest-CreateVolumesFromSourceVolumeTest-29009867 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898': None} {{(pid=87272) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 11:09:59 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-044b373f-3f2e-4861-b1be-81b2d1c1a122 tempest-CreateVolumesFromSourceVolumeTest-29009867 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'] {{(pid=87272) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 11:09:59 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-044b373f-3f2e-4861-b1be-81b2d1c1a122 tempest-CreateVolumesFromSourceVolumeTest-29009867 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 11:09:59 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-044b373f-3f2e-4861-b1be-81b2d1c1a122 tempest-CreateVolumesFromSourceVolumeTest-29009867 None] Selected osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898 as target Quobyte volume. {{(pid=87272) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 11:09:59 devstack cinder-volume[87272]: INFO cinder.volume.drivers.remotefs [None req-044b373f-3f2e-4861-b1be-81b2d1c1a122 tempest-CreateVolumesFromSourceVolumeTest-29009867 None] casted to osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898 Nov 04 11:09:59 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-044b373f-3f2e-4861-b1be-81b2d1c1a122 tempest-CreateVolumesFromSourceVolumeTest-29009867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-dfa48361-b513-4484-bb70-a0698e7c50ec 1073741824 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:09:59 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-7e2f18a7-9e6d-45ce-b08e-88dbc5903008 tempest-CreateVolumesFromSourceVolumeTest-29009867 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db4877a2-0023-480b-8cd4-e0699d4eab82) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-945c4150-ab0c-4fbb-8b13-12c3460c66a2', 'volume_size': 1}' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:09:59 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-7e2f18a7-9e6d-45ce-b08e-88dbc5903008 tempest-CreateVolumesFromSourceVolumeTest-29009867 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31e53aba-5e60-4552-b059-474ceab53f80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:09:59 devstack sudo[106699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-dfa48361-b513-4484-bb70-a0698e7c50ec 1073741824 Nov 04 11:09:59 devstack sudo[106699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:09:59 devstack cinder-volume[87272]: INFO cinder.volume.flows.manager.create_volume [None req-7e2f18a7-9e6d-45ce-b08e-88dbc5903008 tempest-CreateVolumesFromSourceVolumeTest-29009867 None] Volume volume-945c4150-ab0c-4fbb-8b13-12c3460c66a2 (945c4150-ab0c-4fbb-8b13-12c3460c66a2): created successfully Nov 04 11:09:59 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-7e2f18a7-9e6d-45ce-b08e-88dbc5903008 tempest-CreateVolumesFromSourceVolumeTest-29009867 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31e53aba-5e60-4552-b059-474ceab53f80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:09:59 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-7e2f18a7-9e6d-45ce-b08e-88dbc5903008 tempest-CreateVolumesFromSourceVolumeTest-29009867 None] Flow 'volume_create_manager' (60a25e60-624a-44a4-9cf7-1b71caa7efbd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87272) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 11:09:59 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-7e2f18a7-9e6d-45ce-b08e-88dbc5903008 tempest-CreateVolumesFromSourceVolumeTest-29009867 None] Created volume successfully. Nov 04 11:09:59 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-d7446a70-8ee0-4c4f-8a7a-6816ce1111df tempest-CreateVolumesFromImageTest-1429238948 None] Acquiring lock "cinder-c9ce2469-e95c-478d-b06c-faadab825310-delete_volume" by "delete_volume" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 11:09:59 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-d7446a70-8ee0-4c4f-8a7a-6816ce1111df tempest-CreateVolumesFromImageTest-1429238948 None] Lock "cinder-c9ce2469-e95c-478d-b06c-faadab825310-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 11:09:59 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-d7446a70-8ee0-4c4f-8a7a-6816ce1111df tempest-CreateVolumesFromImageTest-1429238948 None] Acquiring lock "cinder-quobyte-c9ce2469-e95c-478d-b06c-faadab825310" by "delete_volume" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 11:09:59 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-d7446a70-8ee0-4c4f-8a7a-6816ce1111df tempest-CreateVolumesFromImageTest-1429238948 None] Lock "cinder-quobyte-c9ce2469-e95c-478d-b06c-faadab825310" acquired by "delete_volume" :: waited 0.016s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 11:09:59 devstack cinder-volume[87272]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e5f0099-adfe-4af0-aa19-1a6ef3b69301]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 11:09:59 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-d7446a70-8ee0-4c4f-8a7a-6816ce1111df tempest-CreateVolumesFromImageTest-1429238948 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-c9ce2469-e95c-478d-b06c-faadab825310 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:09:59 devstack sudo[106701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-c9ce2469-e95c-478d-b06c-faadab825310 Nov 04 11:09:59 devstack sudo[106701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:09:59 devstack sudo[106699]: pam_unix(sudo:session): session closed for user root Nov 04 11:09:59 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-044b373f-3f2e-4861-b1be-81b2d1c1a122 tempest-CreateVolumesFromSourceVolumeTest-29009867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-dfa48361-b513-4484-bb70-a0698e7c50ec 1073741824" returned: 0 in 0.474s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:09:59 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-044b373f-3f2e-4861-b1be-81b2d1c1a122 tempest-CreateVolumesFromSourceVolumeTest-29009867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-dfa48361-b513-4484-bb70-a0698e7c50ec {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:09:59 devstack sudo[106709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-dfa48361-b513-4484-bb70-a0698e7c50ec Nov 04 11:09:59 devstack sudo[106709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:10:00 devstack sudo[106701]: pam_unix(sudo:session): session closed for user root Nov 04 11:10:00 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-d7446a70-8ee0-4c4f-8a7a-6816ce1111df tempest-CreateVolumesFromImageTest-1429238948 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-c9ce2469-e95c-478d-b06c-faadab825310" returned: 0 in 0.384s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:10:00 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-d7446a70-8ee0-4c4f-8a7a-6816ce1111df tempest-CreateVolumesFromImageTest-1429238948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-c9ce2469-e95c-478d-b06c-faadab825310 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:10:00 devstack sudo[106713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-c9ce2469-e95c-478d-b06c-faadab825310 Nov 04 11:10:00 devstack sudo[106713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:10:00 devstack sudo[106709]: pam_unix(sudo:session): session closed for user root Nov 04 11:10:00 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-044b373f-3f2e-4861-b1be-81b2d1c1a122 tempest-CreateVolumesFromSourceVolumeTest-29009867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-dfa48361-b513-4484-bb70-a0698e7c50ec" returned: 0 in 0.269s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:10:00 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-044b373f-3f2e-4861-b1be-81b2d1c1a122 tempest-CreateVolumesFromSourceVolumeTest-29009867 None] <== create_volume: return (791ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'} {{(pid=87272) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 04 11:10:00 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-044b373f-3f2e-4861-b1be-81b2d1c1a122 tempest-CreateVolumesFromSourceVolumeTest-29009867 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.796s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 11:10:00 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-8fce7fb5-6f79-4713-b083-aa21022ccc15 tempest-CreateVolumesFromSourceVolumeTest-29009867 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.108s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 11:10:00 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-8fce7fb5-6f79-4713-b083-aa21022ccc15 tempest-CreateVolumesFromSourceVolumeTest-29009867 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T10:09:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2062402276',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=87ba91b7-949b-4433-819c-c796f0ac0ab1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='147901517b8c4f76939552d314ca24cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T10:09:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T10:09:54Z,use_quota=True,user_id='786d418577bc457585572c60157f6545',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8989e4f-21e3-4f0a-9584-0d818784e883),volume_type_id=f8989e4f-21e3-4f0a-9584-0d818784e883)}" {{(pid=87272) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 04 11:10:00 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.remotefs [None req-8fce7fb5-6f79-4713-b083-aa21022ccc15 tempest-CreateVolumesFromSourceVolumeTest-29009867 None] Creating volume 87ba91b7-949b-4433-819c-c796f0ac0ab1 {{(pid=87272) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 11:10:00 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-8fce7fb5-6f79-4713-b083-aa21022ccc15 tempest-CreateVolumesFromSourceVolumeTest-29009867 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 11:10:00 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-8fce7fb5-6f79-4713-b083-aa21022ccc15 tempest-CreateVolumesFromSourceVolumeTest-29009867 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 11:10:00 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-8fce7fb5-6f79-4713-b083-aa21022ccc15 tempest-CreateVolumesFromSourceVolumeTest-29009867 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898': None} {{(pid=87272) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 11:10:00 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-8fce7fb5-6f79-4713-b083-aa21022ccc15 tempest-CreateVolumesFromSourceVolumeTest-29009867 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'] {{(pid=87272) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 11:10:00 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-8fce7fb5-6f79-4713-b083-aa21022ccc15 tempest-CreateVolumesFromSourceVolumeTest-29009867 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 11:10:00 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-8fce7fb5-6f79-4713-b083-aa21022ccc15 tempest-CreateVolumesFromSourceVolumeTest-29009867 None] Selected osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898 as target Quobyte volume. {{(pid=87272) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 11:10:00 devstack cinder-volume[87272]: INFO cinder.volume.drivers.remotefs [None req-8fce7fb5-6f79-4713-b083-aa21022ccc15 tempest-CreateVolumesFromSourceVolumeTest-29009867 None] casted to osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898 Nov 04 11:10:00 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-8fce7fb5-6f79-4713-b083-aa21022ccc15 tempest-CreateVolumesFromSourceVolumeTest-29009867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-87ba91b7-949b-4433-819c-c796f0ac0ab1 1073741824 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:10:00 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-044b373f-3f2e-4861-b1be-81b2d1c1a122 tempest-CreateVolumesFromSourceVolumeTest-29009867 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc2f82de-4cf3-49a2-8ba4-4b27045a4fa4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dfa48361-b513-4484-bb70-a0698e7c50ec', 'volume_size': 1}' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:10:00 devstack sudo[106717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-87ba91b7-949b-4433-819c-c796f0ac0ab1 1073741824 Nov 04 11:10:00 devstack sudo[106717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:10:00 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-044b373f-3f2e-4861-b1be-81b2d1c1a122 tempest-CreateVolumesFromSourceVolumeTest-29009867 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6828b584-df03-4c93-a9df-62eb36da4db4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:10:00 devstack cinder-volume[87272]: INFO cinder.volume.flows.manager.create_volume [None req-044b373f-3f2e-4861-b1be-81b2d1c1a122 tempest-CreateVolumesFromSourceVolumeTest-29009867 None] Volume volume-dfa48361-b513-4484-bb70-a0698e7c50ec (dfa48361-b513-4484-bb70-a0698e7c50ec): created successfully Nov 04 11:10:00 devstack sudo[106713]: pam_unix(sudo:session): session closed for user root Nov 04 11:10:00 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-044b373f-3f2e-4861-b1be-81b2d1c1a122 tempest-CreateVolumesFromSourceVolumeTest-29009867 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6828b584-df03-4c93-a9df-62eb36da4db4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:10:00 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-044b373f-3f2e-4861-b1be-81b2d1c1a122 tempest-CreateVolumesFromSourceVolumeTest-29009867 None] Flow 'volume_create_manager' (9493f26d-e535-41fb-9fb4-3231f7d99775) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87272) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 11:10:00 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-d7446a70-8ee0-4c4f-8a7a-6816ce1111df tempest-CreateVolumesFromImageTest-1429238948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-c9ce2469-e95c-478d-b06c-faadab825310" returned: 0 in 0.274s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:10:00 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-d7446a70-8ee0-4c4f-8a7a-6816ce1111df tempest-CreateVolumesFromImageTest-1429238948 None] Lock "cinder-quobyte-c9ce2469-e95c-478d-b06c-faadab825310" released by "delete_volume" :: held 0.710s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 11:10:00 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-044b373f-3f2e-4861-b1be-81b2d1c1a122 tempest-CreateVolumesFromSourceVolumeTest-29009867 None] Created volume successfully. Nov 04 11:10:00 devstack cinder-volume[87272]: DEBUG cinder.quota [None req-d7446a70-8ee0-4c4f-8a7a-6816ce1111df tempest-CreateVolumesFromImageTest-1429238948 None] Created reservations ['d0f3a5b2-20b1-4c59-87bb-8677da44568c', 'cdd302e5-61f3-42c8-b1f9-8d67048b0bd9', '0afc893f-cf84-4fbf-9ac1-4b922eaf8c56', 'd2e8b523-9876-4035-9e18-dad788120f5d'] {{(pid=87272) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 11:10:00 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-d7446a70-8ee0-4c4f-8a7a-6816ce1111df tempest-CreateVolumesFromImageTest-1429238948 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 11:10:00 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-d7446a70-8ee0-4c4f-8a7a-6816ce1111df tempest-CreateVolumesFromImageTest-1429238948 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 11:10:00 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-d7446a70-8ee0-4c4f-8a7a-6816ce1111df tempest-CreateVolumesFromImageTest-1429238948 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898': None} {{(pid=87272) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 11:10:00 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-d7446a70-8ee0-4c4f-8a7a-6816ce1111df tempest-CreateVolumesFromImageTest-1429238948 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'] {{(pid=87272) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 11:10:00 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-d7446a70-8ee0-4c4f-8a7a-6816ce1111df tempest-CreateVolumesFromImageTest-1429238948 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 11:10:00 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-d7446a70-8ee0-4c4f-8a7a-6816ce1111df tempest-CreateVolumesFromImageTest-1429238948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:10:00 devstack sudo[106719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1 Nov 04 11:10:00 devstack sudo[106719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:10:00 devstack sudo[106719]: pam_unix(sudo:session): session closed for user root Nov 04 11:10:00 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-2d598ce3-07b5-4038-8bb9-8fa2c4cea13f tempest-CreateVolumesFromImageTest-1429238948 None] Acquiring lock "cinder-e484ed5f-3e8a-4d10-9a20-8601a96f3ce3-delete_volume" by "delete_volume" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 11:10:00 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-d7446a70-8ee0-4c4f-8a7a-6816ce1111df tempest-CreateVolumesFromImageTest-1429238948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1" returned: 0 in 0.307s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:10:00 devstack cinder-volume[87272]: DEBUG cinder.manager [None req-d7446a70-8ee0-4c4f-8a7a-6816ce1111df tempest-CreateVolumesFromImageTest-1429238948 None] Notifying Schedulers of capabilities ... {{(pid=87272) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 11:10:00 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-d7446a70-8ee0-4c4f-8a7a-6816ce1111df tempest-CreateVolumesFromImageTest-1429238948 None] Deleted volume successfully. Nov 04 11:10:00 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-2d598ce3-07b5-4038-8bb9-8fa2c4cea13f tempest-CreateVolumesFromImageTest-1429238948 None] Lock "cinder-e484ed5f-3e8a-4d10-9a20-8601a96f3ce3-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 11:10:00 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-d7446a70-8ee0-4c4f-8a7a-6816ce1111df tempest-CreateVolumesFromImageTest-1429238948 None] Lock "cinder-c9ce2469-e95c-478d-b06c-faadab825310-delete_volume" released by "delete_volume" :: held 1.241s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 11:10:00 devstack sudo[106717]: pam_unix(sudo:session): session closed for user root Nov 04 11:10:00 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-8fce7fb5-6f79-4713-b083-aa21022ccc15 tempest-CreateVolumesFromSourceVolumeTest-29009867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-87ba91b7-949b-4433-819c-c796f0ac0ab1 1073741824" returned: 0 in 0.565s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:10:00 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-2d598ce3-07b5-4038-8bb9-8fa2c4cea13f tempest-CreateVolumesFromImageTest-1429238948 None] Acquiring lock "cinder-quobyte-e484ed5f-3e8a-4d10-9a20-8601a96f3ce3" by "delete_volume" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 11:10:00 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-2d598ce3-07b5-4038-8bb9-8fa2c4cea13f tempest-CreateVolumesFromImageTest-1429238948 None] Lock "cinder-quobyte-e484ed5f-3e8a-4d10-9a20-8601a96f3ce3" acquired by "delete_volume" :: waited 0.018s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 11:10:00 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-8fce7fb5-6f79-4713-b083-aa21022ccc15 tempest-CreateVolumesFromSourceVolumeTest-29009867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-87ba91b7-949b-4433-819c-c796f0ac0ab1 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:10:00 devstack cinder-volume[87272]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4fe53ca-3544-4eda-83c5-e1348c4b1bfc]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 11:10:00 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-2d598ce3-07b5-4038-8bb9-8fa2c4cea13f tempest-CreateVolumesFromImageTest-1429238948 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-e484ed5f-3e8a-4d10-9a20-8601a96f3ce3 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:10:00 devstack sudo[106728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-87ba91b7-949b-4433-819c-c796f0ac0ab1 Nov 04 11:10:00 devstack sudo[106728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:10:00 devstack sudo[106729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-e484ed5f-3e8a-4d10-9a20-8601a96f3ce3 Nov 04 11:10:00 devstack sudo[106729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:10:01 devstack sudo[106728]: pam_unix(sudo:session): session closed for user root Nov 04 11:10:01 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-8fce7fb5-6f79-4713-b083-aa21022ccc15 tempest-CreateVolumesFromSourceVolumeTest-29009867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-87ba91b7-949b-4433-819c-c796f0ac0ab1" returned: 0 in 0.239s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:10:01 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-8fce7fb5-6f79-4713-b083-aa21022ccc15 tempest-CreateVolumesFromSourceVolumeTest-29009867 None] <== create_volume: return (870ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'} {{(pid=87272) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 04 11:10:01 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-8fce7fb5-6f79-4713-b083-aa21022ccc15 tempest-CreateVolumesFromSourceVolumeTest-29009867 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.875s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 11:10:01 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-4af0e188-0c25-4c43-8a0e-09e15e97de6c tempest-VolumeAndVolumeTypeFromImageTest-181192630 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.859s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 11:10:01 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-4af0e188-0c25-4c43-8a0e-09e15e97de6c tempest-VolumeAndVolumeTypeFromImageTest-181192630 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T10:09:52Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ed48d05-b3e7-4004-9adf-2c9e87e451e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='59ad281d78de4fadbc15ce7984e0240c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T10:09:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T10:09:53Z,use_quota=True,user_id='7c679f0692594e46b24274f5ad69fee5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d4572b4a-c8e3-496f-ad9c-3306c724b03f),volume_type_id=d4572b4a-c8e3-496f-ad9c-3306c724b03f)}" {{(pid=87272) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 04 11:10:01 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.remotefs [None req-4af0e188-0c25-4c43-8a0e-09e15e97de6c tempest-VolumeAndVolumeTypeFromImageTest-181192630 None] Creating volume 9ed48d05-b3e7-4004-9adf-2c9e87e451e5 {{(pid=87272) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 11:10:01 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-4af0e188-0c25-4c43-8a0e-09e15e97de6c tempest-VolumeAndVolumeTypeFromImageTest-181192630 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 11:10:01 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-4af0e188-0c25-4c43-8a0e-09e15e97de6c tempest-VolumeAndVolumeTypeFromImageTest-181192630 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 11:10:01 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-4af0e188-0c25-4c43-8a0e-09e15e97de6c tempest-VolumeAndVolumeTypeFromImageTest-181192630 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898': None} {{(pid=87272) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 11:10:01 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-4af0e188-0c25-4c43-8a0e-09e15e97de6c tempest-VolumeAndVolumeTypeFromImageTest-181192630 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'] {{(pid=87272) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 11:10:01 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-4af0e188-0c25-4c43-8a0e-09e15e97de6c tempest-VolumeAndVolumeTypeFromImageTest-181192630 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 11:10:01 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-4af0e188-0c25-4c43-8a0e-09e15e97de6c tempest-VolumeAndVolumeTypeFromImageTest-181192630 None] Selected osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898 as target Quobyte volume. {{(pid=87272) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 11:10:01 devstack cinder-volume[87272]: INFO cinder.volume.drivers.remotefs [None req-4af0e188-0c25-4c43-8a0e-09e15e97de6c tempest-VolumeAndVolumeTypeFromImageTest-181192630 None] casted to osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898 Nov 04 11:10:01 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-4af0e188-0c25-4c43-8a0e-09e15e97de6c tempest-VolumeAndVolumeTypeFromImageTest-181192630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-9ed48d05-b3e7-4004-9adf-2c9e87e451e5 1073741824 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:10:01 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-8fce7fb5-6f79-4713-b083-aa21022ccc15 tempest-CreateVolumesFromSourceVolumeTest-29009867 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a6e9d4c-fecd-4913-bcee-cc5b9c69f75b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-87ba91b7-949b-4433-819c-c796f0ac0ab1', 'volume_size': 1}' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:10:01 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-8fce7fb5-6f79-4713-b083-aa21022ccc15 tempest-CreateVolumesFromSourceVolumeTest-29009867 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5398536d-90fe-4540-9b44-9d28a8128765) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:10:01 devstack sudo[106733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-9ed48d05-b3e7-4004-9adf-2c9e87e451e5 1073741824 Nov 04 11:10:01 devstack sudo[106733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:10:01 devstack cinder-volume[87272]: INFO cinder.volume.flows.manager.create_volume [None req-8fce7fb5-6f79-4713-b083-aa21022ccc15 tempest-CreateVolumesFromSourceVolumeTest-29009867 None] Volume volume-87ba91b7-949b-4433-819c-c796f0ac0ab1 (87ba91b7-949b-4433-819c-c796f0ac0ab1): created successfully Nov 04 11:10:01 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-8fce7fb5-6f79-4713-b083-aa21022ccc15 tempest-CreateVolumesFromSourceVolumeTest-29009867 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5398536d-90fe-4540-9b44-9d28a8128765) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:10:01 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-8fce7fb5-6f79-4713-b083-aa21022ccc15 tempest-CreateVolumesFromSourceVolumeTest-29009867 None] Flow 'volume_create_manager' (e15540d0-e2d1-4c42-ab6d-7184b8962475) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87272) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 11:10:01 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-8fce7fb5-6f79-4713-b083-aa21022ccc15 tempest-CreateVolumesFromSourceVolumeTest-29009867 None] Created volume successfully. Nov 04 11:10:01 devstack sudo[106729]: pam_unix(sudo:session): session closed for user root Nov 04 11:10:01 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-2d598ce3-07b5-4038-8bb9-8fa2c4cea13f tempest-CreateVolumesFromImageTest-1429238948 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-e484ed5f-3e8a-4d10-9a20-8601a96f3ce3" returned: 0 in 0.389s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:10:01 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-2d598ce3-07b5-4038-8bb9-8fa2c4cea13f tempest-CreateVolumesFromImageTest-1429238948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-e484ed5f-3e8a-4d10-9a20-8601a96f3ce3 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:10:01 devstack sudo[106738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-e484ed5f-3e8a-4d10-9a20-8601a96f3ce3 Nov 04 11:10:01 devstack sudo[106738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:10:01 devstack sudo[106738]: pam_unix(sudo:session): session closed for user root Nov 04 11:10:01 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-2d598ce3-07b5-4038-8bb9-8fa2c4cea13f tempest-CreateVolumesFromImageTest-1429238948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-e484ed5f-3e8a-4d10-9a20-8601a96f3ce3" returned: 0 in 0.275s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:10:01 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-2d598ce3-07b5-4038-8bb9-8fa2c4cea13f tempest-CreateVolumesFromImageTest-1429238948 None] Lock "cinder-quobyte-e484ed5f-3e8a-4d10-9a20-8601a96f3ce3" released by "delete_volume" :: held 0.716s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 11:10:01 devstack cinder-volume[87272]: DEBUG cinder.quota [None req-2d598ce3-07b5-4038-8bb9-8fa2c4cea13f tempest-CreateVolumesFromImageTest-1429238948 None] Created reservations ['d95e1d53-f581-4040-881a-e62c19452720', '38f74578-4825-4440-907c-ad33c01f8b87', '43e6b925-a403-4daa-b978-54cc2d48a9d6', '57573dc2-4763-405b-8e53-de359b49191e'] {{(pid=87272) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 11:10:01 devstack sudo[106733]: pam_unix(sudo:session): session closed for user root Nov 04 11:10:01 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-4af0e188-0c25-4c43-8a0e-09e15e97de6c tempest-VolumeAndVolumeTypeFromImageTest-181192630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-9ed48d05-b3e7-4004-9adf-2c9e87e451e5 1073741824" returned: 0 in 0.521s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:10:01 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-4af0e188-0c25-4c43-8a0e-09e15e97de6c tempest-VolumeAndVolumeTypeFromImageTest-181192630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-9ed48d05-b3e7-4004-9adf-2c9e87e451e5 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:10:01 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-2d598ce3-07b5-4038-8bb9-8fa2c4cea13f tempest-CreateVolumesFromImageTest-1429238948 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 11:10:01 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-2d598ce3-07b5-4038-8bb9-8fa2c4cea13f tempest-CreateVolumesFromImageTest-1429238948 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 11:10:01 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-2d598ce3-07b5-4038-8bb9-8fa2c4cea13f tempest-CreateVolumesFromImageTest-1429238948 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898': None} {{(pid=87272) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 11:10:01 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-2d598ce3-07b5-4038-8bb9-8fa2c4cea13f tempest-CreateVolumesFromImageTest-1429238948 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'] {{(pid=87272) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 11:10:01 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-2d598ce3-07b5-4038-8bb9-8fa2c4cea13f tempest-CreateVolumesFromImageTest-1429238948 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 11:10:01 devstack sudo[106744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-9ed48d05-b3e7-4004-9adf-2c9e87e451e5 Nov 04 11:10:01 devstack sudo[106744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:10:01 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-2d598ce3-07b5-4038-8bb9-8fa2c4cea13f tempest-CreateVolumesFromImageTest-1429238948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:10:01 devstack sudo[106746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1 Nov 04 11:10:01 devstack sudo[106746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:10:01 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-937a86a6-be85-4afc-802d-15628596c135 tempest-CreateVolumesFromSourceVolumeTest-29009867 None] Acquiring lock "cinder-87ba91b7-949b-4433-819c-c796f0ac0ab1-delete_volume" by "delete_volume" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 11:10:01 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-937a86a6-be85-4afc-802d-15628596c135 tempest-CreateVolumesFromSourceVolumeTest-29009867 None] Lock "cinder-87ba91b7-949b-4433-819c-c796f0ac0ab1-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 11:10:01 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-937a86a6-be85-4afc-802d-15628596c135 tempest-CreateVolumesFromSourceVolumeTest-29009867 None] Acquiring lock "cinder-quobyte-87ba91b7-949b-4433-819c-c796f0ac0ab1" by "delete_volume" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 11:10:01 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-937a86a6-be85-4afc-802d-15628596c135 tempest-CreateVolumesFromSourceVolumeTest-29009867 None] Lock "cinder-quobyte-87ba91b7-949b-4433-819c-c796f0ac0ab1" acquired by "delete_volume" :: waited 0.026s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 11:10:01 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-efd24bdd-03ba-47c8-ba61-c6bee957c342 tempest-CreateVolumesFromImageTest-1429238948 None] Acquiring lock "cinder-332477cf-a829-4acf-981b-cb281b84afa4-delete_volume" by "delete_volume" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 11:10:01 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-efd24bdd-03ba-47c8-ba61-c6bee957c342 tempest-CreateVolumesFromImageTest-1429238948 None] Lock "cinder-332477cf-a829-4acf-981b-cb281b84afa4-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 11:10:01 devstack cinder-volume[87272]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2a2b813-0d0a-461b-9c87-96ef5bd4461e]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 11:10:01 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-937a86a6-be85-4afc-802d-15628596c135 tempest-CreateVolumesFromSourceVolumeTest-29009867 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-87ba91b7-949b-4433-819c-c796f0ac0ab1 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:10:01 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-efd24bdd-03ba-47c8-ba61-c6bee957c342 tempest-CreateVolumesFromImageTest-1429238948 None] Acquiring lock "cinder-quobyte-332477cf-a829-4acf-981b-cb281b84afa4" by "delete_volume" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 11:10:02 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-efd24bdd-03ba-47c8-ba61-c6bee957c342 tempest-CreateVolumesFromImageTest-1429238948 None] Lock "cinder-quobyte-332477cf-a829-4acf-981b-cb281b84afa4" acquired by "delete_volume" :: waited 0.019s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 11:10:02 devstack sudo[106744]: pam_unix(sudo:session): session closed for user root Nov 04 11:10:02 devstack sudo[106746]: pam_unix(sudo:session): session closed for user root Nov 04 11:10:02 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-4af0e188-0c25-4c43-8a0e-09e15e97de6c tempest-VolumeAndVolumeTypeFromImageTest-181192630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-9ed48d05-b3e7-4004-9adf-2c9e87e451e5" returned: 0 in 0.372s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:10:02 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-2d598ce3-07b5-4038-8bb9-8fa2c4cea13f tempest-CreateVolumesFromImageTest-1429238948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1" returned: 0 in 0.343s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:10:02 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-4af0e188-0c25-4c43-8a0e-09e15e97de6c tempest-VolumeAndVolumeTypeFromImageTest-181192630 None] <== create_volume: return (947ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'} {{(pid=87272) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 04 11:10:02 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-4af0e188-0c25-4c43-8a0e-09e15e97de6c tempest-VolumeAndVolumeTypeFromImageTest-181192630 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.950s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 11:10:02 devstack cinder-volume[87272]: DEBUG cinder.manager [None req-2d598ce3-07b5-4038-8bb9-8fa2c4cea13f tempest-CreateVolumesFromImageTest-1429238948 None] Notifying Schedulers of capabilities ... {{(pid=87272) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 11:10:02 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-2d598ce3-07b5-4038-8bb9-8fa2c4cea13f tempest-CreateVolumesFromImageTest-1429238948 None] Deleted volume successfully. Nov 04 11:10:02 devstack cinder-volume[87272]: DEBUG oslo.privsep.daemon [-] privsep: reply[78f25374-411e-4895-92b4-913a4883c0c2]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 11:10:02 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-1133ff15-9bca-4e2f-8b42-f69ab6dad2ee tempest-CreateVolumesFromSnapshotTest-2009706975 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.218s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 11:10:02 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-1133ff15-9bca-4e2f-8b42-f69ab6dad2ee tempest-CreateVolumesFromSnapshotTest-2009706975 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T10:09:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-305909338',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=69925c2f-f55e-4250-a97d-bb5e9656efb6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a7cf076311674eb4ae990d0029f6b92e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T10:09:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T10:09:57Z,use_quota=True,user_id='79baf402f53c43fc86365839709ab62e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8989e4f-21e3-4f0a-9584-0d818784e883),volume_type_id=f8989e4f-21e3-4f0a-9584-0d818784e883)}" {{(pid=87272) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 04 11:10:02 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.remotefs [None req-1133ff15-9bca-4e2f-8b42-f69ab6dad2ee tempest-CreateVolumesFromSnapshotTest-2009706975 None] Creating volume 69925c2f-f55e-4250-a97d-bb5e9656efb6 {{(pid=87272) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 11:10:02 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-1133ff15-9bca-4e2f-8b42-f69ab6dad2ee tempest-CreateVolumesFromSnapshotTest-2009706975 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 11:10:02 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-1133ff15-9bca-4e2f-8b42-f69ab6dad2ee tempest-CreateVolumesFromSnapshotTest-2009706975 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 11:10:02 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-1133ff15-9bca-4e2f-8b42-f69ab6dad2ee tempest-CreateVolumesFromSnapshotTest-2009706975 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898': None} {{(pid=87272) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 11:10:02 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-1133ff15-9bca-4e2f-8b42-f69ab6dad2ee tempest-CreateVolumesFromSnapshotTest-2009706975 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'] {{(pid=87272) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 11:10:02 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-1133ff15-9bca-4e2f-8b42-f69ab6dad2ee tempest-CreateVolumesFromSnapshotTest-2009706975 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 11:10:02 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-1133ff15-9bca-4e2f-8b42-f69ab6dad2ee tempest-CreateVolumesFromSnapshotTest-2009706975 None] Selected osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898 as target Quobyte volume. {{(pid=87272) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 11:10:02 devstack cinder-volume[87272]: INFO cinder.volume.drivers.remotefs [None req-1133ff15-9bca-4e2f-8b42-f69ab6dad2ee tempest-CreateVolumesFromSnapshotTest-2009706975 None] casted to osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898 Nov 04 11:10:02 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-1133ff15-9bca-4e2f-8b42-f69ab6dad2ee tempest-CreateVolumesFromSnapshotTest-2009706975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-69925c2f-f55e-4250-a97d-bb5e9656efb6 1073741824 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:10:02 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-efd24bdd-03ba-47c8-ba61-c6bee957c342 tempest-CreateVolumesFromImageTest-1429238948 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-332477cf-a829-4acf-981b-cb281b84afa4 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:10:02 devstack sudo[106751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-69925c2f-f55e-4250-a97d-bb5e9656efb6 1073741824 Nov 04 11:10:02 devstack sudo[106751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:10:02 devstack sudo[106749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-87ba91b7-949b-4433-819c-c796f0ac0ab1 Nov 04 11:10:02 devstack sudo[106749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:10:02 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-2d598ce3-07b5-4038-8bb9-8fa2c4cea13f tempest-CreateVolumesFromImageTest-1429238948 None] Lock "cinder-e484ed5f-3e8a-4d10-9a20-8601a96f3ce3-delete_volume" released by "delete_volume" :: held 1.361s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 11:10:02 devstack cinder-volume[87272]: DEBUG cinder.volume.volume_utils [None req-4af0e188-0c25-4c43-8a0e-09e15e97de6c tempest-VolumeAndVolumeTypeFromImageTest-181192630 None] Attempting download of 5a613177-e9d9-4719-b439-f26d96cda456 ((None, [{'url': 'file:///opt/stack/data/glance/images/5a613177-e9d9-4719-b439-f26d96cda456', 'metadata': {}}])) to volume 9ed48d05-b3e7-4004-9adf-2c9e87e451e5. {{(pid=87272) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Nov 04 11:10:02 devstack cinder-volume[87272]: DEBUG oslo.privsep.daemon [-] privsep: reply[f432b55b-b80c-477c-b1b4-f609db7aa9e6]: (4, 'raw') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 11:10:02 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-4af0e188-0c25-4c43-8a0e-09e15e97de6c tempest-VolumeAndVolumeTypeFromImageTest-181192630 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5a613177-e9d9-4719-b439-f26d96cda456_hk6jtxph {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:10:02 devstack sudo[106752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-332477cf-a829-4acf-981b-cb281b84afa4 Nov 04 11:10:02 devstack sudo[106752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:10:02 devstack sudo[106755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5a613177-e9d9-4719-b439-f26d96cda456_hk6jtxph Nov 04 11:10:02 devstack sudo[106755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:10:02 devstack sudo[106749]: pam_unix(sudo:session): session closed for user root Nov 04 11:10:02 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-937a86a6-be85-4afc-802d-15628596c135 tempest-CreateVolumesFromSourceVolumeTest-29009867 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-87ba91b7-949b-4433-819c-c796f0ac0ab1" returned: 0 in 0.501s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:10:02 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-937a86a6-be85-4afc-802d-15628596c135 tempest-CreateVolumesFromSourceVolumeTest-29009867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-87ba91b7-949b-4433-819c-c796f0ac0ab1 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:10:02 devstack sudo[106766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-87ba91b7-949b-4433-819c-c796f0ac0ab1 Nov 04 11:10:02 devstack sudo[106766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:10:02 devstack sudo[106752]: pam_unix(sudo:session): session closed for user root Nov 04 11:10:02 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-efd24bdd-03ba-47c8-ba61-c6bee957c342 tempest-CreateVolumesFromImageTest-1429238948 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-332477cf-a829-4acf-981b-cb281b84afa4" returned: 0 in 0.467s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:10:02 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-efd24bdd-03ba-47c8-ba61-c6bee957c342 tempest-CreateVolumesFromImageTest-1429238948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-332477cf-a829-4acf-981b-cb281b84afa4 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:10:02 devstack sudo[106771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-332477cf-a829-4acf-981b-cb281b84afa4 Nov 04 11:10:02 devstack sudo[106771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:10:02 devstack sudo[106755]: pam_unix(sudo:session): session closed for user root Nov 04 11:10:02 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-4af0e188-0c25-4c43-8a0e-09e15e97de6c tempest-VolumeAndVolumeTypeFromImageTest-181192630 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5a613177-e9d9-4719-b439-f26d96cda456_hk6jtxph" returned: 0 in 0.391s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:10:02 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-4af0e188-0c25-4c43-8a0e-09e15e97de6c tempest-VolumeAndVolumeTypeFromImageTest-181192630 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5a613177-e9d9-4719-b439-f26d96cda456_hk6jtxph {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:10:02 devstack sudo[106751]: pam_unix(sudo:session): session closed for user root Nov 04 11:10:02 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-1133ff15-9bca-4e2f-8b42-f69ab6dad2ee tempest-CreateVolumesFromSnapshotTest-2009706975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-69925c2f-f55e-4250-a97d-bb5e9656efb6 1073741824" returned: 0 in 0.570s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:10:02 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-1133ff15-9bca-4e2f-8b42-f69ab6dad2ee tempest-CreateVolumesFromSnapshotTest-2009706975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-69925c2f-f55e-4250-a97d-bb5e9656efb6 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:10:02 devstack sudo[106775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-69925c2f-f55e-4250-a97d-bb5e9656efb6 Nov 04 11:10:02 devstack sudo[106775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:10:02 devstack sudo[106774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5a613177-e9d9-4719-b439-f26d96cda456_hk6jtxph Nov 04 11:10:02 devstack sudo[106774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:10:02 devstack sudo[106766]: pam_unix(sudo:session): session closed for user root Nov 04 11:10:02 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-937a86a6-be85-4afc-802d-15628596c135 tempest-CreateVolumesFromSourceVolumeTest-29009867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-87ba91b7-949b-4433-819c-c796f0ac0ab1" returned: 0 in 0.308s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:10:02 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-937a86a6-be85-4afc-802d-15628596c135 tempest-CreateVolumesFromSourceVolumeTest-29009867 None] Lock "cinder-quobyte-87ba91b7-949b-4433-819c-c796f0ac0ab1" released by "delete_volume" :: held 0.879s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 11:10:02 devstack sudo[106771]: pam_unix(sudo:session): session closed for user root Nov 04 11:10:02 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-efd24bdd-03ba-47c8-ba61-c6bee957c342 tempest-CreateVolumesFromImageTest-1429238948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-332477cf-a829-4acf-981b-cb281b84afa4" returned: 0 in 0.287s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:10:02 devstack cinder-volume[87272]: DEBUG cinder.quota [None req-937a86a6-be85-4afc-802d-15628596c135 tempest-CreateVolumesFromSourceVolumeTest-29009867 None] Created reservations ['cb37605a-6182-44f8-82f2-745f34621f1b', 'def91914-b6dc-47ea-b07d-02c11ba1f7b4', '65930f72-ea5d-41e5-9345-ad90d4a927fa', 'e758834d-e457-4521-a972-14eaef81f9bf'] {{(pid=87272) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 11:10:02 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-efd24bdd-03ba-47c8-ba61-c6bee957c342 tempest-CreateVolumesFromImageTest-1429238948 None] Lock "cinder-quobyte-332477cf-a829-4acf-981b-cb281b84afa4" released by "delete_volume" :: held 0.833s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 11:10:02 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-937a86a6-be85-4afc-802d-15628596c135 tempest-CreateVolumesFromSourceVolumeTest-29009867 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 11:10:02 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-937a86a6-be85-4afc-802d-15628596c135 tempest-CreateVolumesFromSourceVolumeTest-29009867 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 11:10:02 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-937a86a6-be85-4afc-802d-15628596c135 tempest-CreateVolumesFromSourceVolumeTest-29009867 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898': None} {{(pid=87272) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 11:10:02 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-937a86a6-be85-4afc-802d-15628596c135 tempest-CreateVolumesFromSourceVolumeTest-29009867 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'] {{(pid=87272) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 11:10:02 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-937a86a6-be85-4afc-802d-15628596c135 tempest-CreateVolumesFromSourceVolumeTest-29009867 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 11:10:02 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-937a86a6-be85-4afc-802d-15628596c135 tempest-CreateVolumesFromSourceVolumeTest-29009867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:10:02 devstack sudo[106782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1 Nov 04 11:10:02 devstack sudo[106782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:10:02 devstack cinder-volume[87272]: DEBUG cinder.quota [None req-efd24bdd-03ba-47c8-ba61-c6bee957c342 tempest-CreateVolumesFromImageTest-1429238948 None] Created reservations ['c0b0470b-5ea4-4de3-9ef1-d037312aa3da', '802acd61-e664-4baa-8d60-013741faba98', '1b25950c-e815-4f7f-a30f-e37aa885de99', '1e91e4d6-96f5-4cd4-adc5-05a766ab4274'] {{(pid=87272) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 11:10:02 devstack sudo[106774]: pam_unix(sudo:session): session closed for user root Nov 04 11:10:03 devstack sudo[106775]: pam_unix(sudo:session): session closed for user root Nov 04 11:10:03 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-4af0e188-0c25-4c43-8a0e-09e15e97de6c tempest-VolumeAndVolumeTypeFromImageTest-181192630 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5a613177-e9d9-4719-b439-f26d96cda456_hk6jtxph" returned: 1 in 0.417s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:10:03 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-4af0e188-0c25-4c43-8a0e-09e15e97de6c tempest-VolumeAndVolumeTypeFromImageTest-181192630 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5a613177-e9d9-4719-b439-f26d96cda456_hk6jtxph' failed. Not Retrying. {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 04 11:10:03 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-1133ff15-9bca-4e2f-8b42-f69ab6dad2ee tempest-CreateVolumesFromSnapshotTest-2009706975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-69925c2f-f55e-4250-a97d-bb5e9656efb6" returned: 0 in 0.333s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:10:03 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-1133ff15-9bca-4e2f-8b42-f69ab6dad2ee tempest-CreateVolumesFromSnapshotTest-2009706975 None] <== create_volume: return (963ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'} {{(pid=87272) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 04 11:10:03 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-1133ff15-9bca-4e2f-8b42-f69ab6dad2ee tempest-CreateVolumesFromSnapshotTest-2009706975 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.966s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 11:10:03 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-776c2680-2aa3-4420-b582-d926cdaa6856 tempest-CreateVolumesFromSourceVolumeTest-29009867 None] Acquiring lock "cinder-dfa48361-b513-4484-bb70-a0698e7c50ec-delete_volume" by "delete_volume" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 11:10:03 devstack cinder-volume[87272]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf2cbdf4-4353-41c0-b41a-6be5add563f0]: (4, 'raw') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 11:10:03 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-60a46cc7-adf2-41ec-902b-baa47f9fe94c tempest-CreateVolumesFromSnapshotTest-2009706975 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.798s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 11:10:03 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-60a46cc7-adf2-41ec-902b-baa47f9fe94c tempest-CreateVolumesFromSnapshotTest-2009706975 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T10:09:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1151559369',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9bd59a55-ae43-4637-ad94-fe9be4b24b2c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a7cf076311674eb4ae990d0029f6b92e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T10:09:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T10:09:57Z,use_quota=True,user_id='79baf402f53c43fc86365839709ab62e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8989e4f-21e3-4f0a-9584-0d818784e883),volume_type_id=f8989e4f-21e3-4f0a-9584-0d818784e883)}" {{(pid=87272) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 04 11:10:03 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.remotefs [None req-60a46cc7-adf2-41ec-902b-baa47f9fe94c tempest-CreateVolumesFromSnapshotTest-2009706975 None] Creating volume 9bd59a55-ae43-4637-ad94-fe9be4b24b2c {{(pid=87272) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 11:10:03 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-60a46cc7-adf2-41ec-902b-baa47f9fe94c tempest-CreateVolumesFromSnapshotTest-2009706975 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 11:10:03 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-60a46cc7-adf2-41ec-902b-baa47f9fe94c tempest-CreateVolumesFromSnapshotTest-2009706975 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 11:10:03 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-60a46cc7-adf2-41ec-902b-baa47f9fe94c tempest-CreateVolumesFromSnapshotTest-2009706975 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898': None} {{(pid=87272) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 11:10:03 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-60a46cc7-adf2-41ec-902b-baa47f9fe94c tempest-CreateVolumesFromSnapshotTest-2009706975 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'] {{(pid=87272) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 11:10:03 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-60a46cc7-adf2-41ec-902b-baa47f9fe94c tempest-CreateVolumesFromSnapshotTest-2009706975 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 11:10:03 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-60a46cc7-adf2-41ec-902b-baa47f9fe94c tempest-CreateVolumesFromSnapshotTest-2009706975 None] Selected osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898 as target Quobyte volume. {{(pid=87272) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 11:10:03 devstack cinder-volume[87272]: INFO cinder.volume.drivers.remotefs [None req-60a46cc7-adf2-41ec-902b-baa47f9fe94c tempest-CreateVolumesFromSnapshotTest-2009706975 None] casted to osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898 Nov 04 11:10:03 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-60a46cc7-adf2-41ec-902b-baa47f9fe94c tempest-CreateVolumesFromSnapshotTest-2009706975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-9bd59a55-ae43-4637-ad94-fe9be4b24b2c 1073741824 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:10:03 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-4af0e188-0c25-4c43-8a0e-09e15e97de6c tempest-VolumeAndVolumeTypeFromImageTest-181192630 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5a613177-e9d9-4719-b439-f26d96cda456_6n75ml1idevstack@QuobyteHD {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:10:03 devstack sudo[106785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-9bd59a55-ae43-4637-ad94-fe9be4b24b2c 1073741824 Nov 04 11:10:03 devstack sudo[106785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:10:03 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-1133ff15-9bca-4e2f-8b42-f69ab6dad2ee tempest-CreateVolumesFromSnapshotTest-2009706975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (745b2358-77c7-4fd7-bab0-7d3fa13ed713) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-69925c2f-f55e-4250-a97d-bb5e9656efb6', 'volume_size': 1}' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:10:03 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-1133ff15-9bca-4e2f-8b42-f69ab6dad2ee tempest-CreateVolumesFromSnapshotTest-2009706975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f156815f-22e4-448e-ad6b-229400a8712a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:10:03 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-776c2680-2aa3-4420-b582-d926cdaa6856 tempest-CreateVolumesFromSourceVolumeTest-29009867 None] Lock "cinder-dfa48361-b513-4484-bb70-a0698e7c50ec-delete_volume" acquired by "delete_volume" :: waited 0.130s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 11:10:03 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-8a3804fa-767f-4aef-9874-0ee7ef03a1e7 tempest-CreateVolumesFromImageTest-1429238948 None] Acquiring lock "cinder-7d7fd27b-d4a8-4a74-abc6-d772655476f5-delete_volume" by "delete_volume" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 11:10:03 devstack cinder-volume[87272]: INFO cinder.volume.flows.manager.create_volume [None req-1133ff15-9bca-4e2f-8b42-f69ab6dad2ee tempest-CreateVolumesFromSnapshotTest-2009706975 None] Volume volume-69925c2f-f55e-4250-a97d-bb5e9656efb6 (69925c2f-f55e-4250-a97d-bb5e9656efb6): created successfully Nov 04 11:10:03 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-1133ff15-9bca-4e2f-8b42-f69ab6dad2ee tempest-CreateVolumesFromSnapshotTest-2009706975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f156815f-22e4-448e-ad6b-229400a8712a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:10:03 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-1133ff15-9bca-4e2f-8b42-f69ab6dad2ee tempest-CreateVolumesFromSnapshotTest-2009706975 None] Flow 'volume_create_manager' (7bfa97d6-05e7-4de4-b2bc-6cebcc0913f7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87272) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 11:10:03 devstack sudo[106786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5a613177-e9d9-4719-b439-f26d96cda456_6n75ml1idevstack@QuobyteHD Nov 04 11:10:03 devstack sudo[106786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:10:03 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-efd24bdd-03ba-47c8-ba61-c6bee957c342 tempest-CreateVolumesFromImageTest-1429238948 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 11:10:03 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-efd24bdd-03ba-47c8-ba61-c6bee957c342 tempest-CreateVolumesFromImageTest-1429238948 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 11:10:03 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-efd24bdd-03ba-47c8-ba61-c6bee957c342 tempest-CreateVolumesFromImageTest-1429238948 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898': None} {{(pid=87272) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 11:10:03 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-efd24bdd-03ba-47c8-ba61-c6bee957c342 tempest-CreateVolumesFromImageTest-1429238948 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'] {{(pid=87272) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 11:10:03 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-efd24bdd-03ba-47c8-ba61-c6bee957c342 tempest-CreateVolumesFromImageTest-1429238948 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 11:10:03 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-efd24bdd-03ba-47c8-ba61-c6bee957c342 tempest-CreateVolumesFromImageTest-1429238948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:10:03 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-8a3804fa-767f-4aef-9874-0ee7ef03a1e7 tempest-CreateVolumesFromImageTest-1429238948 None] Lock "cinder-7d7fd27b-d4a8-4a74-abc6-d772655476f5-delete_volume" acquired by "delete_volume" :: waited 0.113s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 11:10:03 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-1133ff15-9bca-4e2f-8b42-f69ab6dad2ee tempest-CreateVolumesFromSnapshotTest-2009706975 None] Created volume successfully. Nov 04 11:10:03 devstack sudo[106782]: pam_unix(sudo:session): session closed for user root Nov 04 11:10:03 devstack sudo[106790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1 Nov 04 11:10:03 devstack sudo[106790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:10:03 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-937a86a6-be85-4afc-802d-15628596c135 tempest-CreateVolumesFromSourceVolumeTest-29009867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1" returned: 0 in 0.383s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:10:03 devstack cinder-volume[87272]: DEBUG cinder.manager [None req-937a86a6-be85-4afc-802d-15628596c135 tempest-CreateVolumesFromSourceVolumeTest-29009867 None] Notifying Schedulers of capabilities ... {{(pid=87272) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 11:10:03 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-937a86a6-be85-4afc-802d-15628596c135 tempest-CreateVolumesFromSourceVolumeTest-29009867 None] Deleted volume successfully. Nov 04 11:10:03 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-776c2680-2aa3-4420-b582-d926cdaa6856 tempest-CreateVolumesFromSourceVolumeTest-29009867 None] Acquiring lock "cinder-quobyte-dfa48361-b513-4484-bb70-a0698e7c50ec" by "delete_volume" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 11:10:03 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-8a3804fa-767f-4aef-9874-0ee7ef03a1e7 tempest-CreateVolumesFromImageTest-1429238948 None] Acquiring lock "cinder-quobyte-7d7fd27b-d4a8-4a74-abc6-d772655476f5" by "delete_volume" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 11:10:03 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-776c2680-2aa3-4420-b582-d926cdaa6856 tempest-CreateVolumesFromSourceVolumeTest-29009867 None] Lock "cinder-quobyte-dfa48361-b513-4484-bb70-a0698e7c50ec" acquired by "delete_volume" :: waited 0.035s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 11:10:03 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-937a86a6-be85-4afc-802d-15628596c135 tempest-CreateVolumesFromSourceVolumeTest-29009867 None] Lock "cinder-87ba91b7-949b-4433-819c-c796f0ac0ab1-delete_volume" released by "delete_volume" :: held 1.685s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 11:10:03 devstack cinder-volume[87272]: DEBUG oslo.privsep.daemon [-] privsep: reply[23478c79-f5c9-47cb-a5d9-599065c007a9]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 11:10:03 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-8a3804fa-767f-4aef-9874-0ee7ef03a1e7 tempest-CreateVolumesFromImageTest-1429238948 None] Lock "cinder-quobyte-7d7fd27b-d4a8-4a74-abc6-d772655476f5" acquired by "delete_volume" :: waited 0.051s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 11:10:03 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-776c2680-2aa3-4420-b582-d926cdaa6856 tempest-CreateVolumesFromSourceVolumeTest-29009867 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-dfa48361-b513-4484-bb70-a0698e7c50ec {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:10:03 devstack sudo[106786]: pam_unix(sudo:session): session closed for user root Nov 04 11:10:03 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-4af0e188-0c25-4c43-8a0e-09e15e97de6c tempest-VolumeAndVolumeTypeFromImageTest-181192630 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5a613177-e9d9-4719-b439-f26d96cda456_6n75ml1idevstack@QuobyteHD" returned: 0 in 0.470s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:10:03 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-4af0e188-0c25-4c43-8a0e-09e15e97de6c tempest-VolumeAndVolumeTypeFromImageTest-181192630 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5a613177-e9d9-4719-b439-f26d96cda456_6n75ml1idevstack@QuobyteHD {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:10:03 devstack cinder-volume[87272]: DEBUG oslo.privsep.daemon [-] privsep: reply[9453892b-4092-4c34-b8dd-428a06f15a1a]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 11:10:03 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-8a3804fa-767f-4aef-9874-0ee7ef03a1e7 tempest-CreateVolumesFromImageTest-1429238948 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-7d7fd27b-d4a8-4a74-abc6-d772655476f5 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:10:03 devstack sudo[106790]: pam_unix(sudo:session): session closed for user root Nov 04 11:10:03 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-efd24bdd-03ba-47c8-ba61-c6bee957c342 tempest-CreateVolumesFromImageTest-1429238948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1" returned: 0 in 0.354s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:10:03 devstack cinder-volume[87272]: DEBUG cinder.manager [None req-efd24bdd-03ba-47c8-ba61-c6bee957c342 tempest-CreateVolumesFromImageTest-1429238948 None] Notifying Schedulers of capabilities ... {{(pid=87272) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 11:10:03 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-efd24bdd-03ba-47c8-ba61-c6bee957c342 tempest-CreateVolumesFromImageTest-1429238948 None] Deleted volume successfully. Nov 04 11:10:03 devstack sudo[106797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-dfa48361-b513-4484-bb70-a0698e7c50ec Nov 04 11:10:03 devstack sudo[106797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:10:03 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-efd24bdd-03ba-47c8-ba61-c6bee957c342 tempest-CreateVolumesFromImageTest-1429238948 None] Lock "cinder-332477cf-a829-4acf-981b-cb281b84afa4-delete_volume" released by "delete_volume" :: held 1.730s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 11:10:03 devstack sudo[106799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-7d7fd27b-d4a8-4a74-abc6-d772655476f5 Nov 04 11:10:03 devstack sudo[106799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:10:03 devstack sudo[106798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5a613177-e9d9-4719-b439-f26d96cda456_6n75ml1idevstack@QuobyteHD Nov 04 11:10:03 devstack sudo[106798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:10:03 devstack sudo[106785]: pam_unix(sudo:session): session closed for user root Nov 04 11:10:03 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-60a46cc7-adf2-41ec-902b-baa47f9fe94c tempest-CreateVolumesFromSnapshotTest-2009706975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-9bd59a55-ae43-4637-ad94-fe9be4b24b2c 1073741824" returned: 0 in 0.769s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:10:03 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-60a46cc7-adf2-41ec-902b-baa47f9fe94c tempest-CreateVolumesFromSnapshotTest-2009706975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-9bd59a55-ae43-4637-ad94-fe9be4b24b2c {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:10:03 devstack sudo[106805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-9bd59a55-ae43-4637-ad94-fe9be4b24b2c Nov 04 11:10:03 devstack sudo[106805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:10:03 devstack sudo[106797]: pam_unix(sudo:session): session closed for user root Nov 04 11:10:03 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-776c2680-2aa3-4420-b582-d926cdaa6856 tempest-CreateVolumesFromSourceVolumeTest-29009867 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-dfa48361-b513-4484-bb70-a0698e7c50ec" returned: 0 in 0.456s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:10:03 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-776c2680-2aa3-4420-b582-d926cdaa6856 tempest-CreateVolumesFromSourceVolumeTest-29009867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-dfa48361-b513-4484-bb70-a0698e7c50ec {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:10:03 devstack sudo[106798]: pam_unix(sudo:session): session closed for user root Nov 04 11:10:03 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-4af0e188-0c25-4c43-8a0e-09e15e97de6c tempest-VolumeAndVolumeTypeFromImageTest-181192630 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5a613177-e9d9-4719-b439-f26d96cda456_6n75ml1idevstack@QuobyteHD" returned: 1 in 0.458s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:10:03 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-4af0e188-0c25-4c43-8a0e-09e15e97de6c tempest-VolumeAndVolumeTypeFromImageTest-181192630 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5a613177-e9d9-4719-b439-f26d96cda456_6n75ml1idevstack@QuobyteHD' failed. Not Retrying. {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 04 11:10:03 devstack cinder-volume[87272]: DEBUG cinder.image.image_utils [None req-4af0e188-0c25-4c43-8a0e-09e15e97de6c tempest-VolumeAndVolumeTypeFromImageTest-181192630 None] 5a613177-e9d9-4719-b439-f26d96cda456 was raw, converting to qcow2 {{(pid=87272) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Nov 04 11:10:04 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-4af0e188-0c25-4c43-8a0e-09e15e97de6c tempest-VolumeAndVolumeTypeFromImageTest-181192630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_5a613177-e9d9-4719-b439-f26d96cda456_6n75ml1idevstack@QuobyteHD /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-9ed48d05-b3e7-4004-9adf-2c9e87e451e5 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:10:04 devstack sudo[106817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-dfa48361-b513-4484-bb70-a0698e7c50ec Nov 04 11:10:04 devstack sudo[106817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:10:04 devstack sudo[106799]: pam_unix(sudo:session): session closed for user root Nov 04 11:10:04 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-8a3804fa-767f-4aef-9874-0ee7ef03a1e7 tempest-CreateVolumesFromImageTest-1429238948 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-7d7fd27b-d4a8-4a74-abc6-d772655476f5" returned: 0 in 0.474s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:10:04 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-8a3804fa-767f-4aef-9874-0ee7ef03a1e7 tempest-CreateVolumesFromImageTest-1429238948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-7d7fd27b-d4a8-4a74-abc6-d772655476f5 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:10:04 devstack sudo[106819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_5a613177-e9d9-4719-b439-f26d96cda456_6n75ml1idevstack@QuobyteHD /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-9ed48d05-b3e7-4004-9adf-2c9e87e451e5 Nov 04 11:10:04 devstack sudo[106819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:10:04 devstack sudo[106821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-7d7fd27b-d4a8-4a74-abc6-d772655476f5 Nov 04 11:10:04 devstack sudo[106821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:10:04 devstack sudo[106805]: pam_unix(sudo:session): session closed for user root Nov 04 11:10:04 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-60a46cc7-adf2-41ec-902b-baa47f9fe94c tempest-CreateVolumesFromSnapshotTest-2009706975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-9bd59a55-ae43-4637-ad94-fe9be4b24b2c" returned: 0 in 0.298s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:10:04 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-60a46cc7-adf2-41ec-902b-baa47f9fe94c tempest-CreateVolumesFromSnapshotTest-2009706975 None] <== create_volume: return (1114ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'} {{(pid=87272) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 04 11:10:04 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-60a46cc7-adf2-41ec-902b-baa47f9fe94c tempest-CreateVolumesFromSnapshotTest-2009706975 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.117s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 11:10:04 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-6d6581fc-61e3-49e0-ba53-173132966962 tempest-CreateVolumesFromSnapshotTest-2009706975 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.472s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 11:10:04 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-6d6581fc-61e3-49e0-ba53-173132966962 tempest-CreateVolumesFromSnapshotTest-2009706975 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T10:09:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1104389421',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e30b71ed-a798-48e4-972b-eebf8bb82bc2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a7cf076311674eb4ae990d0029f6b92e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T10:09:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T10:09:58Z,use_quota=True,user_id='79baf402f53c43fc86365839709ab62e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8989e4f-21e3-4f0a-9584-0d818784e883),volume_type_id=f8989e4f-21e3-4f0a-9584-0d818784e883)}" {{(pid=87272) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 04 11:10:04 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.remotefs [None req-6d6581fc-61e3-49e0-ba53-173132966962 tempest-CreateVolumesFromSnapshotTest-2009706975 None] Creating volume e30b71ed-a798-48e4-972b-eebf8bb82bc2 {{(pid=87272) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 11:10:04 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-6d6581fc-61e3-49e0-ba53-173132966962 tempest-CreateVolumesFromSnapshotTest-2009706975 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 11:10:04 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-6d6581fc-61e3-49e0-ba53-173132966962 tempest-CreateVolumesFromSnapshotTest-2009706975 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 11:10:04 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-6d6581fc-61e3-49e0-ba53-173132966962 tempest-CreateVolumesFromSnapshotTest-2009706975 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898': None} {{(pid=87272) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 11:10:04 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-6d6581fc-61e3-49e0-ba53-173132966962 tempest-CreateVolumesFromSnapshotTest-2009706975 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'] {{(pid=87272) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 11:10:04 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-6d6581fc-61e3-49e0-ba53-173132966962 tempest-CreateVolumesFromSnapshotTest-2009706975 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 11:10:04 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-6d6581fc-61e3-49e0-ba53-173132966962 tempest-CreateVolumesFromSnapshotTest-2009706975 None] Selected osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898 as target Quobyte volume. {{(pid=87272) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 11:10:04 devstack cinder-volume[87272]: INFO cinder.volume.drivers.remotefs [None req-6d6581fc-61e3-49e0-ba53-173132966962 tempest-CreateVolumesFromSnapshotTest-2009706975 None] casted to osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898 Nov 04 11:10:04 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-6d6581fc-61e3-49e0-ba53-173132966962 tempest-CreateVolumesFromSnapshotTest-2009706975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-e30b71ed-a798-48e4-972b-eebf8bb82bc2 1073741824 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:10:04 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-60a46cc7-adf2-41ec-902b-baa47f9fe94c tempest-CreateVolumesFromSnapshotTest-2009706975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (777f6b73-768c-4ea6-9e64-128e923b0027) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9bd59a55-ae43-4637-ad94-fe9be4b24b2c', 'volume_size': 1}' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:10:04 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-60a46cc7-adf2-41ec-902b-baa47f9fe94c tempest-CreateVolumesFromSnapshotTest-2009706975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5fd74cf-23da-4af3-8e21-0ed6d668044c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:10:04 devstack cinder-volume[87272]: INFO cinder.volume.flows.manager.create_volume [None req-60a46cc7-adf2-41ec-902b-baa47f9fe94c tempest-CreateVolumesFromSnapshotTest-2009706975 None] Volume volume-9bd59a55-ae43-4637-ad94-fe9be4b24b2c (9bd59a55-ae43-4637-ad94-fe9be4b24b2c): created successfully Nov 04 11:10:04 devstack sudo[106824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-e30b71ed-a798-48e4-972b-eebf8bb82bc2 1073741824 Nov 04 11:10:04 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-60a46cc7-adf2-41ec-902b-baa47f9fe94c tempest-CreateVolumesFromSnapshotTest-2009706975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5fd74cf-23da-4af3-8e21-0ed6d668044c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:10:04 devstack sudo[106824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:10:04 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-60a46cc7-adf2-41ec-902b-baa47f9fe94c tempest-CreateVolumesFromSnapshotTest-2009706975 None] Flow 'volume_create_manager' (3b6a7bc4-52ee-469a-ade8-59872897f2a3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87272) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 11:10:04 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-60a46cc7-adf2-41ec-902b-baa47f9fe94c tempest-CreateVolumesFromSnapshotTest-2009706975 None] Created volume successfully. Nov 04 11:10:04 devstack sudo[106817]: pam_unix(sudo:session): session closed for user root Nov 04 11:10:04 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-776c2680-2aa3-4420-b582-d926cdaa6856 tempest-CreateVolumesFromSourceVolumeTest-29009867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-dfa48361-b513-4484-bb70-a0698e7c50ec" returned: 0 in 0.342s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:10:04 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-776c2680-2aa3-4420-b582-d926cdaa6856 tempest-CreateVolumesFromSourceVolumeTest-29009867 None] Lock "cinder-quobyte-dfa48361-b513-4484-bb70-a0698e7c50ec" released by "delete_volume" :: held 0.878s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 11:10:04 devstack sudo[106821]: pam_unix(sudo:session): session closed for user root Nov 04 11:10:04 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-8a3804fa-767f-4aef-9874-0ee7ef03a1e7 tempest-CreateVolumesFromImageTest-1429238948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-7d7fd27b-d4a8-4a74-abc6-d772655476f5" returned: 0 in 0.323s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:10:04 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-8a3804fa-767f-4aef-9874-0ee7ef03a1e7 tempest-CreateVolumesFromImageTest-1429238948 None] Lock "cinder-quobyte-7d7fd27b-d4a8-4a74-abc6-d772655476f5" released by "delete_volume" :: held 0.862s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 11:10:04 devstack cinder-volume[87272]: DEBUG cinder.quota [None req-776c2680-2aa3-4420-b582-d926cdaa6856 tempest-CreateVolumesFromSourceVolumeTest-29009867 None] Created reservations ['310d0bd3-c0ea-4161-bdf0-1d32e494a27f', 'd108b925-5dec-42e9-ac2e-f2d799413e61', '4a75ed3b-3d3f-4898-b326-d5dda51eb4f6', 'a2883549-d9c0-4c9a-a19c-3cc9d03f920c'] {{(pid=87272) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 11:10:04 devstack cinder-volume[87272]: DEBUG cinder.quota [None req-8a3804fa-767f-4aef-9874-0ee7ef03a1e7 tempest-CreateVolumesFromImageTest-1429238948 None] Created reservations ['0789c2bd-436d-4855-aeb6-c51a96f7766e', 'a48ff7cc-8d1c-4114-9af1-cc6727549ad5', 'baf3063d-8e18-4233-960e-23837c4d6d5f', '0499dbf4-9952-4bb1-888b-74391977afbb'] {{(pid=87272) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 11:10:04 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-776c2680-2aa3-4420-b582-d926cdaa6856 tempest-CreateVolumesFromSourceVolumeTest-29009867 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 11:10:04 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-776c2680-2aa3-4420-b582-d926cdaa6856 tempest-CreateVolumesFromSourceVolumeTest-29009867 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 11:10:04 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-776c2680-2aa3-4420-b582-d926cdaa6856 tempest-CreateVolumesFromSourceVolumeTest-29009867 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898': None} {{(pid=87272) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 11:10:04 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-776c2680-2aa3-4420-b582-d926cdaa6856 tempest-CreateVolumesFromSourceVolumeTest-29009867 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'] {{(pid=87272) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 11:10:04 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-776c2680-2aa3-4420-b582-d926cdaa6856 tempest-CreateVolumesFromSourceVolumeTest-29009867 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 11:10:04 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-776c2680-2aa3-4420-b582-d926cdaa6856 tempest-CreateVolumesFromSourceVolumeTest-29009867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:10:04 devstack sudo[106835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1 Nov 04 11:10:04 devstack sudo[106835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:10:04 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-8a3804fa-767f-4aef-9874-0ee7ef03a1e7 tempest-CreateVolumesFromImageTest-1429238948 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 11:10:04 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-8a3804fa-767f-4aef-9874-0ee7ef03a1e7 tempest-CreateVolumesFromImageTest-1429238948 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 11:10:04 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-8a3804fa-767f-4aef-9874-0ee7ef03a1e7 tempest-CreateVolumesFromImageTest-1429238948 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898': None} {{(pid=87272) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 11:10:04 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-8a3804fa-767f-4aef-9874-0ee7ef03a1e7 tempest-CreateVolumesFromImageTest-1429238948 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'] {{(pid=87272) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 11:10:04 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-8a3804fa-767f-4aef-9874-0ee7ef03a1e7 tempest-CreateVolumesFromImageTest-1429238948 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 11:10:04 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-8a3804fa-767f-4aef-9874-0ee7ef03a1e7 tempest-CreateVolumesFromImageTest-1429238948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:10:04 devstack sudo[106819]: pam_unix(sudo:session): session closed for user root Nov 04 11:10:04 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-4af0e188-0c25-4c43-8a0e-09e15e97de6c tempest-VolumeAndVolumeTypeFromImageTest-181192630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_5a613177-e9d9-4719-b439-f26d96cda456_6n75ml1idevstack@QuobyteHD /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-9ed48d05-b3e7-4004-9adf-2c9e87e451e5" returned: 0 in 0.591s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:10:04 devstack cinder-volume[87272]: DEBUG cinder.image.image_utils [None req-4af0e188-0c25-4c43-8a0e-09e15e97de6c tempest-VolumeAndVolumeTypeFromImageTest-181192630 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_5a613177-e9d9-4719-b439-f26d96cda456_6n75ml1idevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-9ed48d05-b3e7-4004-9adf-2c9e87e451e5 {{(pid=87272) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Nov 04 11:10:04 devstack cinder-volume[87272]: INFO cinder.image.image_utils [None req-4af0e188-0c25-4c43-8a0e-09e15e97de6c tempest-VolumeAndVolumeTypeFromImageTest-181192630 None] Converted 0.00 MB image at 0.00 MB/s Nov 04 11:10:04 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-4af0e188-0c25-4c43-8a0e-09e15e97de6c tempest-VolumeAndVolumeTypeFromImageTest-181192630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-9ed48d05-b3e7-4004-9adf-2c9e87e451e5 1G {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:10:04 devstack sudo[106837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1 Nov 04 11:10:04 devstack sudo[106837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:10:04 devstack sudo[106838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-9ed48d05-b3e7-4004-9adf-2c9e87e451e5 1G Nov 04 11:10:04 devstack sudo[106838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:10:04 devstack sudo[106824]: pam_unix(sudo:session): session closed for user root Nov 04 11:10:04 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-6d6581fc-61e3-49e0-ba53-173132966962 tempest-CreateVolumesFromSnapshotTest-2009706975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-e30b71ed-a798-48e4-972b-eebf8bb82bc2 1073741824" returned: 0 in 0.589s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:10:04 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-6d6581fc-61e3-49e0-ba53-173132966962 tempest-CreateVolumesFromSnapshotTest-2009706975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-e30b71ed-a798-48e4-972b-eebf8bb82bc2 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:10:04 devstack sudo[106835]: pam_unix(sudo:session): session closed for user root Nov 04 11:10:04 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-776c2680-2aa3-4420-b582-d926cdaa6856 tempest-CreateVolumesFromSourceVolumeTest-29009867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1" returned: 0 in 0.323s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:10:04 devstack sudo[106844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-e30b71ed-a798-48e4-972b-eebf8bb82bc2 Nov 04 11:10:04 devstack sudo[106844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:10:04 devstack cinder-volume[87272]: DEBUG cinder.manager [None req-776c2680-2aa3-4420-b582-d926cdaa6856 tempest-CreateVolumesFromSourceVolumeTest-29009867 None] Notifying Schedulers of capabilities ... {{(pid=87272) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 11:10:04 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-776c2680-2aa3-4420-b582-d926cdaa6856 tempest-CreateVolumesFromSourceVolumeTest-29009867 None] Deleted volume successfully. Nov 04 11:10:04 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-776c2680-2aa3-4420-b582-d926cdaa6856 tempest-CreateVolumesFromSourceVolumeTest-29009867 None] Lock "cinder-dfa48361-b513-4484-bb70-a0698e7c50ec-delete_volume" released by "delete_volume" :: held 1.742s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 11:10:04 devstack sudo[106837]: pam_unix(sudo:session): session closed for user root Nov 04 11:10:04 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-8a3804fa-767f-4aef-9874-0ee7ef03a1e7 tempest-CreateVolumesFromImageTest-1429238948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1" returned: 0 in 0.328s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:10:04 devstack cinder-volume[87272]: DEBUG cinder.manager [None req-8a3804fa-767f-4aef-9874-0ee7ef03a1e7 tempest-CreateVolumesFromImageTest-1429238948 None] Notifying Schedulers of capabilities ... {{(pid=87272) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 11:10:04 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-8a3804fa-767f-4aef-9874-0ee7ef03a1e7 tempest-CreateVolumesFromImageTest-1429238948 None] Deleted volume successfully. Nov 04 11:10:04 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-8a3804fa-767f-4aef-9874-0ee7ef03a1e7 tempest-CreateVolumesFromImageTest-1429238948 None] Lock "cinder-7d7fd27b-d4a8-4a74-abc6-d772655476f5-delete_volume" released by "delete_volume" :: held 1.648s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 11:10:04 devstack sudo[106838]: pam_unix(sudo:session): session closed for user root Nov 04 11:10:04 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-4af0e188-0c25-4c43-8a0e-09e15e97de6c tempest-VolumeAndVolumeTypeFromImageTest-181192630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-9ed48d05-b3e7-4004-9adf-2c9e87e451e5 1G" returned: 0 in 0.392s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:10:04 devstack cinder-volume[87272]: DEBUG cinder.volume.volume_utils [None req-4af0e188-0c25-4c43-8a0e-09e15e97de6c tempest-VolumeAndVolumeTypeFromImageTest-181192630 None] Downloaded image 5a613177-e9d9-4719-b439-f26d96cda456 ((None, [{'url': 'file:///opt/stack/data/glance/images/5a613177-e9d9-4719-b439-f26d96cda456', 'metadata': {}}])) to volume 9ed48d05-b3e7-4004-9adf-2c9e87e451e5 successfully. {{(pid=87272) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Nov 04 11:10:04 devstack cinder-volume[87272]: DEBUG cinder.image.image_utils [None req-4af0e188-0c25-4c43-8a0e-09e15e97de6c tempest-VolumeAndVolumeTypeFromImageTest-181192630 None] Temporary image 5a613177-e9d9-4719-b439-f26d96cda456 for user 7c679f0692594e46b24274f5ad69fee5 is deleted. {{(pid=87272) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Nov 04 11:10:04 devstack cinder-volume[87272]: DEBUG cinder.volume.volume_utils [None req-4af0e188-0c25-4c43-8a0e-09e15e97de6c tempest-VolumeAndVolumeTypeFromImageTest-181192630 None] Marking volume 9ed48d05-b3e7-4004-9adf-2c9e87e451e5 as bootable. {{(pid=87272) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Nov 04 11:10:05 devstack cinder-volume[87272]: DEBUG cinder.volume.flows.manager.create_volume [None req-4af0e188-0c25-4c43-8a0e-09e15e97de6c tempest-VolumeAndVolumeTypeFromImageTest-181192630 None] Copying metadata from image 5a613177-e9d9-4719-b439-f26d96cda456 to 9ed48d05-b3e7-4004-9adf-2c9e87e451e5. {{(pid=87272) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 04 11:10:05 devstack cinder-volume[87272]: DEBUG cinder.volume.flows.manager.create_volume [None req-4af0e188-0c25-4c43-8a0e-09e15e97de6c tempest-VolumeAndVolumeTypeFromImageTest-181192630 None] Creating volume glance metadata for volume 9ed48d05-b3e7-4004-9adf-2c9e87e451e5 backed by image 5a613177-e9d9-4719-b439-f26d96cda456 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '5a613177-e9d9-4719-b439-f26d96cda456', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': 'e337bf427b2173615745fa4f7ac72eab', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87272) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 04 11:10:05 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-4af0e188-0c25-4c43-8a0e-09e15e97de6c tempest-VolumeAndVolumeTypeFromImageTest-181192630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (596aa7ac-6808-4681-b211-a5f950089bff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9ed48d05-b3e7-4004-9adf-2c9e87e451e5', 'volume_size': 1, 'image_id': '5a613177-e9d9-4719-b439-f26d96cda456', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5a613177-e9d9-4719-b439-f26d96cda456', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'e337bf427b2173615745fa4f7ac72eab', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '59ad281d78de4fadbc15ce7984e0240c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'f108e06aed15fc6dbb6f12d02a14f13b305480590dd44a787ee8549330815b5cc94279ac4cd196b480bd3ba5e61ab3b903bf86af5ae79ee4d96a2f4a1eb72fb1', 'id': '5a613177-e9d9-4719-b439-f26d96cda456', 'created_at': datetime.datetime(2026, 11, 4, 10, 9, 50, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 4, 10, 9, 51, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5a613177-e9d9-4719-b439-f26d96cda456/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:10:05 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-4af0e188-0c25-4c43-8a0e-09e15e97de6c tempest-VolumeAndVolumeTypeFromImageTest-181192630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e9ab7d5-867b-4e80-aae0-2cbc2ed3942e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:10:05 devstack cinder-volume[87272]: INFO cinder.volume.flows.manager.create_volume [None req-4af0e188-0c25-4c43-8a0e-09e15e97de6c tempest-VolumeAndVolumeTypeFromImageTest-181192630 None] Volume volume-9ed48d05-b3e7-4004-9adf-2c9e87e451e5 (9ed48d05-b3e7-4004-9adf-2c9e87e451e5): created successfully Nov 04 11:10:05 devstack sudo[106844]: pam_unix(sudo:session): session closed for user root Nov 04 11:10:05 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-4af0e188-0c25-4c43-8a0e-09e15e97de6c tempest-VolumeAndVolumeTypeFromImageTest-181192630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e9ab7d5-867b-4e80-aae0-2cbc2ed3942e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:10:05 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-4af0e188-0c25-4c43-8a0e-09e15e97de6c tempest-VolumeAndVolumeTypeFromImageTest-181192630 None] Flow 'volume_create_manager' (41392dc4-d8cf-4aba-8fe7-dd958eb20039) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87272) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 11:10:05 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-6d6581fc-61e3-49e0-ba53-173132966962 tempest-CreateVolumesFromSnapshotTest-2009706975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-e30b71ed-a798-48e4-972b-eebf8bb82bc2" returned: 0 in 0.300s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:10:05 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-6d6581fc-61e3-49e0-ba53-173132966962 tempest-CreateVolumesFromSnapshotTest-2009706975 None] <== create_volume: return (944ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'} {{(pid=87272) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 04 11:10:05 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-6d6581fc-61e3-49e0-ba53-173132966962 tempest-CreateVolumesFromSnapshotTest-2009706975 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.947s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 11:10:05 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-e4b82bdf-4f39-4f38-a82b-6e5dc9439e74 tempest-CreateVolumesFromSnapshotTest-2009706975 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.871s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 11:10:05 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-e4b82bdf-4f39-4f38-a82b-6e5dc9439e74 tempest-CreateVolumesFromSnapshotTest-2009706975 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T10:09:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1776861982',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=29e2cdd8-0ddd-4bf9-9c06-f49655bcd28b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a7cf076311674eb4ae990d0029f6b92e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T10:09:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T10:09:58Z,use_quota=True,user_id='79baf402f53c43fc86365839709ab62e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8989e4f-21e3-4f0a-9584-0d818784e883),volume_type_id=f8989e4f-21e3-4f0a-9584-0d818784e883)}" {{(pid=87272) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 04 11:10:05 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.remotefs [None req-e4b82bdf-4f39-4f38-a82b-6e5dc9439e74 tempest-CreateVolumesFromSnapshotTest-2009706975 None] Creating volume 29e2cdd8-0ddd-4bf9-9c06-f49655bcd28b {{(pid=87272) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 11:10:05 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-e4b82bdf-4f39-4f38-a82b-6e5dc9439e74 tempest-CreateVolumesFromSnapshotTest-2009706975 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 11:10:05 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-e4b82bdf-4f39-4f38-a82b-6e5dc9439e74 tempest-CreateVolumesFromSnapshotTest-2009706975 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 11:10:05 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-e4b82bdf-4f39-4f38-a82b-6e5dc9439e74 tempest-CreateVolumesFromSnapshotTest-2009706975 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898': None} {{(pid=87272) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 11:10:05 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-e4b82bdf-4f39-4f38-a82b-6e5dc9439e74 tempest-CreateVolumesFromSnapshotTest-2009706975 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'] {{(pid=87272) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 11:10:05 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-e4b82bdf-4f39-4f38-a82b-6e5dc9439e74 tempest-CreateVolumesFromSnapshotTest-2009706975 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 11:10:05 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-e4b82bdf-4f39-4f38-a82b-6e5dc9439e74 tempest-CreateVolumesFromSnapshotTest-2009706975 None] Selected osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898 as target Quobyte volume. {{(pid=87272) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 11:10:05 devstack cinder-volume[87272]: INFO cinder.volume.drivers.remotefs [None req-e4b82bdf-4f39-4f38-a82b-6e5dc9439e74 tempest-CreateVolumesFromSnapshotTest-2009706975 None] casted to osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898 Nov 04 11:10:05 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-e4b82bdf-4f39-4f38-a82b-6e5dc9439e74 tempest-CreateVolumesFromSnapshotTest-2009706975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-29e2cdd8-0ddd-4bf9-9c06-f49655bcd28b 1073741824 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:10:05 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-4af0e188-0c25-4c43-8a0e-09e15e97de6c tempest-VolumeAndVolumeTypeFromImageTest-181192630 None] Created volume successfully. Nov 04 11:10:05 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-6d6581fc-61e3-49e0-ba53-173132966962 tempest-CreateVolumesFromSnapshotTest-2009706975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d88fde4-d53b-4a04-9ef8-b0fceb37f558) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e30b71ed-a798-48e4-972b-eebf8bb82bc2', 'volume_size': 1}' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:10:05 devstack sudo[106851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-29e2cdd8-0ddd-4bf9-9c06-f49655bcd28b 1073741824 Nov 04 11:10:05 devstack sudo[106851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:10:05 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-6d6581fc-61e3-49e0-ba53-173132966962 tempest-CreateVolumesFromSnapshotTest-2009706975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ee9f3b7-c902-4ea0-abbd-25ae6268d25a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:10:05 devstack cinder-volume[87272]: INFO cinder.volume.flows.manager.create_volume [None req-6d6581fc-61e3-49e0-ba53-173132966962 tempest-CreateVolumesFromSnapshotTest-2009706975 None] Volume volume-e30b71ed-a798-48e4-972b-eebf8bb82bc2 (e30b71ed-a798-48e4-972b-eebf8bb82bc2): created successfully Nov 04 11:10:05 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-6d6581fc-61e3-49e0-ba53-173132966962 tempest-CreateVolumesFromSnapshotTest-2009706975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ee9f3b7-c902-4ea0-abbd-25ae6268d25a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:10:05 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-6d6581fc-61e3-49e0-ba53-173132966962 tempest-CreateVolumesFromSnapshotTest-2009706975 None] Flow 'volume_create_manager' (dc435f36-bb0c-4490-b7ea-5ad585b7d3e5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87272) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 11:10:05 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-6d6581fc-61e3-49e0-ba53-173132966962 tempest-CreateVolumesFromSnapshotTest-2009706975 None] Created volume successfully. Nov 04 11:10:05 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-1c1db92d-4b0d-4bc9-b9b5-18d70296a6f8 tempest-CreateVolumesFromSourceVolumeTest-29009867 None] Acquiring lock "cinder-945c4150-ab0c-4fbb-8b13-12c3460c66a2-delete_volume" by "delete_volume" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 11:10:05 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-1c1db92d-4b0d-4bc9-b9b5-18d70296a6f8 tempest-CreateVolumesFromSourceVolumeTest-29009867 None] Lock "cinder-945c4150-ab0c-4fbb-8b13-12c3460c66a2-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 11:10:05 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-1c1db92d-4b0d-4bc9-b9b5-18d70296a6f8 tempest-CreateVolumesFromSourceVolumeTest-29009867 None] Acquiring lock "cinder-quobyte-945c4150-ab0c-4fbb-8b13-12c3460c66a2" by "delete_volume" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 11:10:05 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-1c1db92d-4b0d-4bc9-b9b5-18d70296a6f8 tempest-CreateVolumesFromSourceVolumeTest-29009867 None] Lock "cinder-quobyte-945c4150-ab0c-4fbb-8b13-12c3460c66a2" acquired by "delete_volume" :: waited 0.026s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 11:10:05 devstack cinder-volume[87272]: DEBUG oslo.privsep.daemon [-] privsep: reply[d691cf2e-1ee4-4695-81f8-a364a23fab5c]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 11:10:05 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-1c1db92d-4b0d-4bc9-b9b5-18d70296a6f8 tempest-CreateVolumesFromSourceVolumeTest-29009867 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-945c4150-ab0c-4fbb-8b13-12c3460c66a2 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:10:05 devstack sudo[106856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-945c4150-ab0c-4fbb-8b13-12c3460c66a2 Nov 04 11:10:05 devstack sudo[106856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:10:05 devstack sudo[106851]: pam_unix(sudo:session): session closed for user root Nov 04 11:10:05 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-e4b82bdf-4f39-4f38-a82b-6e5dc9439e74 tempest-CreateVolumesFromSnapshotTest-2009706975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-29e2cdd8-0ddd-4bf9-9c06-f49655bcd28b 1073741824" returned: 0 in 0.530s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:10:05 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-e4b82bdf-4f39-4f38-a82b-6e5dc9439e74 tempest-CreateVolumesFromSnapshotTest-2009706975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-29e2cdd8-0ddd-4bf9-9c06-f49655bcd28b {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:10:05 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-42ab3f30-e80a-4252-83e1-875fd9817914 tempest-VolumeAndVolumeTypeFromImageTest-181192630 None] Acquiring lock "cinder-9ed48d05-b3e7-4004-9adf-2c9e87e451e5-delete_volume" by "delete_volume" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 11:10:05 devstack sudo[106859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-29e2cdd8-0ddd-4bf9-9c06-f49655bcd28b Nov 04 11:10:05 devstack sudo[106859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:10:05 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-42ab3f30-e80a-4252-83e1-875fd9817914 tempest-VolumeAndVolumeTypeFromImageTest-181192630 None] Lock "cinder-9ed48d05-b3e7-4004-9adf-2c9e87e451e5-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 11:10:05 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-42ab3f30-e80a-4252-83e1-875fd9817914 tempest-VolumeAndVolumeTypeFromImageTest-181192630 None] Acquiring lock "cinder-quobyte-9ed48d05-b3e7-4004-9adf-2c9e87e451e5" by "delete_volume" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 11:10:05 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-42ab3f30-e80a-4252-83e1-875fd9817914 tempest-VolumeAndVolumeTypeFromImageTest-181192630 None] Lock "cinder-quobyte-9ed48d05-b3e7-4004-9adf-2c9e87e451e5" acquired by "delete_volume" :: waited 0.022s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 11:10:05 devstack cinder-volume[87272]: DEBUG oslo.privsep.daemon [-] privsep: reply[8da43184-635f-443b-80ee-e58bb29a8dee]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 11:10:05 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-42ab3f30-e80a-4252-83e1-875fd9817914 tempest-VolumeAndVolumeTypeFromImageTest-181192630 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-9ed48d05-b3e7-4004-9adf-2c9e87e451e5 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:10:05 devstack sudo[106856]: pam_unix(sudo:session): session closed for user root Nov 04 11:10:05 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-1c1db92d-4b0d-4bc9-b9b5-18d70296a6f8 tempest-CreateVolumesFromSourceVolumeTest-29009867 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-945c4150-ab0c-4fbb-8b13-12c3460c66a2" returned: 0 in 0.472s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:10:05 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-1c1db92d-4b0d-4bc9-b9b5-18d70296a6f8 tempest-CreateVolumesFromSourceVolumeTest-29009867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-945c4150-ab0c-4fbb-8b13-12c3460c66a2 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:10:05 devstack sudo[106866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-945c4150-ab0c-4fbb-8b13-12c3460c66a2 Nov 04 11:10:05 devstack sudo[106866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:10:06 devstack sudo[106865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-9ed48d05-b3e7-4004-9adf-2c9e87e451e5 Nov 04 11:10:06 devstack sudo[106865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:10:06 devstack sudo[106859]: pam_unix(sudo:session): session closed for user root Nov 04 11:10:06 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-e4b82bdf-4f39-4f38-a82b-6e5dc9439e74 tempest-CreateVolumesFromSnapshotTest-2009706975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-29e2cdd8-0ddd-4bf9-9c06-f49655bcd28b" returned: 0 in 0.362s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:10:06 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-e4b82bdf-4f39-4f38-a82b-6e5dc9439e74 tempest-CreateVolumesFromSnapshotTest-2009706975 None] <== create_volume: return (951ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'} {{(pid=87272) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 04 11:10:06 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-e4b82bdf-4f39-4f38-a82b-6e5dc9439e74 tempest-CreateVolumesFromSnapshotTest-2009706975 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.953s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 11:10:06 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-3ea6e76e-0907-46e1-af78-8afc8e46b06b tempest-CreateVolumesFromSnapshotTest-2009706975 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.418s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 11:10:06 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-3ea6e76e-0907-46e1-af78-8afc8e46b06b tempest-CreateVolumesFromSnapshotTest-2009706975 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T10:09:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1076944953',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f8f004d-1ffd-43f5-8a44-03c824ce75d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a7cf076311674eb4ae990d0029f6b92e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T10:09:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T10:09:58Z,use_quota=True,user_id='79baf402f53c43fc86365839709ab62e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8989e4f-21e3-4f0a-9584-0d818784e883),volume_type_id=f8989e4f-21e3-4f0a-9584-0d818784e883)}" {{(pid=87272) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 04 11:10:06 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.remotefs [None req-3ea6e76e-0907-46e1-af78-8afc8e46b06b tempest-CreateVolumesFromSnapshotTest-2009706975 None] Creating volume 2f8f004d-1ffd-43f5-8a44-03c824ce75d6 {{(pid=87272) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 11:10:06 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-3ea6e76e-0907-46e1-af78-8afc8e46b06b tempest-CreateVolumesFromSnapshotTest-2009706975 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 11:10:06 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-3ea6e76e-0907-46e1-af78-8afc8e46b06b tempest-CreateVolumesFromSnapshotTest-2009706975 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 11:10:06 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-3ea6e76e-0907-46e1-af78-8afc8e46b06b tempest-CreateVolumesFromSnapshotTest-2009706975 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898': None} {{(pid=87272) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 11:10:06 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-3ea6e76e-0907-46e1-af78-8afc8e46b06b tempest-CreateVolumesFromSnapshotTest-2009706975 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'] {{(pid=87272) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 11:10:06 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-3ea6e76e-0907-46e1-af78-8afc8e46b06b tempest-CreateVolumesFromSnapshotTest-2009706975 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 11:10:06 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-3ea6e76e-0907-46e1-af78-8afc8e46b06b tempest-CreateVolumesFromSnapshotTest-2009706975 None] Selected osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898 as target Quobyte volume. {{(pid=87272) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 11:10:06 devstack cinder-volume[87272]: INFO cinder.volume.drivers.remotefs [None req-3ea6e76e-0907-46e1-af78-8afc8e46b06b tempest-CreateVolumesFromSnapshotTest-2009706975 None] casted to osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898 Nov 04 11:10:06 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-3ea6e76e-0907-46e1-af78-8afc8e46b06b tempest-CreateVolumesFromSnapshotTest-2009706975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-2f8f004d-1ffd-43f5-8a44-03c824ce75d6 1073741824 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:10:06 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-e4b82bdf-4f39-4f38-a82b-6e5dc9439e74 tempest-CreateVolumesFromSnapshotTest-2009706975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (53b78abd-05d8-475f-9e96-8f343b5a3423) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-29e2cdd8-0ddd-4bf9-9c06-f49655bcd28b', 'volume_size': 1}' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:10:06 devstack sudo[106870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-2f8f004d-1ffd-43f5-8a44-03c824ce75d6 1073741824 Nov 04 11:10:06 devstack sudo[106870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:10:06 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-e4b82bdf-4f39-4f38-a82b-6e5dc9439e74 tempest-CreateVolumesFromSnapshotTest-2009706975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d3190d70-af65-46a4-ba9b-684b0dc121d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:10:06 devstack cinder-volume[87272]: INFO cinder.volume.flows.manager.create_volume [None req-e4b82bdf-4f39-4f38-a82b-6e5dc9439e74 tempest-CreateVolumesFromSnapshotTest-2009706975 None] Volume volume-29e2cdd8-0ddd-4bf9-9c06-f49655bcd28b (29e2cdd8-0ddd-4bf9-9c06-f49655bcd28b): created successfully Nov 04 11:10:06 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-e4b82bdf-4f39-4f38-a82b-6e5dc9439e74 tempest-CreateVolumesFromSnapshotTest-2009706975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d3190d70-af65-46a4-ba9b-684b0dc121d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:10:06 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-e4b82bdf-4f39-4f38-a82b-6e5dc9439e74 tempest-CreateVolumesFromSnapshotTest-2009706975 None] Flow 'volume_create_manager' (0e22f2c5-0c7d-4474-917c-6a35f75ddfd0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87272) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 11:10:06 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-e4b82bdf-4f39-4f38-a82b-6e5dc9439e74 tempest-CreateVolumesFromSnapshotTest-2009706975 None] Created volume successfully. Nov 04 11:10:06 devstack sudo[106866]: pam_unix(sudo:session): session closed for user root Nov 04 11:10:06 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-1c1db92d-4b0d-4bc9-b9b5-18d70296a6f8 tempest-CreateVolumesFromSourceVolumeTest-29009867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-945c4150-ab0c-4fbb-8b13-12c3460c66a2" returned: 0 in 0.355s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:10:06 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-1c1db92d-4b0d-4bc9-b9b5-18d70296a6f8 tempest-CreateVolumesFromSourceVolumeTest-29009867 None] Lock "cinder-quobyte-945c4150-ab0c-4fbb-8b13-12c3460c66a2" released by "delete_volume" :: held 0.877s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 11:10:06 devstack cinder-volume[87272]: DEBUG cinder.quota [None req-1c1db92d-4b0d-4bc9-b9b5-18d70296a6f8 tempest-CreateVolumesFromSourceVolumeTest-29009867 None] Created reservations ['7bd97d91-3448-42ea-9dd8-0775f23fb5aa', '15379232-d73c-4dd5-8bc2-40f08ebaafcc', 'a01362bb-6eef-4ee1-a539-5ae02dfe6933', 'ca23cfb0-5824-4b73-976c-55fec00c193c'] {{(pid=87272) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 11:10:06 devstack sudo[106865]: pam_unix(sudo:session): session closed for user root Nov 04 11:10:06 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-42ab3f30-e80a-4252-83e1-875fd9817914 tempest-VolumeAndVolumeTypeFromImageTest-181192630 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-9ed48d05-b3e7-4004-9adf-2c9e87e451e5" returned: 0 in 0.557s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:10:06 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-42ab3f30-e80a-4252-83e1-875fd9817914 tempest-VolumeAndVolumeTypeFromImageTest-181192630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-9ed48d05-b3e7-4004-9adf-2c9e87e451e5 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:10:06 devstack sudo[106876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-9ed48d05-b3e7-4004-9adf-2c9e87e451e5 Nov 04 11:10:06 devstack sudo[106876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:10:06 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-1c1db92d-4b0d-4bc9-b9b5-18d70296a6f8 tempest-CreateVolumesFromSourceVolumeTest-29009867 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 11:10:06 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-1c1db92d-4b0d-4bc9-b9b5-18d70296a6f8 tempest-CreateVolumesFromSourceVolumeTest-29009867 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 11:10:06 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-1c1db92d-4b0d-4bc9-b9b5-18d70296a6f8 tempest-CreateVolumesFromSourceVolumeTest-29009867 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898': None} {{(pid=87272) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 11:10:06 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-1c1db92d-4b0d-4bc9-b9b5-18d70296a6f8 tempest-CreateVolumesFromSourceVolumeTest-29009867 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'] {{(pid=87272) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 11:10:06 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-1c1db92d-4b0d-4bc9-b9b5-18d70296a6f8 tempest-CreateVolumesFromSourceVolumeTest-29009867 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 11:10:06 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-1c1db92d-4b0d-4bc9-b9b5-18d70296a6f8 tempest-CreateVolumesFromSourceVolumeTest-29009867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:10:06 devstack sudo[106881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1 Nov 04 11:10:06 devstack sudo[106881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:10:06 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-8127ba8b-1d7d-4610-af24-4def38c77b10 tempest-CreateVolumesFromSourceVolumeTest-29009867 None] Acquiring lock "cinder-61e9533f-44fe-4e24-bd4e-5b00d89db96a-delete_volume" by "delete_volume" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 11:10:06 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-8127ba8b-1d7d-4610-af24-4def38c77b10 tempest-CreateVolumesFromSourceVolumeTest-29009867 None] Lock "cinder-61e9533f-44fe-4e24-bd4e-5b00d89db96a-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 11:10:06 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-8127ba8b-1d7d-4610-af24-4def38c77b10 tempest-CreateVolumesFromSourceVolumeTest-29009867 None] Acquiring lock "cinder-quobyte-61e9533f-44fe-4e24-bd4e-5b00d89db96a" by "delete_volume" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 11:10:06 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-8127ba8b-1d7d-4610-af24-4def38c77b10 tempest-CreateVolumesFromSourceVolumeTest-29009867 None] Lock "cinder-quobyte-61e9533f-44fe-4e24-bd4e-5b00d89db96a" acquired by "delete_volume" :: waited 0.026s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 11:10:06 devstack cinder-volume[87272]: DEBUG oslo.privsep.daemon [-] privsep: reply[4411ce03-283a-475b-ba04-e51dd9d69099]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 11:10:06 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-8127ba8b-1d7d-4610-af24-4def38c77b10 tempest-CreateVolumesFromSourceVolumeTest-29009867 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-61e9533f-44fe-4e24-bd4e-5b00d89db96a {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:10:06 devstack sudo[106876]: pam_unix(sudo:session): session closed for user root Nov 04 11:10:06 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-42ab3f30-e80a-4252-83e1-875fd9817914 tempest-VolumeAndVolumeTypeFromImageTest-181192630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-9ed48d05-b3e7-4004-9adf-2c9e87e451e5" returned: 0 in 0.420s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:10:06 devstack sudo[106885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-61e9533f-44fe-4e24-bd4e-5b00d89db96a Nov 04 11:10:06 devstack sudo[106885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:10:06 devstack sudo[106870]: pam_unix(sudo:session): session closed for user root Nov 04 11:10:06 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-3ea6e76e-0907-46e1-af78-8afc8e46b06b tempest-CreateVolumesFromSnapshotTest-2009706975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-2f8f004d-1ffd-43f5-8a44-03c824ce75d6 1073741824" returned: 0 in 0.792s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:10:06 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-42ab3f30-e80a-4252-83e1-875fd9817914 tempest-VolumeAndVolumeTypeFromImageTest-181192630 None] Lock "cinder-quobyte-9ed48d05-b3e7-4004-9adf-2c9e87e451e5" released by "delete_volume" :: held 1.072s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 11:10:06 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-3ea6e76e-0907-46e1-af78-8afc8e46b06b tempest-CreateVolumesFromSnapshotTest-2009706975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-2f8f004d-1ffd-43f5-8a44-03c824ce75d6 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:10:06 devstack sudo[106881]: pam_unix(sudo:session): session closed for user root Nov 04 11:10:06 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-1c1db92d-4b0d-4bc9-b9b5-18d70296a6f8 tempest-CreateVolumesFromSourceVolumeTest-29009867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1" returned: 0 in 0.474s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:10:06 devstack cinder-volume[87272]: DEBUG cinder.manager [None req-1c1db92d-4b0d-4bc9-b9b5-18d70296a6f8 tempest-CreateVolumesFromSourceVolumeTest-29009867 None] Notifying Schedulers of capabilities ... {{(pid=87272) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 11:10:06 devstack cinder-volume[87272]: DEBUG cinder.quota [None req-42ab3f30-e80a-4252-83e1-875fd9817914 tempest-VolumeAndVolumeTypeFromImageTest-181192630 None] Created reservations ['23184d0c-2e45-421e-beca-a0cd29386ef8', 'b7d1638f-592b-4877-aba3-0eb44aeffe16', '3344ba21-d9b7-4595-a478-e3fce1e825d0', 'f873f7f2-1dd6-413c-a09c-1f2fc1369c97'] {{(pid=87272) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 11:10:07 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-1c1db92d-4b0d-4bc9-b9b5-18d70296a6f8 tempest-CreateVolumesFromSourceVolumeTest-29009867 None] Deleted volume successfully. Nov 04 11:10:07 devstack sudo[106889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-2f8f004d-1ffd-43f5-8a44-03c824ce75d6 Nov 04 11:10:07 devstack sudo[106889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:10:07 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-1c1db92d-4b0d-4bc9-b9b5-18d70296a6f8 tempest-CreateVolumesFromSourceVolumeTest-29009867 None] Lock "cinder-945c4150-ab0c-4fbb-8b13-12c3460c66a2-delete_volume" released by "delete_volume" :: held 1.715s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 11:10:07 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-42ab3f30-e80a-4252-83e1-875fd9817914 tempest-VolumeAndVolumeTypeFromImageTest-181192630 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 11:10:07 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-42ab3f30-e80a-4252-83e1-875fd9817914 tempest-VolumeAndVolumeTypeFromImageTest-181192630 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 11:10:07 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-42ab3f30-e80a-4252-83e1-875fd9817914 tempest-VolumeAndVolumeTypeFromImageTest-181192630 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898': None} {{(pid=87272) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 11:10:07 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-42ab3f30-e80a-4252-83e1-875fd9817914 tempest-VolumeAndVolumeTypeFromImageTest-181192630 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'] {{(pid=87272) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 11:10:07 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-42ab3f30-e80a-4252-83e1-875fd9817914 tempest-VolumeAndVolumeTypeFromImageTest-181192630 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 11:10:07 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-42ab3f30-e80a-4252-83e1-875fd9817914 tempest-VolumeAndVolumeTypeFromImageTest-181192630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:10:07 devstack sudo[106893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1 Nov 04 11:10:07 devstack sudo[106893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:10:07 devstack sudo[106885]: pam_unix(sudo:session): session closed for user root Nov 04 11:10:07 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-8127ba8b-1d7d-4610-af24-4def38c77b10 tempest-CreateVolumesFromSourceVolumeTest-29009867 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-61e9533f-44fe-4e24-bd4e-5b00d89db96a" returned: 0 in 0.486s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:10:07 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-8127ba8b-1d7d-4610-af24-4def38c77b10 tempest-CreateVolumesFromSourceVolumeTest-29009867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-61e9533f-44fe-4e24-bd4e-5b00d89db96a {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:10:07 devstack sudo[106896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-61e9533f-44fe-4e24-bd4e-5b00d89db96a Nov 04 11:10:07 devstack sudo[106896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:10:07 devstack sudo[106889]: pam_unix(sudo:session): session closed for user root Nov 04 11:10:07 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-3ea6e76e-0907-46e1-af78-8afc8e46b06b tempest-CreateVolumesFromSnapshotTest-2009706975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-2f8f004d-1ffd-43f5-8a44-03c824ce75d6" returned: 0 in 0.391s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:10:07 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-3ea6e76e-0907-46e1-af78-8afc8e46b06b tempest-CreateVolumesFromSnapshotTest-2009706975 None] <== create_volume: return (1285ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'} {{(pid=87272) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 04 11:10:07 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-3ea6e76e-0907-46e1-af78-8afc8e46b06b tempest-CreateVolumesFromSnapshotTest-2009706975 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.291s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 11:10:07 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-3ea6e76e-0907-46e1-af78-8afc8e46b06b tempest-CreateVolumesFromSnapshotTest-2009706975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec205afd-50ae-4c3e-9c8a-ff7d21a959bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2f8f004d-1ffd-43f5-8a44-03c824ce75d6', 'volume_size': 1}' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:10:07 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-3ea6e76e-0907-46e1-af78-8afc8e46b06b tempest-CreateVolumesFromSnapshotTest-2009706975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (07c39aa4-643f-440d-af44-a985da41a0c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:10:07 devstack cinder-volume[87272]: INFO cinder.volume.flows.manager.create_volume [None req-3ea6e76e-0907-46e1-af78-8afc8e46b06b tempest-CreateVolumesFromSnapshotTest-2009706975 None] Volume volume-2f8f004d-1ffd-43f5-8a44-03c824ce75d6 (2f8f004d-1ffd-43f5-8a44-03c824ce75d6): created successfully Nov 04 11:10:07 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-3ea6e76e-0907-46e1-af78-8afc8e46b06b tempest-CreateVolumesFromSnapshotTest-2009706975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (07c39aa4-643f-440d-af44-a985da41a0c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:10:07 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-3ea6e76e-0907-46e1-af78-8afc8e46b06b tempest-CreateVolumesFromSnapshotTest-2009706975 None] Flow 'volume_create_manager' (2c8d8352-cdc8-461f-85f3-a1737f3faf1b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87272) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 11:10:07 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-3ea6e76e-0907-46e1-af78-8afc8e46b06b tempest-CreateVolumesFromSnapshotTest-2009706975 None] Created volume successfully. Nov 04 11:10:07 devstack sudo[106893]: pam_unix(sudo:session): session closed for user root Nov 04 11:10:07 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-42ab3f30-e80a-4252-83e1-875fd9817914 tempest-VolumeAndVolumeTypeFromImageTest-181192630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1" returned: 0 in 0.343s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:10:07 devstack cinder-volume[87272]: DEBUG cinder.manager [None req-42ab3f30-e80a-4252-83e1-875fd9817914 tempest-VolumeAndVolumeTypeFromImageTest-181192630 None] Notifying Schedulers of capabilities ... {{(pid=87272) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 11:10:07 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-42ab3f30-e80a-4252-83e1-875fd9817914 tempest-VolumeAndVolumeTypeFromImageTest-181192630 None] Deleted volume successfully. Nov 04 11:10:07 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-42ab3f30-e80a-4252-83e1-875fd9817914 tempest-VolumeAndVolumeTypeFromImageTest-181192630 None] Lock "cinder-9ed48d05-b3e7-4004-9adf-2c9e87e451e5-delete_volume" released by "delete_volume" :: held 1.727s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 11:10:07 devstack sudo[106896]: pam_unix(sudo:session): session closed for user root Nov 04 11:10:07 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-8127ba8b-1d7d-4610-af24-4def38c77b10 tempest-CreateVolumesFromSourceVolumeTest-29009867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-61e9533f-44fe-4e24-bd4e-5b00d89db96a" returned: 0 in 0.296s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:10:07 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-8127ba8b-1d7d-4610-af24-4def38c77b10 tempest-CreateVolumesFromSourceVolumeTest-29009867 None] Lock "cinder-quobyte-61e9533f-44fe-4e24-bd4e-5b00d89db96a" released by "delete_volume" :: held 0.829s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 11:10:07 devstack cinder-volume[87272]: DEBUG cinder.quota [None req-8127ba8b-1d7d-4610-af24-4def38c77b10 tempest-CreateVolumesFromSourceVolumeTest-29009867 None] Created reservations ['f949f2b3-d4bc-467b-90f7-879b67aa2468', '49ddd864-ff97-4a71-b40b-40a9b48c36e8', '270389e8-571d-477b-865d-1750a977bd51', '00b07885-8a3e-4d03-9541-ffdf98c766a9'] {{(pid=87272) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 11:10:07 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-8127ba8b-1d7d-4610-af24-4def38c77b10 tempest-CreateVolumesFromSourceVolumeTest-29009867 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 11:10:07 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-8127ba8b-1d7d-4610-af24-4def38c77b10 tempest-CreateVolumesFromSourceVolumeTest-29009867 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 11:10:07 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-8127ba8b-1d7d-4610-af24-4def38c77b10 tempest-CreateVolumesFromSourceVolumeTest-29009867 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898': None} {{(pid=87272) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 11:10:07 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-8127ba8b-1d7d-4610-af24-4def38c77b10 tempest-CreateVolumesFromSourceVolumeTest-29009867 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'] {{(pid=87272) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 11:10:07 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-8127ba8b-1d7d-4610-af24-4def38c77b10 tempest-CreateVolumesFromSourceVolumeTest-29009867 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 11:10:07 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-8127ba8b-1d7d-4610-af24-4def38c77b10 tempest-CreateVolumesFromSourceVolumeTest-29009867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:10:07 devstack sudo[106901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1 Nov 04 11:10:07 devstack sudo[106901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:10:07 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-20eed6bd-b77e-484a-bb5a-8727241d6b9b tempest-CreateVolumesFromSourceVolumeTest-29009867 None] Acquiring lock "cinder-a9ab4ec4-e6d5-4c2c-b54a-503afcb9f77f-delete_volume" by "delete_volume" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 11:10:07 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-20eed6bd-b77e-484a-bb5a-8727241d6b9b tempest-CreateVolumesFromSourceVolumeTest-29009867 None] Lock "cinder-a9ab4ec4-e6d5-4c2c-b54a-503afcb9f77f-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 11:10:07 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-20eed6bd-b77e-484a-bb5a-8727241d6b9b tempest-CreateVolumesFromSourceVolumeTest-29009867 None] Acquiring lock "cinder-quobyte-a9ab4ec4-e6d5-4c2c-b54a-503afcb9f77f" by "delete_volume" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 11:10:07 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-20eed6bd-b77e-484a-bb5a-8727241d6b9b tempest-CreateVolumesFromSourceVolumeTest-29009867 None] Lock "cinder-quobyte-a9ab4ec4-e6d5-4c2c-b54a-503afcb9f77f" acquired by "delete_volume" :: waited 0.015s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 11:10:07 devstack sudo[106901]: pam_unix(sudo:session): session closed for user root Nov 04 11:10:07 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-8127ba8b-1d7d-4610-af24-4def38c77b10 tempest-CreateVolumesFromSourceVolumeTest-29009867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1" returned: 0 in 0.274s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:10:07 devstack cinder-volume[87272]: DEBUG cinder.manager [None req-8127ba8b-1d7d-4610-af24-4def38c77b10 tempest-CreateVolumesFromSourceVolumeTest-29009867 None] Notifying Schedulers of capabilities ... {{(pid=87272) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 11:10:07 devstack cinder-volume[87272]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cb58d71-854b-4c45-bd10-5525a9443ce4]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 11:10:07 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-20eed6bd-b77e-484a-bb5a-8727241d6b9b tempest-CreateVolumesFromSourceVolumeTest-29009867 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-a9ab4ec4-e6d5-4c2c-b54a-503afcb9f77f {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:10:07 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-8127ba8b-1d7d-4610-af24-4def38c77b10 tempest-CreateVolumesFromSourceVolumeTest-29009867 None] Deleted volume successfully. Nov 04 11:10:07 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-8127ba8b-1d7d-4610-af24-4def38c77b10 tempest-CreateVolumesFromSourceVolumeTest-29009867 None] Lock "cinder-61e9533f-44fe-4e24-bd4e-5b00d89db96a-delete_volume" released by "delete_volume" :: held 1.361s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 11:10:08 devstack sudo[106904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-a9ab4ec4-e6d5-4c2c-b54a-503afcb9f77f Nov 04 11:10:08 devstack sudo[106904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:10:08 devstack sudo[106904]: pam_unix(sudo:session): session closed for user root Nov 04 11:10:08 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-20eed6bd-b77e-484a-bb5a-8727241d6b9b tempest-CreateVolumesFromSourceVolumeTest-29009867 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-a9ab4ec4-e6d5-4c2c-b54a-503afcb9f77f" returned: 0 in 0.441s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:10:08 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-20eed6bd-b77e-484a-bb5a-8727241d6b9b tempest-CreateVolumesFromSourceVolumeTest-29009867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-a9ab4ec4-e6d5-4c2c-b54a-503afcb9f77f {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:10:08 devstack sudo[106910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-a9ab4ec4-e6d5-4c2c-b54a-503afcb9f77f Nov 04 11:10:08 devstack sudo[106910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:10:08 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-4e49e926-e7f2-4a1b-bf01-cedfce0b5a39 tempest-CreateVolumesFromSnapshotTest-2009706975 None] Acquiring lock "cinder-2f8f004d-1ffd-43f5-8a44-03c824ce75d6-delete_volume" by "delete_volume" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 11:10:08 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-4e49e926-e7f2-4a1b-bf01-cedfce0b5a39 tempest-CreateVolumesFromSnapshotTest-2009706975 None] Lock "cinder-2f8f004d-1ffd-43f5-8a44-03c824ce75d6-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 11:10:08 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-4e49e926-e7f2-4a1b-bf01-cedfce0b5a39 tempest-CreateVolumesFromSnapshotTest-2009706975 None] Acquiring lock "cinder-quobyte-2f8f004d-1ffd-43f5-8a44-03c824ce75d6" by "delete_volume" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 11:10:08 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-4e49e926-e7f2-4a1b-bf01-cedfce0b5a39 tempest-CreateVolumesFromSnapshotTest-2009706975 None] Lock "cinder-quobyte-2f8f004d-1ffd-43f5-8a44-03c824ce75d6" acquired by "delete_volume" :: waited 0.027s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 11:10:08 devstack cinder-volume[87272]: DEBUG oslo.privsep.daemon [-] privsep: reply[71b2c6d6-a24d-46a0-8a8a-29b017c239a1]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 11:10:08 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-4e49e926-e7f2-4a1b-bf01-cedfce0b5a39 tempest-CreateVolumesFromSnapshotTest-2009706975 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-2f8f004d-1ffd-43f5-8a44-03c824ce75d6 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:10:08 devstack sudo[106910]: pam_unix(sudo:session): session closed for user root Nov 04 11:10:08 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-20eed6bd-b77e-484a-bb5a-8727241d6b9b tempest-CreateVolumesFromSourceVolumeTest-29009867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-a9ab4ec4-e6d5-4c2c-b54a-503afcb9f77f" returned: 0 in 0.310s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:10:08 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-20eed6bd-b77e-484a-bb5a-8727241d6b9b tempest-CreateVolumesFromSourceVolumeTest-29009867 None] Lock "cinder-quobyte-a9ab4ec4-e6d5-4c2c-b54a-503afcb9f77f" released by "delete_volume" :: held 0.816s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 11:10:08 devstack sudo[106912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-2f8f004d-1ffd-43f5-8a44-03c824ce75d6 Nov 04 11:10:08 devstack sudo[106912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:10:08 devstack cinder-volume[87272]: DEBUG cinder.quota [None req-20eed6bd-b77e-484a-bb5a-8727241d6b9b tempest-CreateVolumesFromSourceVolumeTest-29009867 None] Created reservations ['42574ac7-f89a-4cbc-a1ae-93ab59456718', 'b45e2ec9-a5cf-4839-a0e3-bde3b9579124', 'a5f3241a-e9d6-4914-bcfe-9e651855fff1', '3f44691f-2b14-43ba-9bb0-c4ff0d5da0cb'] {{(pid=87272) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 11:10:08 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-20eed6bd-b77e-484a-bb5a-8727241d6b9b tempest-CreateVolumesFromSourceVolumeTest-29009867 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 11:10:08 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-20eed6bd-b77e-484a-bb5a-8727241d6b9b tempest-CreateVolumesFromSourceVolumeTest-29009867 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 11:10:08 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-20eed6bd-b77e-484a-bb5a-8727241d6b9b tempest-CreateVolumesFromSourceVolumeTest-29009867 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898': None} {{(pid=87272) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 11:10:08 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-20eed6bd-b77e-484a-bb5a-8727241d6b9b tempest-CreateVolumesFromSourceVolumeTest-29009867 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'] {{(pid=87272) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 11:10:08 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-20eed6bd-b77e-484a-bb5a-8727241d6b9b tempest-CreateVolumesFromSourceVolumeTest-29009867 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 11:10:08 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-20eed6bd-b77e-484a-bb5a-8727241d6b9b tempest-CreateVolumesFromSourceVolumeTest-29009867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:10:08 devstack sudo[106915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1 Nov 04 11:10:08 devstack sudo[106915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:10:09 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-f9fa9117-f061-4397-8b0a-24f93e5e5a83 tempest-CreateVolumesFromSourceVolumeTest-29009867 None] Acquiring lock "cinder-4774cf70-877c-48fd-9665-d5cdf99ecf22-delete_volume" by "delete_volume" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 11:10:09 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-f9fa9117-f061-4397-8b0a-24f93e5e5a83 tempest-CreateVolumesFromSourceVolumeTest-29009867 None] Lock "cinder-4774cf70-877c-48fd-9665-d5cdf99ecf22-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 11:10:09 devstack sudo[106912]: pam_unix(sudo:session): session closed for user root Nov 04 11:10:09 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-4e49e926-e7f2-4a1b-bf01-cedfce0b5a39 tempest-CreateVolumesFromSnapshotTest-2009706975 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-2f8f004d-1ffd-43f5-8a44-03c824ce75d6" returned: 0 in 0.526s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:10:09 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-4e49e926-e7f2-4a1b-bf01-cedfce0b5a39 tempest-CreateVolumesFromSnapshotTest-2009706975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-2f8f004d-1ffd-43f5-8a44-03c824ce75d6 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:10:09 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-f9fa9117-f061-4397-8b0a-24f93e5e5a83 tempest-CreateVolumesFromSourceVolumeTest-29009867 None] Acquiring lock "cinder-quobyte-4774cf70-877c-48fd-9665-d5cdf99ecf22" by "delete_volume" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 11:10:09 devstack sudo[106920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-2f8f004d-1ffd-43f5-8a44-03c824ce75d6 Nov 04 11:10:09 devstack sudo[106920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:10:09 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-f9fa9117-f061-4397-8b0a-24f93e5e5a83 tempest-CreateVolumesFromSourceVolumeTest-29009867 None] Lock "cinder-quobyte-4774cf70-877c-48fd-9665-d5cdf99ecf22" acquired by "delete_volume" :: waited 0.036s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 11:10:09 devstack sudo[106915]: pam_unix(sudo:session): session closed for user root Nov 04 11:10:09 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-20eed6bd-b77e-484a-bb5a-8727241d6b9b tempest-CreateVolumesFromSourceVolumeTest-29009867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1" returned: 0 in 0.376s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:10:09 devstack cinder-volume[87272]: DEBUG cinder.manager [None req-20eed6bd-b77e-484a-bb5a-8727241d6b9b tempest-CreateVolumesFromSourceVolumeTest-29009867 None] Notifying Schedulers of capabilities ... {{(pid=87272) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 11:10:09 devstack cinder-volume[87272]: DEBUG oslo.privsep.daemon [-] privsep: reply[42e34d3d-1bd3-40e7-a853-4a8d15fd2569]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 11:10:09 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-f9fa9117-f061-4397-8b0a-24f93e5e5a83 tempest-CreateVolumesFromSourceVolumeTest-29009867 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-4774cf70-877c-48fd-9665-d5cdf99ecf22 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:10:09 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-20eed6bd-b77e-484a-bb5a-8727241d6b9b tempest-CreateVolumesFromSourceVolumeTest-29009867 None] Deleted volume successfully. Nov 04 11:10:09 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-20eed6bd-b77e-484a-bb5a-8727241d6b9b tempest-CreateVolumesFromSourceVolumeTest-29009867 None] Lock "cinder-a9ab4ec4-e6d5-4c2c-b54a-503afcb9f77f-delete_volume" released by "delete_volume" :: held 1.517s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 11:10:09 devstack sudo[106923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-4774cf70-877c-48fd-9665-d5cdf99ecf22 Nov 04 11:10:09 devstack sudo[106923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:10:09 devstack cinder-volume[87272]: DEBUG cinder.volume.flows.manager.create_volume [None req-fa2eab82-4348-4e47-b95d-a2b7d948627e tempest-VolumeDependencyTests-1837957763 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87272) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 11:10:09 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-fa2eab82-4348-4e47-b95d-a2b7d948627e tempest-VolumeDependencyTests-1837957763 None] Flow 'volume_create_manager' (945188d3-1016-400e-a38b-f955b53de1b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 11:10:09 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-fa2eab82-4348-4e47-b95d-a2b7d948627e tempest-VolumeDependencyTests-1837957763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (310ec449-925c-44e4-a651-5af26db3eacc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:10:09 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-fa2eab82-4348-4e47-b95d-a2b7d948627e tempest-VolumeDependencyTests-1837957763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (310ec449-925c-44e4-a651-5af26db3eacc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T10:10:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1935029954',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c7281d58-bcc7-4a93-a593-e684f3310577,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93baf42eb052435ca71dc9e9313fb249',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T10:10:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T10:10:09Z,use_quota=True,user_id='b6516c7a007143df897059b462e74f1f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8989e4f-21e3-4f0a-9584-0d818784e883),volume_type_id=f8989e4f-21e3-4f0a-9584-0d818784e883)' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:10:09 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-fa2eab82-4348-4e47-b95d-a2b7d948627e tempest-VolumeDependencyTests-1837957763 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (652bccee-03ef-47e4-ad5a-b94e83d146d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:10:09 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-fa2eab82-4348-4e47-b95d-a2b7d948627e tempest-VolumeDependencyTests-1837957763 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (652bccee-03ef-47e4-ad5a-b94e83d146d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:10:09 devstack sudo[106920]: pam_unix(sudo:session): session closed for user root Nov 04 11:10:09 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-fa2eab82-4348-4e47-b95d-a2b7d948627e tempest-VolumeDependencyTests-1837957763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (892d230b-e523-465b-9eef-39df5c104797) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:10:09 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-fa2eab82-4348-4e47-b95d-a2b7d948627e tempest-VolumeDependencyTests-1837957763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (892d230b-e523-465b-9eef-39df5c104797) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c7281d58-bcc7-4a93-a593-e684f3310577', 'volume_name': 'volume-c7281d58-bcc7-4a93-a593-e684f3310577', 'volume_size': 1}' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:10:09 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-fa2eab82-4348-4e47-b95d-a2b7d948627e tempest-VolumeDependencyTests-1837957763 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1d0ccb5-e678-4461-bcb9-b4b9b35a316e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:10:09 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-fa2eab82-4348-4e47-b95d-a2b7d948627e tempest-VolumeDependencyTests-1837957763 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1d0ccb5-e678-4461-bcb9-b4b9b35a316e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:10:09 devstack sudo[106927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-c7281d58-bcc7-4a93-a593-e684f3310577 1073741824 Nov 04 11:10:09 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-fa2eab82-4348-4e47-b95d-a2b7d948627e tempest-VolumeDependencyTests-1837957763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b265dd4c-68e2-495d-8862-ea3325cacaec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:10:09 devstack cinder-volume[87272]: INFO cinder.volume.flows.manager.create_volume [None req-fa2eab82-4348-4e47-b95d-a2b7d948627e tempest-VolumeDependencyTests-1837957763 None] Volume c7281d58-bcc7-4a93-a593-e684f3310577: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c7281d58-bcc7-4a93-a593-e684f3310577', 'volume_size': 1} Nov 04 11:10:09 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-fa2eab82-4348-4e47-b95d-a2b7d948627e tempest-VolumeDependencyTests-1837957763 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 11:10:09 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-fa2eab82-4348-4e47-b95d-a2b7d948627e tempest-VolumeDependencyTests-1837957763 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 11:10:09 devstack sudo[106927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:10:09 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-fa2eab82-4348-4e47-b95d-a2b7d948627e tempest-VolumeDependencyTests-1837957763 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T10:10:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1935029954',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c7281d58-bcc7-4a93-a593-e684f3310577,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93baf42eb052435ca71dc9e9313fb249',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T10:10:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T10:10:09Z,use_quota=True,user_id='b6516c7a007143df897059b462e74f1f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8989e4f-21e3-4f0a-9584-0d818784e883),volume_type_id=f8989e4f-21e3-4f0a-9584-0d818784e883)}" {{(pid=87272) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 04 11:10:09 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.remotefs [None req-fa2eab82-4348-4e47-b95d-a2b7d948627e tempest-VolumeDependencyTests-1837957763 None] Creating volume c7281d58-bcc7-4a93-a593-e684f3310577 {{(pid=87272) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 11:10:09 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-fa2eab82-4348-4e47-b95d-a2b7d948627e tempest-VolumeDependencyTests-1837957763 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 11:10:09 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-fa2eab82-4348-4e47-b95d-a2b7d948627e tempest-VolumeDependencyTests-1837957763 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 11:10:09 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-fa2eab82-4348-4e47-b95d-a2b7d948627e tempest-VolumeDependencyTests-1837957763 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898': None} {{(pid=87272) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 11:10:09 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-fa2eab82-4348-4e47-b95d-a2b7d948627e tempest-VolumeDependencyTests-1837957763 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'] {{(pid=87272) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 11:10:09 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-fa2eab82-4348-4e47-b95d-a2b7d948627e tempest-VolumeDependencyTests-1837957763 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 11:10:09 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-fa2eab82-4348-4e47-b95d-a2b7d948627e tempest-VolumeDependencyTests-1837957763 None] Selected osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898 as target Quobyte volume. {{(pid=87272) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 11:10:09 devstack cinder-volume[87272]: INFO cinder.volume.drivers.remotefs [None req-fa2eab82-4348-4e47-b95d-a2b7d948627e tempest-VolumeDependencyTests-1837957763 None] casted to osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898 Nov 04 11:10:09 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-fa2eab82-4348-4e47-b95d-a2b7d948627e tempest-VolumeDependencyTests-1837957763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-c7281d58-bcc7-4a93-a593-e684f3310577 1073741824 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:10:09 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-4e49e926-e7f2-4a1b-bf01-cedfce0b5a39 tempest-CreateVolumesFromSnapshotTest-2009706975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-2f8f004d-1ffd-43f5-8a44-03c824ce75d6" returned: 0 in 0.480s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:10:09 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-4e49e926-e7f2-4a1b-bf01-cedfce0b5a39 tempest-CreateVolumesFromSnapshotTest-2009706975 None] Lock "cinder-quobyte-2f8f004d-1ffd-43f5-8a44-03c824ce75d6" released by "delete_volume" :: held 1.078s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 11:10:09 devstack cinder-volume[87272]: DEBUG cinder.quota [None req-4e49e926-e7f2-4a1b-bf01-cedfce0b5a39 tempest-CreateVolumesFromSnapshotTest-2009706975 None] Created reservations ['66031649-aea7-4d1f-9e97-1d5774572f5e', 'f286912e-168a-472f-8415-9cfa3d5a954e', '10915a3b-02bb-422e-b537-5485a6b0e9b3', '3a7fa194-5125-4217-a91a-7ad23a1d3457'] {{(pid=87272) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 11:10:09 devstack sudo[106923]: pam_unix(sudo:session): session closed for user root Nov 04 11:10:09 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-f9fa9117-f061-4397-8b0a-24f93e5e5a83 tempest-CreateVolumesFromSourceVolumeTest-29009867 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-4774cf70-877c-48fd-9665-d5cdf99ecf22" returned: 0 in 0.544s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:10:09 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-f9fa9117-f061-4397-8b0a-24f93e5e5a83 tempest-CreateVolumesFromSourceVolumeTest-29009867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-4774cf70-877c-48fd-9665-d5cdf99ecf22 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:10:09 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-4e49e926-e7f2-4a1b-bf01-cedfce0b5a39 tempest-CreateVolumesFromSnapshotTest-2009706975 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 11:10:09 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-4e49e926-e7f2-4a1b-bf01-cedfce0b5a39 tempest-CreateVolumesFromSnapshotTest-2009706975 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 11:10:09 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-4e49e926-e7f2-4a1b-bf01-cedfce0b5a39 tempest-CreateVolumesFromSnapshotTest-2009706975 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898': None} {{(pid=87272) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 11:10:09 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-4e49e926-e7f2-4a1b-bf01-cedfce0b5a39 tempest-CreateVolumesFromSnapshotTest-2009706975 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'] {{(pid=87272) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 11:10:09 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-4e49e926-e7f2-4a1b-bf01-cedfce0b5a39 tempest-CreateVolumesFromSnapshotTest-2009706975 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 11:10:09 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-4e49e926-e7f2-4a1b-bf01-cedfce0b5a39 tempest-CreateVolumesFromSnapshotTest-2009706975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:10:09 devstack sudo[106933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-4774cf70-877c-48fd-9665-d5cdf99ecf22 Nov 04 11:10:09 devstack sudo[106933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:10:09 devstack sudo[106934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1 Nov 04 11:10:09 devstack sudo[106934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:10:10 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-f9fa9117-f061-4397-8b0a-24f93e5e5a83 tempest-CreateVolumesFromSourceVolumeTest-29009867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-4774cf70-877c-48fd-9665-d5cdf99ecf22" returned: 0 in 0.380s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:10:10 devstack sudo[106933]: pam_unix(sudo:session): session closed for user root Nov 04 11:10:10 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-f9fa9117-f061-4397-8b0a-24f93e5e5a83 tempest-CreateVolumesFromSourceVolumeTest-29009867 None] Lock "cinder-quobyte-4774cf70-877c-48fd-9665-d5cdf99ecf22" released by "delete_volume" :: held 1.035s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 11:10:10 devstack sudo[106934]: pam_unix(sudo:session): session closed for user root Nov 04 11:10:10 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-4e49e926-e7f2-4a1b-bf01-cedfce0b5a39 tempest-CreateVolumesFromSnapshotTest-2009706975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1" returned: 0 in 0.412s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:10:10 devstack cinder-volume[87272]: DEBUG cinder.manager [None req-4e49e926-e7f2-4a1b-bf01-cedfce0b5a39 tempest-CreateVolumesFromSnapshotTest-2009706975 None] Notifying Schedulers of capabilities ... {{(pid=87272) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 11:10:10 devstack sudo[106927]: pam_unix(sudo:session): session closed for user root Nov 04 11:10:10 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-4e49e926-e7f2-4a1b-bf01-cedfce0b5a39 tempest-CreateVolumesFromSnapshotTest-2009706975 None] Deleted volume successfully. Nov 04 11:10:10 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-fa2eab82-4348-4e47-b95d-a2b7d948627e tempest-VolumeDependencyTests-1837957763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-c7281d58-bcc7-4a93-a593-e684f3310577 1073741824" returned: 0 in 0.708s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:10:10 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-4e49e926-e7f2-4a1b-bf01-cedfce0b5a39 tempest-CreateVolumesFromSnapshotTest-2009706975 None] Lock "cinder-2f8f004d-1ffd-43f5-8a44-03c824ce75d6-delete_volume" released by "delete_volume" :: held 1.868s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 11:10:10 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-fa2eab82-4348-4e47-b95d-a2b7d948627e tempest-VolumeDependencyTests-1837957763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-c7281d58-bcc7-4a93-a593-e684f3310577 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:10:10 devstack cinder-volume[87272]: DEBUG cinder.quota [None req-f9fa9117-f061-4397-8b0a-24f93e5e5a83 tempest-CreateVolumesFromSourceVolumeTest-29009867 None] Created reservations ['57b92a1e-5f77-4183-9668-c70d5303ca94', 'e9507173-c4d1-4f4f-ba6c-003661539e2a', '1a11ae0a-0123-4841-9001-f7bd7a0e4899', '8292fafe-4e0d-4ad2-9ebe-f8409ce9dfa3'] {{(pid=87272) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 11:10:10 devstack sudo[106943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-c7281d58-bcc7-4a93-a593-e684f3310577 Nov 04 11:10:10 devstack sudo[106943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:10:10 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-f9fa9117-f061-4397-8b0a-24f93e5e5a83 tempest-CreateVolumesFromSourceVolumeTest-29009867 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 11:10:10 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-f9fa9117-f061-4397-8b0a-24f93e5e5a83 tempest-CreateVolumesFromSourceVolumeTest-29009867 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 11:10:10 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-f9fa9117-f061-4397-8b0a-24f93e5e5a83 tempest-CreateVolumesFromSourceVolumeTest-29009867 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898': None} {{(pid=87272) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 11:10:10 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-f9fa9117-f061-4397-8b0a-24f93e5e5a83 tempest-CreateVolumesFromSourceVolumeTest-29009867 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'] {{(pid=87272) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 11:10:10 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-f9fa9117-f061-4397-8b0a-24f93e5e5a83 tempest-CreateVolumesFromSourceVolumeTest-29009867 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 11:10:10 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-f9fa9117-f061-4397-8b0a-24f93e5e5a83 tempest-CreateVolumesFromSourceVolumeTest-29009867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:10:10 devstack sudo[106945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1 Nov 04 11:10:10 devstack sudo[106945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:10:10 devstack sudo[106943]: pam_unix(sudo:session): session closed for user root Nov 04 11:10:10 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-fa2eab82-4348-4e47-b95d-a2b7d948627e tempest-VolumeDependencyTests-1837957763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-c7281d58-bcc7-4a93-a593-e684f3310577" returned: 0 in 0.287s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:10:10 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-fa2eab82-4348-4e47-b95d-a2b7d948627e tempest-VolumeDependencyTests-1837957763 None] <== create_volume: return (1094ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'} {{(pid=87272) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 04 11:10:10 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-fa2eab82-4348-4e47-b95d-a2b7d948627e tempest-VolumeDependencyTests-1837957763 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.097s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 11:10:10 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-fa2eab82-4348-4e47-b95d-a2b7d948627e tempest-VolumeDependencyTests-1837957763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b265dd4c-68e2-495d-8862-ea3325cacaec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c7281d58-bcc7-4a93-a593-e684f3310577', 'volume_size': 1}' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:10:10 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-fa2eab82-4348-4e47-b95d-a2b7d948627e tempest-VolumeDependencyTests-1837957763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d23a974c-a952-4031-b090-a73e08998a16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:10:10 devstack cinder-volume[87272]: INFO cinder.volume.flows.manager.create_volume [None req-fa2eab82-4348-4e47-b95d-a2b7d948627e tempest-VolumeDependencyTests-1837957763 None] Volume volume-c7281d58-bcc7-4a93-a593-e684f3310577 (c7281d58-bcc7-4a93-a593-e684f3310577): created successfully Nov 04 11:10:10 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-fa2eab82-4348-4e47-b95d-a2b7d948627e tempest-VolumeDependencyTests-1837957763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d23a974c-a952-4031-b090-a73e08998a16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:10:10 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-fa2eab82-4348-4e47-b95d-a2b7d948627e tempest-VolumeDependencyTests-1837957763 None] Flow 'volume_create_manager' (945188d3-1016-400e-a38b-f955b53de1b1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87272) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 11:10:10 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-50650057-2b85-470a-bf43-60c79842a457 tempest-CreateVolumesFromSnapshotTest-2009706975 None] Acquiring lock "cinder-29e2cdd8-0ddd-4bf9-9c06-f49655bcd28b-delete_volume" by "delete_volume" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 11:10:10 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-fa2eab82-4348-4e47-b95d-a2b7d948627e tempest-VolumeDependencyTests-1837957763 None] Created volume successfully. Nov 04 11:10:10 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-50650057-2b85-470a-bf43-60c79842a457 tempest-CreateVolumesFromSnapshotTest-2009706975 None] Lock "cinder-29e2cdd8-0ddd-4bf9-9c06-f49655bcd28b-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 11:10:10 devstack sudo[106945]: pam_unix(sudo:session): session closed for user root Nov 04 11:10:10 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-f9fa9117-f061-4397-8b0a-24f93e5e5a83 tempest-CreateVolumesFromSourceVolumeTest-29009867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1" returned: 0 in 0.332s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:10:10 devstack cinder-volume[87272]: DEBUG cinder.manager [None req-f9fa9117-f061-4397-8b0a-24f93e5e5a83 tempest-CreateVolumesFromSourceVolumeTest-29009867 None] Notifying Schedulers of capabilities ... {{(pid=87272) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 11:10:10 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-f9fa9117-f061-4397-8b0a-24f93e5e5a83 tempest-CreateVolumesFromSourceVolumeTest-29009867 None] Deleted volume successfully. Nov 04 11:10:10 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-f9fa9117-f061-4397-8b0a-24f93e5e5a83 tempest-CreateVolumesFromSourceVolumeTest-29009867 None] Lock "cinder-4774cf70-877c-48fd-9665-d5cdf99ecf22-delete_volume" released by "delete_volume" :: held 1.802s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 11:10:10 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-50650057-2b85-470a-bf43-60c79842a457 tempest-CreateVolumesFromSnapshotTest-2009706975 None] Acquiring lock "cinder-quobyte-29e2cdd8-0ddd-4bf9-9c06-f49655bcd28b" by "delete_volume" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 11:10:10 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-50650057-2b85-470a-bf43-60c79842a457 tempest-CreateVolumesFromSnapshotTest-2009706975 None] Lock "cinder-quobyte-29e2cdd8-0ddd-4bf9-9c06-f49655bcd28b" acquired by "delete_volume" :: waited 0.016s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 11:10:10 devstack cinder-volume[87272]: DEBUG oslo.privsep.daemon [-] privsep: reply[754e08ca-87fe-4c02-9ef5-530e9514822c]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 11:10:10 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-50650057-2b85-470a-bf43-60c79842a457 tempest-CreateVolumesFromSnapshotTest-2009706975 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-29e2cdd8-0ddd-4bf9-9c06-f49655bcd28b {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:10:11 devstack sudo[106949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-29e2cdd8-0ddd-4bf9-9c06-f49655bcd28b Nov 04 11:10:11 devstack sudo[106949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:10:11 devstack sudo[106949]: pam_unix(sudo:session): session closed for user root Nov 04 11:10:11 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-50650057-2b85-470a-bf43-60c79842a457 tempest-CreateVolumesFromSnapshotTest-2009706975 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-29e2cdd8-0ddd-4bf9-9c06-f49655bcd28b" returned: 0 in 0.433s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:10:11 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-50650057-2b85-470a-bf43-60c79842a457 tempest-CreateVolumesFromSnapshotTest-2009706975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-29e2cdd8-0ddd-4bf9-9c06-f49655bcd28b {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:10:11 devstack sudo[106954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-29e2cdd8-0ddd-4bf9-9c06-f49655bcd28b Nov 04 11:10:11 devstack sudo[106954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:10:11 devstack sudo[106954]: pam_unix(sudo:session): session closed for user root Nov 04 11:10:11 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-50650057-2b85-470a-bf43-60c79842a457 tempest-CreateVolumesFromSnapshotTest-2009706975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-29e2cdd8-0ddd-4bf9-9c06-f49655bcd28b" returned: 0 in 0.325s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:10:11 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-50650057-2b85-470a-bf43-60c79842a457 tempest-CreateVolumesFromSnapshotTest-2009706975 None] Lock "cinder-quobyte-29e2cdd8-0ddd-4bf9-9c06-f49655bcd28b" released by "delete_volume" :: held 0.813s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 11:10:11 devstack cinder-volume[87272]: DEBUG cinder.quota [None req-50650057-2b85-470a-bf43-60c79842a457 tempest-CreateVolumesFromSnapshotTest-2009706975 None] Created reservations ['eec36085-cb94-4a6b-a085-eccd5024fc26', 'c0aab2c0-5728-4c8f-975c-7c01096f03ea', 'f7389e72-3f86-42ba-93fc-89e1e87a9c36', '0689a722-60ab-4fd8-b999-45192e05dc3a'] {{(pid=87272) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 11:10:11 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-233ccb85-98ce-4827-b4dd-e9f4a48cfa43 tempest-VolumeDependencyTests-1837957763 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 11:10:11 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-233ccb85-98ce-4827-b4dd-e9f4a48cfa43 tempest-VolumeDependencyTests-1837957763 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 11:10:11 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.remotefs [None req-233ccb85-98ce-4827-b4dd-e9f4a48cfa43 tempest-VolumeDependencyTests-1837957763 None] Creating offline snapshot 81a511a0-3a36-4ca1-8000-83297231be06 of volume c7281d58-bcc7-4a93-a593-e684f3310577 {{(pid=87272) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 04 11:10:11 devstack cinder-volume[87272]: DEBUG oslo.privsep.daemon [-] privsep: reply[89bf7fd6-453c-42a4-901f-cbe74abc51e9]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 11:10:11 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-233ccb85-98ce-4827-b4dd-e9f4a48cfa43 tempest-VolumeDependencyTests-1837957763 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-c7281d58-bcc7-4a93-a593-e684f3310577 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:10:12 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-50650057-2b85-470a-bf43-60c79842a457 tempest-CreateVolumesFromSnapshotTest-2009706975 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 11:10:12 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-50650057-2b85-470a-bf43-60c79842a457 tempest-CreateVolumesFromSnapshotTest-2009706975 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 11:10:12 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-50650057-2b85-470a-bf43-60c79842a457 tempest-CreateVolumesFromSnapshotTest-2009706975 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898': None} {{(pid=87272) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 11:10:12 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-50650057-2b85-470a-bf43-60c79842a457 tempest-CreateVolumesFromSnapshotTest-2009706975 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'] {{(pid=87272) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 11:10:12 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-50650057-2b85-470a-bf43-60c79842a457 tempest-CreateVolumesFromSnapshotTest-2009706975 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 11:10:12 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-50650057-2b85-470a-bf43-60c79842a457 tempest-CreateVolumesFromSnapshotTest-2009706975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:10:12 devstack sudo[106958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1 Nov 04 11:10:12 devstack sudo[106958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:10:12 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-45b0f3cd-7827-42af-ae8a-3e69604de354 tempest-CreateVolumesFromSnapshotTest-2009706975 None] Acquiring lock "cinder-e30b71ed-a798-48e4-972b-eebf8bb82bc2-delete_volume" by "delete_volume" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 11:10:12 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-45b0f3cd-7827-42af-ae8a-3e69604de354 tempest-CreateVolumesFromSnapshotTest-2009706975 None] Lock "cinder-e30b71ed-a798-48e4-972b-eebf8bb82bc2-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 11:10:12 devstack sudo[106957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-c7281d58-bcc7-4a93-a593-e684f3310577 Nov 04 11:10:12 devstack sudo[106957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:10:12 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-45b0f3cd-7827-42af-ae8a-3e69604de354 tempest-CreateVolumesFromSnapshotTest-2009706975 None] Acquiring lock "cinder-quobyte-e30b71ed-a798-48e4-972b-eebf8bb82bc2" by "delete_volume" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 11:10:12 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-45b0f3cd-7827-42af-ae8a-3e69604de354 tempest-CreateVolumesFromSnapshotTest-2009706975 None] Lock "cinder-quobyte-e30b71ed-a798-48e4-972b-eebf8bb82bc2" acquired by "delete_volume" :: waited 0.030s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 11:10:12 devstack cinder-volume[87272]: DEBUG oslo.privsep.daemon [-] privsep: reply[aafc1676-4b33-46db-9125-ca91482f3824]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 11:10:12 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-45b0f3cd-7827-42af-ae8a-3e69604de354 tempest-CreateVolumesFromSnapshotTest-2009706975 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-e30b71ed-a798-48e4-972b-eebf8bb82bc2 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:10:12 devstack sudo[106958]: pam_unix(sudo:session): session closed for user root Nov 04 11:10:12 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-50650057-2b85-470a-bf43-60c79842a457 tempest-CreateVolumesFromSnapshotTest-2009706975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1" returned: 0 in 0.390s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:10:12 devstack cinder-volume[87272]: DEBUG cinder.manager [None req-50650057-2b85-470a-bf43-60c79842a457 tempest-CreateVolumesFromSnapshotTest-2009706975 None] Notifying Schedulers of capabilities ... {{(pid=87272) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 11:10:12 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-50650057-2b85-470a-bf43-60c79842a457 tempest-CreateVolumesFromSnapshotTest-2009706975 None] Deleted volume successfully. Nov 04 11:10:12 devstack sudo[106961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-e30b71ed-a798-48e4-972b-eebf8bb82bc2 Nov 04 11:10:12 devstack sudo[106961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:10:12 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-50650057-2b85-470a-bf43-60c79842a457 tempest-CreateVolumesFromSnapshotTest-2009706975 None] Lock "cinder-29e2cdd8-0ddd-4bf9-9c06-f49655bcd28b-delete_volume" released by "delete_volume" :: held 1.666s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 11:10:12 devstack sudo[106957]: pam_unix(sudo:session): session closed for user root Nov 04 11:10:12 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-233ccb85-98ce-4827-b4dd-e9f4a48cfa43 tempest-VolumeDependencyTests-1837957763 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-c7281d58-bcc7-4a93-a593-e684f3310577" returned: 0 in 0.702s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:10:12 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-233ccb85-98ce-4827-b4dd-e9f4a48cfa43 tempest-VolumeDependencyTests-1837957763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-c7281d58-bcc7-4a93-a593-e684f3310577,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-c7281d58-bcc7-4a93-a593-e684f3310577.81a511a0-3a36-4ca1-8000-83297231be06 1G {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:10:12 devstack sudo[106969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-c7281d58-bcc7-4a93-a593-e684f3310577,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-c7281d58-bcc7-4a93-a593-e684f3310577.81a511a0-3a36-4ca1-8000-83297231be06 1G Nov 04 11:10:12 devstack sudo[106969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:10:12 devstack sudo[106961]: pam_unix(sudo:session): session closed for user root Nov 04 11:10:12 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-45b0f3cd-7827-42af-ae8a-3e69604de354 tempest-CreateVolumesFromSnapshotTest-2009706975 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-e30b71ed-a798-48e4-972b-eebf8bb82bc2" returned: 0 in 0.485s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:10:12 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-45b0f3cd-7827-42af-ae8a-3e69604de354 tempest-CreateVolumesFromSnapshotTest-2009706975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-e30b71ed-a798-48e4-972b-eebf8bb82bc2 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:10:12 devstack sudo[106974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-e30b71ed-a798-48e4-972b-eebf8bb82bc2 Nov 04 11:10:12 devstack sudo[106974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:10:13 devstack sudo[106974]: pam_unix(sudo:session): session closed for user root Nov 04 11:10:13 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-45b0f3cd-7827-42af-ae8a-3e69604de354 tempest-CreateVolumesFromSnapshotTest-2009706975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-e30b71ed-a798-48e4-972b-eebf8bb82bc2" returned: 0 in 0.359s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:10:13 devstack sudo[106969]: pam_unix(sudo:session): session closed for user root Nov 04 11:10:13 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-233ccb85-98ce-4827-b4dd-e9f4a48cfa43 tempest-VolumeDependencyTests-1837957763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-c7281d58-bcc7-4a93-a593-e684f3310577,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-c7281d58-bcc7-4a93-a593-e684f3310577.81a511a0-3a36-4ca1-8000-83297231be06 1G" returned: 0 in 0.543s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:10:13 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-233ccb85-98ce-4827-b4dd-e9f4a48cfa43 tempest-VolumeDependencyTests-1837957763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c7281d58-bcc7-4a93-a593-e684f3310577 -F qcow2 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-c7281d58-bcc7-4a93-a593-e684f3310577.81a511a0-3a36-4ca1-8000-83297231be06 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:10:13 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-45b0f3cd-7827-42af-ae8a-3e69604de354 tempest-CreateVolumesFromSnapshotTest-2009706975 None] Lock "cinder-quobyte-e30b71ed-a798-48e4-972b-eebf8bb82bc2" released by "delete_volume" :: held 0.943s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 11:10:13 devstack sudo[106981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c7281d58-bcc7-4a93-a593-e684f3310577 -F qcow2 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-c7281d58-bcc7-4a93-a593-e684f3310577.81a511a0-3a36-4ca1-8000-83297231be06 Nov 04 11:10:13 devstack sudo[106981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:10:13 devstack cinder-volume[87272]: DEBUG cinder.quota [None req-45b0f3cd-7827-42af-ae8a-3e69604de354 tempest-CreateVolumesFromSnapshotTest-2009706975 None] Created reservations ['8ce2f657-724a-4778-b644-33b910f48521', '37aede1c-f86f-4631-9f6d-d0c5604714e2', '7c9a0e78-6311-4aba-8007-b58a529f2dd4', 'd9831c7a-103b-4d08-8601-808ecc3abcee'] {{(pid=87272) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 11:10:13 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-45b0f3cd-7827-42af-ae8a-3e69604de354 tempest-CreateVolumesFromSnapshotTest-2009706975 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 11:10:13 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-45b0f3cd-7827-42af-ae8a-3e69604de354 tempest-CreateVolumesFromSnapshotTest-2009706975 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 11:10:13 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-45b0f3cd-7827-42af-ae8a-3e69604de354 tempest-CreateVolumesFromSnapshotTest-2009706975 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898': None} {{(pid=87272) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 11:10:13 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-45b0f3cd-7827-42af-ae8a-3e69604de354 tempest-CreateVolumesFromSnapshotTest-2009706975 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'] {{(pid=87272) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 11:10:13 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-45b0f3cd-7827-42af-ae8a-3e69604de354 tempest-CreateVolumesFromSnapshotTest-2009706975 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 11:10:13 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-45b0f3cd-7827-42af-ae8a-3e69604de354 tempest-CreateVolumesFromSnapshotTest-2009706975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:10:13 devstack sudo[106983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1 Nov 04 11:10:13 devstack sudo[106983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:10:13 devstack sudo[106981]: pam_unix(sudo:session): session closed for user root Nov 04 11:10:13 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-233ccb85-98ce-4827-b4dd-e9f4a48cfa43 tempest-VolumeDependencyTests-1837957763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c7281d58-bcc7-4a93-a593-e684f3310577 -F qcow2 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-c7281d58-bcc7-4a93-a593-e684f3310577.81a511a0-3a36-4ca1-8000-83297231be06" returned: 0 in 0.426s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:10:13 devstack cinder-volume[87272]: WARNING cinder.volume.drivers.remotefs [None req-233ccb85-98ce-4827-b4dd-e9f4a48cfa43 tempest-VolumeDependencyTests-1837957763 None] /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-c7281d58-bcc7-4a93-a593-e684f3310577.81a511a0-3a36-4ca1-8000-83297231be06 is being set with open permissions: ugo+rw Nov 04 11:10:13 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-233ccb85-98ce-4827-b4dd-e9f4a48cfa43 tempest-VolumeDependencyTests-1837957763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-c7281d58-bcc7-4a93-a593-e684f3310577.81a511a0-3a36-4ca1-8000-83297231be06 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:10:13 devstack sudo[106989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-c7281d58-bcc7-4a93-a593-e684f3310577.81a511a0-3a36-4ca1-8000-83297231be06 Nov 04 11:10:13 devstack sudo[106989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:10:13 devstack sudo[106983]: pam_unix(sudo:session): session closed for user root Nov 04 11:10:13 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-45b0f3cd-7827-42af-ae8a-3e69604de354 tempest-CreateVolumesFromSnapshotTest-2009706975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1" returned: 0 in 0.290s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:10:13 devstack cinder-volume[87272]: DEBUG cinder.manager [None req-45b0f3cd-7827-42af-ae8a-3e69604de354 tempest-CreateVolumesFromSnapshotTest-2009706975 None] Notifying Schedulers of capabilities ... {{(pid=87272) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 11:10:13 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-45b0f3cd-7827-42af-ae8a-3e69604de354 tempest-CreateVolumesFromSnapshotTest-2009706975 None] Deleted volume successfully. Nov 04 11:10:13 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-45b0f3cd-7827-42af-ae8a-3e69604de354 tempest-CreateVolumesFromSnapshotTest-2009706975 None] Lock "cinder-e30b71ed-a798-48e4-972b-eebf8bb82bc2-delete_volume" released by "delete_volume" :: held 1.621s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 11:10:13 devstack sudo[106989]: pam_unix(sudo:session): session closed for user root Nov 04 11:10:13 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-233ccb85-98ce-4827-b4dd-e9f4a48cfa43 tempest-VolumeDependencyTests-1837957763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-c7281d58-bcc7-4a93-a593-e684f3310577.81a511a0-3a36-4ca1-8000-83297231be06" returned: 0 in 0.284s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:10:13 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-233ccb85-98ce-4827-b4dd-e9f4a48cfa43 tempest-VolumeDependencyTests-1837957763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-c7281d58-bcc7-4a93-a593-e684f3310577.info {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:10:13 devstack sudo[106993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-c7281d58-bcc7-4a93-a593-e684f3310577.info Nov 04 11:10:13 devstack sudo[106993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:10:14 devstack cinder-volume[87272]: DEBUG oslo_service.periodic_task [None req-236af0be-7f9d-4c80-b3d7-d645a9cd0dd1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87272) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 04 11:10:14 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-236af0be-7f9d-4c80-b3d7-d645a9cd0dd1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 11:10:14 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-236af0be-7f9d-4c80-b3d7-d645a9cd0dd1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 11:10:14 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-236af0be-7f9d-4c80-b3d7-d645a9cd0dd1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898': None} {{(pid=87272) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 11:10:14 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-236af0be-7f9d-4c80-b3d7-d645a9cd0dd1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'] {{(pid=87272) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 11:10:14 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-236af0be-7f9d-4c80-b3d7-d645a9cd0dd1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 11:10:14 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-236af0be-7f9d-4c80-b3d7-d645a9cd0dd1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:10:14 devstack sudo[106996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1 Nov 04 11:10:14 devstack sudo[106996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:10:14 devstack sudo[106993]: pam_unix(sudo:session): session closed for user root Nov 04 11:10:14 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-233ccb85-98ce-4827-b4dd-e9f4a48cfa43 tempest-VolumeDependencyTests-1837957763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-c7281d58-bcc7-4a93-a593-e684f3310577.info" returned: 0 in 0.285s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:10:14 devstack cinder-volume[87272]: WARNING cinder.volume.drivers.remotefs [None req-233ccb85-98ce-4827-b4dd-e9f4a48cfa43 tempest-VolumeDependencyTests-1837957763 None] /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-c7281d58-bcc7-4a93-a593-e684f3310577.info is being set with open permissions: ugo+rw Nov 04 11:10:14 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-233ccb85-98ce-4827-b4dd-e9f4a48cfa43 tempest-VolumeDependencyTests-1837957763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-c7281d58-bcc7-4a93-a593-e684f3310577.info {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:10:14 devstack sudo[106998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-c7281d58-bcc7-4a93-a593-e684f3310577.info Nov 04 11:10:14 devstack sudo[106998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:10:14 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-d1494b96-b7ef-4033-8542-8aab8c2df499 tempest-CreateVolumesFromSnapshotTest-2009706975 None] Acquiring lock "cinder-9bd59a55-ae43-4637-ad94-fe9be4b24b2c-delete_volume" by "delete_volume" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 11:10:14 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-d1494b96-b7ef-4033-8542-8aab8c2df499 tempest-CreateVolumesFromSnapshotTest-2009706975 None] Lock "cinder-9bd59a55-ae43-4637-ad94-fe9be4b24b2c-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 11:10:14 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-236af0be-7f9d-4c80-b3d7-d645a9cd0dd1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1" returned: 0 in 0.397s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:10:14 devstack cinder-volume[87272]: DEBUG cinder.manager [None req-236af0be-7f9d-4c80-b3d7-d645a9cd0dd1 None None] Notifying Schedulers of capabilities ... {{(pid=87272) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 11:10:14 devstack sudo[106996]: pam_unix(sudo:session): session closed for user root Nov 04 11:10:14 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-d1494b96-b7ef-4033-8542-8aab8c2df499 tempest-CreateVolumesFromSnapshotTest-2009706975 None] Acquiring lock "cinder-quobyte-9bd59a55-ae43-4637-ad94-fe9be4b24b2c" by "delete_volume" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 11:10:14 devstack cinder-volume[87272]: DEBUG oslo_service.periodic_task [None req-236af0be-7f9d-4c80-b3d7-d645a9cd0dd1 None None] Running periodic task VolumeManager._thread_info {{(pid=87272) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 04 11:10:14 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-236af0be-7f9d-4c80-b3d7-d645a9cd0dd1 None None] thread count: 28 {{(pid=87272) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 04 11:10:14 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-236af0be-7f9d-4c80-b3d7-d645a9cd0dd1 None None] thread info: [<_MainThread(MainThread, started 127085713244288)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87272) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 04 11:10:14 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-d1494b96-b7ef-4033-8542-8aab8c2df499 tempest-CreateVolumesFromSnapshotTest-2009706975 None] Lock "cinder-quobyte-9bd59a55-ae43-4637-ad94-fe9be4b24b2c" acquired by "delete_volume" :: waited 0.027s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 11:10:14 devstack cinder-volume[87272]: DEBUG oslo.privsep.daemon [-] privsep: reply[4655f8e9-3435-4705-9cf6-b8847fed8b40]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 11:10:14 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-d1494b96-b7ef-4033-8542-8aab8c2df499 tempest-CreateVolumesFromSnapshotTest-2009706975 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-9bd59a55-ae43-4637-ad94-fe9be4b24b2c {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:10:14 devstack sudo[106998]: pam_unix(sudo:session): session closed for user root Nov 04 11:10:14 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-233ccb85-98ce-4827-b4dd-e9f4a48cfa43 tempest-VolumeDependencyTests-1837957763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-c7281d58-bcc7-4a93-a593-e684f3310577.info" returned: 0 in 0.439s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:10:14 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-233ccb85-98ce-4827-b4dd-e9f4a48cfa43 tempest-VolumeDependencyTests-1837957763 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.822s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 11:10:14 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-0146c83c-759e-489b-a147-62bd46c35216 tempest-ProjectAdminTests-1890482627 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.6128959655762, 'free_capacity_gb': 1773.6128959655762, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87272) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Nov 04 11:10:14 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-233ccb85-98ce-4827-b4dd-e9f4a48cfa43 tempest-VolumeDependencyTests-1837957763 None] Create snapshot completed successfully Nov 04 11:10:14 devstack sudo[107002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-9bd59a55-ae43-4637-ad94-fe9be4b24b2c Nov 04 11:10:14 devstack sudo[107002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:10:15 devstack sudo[107002]: pam_unix(sudo:session): session closed for user root Nov 04 11:10:15 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-d1494b96-b7ef-4033-8542-8aab8c2df499 tempest-CreateVolumesFromSnapshotTest-2009706975 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-9bd59a55-ae43-4637-ad94-fe9be4b24b2c" returned: 0 in 0.429s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:10:15 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-d1494b96-b7ef-4033-8542-8aab8c2df499 tempest-CreateVolumesFromSnapshotTest-2009706975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-9bd59a55-ae43-4637-ad94-fe9be4b24b2c {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:10:15 devstack sudo[107007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-9bd59a55-ae43-4637-ad94-fe9be4b24b2c Nov 04 11:10:15 devstack sudo[107007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:10:15 devstack cinder-volume[87272]: DEBUG cinder.volume.flows.manager.create_volume [None req-4d29e65c-711b-4d7c-8a24-26d2f502a569 tempest-CinderUnicodeTest-1637078103 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87272) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 11:10:15 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-4d29e65c-711b-4d7c-8a24-26d2f502a569 tempest-CinderUnicodeTest-1637078103 None] Flow 'volume_create_manager' (cca8c12e-4ca6-465f-9201-928c96751d13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 11:10:15 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-4d29e65c-711b-4d7c-8a24-26d2f502a569 tempest-CinderUnicodeTest-1637078103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e02d925-0bb7-4297-8685-4539f589ad38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:10:15 devstack sudo[107007]: pam_unix(sudo:session): session closed for user root Nov 04 11:10:15 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-d1494b96-b7ef-4033-8542-8aab8c2df499 tempest-CreateVolumesFromSnapshotTest-2009706975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-9bd59a55-ae43-4637-ad94-fe9be4b24b2c" returned: 0 in 0.368s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:10:15 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-4d29e65c-711b-4d7c-8a24-26d2f502a569 tempest-CinderUnicodeTest-1637078103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e02d925-0bb7-4297-8685-4539f589ad38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T10:10:15Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=919a00f7-1435-4bef-b0eb-da8f4738a3bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a5071e824678406e81d1ca9e69f311b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T10:10:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T10:10:15Z,use_quota=True,user_id='61e2043c08da4cd8a362208d402dfb4f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8989e4f-21e3-4f0a-9584-0d818784e883),volume_type_id=f8989e4f-21e3-4f0a-9584-0d818784e883)' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:10:15 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-4d29e65c-711b-4d7c-8a24-26d2f502a569 tempest-CinderUnicodeTest-1637078103 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10a099ca-9a25-4d4a-8129-ac6d0672bfaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:10:15 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-4d29e65c-711b-4d7c-8a24-26d2f502a569 tempest-CinderUnicodeTest-1637078103 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10a099ca-9a25-4d4a-8129-ac6d0672bfaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:10:15 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-4d29e65c-711b-4d7c-8a24-26d2f502a569 tempest-CinderUnicodeTest-1637078103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7703ffc-a841-45b2-9c16-aa6758b151f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:10:15 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-4d29e65c-711b-4d7c-8a24-26d2f502a569 tempest-CinderUnicodeTest-1637078103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7703ffc-a841-45b2-9c16-aa6758b151f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '919a00f7-1435-4bef-b0eb-da8f4738a3bd', 'volume_name': 'volume-919a00f7-1435-4bef-b0eb-da8f4738a3bd', 'volume_size': 1}' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:10:15 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-4d29e65c-711b-4d7c-8a24-26d2f502a569 tempest-CinderUnicodeTest-1637078103 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d6acf173-43b7-410f-88af-91ee6ac61897) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:10:15 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-4d29e65c-711b-4d7c-8a24-26d2f502a569 tempest-CinderUnicodeTest-1637078103 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d6acf173-43b7-410f-88af-91ee6ac61897) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:10:15 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-4d29e65c-711b-4d7c-8a24-26d2f502a569 tempest-CinderUnicodeTest-1637078103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4906b970-3a03-4bc1-906c-14fd5231a3b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:10:15 devstack cinder-volume[87272]: INFO cinder.volume.flows.manager.create_volume [None req-4d29e65c-711b-4d7c-8a24-26d2f502a569 tempest-CinderUnicodeTest-1637078103 None] Volume 919a00f7-1435-4bef-b0eb-da8f4738a3bd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-919a00f7-1435-4bef-b0eb-da8f4738a3bd', 'volume_size': 1} Nov 04 11:10:15 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-4d29e65c-711b-4d7c-8a24-26d2f502a569 tempest-CinderUnicodeTest-1637078103 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 11:10:15 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-4d29e65c-711b-4d7c-8a24-26d2f502a569 tempest-CinderUnicodeTest-1637078103 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 11:10:15 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-4d29e65c-711b-4d7c-8a24-26d2f502a569 tempest-CinderUnicodeTest-1637078103 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T10:10:15Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=919a00f7-1435-4bef-b0eb-da8f4738a3bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a5071e824678406e81d1ca9e69f311b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T10:10:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T10:10:15Z,use_quota=True,user_id='61e2043c08da4cd8a362208d402dfb4f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8989e4f-21e3-4f0a-9584-0d818784e883),volume_type_id=f8989e4f-21e3-4f0a-9584-0d818784e883)}" {{(pid=87272) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 04 11:10:15 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.remotefs [None req-4d29e65c-711b-4d7c-8a24-26d2f502a569 tempest-CinderUnicodeTest-1637078103 None] Creating volume 919a00f7-1435-4bef-b0eb-da8f4738a3bd {{(pid=87272) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 11:10:15 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-4d29e65c-711b-4d7c-8a24-26d2f502a569 tempest-CinderUnicodeTest-1637078103 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 11:10:15 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-4d29e65c-711b-4d7c-8a24-26d2f502a569 tempest-CinderUnicodeTest-1637078103 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 11:10:15 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-4d29e65c-711b-4d7c-8a24-26d2f502a569 tempest-CinderUnicodeTest-1637078103 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898': None} {{(pid=87272) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 11:10:15 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-4d29e65c-711b-4d7c-8a24-26d2f502a569 tempest-CinderUnicodeTest-1637078103 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'] {{(pid=87272) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 11:10:15 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-4d29e65c-711b-4d7c-8a24-26d2f502a569 tempest-CinderUnicodeTest-1637078103 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 11:10:15 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-4d29e65c-711b-4d7c-8a24-26d2f502a569 tempest-CinderUnicodeTest-1637078103 None] Selected osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898 as target Quobyte volume. {{(pid=87272) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 11:10:15 devstack cinder-volume[87272]: INFO cinder.volume.drivers.remotefs [None req-4d29e65c-711b-4d7c-8a24-26d2f502a569 tempest-CinderUnicodeTest-1637078103 None] casted to osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898 Nov 04 11:10:15 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-4d29e65c-711b-4d7c-8a24-26d2f502a569 tempest-CinderUnicodeTest-1637078103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-919a00f7-1435-4bef-b0eb-da8f4738a3bd 1073741824 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:10:15 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-d1494b96-b7ef-4033-8542-8aab8c2df499 tempest-CreateVolumesFromSnapshotTest-2009706975 None] Lock "cinder-quobyte-9bd59a55-ae43-4637-ad94-fe9be4b24b2c" released by "delete_volume" :: held 0.956s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 11:10:15 devstack sudo[107010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-919a00f7-1435-4bef-b0eb-da8f4738a3bd 1073741824 Nov 04 11:10:15 devstack sudo[107010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:10:15 devstack cinder-volume[87272]: DEBUG cinder.quota [None req-d1494b96-b7ef-4033-8542-8aab8c2df499 tempest-CreateVolumesFromSnapshotTest-2009706975 None] Created reservations ['1c9227d0-0495-4965-bfa2-1b93d0b40e01', '728b337c-28f0-4e0a-8a83-5b30e69f68d8', '0f1fa4cb-7635-48cd-b9fd-c0cb7d6da33b', '0b063004-80fc-4ddb-a3d4-6e3e0dc38722'] {{(pid=87272) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 11:10:15 devstack cinder-volume[87272]: DEBUG cinder.volume.flows.manager.create_volume [None req-24d17074-2a21-4770-ae90-4b18eac61fc9 tempest-VolumeDependencyTests-1837957763 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87272) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 11:10:15 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-24d17074-2a21-4770-ae90-4b18eac61fc9 tempest-VolumeDependencyTests-1837957763 None] Flow 'volume_create_manager' (2c38b697-b2ea-474f-9b59-f65a3fd458aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 11:10:15 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-24d17074-2a21-4770-ae90-4b18eac61fc9 tempest-VolumeDependencyTests-1837957763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (609eb89b-f37f-45a1-98fc-a1a9a85ce60c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:10:15 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-d1494b96-b7ef-4033-8542-8aab8c2df499 tempest-CreateVolumesFromSnapshotTest-2009706975 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 11:10:15 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-d1494b96-b7ef-4033-8542-8aab8c2df499 tempest-CreateVolumesFromSnapshotTest-2009706975 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 11:10:15 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-d1494b96-b7ef-4033-8542-8aab8c2df499 tempest-CreateVolumesFromSnapshotTest-2009706975 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898': None} {{(pid=87272) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 11:10:15 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-d1494b96-b7ef-4033-8542-8aab8c2df499 tempest-CreateVolumesFromSnapshotTest-2009706975 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'] {{(pid=87272) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 11:10:15 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-d1494b96-b7ef-4033-8542-8aab8c2df499 tempest-CreateVolumesFromSnapshotTest-2009706975 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 11:10:15 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-d1494b96-b7ef-4033-8542-8aab8c2df499 tempest-CreateVolumesFromSnapshotTest-2009706975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:10:15 devstack sudo[107012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1 Nov 04 11:10:15 devstack sudo[107012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:10:15 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-24d17074-2a21-4770-ae90-4b18eac61fc9 tempest-VolumeDependencyTests-1837957763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (609eb89b-f37f-45a1-98fc-a1a9a85ce60c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T10:10:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-359966249',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e8ee4bef-ab89-4a87-ba6e-98309c90695b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93baf42eb052435ca71dc9e9313fb249',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T10:10:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=81a511a0-3a36-4ca1-8000-83297231be06,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T10:10:16Z,use_quota=True,user_id='b6516c7a007143df897059b462e74f1f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8989e4f-21e3-4f0a-9584-0d818784e883),volume_type_id=f8989e4f-21e3-4f0a-9584-0d818784e883)' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:10:15 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-24d17074-2a21-4770-ae90-4b18eac61fc9 tempest-VolumeDependencyTests-1837957763 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a81fb91-5ee5-48fc-be4f-7167d20fed9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:10:15 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-24d17074-2a21-4770-ae90-4b18eac61fc9 tempest-VolumeDependencyTests-1837957763 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a81fb91-5ee5-48fc-be4f-7167d20fed9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:10:15 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-24d17074-2a21-4770-ae90-4b18eac61fc9 tempest-VolumeDependencyTests-1837957763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6fecee0e-ff59-446c-a8c0-cbbac8cc480e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:10:15 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-24d17074-2a21-4770-ae90-4b18eac61fc9 tempest-VolumeDependencyTests-1837957763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6fecee0e-ff59-446c-a8c0-cbbac8cc480e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'e8ee4bef-ab89-4a87-ba6e-98309c90695b', 'volume_name': 'volume-e8ee4bef-ab89-4a87-ba6e-98309c90695b', 'volume_size': 1, 'snapshot_id': '81a511a0-3a36-4ca1-8000-83297231be06'}' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:10:15 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-24d17074-2a21-4770-ae90-4b18eac61fc9 tempest-VolumeDependencyTests-1837957763 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e041405a-a1c2-4976-9146-de9bf92cf151) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:10:15 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-24d17074-2a21-4770-ae90-4b18eac61fc9 tempest-VolumeDependencyTests-1837957763 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e041405a-a1c2-4976-9146-de9bf92cf151) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:10:15 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-24d17074-2a21-4770-ae90-4b18eac61fc9 tempest-VolumeDependencyTests-1837957763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (020e28ab-858a-45b4-998e-87b2c5e87a12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:10:15 devstack cinder-volume[87272]: INFO cinder.volume.flows.manager.create_volume [None req-24d17074-2a21-4770-ae90-4b18eac61fc9 tempest-VolumeDependencyTests-1837957763 None] Volume e8ee4bef-ab89-4a87-ba6e-98309c90695b: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-e8ee4bef-ab89-4a87-ba6e-98309c90695b', 'volume_size': 1, 'snapshot_id': '81a511a0-3a36-4ca1-8000-83297231be06'} Nov 04 11:10:15 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-24d17074-2a21-4770-ae90-4b18eac61fc9 tempest-VolumeDependencyTests-1837957763 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 11:10:16 devstack sudo[107012]: pam_unix(sudo:session): session closed for user root Nov 04 11:10:16 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-d1494b96-b7ef-4033-8542-8aab8c2df499 tempest-CreateVolumesFromSnapshotTest-2009706975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1" returned: 0 in 0.278s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:10:16 devstack cinder-volume[87272]: DEBUG cinder.manager [None req-d1494b96-b7ef-4033-8542-8aab8c2df499 tempest-CreateVolumesFromSnapshotTest-2009706975 None] Notifying Schedulers of capabilities ... {{(pid=87272) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 11:10:16 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-d1494b96-b7ef-4033-8542-8aab8c2df499 tempest-CreateVolumesFromSnapshotTest-2009706975 None] Deleted volume successfully. Nov 04 11:10:16 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-d1494b96-b7ef-4033-8542-8aab8c2df499 tempest-CreateVolumesFromSnapshotTest-2009706975 None] Lock "cinder-9bd59a55-ae43-4637-ad94-fe9be4b24b2c-delete_volume" released by "delete_volume" :: held 1.606s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 11:10:16 devstack sudo[107010]: pam_unix(sudo:session): session closed for user root Nov 04 11:10:16 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-4d29e65c-711b-4d7c-8a24-26d2f502a569 tempest-CinderUnicodeTest-1637078103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-919a00f7-1435-4bef-b0eb-da8f4738a3bd 1073741824" returned: 0 in 0.596s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:10:16 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-4d29e65c-711b-4d7c-8a24-26d2f502a569 tempest-CinderUnicodeTest-1637078103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-919a00f7-1435-4bef-b0eb-da8f4738a3bd {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:10:16 devstack sudo[107019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-919a00f7-1435-4bef-b0eb-da8f4738a3bd Nov 04 11:10:16 devstack sudo[107019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:10:16 devstack sudo[107019]: pam_unix(sudo:session): session closed for user root Nov 04 11:10:16 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-4d29e65c-711b-4d7c-8a24-26d2f502a569 tempest-CinderUnicodeTest-1637078103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-919a00f7-1435-4bef-b0eb-da8f4738a3bd" returned: 0 in 0.261s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:10:16 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-4d29e65c-711b-4d7c-8a24-26d2f502a569 tempest-CinderUnicodeTest-1637078103 None] <== create_volume: return (906ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'} {{(pid=87272) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 04 11:10:16 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-4d29e65c-711b-4d7c-8a24-26d2f502a569 tempest-CinderUnicodeTest-1637078103 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.910s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 11:10:16 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-24d17074-2a21-4770-ae90-4b18eac61fc9 tempest-VolumeDependencyTests-1837957763 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.529s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 11:10:16 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-24d17074-2a21-4770-ae90-4b18eac61fc9 tempest-VolumeDependencyTests-1837957763 None] Acquiring lock "cinder-quobyte-81a511a0-3a36-4ca1-8000-83297231be06-e8ee4bef-ab89-4a87-ba6e-98309c90695b" by "_create_volume_from_snapshot" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 11:10:16 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-4d29e65c-711b-4d7c-8a24-26d2f502a569 tempest-CinderUnicodeTest-1637078103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4906b970-3a03-4bc1-906c-14fd5231a3b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-919a00f7-1435-4bef-b0eb-da8f4738a3bd', 'volume_size': 1}' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:10:16 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-4d29e65c-711b-4d7c-8a24-26d2f502a569 tempest-CinderUnicodeTest-1637078103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c1e4a2cc-fb13-4e76-823c-c47198a6a68a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:10:16 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-24d17074-2a21-4770-ae90-4b18eac61fc9 tempest-VolumeDependencyTests-1837957763 None] Lock "cinder-quobyte-81a511a0-3a36-4ca1-8000-83297231be06-e8ee4bef-ab89-4a87-ba6e-98309c90695b" acquired by "_create_volume_from_snapshot" :: waited 0.045s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 11:10:16 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-24d17074-2a21-4770-ae90-4b18eac61fc9 tempest-VolumeDependencyTests-1837957763 None] Creating volume e8ee4bef-ab89-4a87-ba6e-98309c90695b from snapshot 81a511a0-3a36-4ca1-8000-83297231be06 {{(pid=87272) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 04 11:10:16 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-24d17074-2a21-4770-ae90-4b18eac61fc9 tempest-VolumeDependencyTests-1837957763 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 11:10:16 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-24d17074-2a21-4770-ae90-4b18eac61fc9 tempest-VolumeDependencyTests-1837957763 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 11:10:16 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-24d17074-2a21-4770-ae90-4b18eac61fc9 tempest-VolumeDependencyTests-1837957763 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898': None} {{(pid=87272) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 11:10:16 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-24d17074-2a21-4770-ae90-4b18eac61fc9 tempest-VolumeDependencyTests-1837957763 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'] {{(pid=87272) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 11:10:16 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-24d17074-2a21-4770-ae90-4b18eac61fc9 tempest-VolumeDependencyTests-1837957763 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 11:10:16 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-24d17074-2a21-4770-ae90-4b18eac61fc9 tempest-VolumeDependencyTests-1837957763 None] Selected osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898 as target Quobyte volume. {{(pid=87272) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 11:10:16 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-24d17074-2a21-4770-ae90-4b18eac61fc9 tempest-VolumeDependencyTests-1837957763 None] Acquiring lock "cinder-quobyte-e8ee4bef-ab89-4a87-ba6e-98309c90695b" by "_copy_volume_from_snapshot" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 11:10:16 devstack cinder-volume[87272]: INFO cinder.volume.flows.manager.create_volume [None req-4d29e65c-711b-4d7c-8a24-26d2f502a569 tempest-CinderUnicodeTest-1637078103 None] Volume volume-919a00f7-1435-4bef-b0eb-da8f4738a3bd (919a00f7-1435-4bef-b0eb-da8f4738a3bd): created successfully Nov 04 11:10:16 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-4d29e65c-711b-4d7c-8a24-26d2f502a569 tempest-CinderUnicodeTest-1637078103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c1e4a2cc-fb13-4e76-823c-c47198a6a68a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:10:16 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-4d29e65c-711b-4d7c-8a24-26d2f502a569 tempest-CinderUnicodeTest-1637078103 None] Flow 'volume_create_manager' (cca8c12e-4ca6-465f-9201-928c96751d13) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87272) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 11:10:16 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-24d17074-2a21-4770-ae90-4b18eac61fc9 tempest-VolumeDependencyTests-1837957763 None] Lock "cinder-quobyte-e8ee4bef-ab89-4a87-ba6e-98309c90695b" acquired by "_copy_volume_from_snapshot" :: waited 0.037s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 11:10:16 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-24d17074-2a21-4770-ae90-4b18eac61fc9 tempest-VolumeDependencyTests-1837957763 None] snapshot: 81a511a0-3a36-4ca1-8000-83297231be06, volume: e8ee4bef-ab89-4a87-ba6e-98309c90695b, {{(pid=87272) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 04 11:10:16 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-4d29e65c-711b-4d7c-8a24-26d2f502a569 tempest-CinderUnicodeTest-1637078103 None] Created volume successfully. Nov 04 11:10:16 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-24d17074-2a21-4770-ae90-4b18eac61fc9 tempest-VolumeDependencyTests-1837957763 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 11:10:16 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-24d17074-2a21-4770-ae90-4b18eac61fc9 tempest-VolumeDependencyTests-1837957763 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 11:10:16 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-24d17074-2a21-4770-ae90-4b18eac61fc9 tempest-VolumeDependencyTests-1837957763 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898': None} {{(pid=87272) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 11:10:16 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-24d17074-2a21-4770-ae90-4b18eac61fc9 tempest-VolumeDependencyTests-1837957763 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'] {{(pid=87272) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 11:10:16 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-24d17074-2a21-4770-ae90-4b18eac61fc9 tempest-VolumeDependencyTests-1837957763 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 11:10:16 devstack cinder-volume[87272]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8685d89-d871-437b-9a6d-f4e9727739e9]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 11:10:16 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-24d17074-2a21-4770-ae90-4b18eac61fc9 tempest-VolumeDependencyTests-1837957763 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-c7281d58-bcc7-4a93-a593-e684f3310577.81a511a0-3a36-4ca1-8000-83297231be06 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:10:16 devstack sudo[107022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-c7281d58-bcc7-4a93-a593-e684f3310577.81a511a0-3a36-4ca1-8000-83297231be06 Nov 04 11:10:16 devstack sudo[107022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:10:16 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-c286090d-a6b2-4f00-ac52-741584ba40a1 tempest-CreateVolumesFromSnapshotTest-2009706975 None] Acquiring lock "cinder-69925c2f-f55e-4250-a97d-bb5e9656efb6-delete_volume" by "delete_volume" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 11:10:16 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-c286090d-a6b2-4f00-ac52-741584ba40a1 tempest-CreateVolumesFromSnapshotTest-2009706975 None] Lock "cinder-69925c2f-f55e-4250-a97d-bb5e9656efb6-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 11:10:16 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-c286090d-a6b2-4f00-ac52-741584ba40a1 tempest-CreateVolumesFromSnapshotTest-2009706975 None] Acquiring lock "cinder-quobyte-69925c2f-f55e-4250-a97d-bb5e9656efb6" by "delete_volume" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 11:10:16 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-c286090d-a6b2-4f00-ac52-741584ba40a1 tempest-CreateVolumesFromSnapshotTest-2009706975 None] Lock "cinder-quobyte-69925c2f-f55e-4250-a97d-bb5e9656efb6" acquired by "delete_volume" :: waited 0.016s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 11:10:16 devstack cinder-volume[87272]: DEBUG oslo.privsep.daemon [-] privsep: reply[f68d3b15-fc28-4413-af7a-7714dbb57868]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 11:10:16 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-c286090d-a6b2-4f00-ac52-741584ba40a1 tempest-CreateVolumesFromSnapshotTest-2009706975 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-69925c2f-f55e-4250-a97d-bb5e9656efb6 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:10:16 devstack sudo[107022]: pam_unix(sudo:session): session closed for user root Nov 04 11:10:17 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-24d17074-2a21-4770-ae90-4b18eac61fc9 tempest-VolumeDependencyTests-1837957763 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-c7281d58-bcc7-4a93-a593-e684f3310577.81a511a0-3a36-4ca1-8000-83297231be06" returned: 0 in 0.409s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:10:17 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.remotefs [None req-24d17074-2a21-4770-ae90-4b18eac61fc9 tempest-VolumeDependencyTests-1837957763 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c7281d58-bcc7-4a93-a593-e684f3310577(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87272) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 11:10:17 devstack cinder-volume[87272]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2cc4bfd-b68f-448e-a5d6-2869ddb1f30d]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 11:10:17 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-24d17074-2a21-4770-ae90-4b18eac61fc9 tempest-VolumeDependencyTests-1837957763 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-c7281d58-bcc7-4a93-a593-e684f3310577 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:10:17 devstack sudo[107028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-69925c2f-f55e-4250-a97d-bb5e9656efb6 Nov 04 11:10:17 devstack sudo[107028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:10:17 devstack sudo[107029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-c7281d58-bcc7-4a93-a593-e684f3310577 Nov 04 11:10:17 devstack sudo[107029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:10:17 devstack sudo[107028]: pam_unix(sudo:session): session closed for user root Nov 04 11:10:17 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-c286090d-a6b2-4f00-ac52-741584ba40a1 tempest-CreateVolumesFromSnapshotTest-2009706975 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-69925c2f-f55e-4250-a97d-bb5e9656efb6" returned: 0 in 0.436s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:10:17 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-c286090d-a6b2-4f00-ac52-741584ba40a1 tempest-CreateVolumesFromSnapshotTest-2009706975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-69925c2f-f55e-4250-a97d-bb5e9656efb6 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:10:17 devstack sudo[107037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-69925c2f-f55e-4250-a97d-bb5e9656efb6 Nov 04 11:10:17 devstack sudo[107037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:10:17 devstack sudo[107029]: pam_unix(sudo:session): session closed for user root Nov 04 11:10:17 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-24d17074-2a21-4770-ae90-4b18eac61fc9 tempest-VolumeDependencyTests-1837957763 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-c7281d58-bcc7-4a93-a593-e684f3310577" returned: 0 in 0.458s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:10:17 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-24d17074-2a21-4770-ae90-4b18eac61fc9 tempest-VolumeDependencyTests-1837957763 None] will copy from snapshot at /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-c7281d58-bcc7-4a93-a593-e684f3310577 {{(pid=87272) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 04 11:10:17 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-24d17074-2a21-4770-ae90-4b18eac61fc9 tempest-VolumeDependencyTests-1837957763 None] Creating direct copy from snapshot {{(pid=87272) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 04 11:10:17 devstack cinder-volume[87272]: DEBUG cinder.utils [None req-24d17074-2a21-4770-ae90-4b18eac61fc9 tempest-VolumeDependencyTests-1837957763 None] Path /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-e8ee4bef-ab89-4a87-ba6e-98309c90695b not found in is_blk_device check {{(pid=87272) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Nov 04 11:10:17 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-24d17074-2a21-4770-ae90-4b18eac61fc9 tempest-VolumeDependencyTests-1837957763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-c7281d58-bcc7-4a93-a593-e684f3310577 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-e8ee4bef-ab89-4a87-ba6e-98309c90695b {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:10:17 devstack sudo[107040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-c7281d58-bcc7-4a93-a593-e684f3310577 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-e8ee4bef-ab89-4a87-ba6e-98309c90695b Nov 04 11:10:17 devstack sudo[107040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:10:17 devstack sudo[107037]: pam_unix(sudo:session): session closed for user root Nov 04 11:10:17 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-c286090d-a6b2-4f00-ac52-741584ba40a1 tempest-CreateVolumesFromSnapshotTest-2009706975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-69925c2f-f55e-4250-a97d-bb5e9656efb6" returned: 0 in 0.334s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:10:17 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-c286090d-a6b2-4f00-ac52-741584ba40a1 tempest-CreateVolumesFromSnapshotTest-2009706975 None] Lock "cinder-quobyte-69925c2f-f55e-4250-a97d-bb5e9656efb6" released by "delete_volume" :: held 0.835s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 11:10:17 devstack cinder-volume[87272]: DEBUG cinder.quota [None req-c286090d-a6b2-4f00-ac52-741584ba40a1 tempest-CreateVolumesFromSnapshotTest-2009706975 None] Created reservations ['0e0f053c-2c64-4304-b0cc-5bb926f6ba8e', '192181b0-b936-432d-bab4-8179f425cfdf', '82775783-708f-4aa8-b41f-1386184dc625', '60d0a9f1-d1f3-4a62-8b2b-c15a3a1f77ea'] {{(pid=87272) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 11:10:17 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-c286090d-a6b2-4f00-ac52-741584ba40a1 tempest-CreateVolumesFromSnapshotTest-2009706975 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 11:10:17 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-c286090d-a6b2-4f00-ac52-741584ba40a1 tempest-CreateVolumesFromSnapshotTest-2009706975 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 11:10:17 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-c286090d-a6b2-4f00-ac52-741584ba40a1 tempest-CreateVolumesFromSnapshotTest-2009706975 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898': None} {{(pid=87272) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 11:10:17 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-c286090d-a6b2-4f00-ac52-741584ba40a1 tempest-CreateVolumesFromSnapshotTest-2009706975 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'] {{(pid=87272) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 11:10:17 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-c286090d-a6b2-4f00-ac52-741584ba40a1 tempest-CreateVolumesFromSnapshotTest-2009706975 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 11:10:17 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-c286090d-a6b2-4f00-ac52-741584ba40a1 tempest-CreateVolumesFromSnapshotTest-2009706975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:10:18 devstack sudo[107047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1 Nov 04 11:10:18 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-182c4cf9-0f55-413d-b0f6-7f2ff83937f0 tempest-CreateVolumesFromSnapshotTest-2009706975 None] Acquiring lock "cinder-00126f67-e5f6-4037-8780-966009a161ef-delete_snapshot" by "delete_snapshot" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 11:10:18 devstack sudo[107047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:10:18 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-182c4cf9-0f55-413d-b0f6-7f2ff83937f0 tempest-CreateVolumesFromSnapshotTest-2009706975 None] Lock "cinder-00126f67-e5f6-4037-8780-966009a161ef-delete_snapshot" acquired by "delete_snapshot" :: waited 0.040s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 11:10:18 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-182c4cf9-0f55-413d-b0f6-7f2ff83937f0 tempest-CreateVolumesFromSnapshotTest-2009706975 None] Acquiring lock "cinder-quobyte-734fb143-2aba-48e6-9cc7-b27c6a66552f" by "delete_snapshot" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 11:10:18 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-182c4cf9-0f55-413d-b0f6-7f2ff83937f0 tempest-CreateVolumesFromSnapshotTest-2009706975 None] Lock "cinder-quobyte-734fb143-2aba-48e6-9cc7-b27c6a66552f" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 11:10:18 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-182c4cf9-0f55-413d-b0f6-7f2ff83937f0 tempest-CreateVolumesFromSnapshotTest-2009706975 None] Acquiring lock "cinder-quobyte-00126f67-e5f6-4037-8780-966009a161ef" by "_delete_snapshot" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 11:10:18 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-182c4cf9-0f55-413d-b0f6-7f2ff83937f0 tempest-CreateVolumesFromSnapshotTest-2009706975 None] Lock "cinder-quobyte-00126f67-e5f6-4037-8780-966009a161ef" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 11:10:18 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.remotefs [None req-182c4cf9-0f55-413d-b0f6-7f2ff83937f0 tempest-CreateVolumesFromSnapshotTest-2009706975 None] Deleting offline snapshot 00126f67-e5f6-4037-8780-966009a161ef of volume 734fb143-2aba-48e6-9cc7-b27c6a66552f {{(pid=87272) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 04 11:10:18 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.remotefs [None req-182c4cf9-0f55-413d-b0f6-7f2ff83937f0 tempest-CreateVolumesFromSnapshotTest-2009706975 None] snapshot_file for this snap is: volume-734fb143-2aba-48e6-9cc7-b27c6a66552f.00126f67-e5f6-4037-8780-966009a161ef {{(pid=87272) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 04 11:10:18 devstack cinder-volume[87272]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4c7b3e9-9147-42e1-ae49-f38470ec3cc0]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 11:10:18 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-182c4cf9-0f55-413d-b0f6-7f2ff83937f0 tempest-CreateVolumesFromSnapshotTest-2009706975 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-734fb143-2aba-48e6-9cc7-b27c6a66552f.00126f67-e5f6-4037-8780-966009a161ef {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:10:18 devstack cinder-volume[87272]: DEBUG cinder.volume.flows.manager.create_volume [None req-74a8453e-965d-4ee6-9b76-bd7b21c4b21d tempest-CinderUnicodeTest-1637078103 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87272) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 11:10:18 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-74a8453e-965d-4ee6-9b76-bd7b21c4b21d tempest-CinderUnicodeTest-1637078103 None] Flow 'volume_create_manager' (d530b4eb-1767-4baf-9c4c-1aca285c9f5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 11:10:18 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-74a8453e-965d-4ee6-9b76-bd7b21c4b21d tempest-CinderUnicodeTest-1637078103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2709ddf2-0768-47e0-8c40-80dd32af2848) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:10:18 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-74a8453e-965d-4ee6-9b76-bd7b21c4b21d tempest-CinderUnicodeTest-1637078103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2709ddf2-0768-47e0-8c40-80dd32af2848) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T10:10:18Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1791077885',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a4a53855-2b8d-46ee-a1df-13fc73836800,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a5071e824678406e81d1ca9e69f311b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T10:10:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T10:10:18Z,use_quota=True,user_id='61e2043c08da4cd8a362208d402dfb4f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8989e4f-21e3-4f0a-9584-0d818784e883),volume_type_id=f8989e4f-21e3-4f0a-9584-0d818784e883)' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:10:18 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-74a8453e-965d-4ee6-9b76-bd7b21c4b21d tempest-CinderUnicodeTest-1637078103 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c427c87-63be-45bc-b05b-29270481676c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:10:18 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-74a8453e-965d-4ee6-9b76-bd7b21c4b21d tempest-CinderUnicodeTest-1637078103 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c427c87-63be-45bc-b05b-29270481676c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:10:18 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-74a8453e-965d-4ee6-9b76-bd7b21c4b21d tempest-CinderUnicodeTest-1637078103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f86bddc5-a6db-41a9-9894-473c9e6176c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:10:18 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-74a8453e-965d-4ee6-9b76-bd7b21c4b21d tempest-CinderUnicodeTest-1637078103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f86bddc5-a6db-41a9-9894-473c9e6176c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a4a53855-2b8d-46ee-a1df-13fc73836800', 'volume_name': 'volume-a4a53855-2b8d-46ee-a1df-13fc73836800', 'volume_size': 1}' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:10:18 devstack sudo[107055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-734fb143-2aba-48e6-9cc7-b27c6a66552f.00126f67-e5f6-4037-8780-966009a161ef Nov 04 11:10:18 devstack sudo[107055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:10:18 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-74a8453e-965d-4ee6-9b76-bd7b21c4b21d tempest-CinderUnicodeTest-1637078103 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c62e54f1-a0db-4373-b766-4887594cd434) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:10:18 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-74a8453e-965d-4ee6-9b76-bd7b21c4b21d tempest-CinderUnicodeTest-1637078103 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c62e54f1-a0db-4373-b766-4887594cd434) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:10:18 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-74a8453e-965d-4ee6-9b76-bd7b21c4b21d tempest-CinderUnicodeTest-1637078103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67205a7f-63c8-48e5-843f-77260abda8e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:10:18 devstack cinder-volume[87272]: INFO cinder.volume.flows.manager.create_volume [None req-74a8453e-965d-4ee6-9b76-bd7b21c4b21d tempest-CinderUnicodeTest-1637078103 None] Volume a4a53855-2b8d-46ee-a1df-13fc73836800: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a4a53855-2b8d-46ee-a1df-13fc73836800', 'volume_size': 1} Nov 04 11:10:18 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-74a8453e-965d-4ee6-9b76-bd7b21c4b21d tempest-CinderUnicodeTest-1637078103 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 11:10:18 devstack sudo[107047]: pam_unix(sudo:session): session closed for user root Nov 04 11:10:18 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-c286090d-a6b2-4f00-ac52-741584ba40a1 tempest-CreateVolumesFromSnapshotTest-2009706975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1" returned: 0 in 0.551s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:10:18 devstack cinder-volume[87272]: DEBUG cinder.manager [None req-c286090d-a6b2-4f00-ac52-741584ba40a1 tempest-CreateVolumesFromSnapshotTest-2009706975 None] Notifying Schedulers of capabilities ... {{(pid=87272) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 11:10:18 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-c286090d-a6b2-4f00-ac52-741584ba40a1 tempest-CreateVolumesFromSnapshotTest-2009706975 None] Deleted volume successfully. Nov 04 11:10:18 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-c286090d-a6b2-4f00-ac52-741584ba40a1 tempest-CreateVolumesFromSnapshotTest-2009706975 None] Lock "cinder-69925c2f-f55e-4250-a97d-bb5e9656efb6-delete_volume" released by "delete_volume" :: held 1.774s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 11:10:19 devstack sudo[107055]: pam_unix(sudo:session): session closed for user root Nov 04 11:10:19 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-182c4cf9-0f55-413d-b0f6-7f2ff83937f0 tempest-CreateVolumesFromSnapshotTest-2009706975 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-734fb143-2aba-48e6-9cc7-b27c6a66552f.00126f67-e5f6-4037-8780-966009a161ef" returned: 0 in 0.989s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:10:19 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.remotefs [None req-182c4cf9-0f55-413d-b0f6-7f2ff83937f0 tempest-CreateVolumesFromSnapshotTest-2009706975 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-734fb143-2aba-48e6-9cc7-b27c6a66552f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87272) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 11:10:19 devstack cinder-volume[87272]: DEBUG oslo.privsep.daemon [-] privsep: reply[1626600f-9da3-49a2-b56c-ebddd6ff42eb]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 11:10:19 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-182c4cf9-0f55-413d-b0f6-7f2ff83937f0 tempest-CreateVolumesFromSnapshotTest-2009706975 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-734fb143-2aba-48e6-9cc7-b27c6a66552f {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:10:19 devstack sudo[107061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-734fb143-2aba-48e6-9cc7-b27c6a66552f Nov 04 11:10:19 devstack sudo[107061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:10:20 devstack sudo[107061]: pam_unix(sudo:session): session closed for user root Nov 04 11:10:20 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-182c4cf9-0f55-413d-b0f6-7f2ff83937f0 tempest-CreateVolumesFromSnapshotTest-2009706975 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-734fb143-2aba-48e6-9cc7-b27c6a66552f" returned: 0 in 0.787s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:10:20 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-182c4cf9-0f55-413d-b0f6-7f2ff83937f0 tempest-CreateVolumesFromSnapshotTest-2009706975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-734fb143-2aba-48e6-9cc7-b27c6a66552f.00126f67-e5f6-4037-8780-966009a161ef {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:10:20 devstack sudo[107066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-734fb143-2aba-48e6-9cc7-b27c6a66552f.00126f67-e5f6-4037-8780-966009a161ef Nov 04 11:10:20 devstack sudo[107066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:10:20 devstack sudo[107066]: pam_unix(sudo:session): session closed for user root Nov 04 11:10:20 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-182c4cf9-0f55-413d-b0f6-7f2ff83937f0 tempest-CreateVolumesFromSnapshotTest-2009706975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-734fb143-2aba-48e6-9cc7-b27c6a66552f.00126f67-e5f6-4037-8780-966009a161ef" returned: 0 in 0.717s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:10:20 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-182c4cf9-0f55-413d-b0f6-7f2ff83937f0 tempest-CreateVolumesFromSnapshotTest-2009706975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-734fb143-2aba-48e6-9cc7-b27c6a66552f.00126f67-e5f6-4037-8780-966009a161ef {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:10:20 devstack sudo[107071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-734fb143-2aba-48e6-9cc7-b27c6a66552f.00126f67-e5f6-4037-8780-966009a161ef Nov 04 11:10:20 devstack sudo[107071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:10:21 devstack sudo[107071]: pam_unix(sudo:session): session closed for user root Nov 04 11:10:21 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-182c4cf9-0f55-413d-b0f6-7f2ff83937f0 tempest-CreateVolumesFromSnapshotTest-2009706975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-734fb143-2aba-48e6-9cc7-b27c6a66552f.00126f67-e5f6-4037-8780-966009a161ef" returned: 0 in 0.419s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:10:21 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-182c4cf9-0f55-413d-b0f6-7f2ff83937f0 tempest-CreateVolumesFromSnapshotTest-2009706975 None] Lock "cinder-quobyte-00126f67-e5f6-4037-8780-966009a161ef" released by "_delete_snapshot" :: held 3.211s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 11:10:21 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-182c4cf9-0f55-413d-b0f6-7f2ff83937f0 tempest-CreateVolumesFromSnapshotTest-2009706975 None] Lock "cinder-quobyte-734fb143-2aba-48e6-9cc7-b27c6a66552f" released by "delete_snapshot" :: held 3.249s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 11:10:21 devstack cinder-volume[87272]: DEBUG cinder.quota [None req-182c4cf9-0f55-413d-b0f6-7f2ff83937f0 tempest-CreateVolumesFromSnapshotTest-2009706975 None] Created reservations ['692e87a1-f07a-408b-a3c0-5b4aab88ae8e', '2982acb9-b2ad-4ade-bcfe-f9052fcadec5', '5258e371-3d45-4b1a-b7da-06c17612cdfd', '7a44fd96-2acc-47d9-b629-efd627d38f60'] {{(pid=87272) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 11:10:21 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-182c4cf9-0f55-413d-b0f6-7f2ff83937f0 tempest-CreateVolumesFromSnapshotTest-2009706975 None] Delete snapshot completed successfully. Nov 04 11:10:21 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-182c4cf9-0f55-413d-b0f6-7f2ff83937f0 tempest-CreateVolumesFromSnapshotTest-2009706975 None] Lock "cinder-00126f67-e5f6-4037-8780-966009a161ef-delete_snapshot" released by "delete_snapshot" :: held 3.497s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 11:10:22 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-26be03bb-7094-4058-b456-422883e0fbe0 tempest-CreateVolumesFromSnapshotTest-2009706975 None] Acquiring lock "cinder-734fb143-2aba-48e6-9cc7-b27c6a66552f-delete_volume" by "delete_volume" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 11:10:22 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-26be03bb-7094-4058-b456-422883e0fbe0 tempest-CreateVolumesFromSnapshotTest-2009706975 None] Lock "cinder-734fb143-2aba-48e6-9cc7-b27c6a66552f-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 11:10:22 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-26be03bb-7094-4058-b456-422883e0fbe0 tempest-CreateVolumesFromSnapshotTest-2009706975 None] Acquiring lock "cinder-quobyte-734fb143-2aba-48e6-9cc7-b27c6a66552f" by "delete_volume" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 11:10:22 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-26be03bb-7094-4058-b456-422883e0fbe0 tempest-CreateVolumesFromSnapshotTest-2009706975 None] Lock "cinder-quobyte-734fb143-2aba-48e6-9cc7-b27c6a66552f" acquired by "delete_volume" :: waited 0.028s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 11:10:22 devstack cinder-volume[87272]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ff0eccd-72ba-4fcf-a9c5-14fe8a6f707f]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 11:10:22 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-26be03bb-7094-4058-b456-422883e0fbe0 tempest-CreateVolumesFromSnapshotTest-2009706975 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-734fb143-2aba-48e6-9cc7-b27c6a66552f {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:10:23 devstack sudo[107082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-734fb143-2aba-48e6-9cc7-b27c6a66552f Nov 04 11:10:23 devstack sudo[107082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:10:23 devstack sudo[107082]: pam_unix(sudo:session): session closed for user root Nov 04 11:10:23 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-26be03bb-7094-4058-b456-422883e0fbe0 tempest-CreateVolumesFromSnapshotTest-2009706975 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-734fb143-2aba-48e6-9cc7-b27c6a66552f" returned: 0 in 0.692s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:10:23 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-26be03bb-7094-4058-b456-422883e0fbe0 tempest-CreateVolumesFromSnapshotTest-2009706975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-734fb143-2aba-48e6-9cc7-b27c6a66552f {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:10:23 devstack sudo[107088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-734fb143-2aba-48e6-9cc7-b27c6a66552f Nov 04 11:10:23 devstack sudo[107088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:10:24 devstack sudo[107088]: pam_unix(sudo:session): session closed for user root Nov 04 11:10:24 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-26be03bb-7094-4058-b456-422883e0fbe0 tempest-CreateVolumesFromSnapshotTest-2009706975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-734fb143-2aba-48e6-9cc7-b27c6a66552f" returned: 0 in 0.414s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:10:24 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-26be03bb-7094-4058-b456-422883e0fbe0 tempest-CreateVolumesFromSnapshotTest-2009706975 None] Lock "cinder-quobyte-734fb143-2aba-48e6-9cc7-b27c6a66552f" released by "delete_volume" :: held 1.227s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 11:10:24 devstack cinder-volume[87272]: DEBUG cinder.quota [None req-26be03bb-7094-4058-b456-422883e0fbe0 tempest-CreateVolumesFromSnapshotTest-2009706975 None] Created reservations ['85d6d0f5-d858-4573-880b-fcdaa3828687', '08ca2a64-9182-4227-b44a-bf212b52c574', '094a1d68-aef1-4489-b2f0-fc903a11d1d2', 'c959655f-be4a-4b18-8fb4-863e72315820'] {{(pid=87272) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 11:10:24 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-26be03bb-7094-4058-b456-422883e0fbe0 tempest-CreateVolumesFromSnapshotTest-2009706975 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 11:10:24 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-26be03bb-7094-4058-b456-422883e0fbe0 tempest-CreateVolumesFromSnapshotTest-2009706975 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 11:10:24 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-26be03bb-7094-4058-b456-422883e0fbe0 tempest-CreateVolumesFromSnapshotTest-2009706975 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898': None} {{(pid=87272) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 11:10:24 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-26be03bb-7094-4058-b456-422883e0fbe0 tempest-CreateVolumesFromSnapshotTest-2009706975 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'] {{(pid=87272) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 11:10:24 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-26be03bb-7094-4058-b456-422883e0fbe0 tempest-CreateVolumesFromSnapshotTest-2009706975 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 11:10:24 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-26be03bb-7094-4058-b456-422883e0fbe0 tempest-CreateVolumesFromSnapshotTest-2009706975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:10:24 devstack sudo[107091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1 Nov 04 11:10:24 devstack sudo[107091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:10:24 devstack sudo[107091]: pam_unix(sudo:session): session closed for user root Nov 04 11:10:24 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-26be03bb-7094-4058-b456-422883e0fbe0 tempest-CreateVolumesFromSnapshotTest-2009706975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1" returned: 0 in 0.311s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:10:24 devstack cinder-volume[87272]: DEBUG cinder.manager [None req-26be03bb-7094-4058-b456-422883e0fbe0 tempest-CreateVolumesFromSnapshotTest-2009706975 None] Notifying Schedulers of capabilities ... {{(pid=87272) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 11:10:24 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-26be03bb-7094-4058-b456-422883e0fbe0 tempest-CreateVolumesFromSnapshotTest-2009706975 None] Deleted volume successfully. Nov 04 11:10:24 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-26be03bb-7094-4058-b456-422883e0fbe0 tempest-CreateVolumesFromSnapshotTest-2009706975 None] Lock "cinder-734fb143-2aba-48e6-9cc7-b27c6a66552f-delete_volume" released by "delete_volume" :: held 1.971s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 11:10:25 devstack sudo[107040]: pam_unix(sudo:session): session closed for user root Nov 04 11:10:25 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-24d17074-2a21-4770-ae90-4b18eac61fc9 tempest-VolumeDependencyTests-1837957763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-c7281d58-bcc7-4a93-a593-e684f3310577 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-e8ee4bef-ab89-4a87-ba6e-98309c90695b" returned: 0 in 8.228s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:10:25 devstack cinder-volume[87272]: DEBUG cinder.image.image_utils [None req-24d17074-2a21-4770-ae90-4b18eac61fc9 tempest-VolumeDependencyTests-1837957763 None] Image conversion details: src /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-c7281d58-bcc7-4a93-a593-e684f3310577, size 1024.00 MB, duration 8.23 sec, destination /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-e8ee4bef-ab89-4a87-ba6e-98309c90695b {{(pid=87272) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Nov 04 11:10:25 devstack cinder-volume[87272]: INFO cinder.image.image_utils [None req-24d17074-2a21-4770-ae90-4b18eac61fc9 tempest-VolumeDependencyTests-1837957763 None] Converted 1024.00 MB image at 124.44 MB/s Nov 04 11:10:25 devstack cinder-volume[87272]: WARNING cinder.volume.drivers.remotefs [None req-24d17074-2a21-4770-ae90-4b18eac61fc9 tempest-VolumeDependencyTests-1837957763 None] /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-e8ee4bef-ab89-4a87-ba6e-98309c90695b is being set with open permissions: ugo+rw Nov 04 11:10:25 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-24d17074-2a21-4770-ae90-4b18eac61fc9 tempest-VolumeDependencyTests-1837957763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-e8ee4bef-ab89-4a87-ba6e-98309c90695b {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:10:25 devstack sudo[107096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-e8ee4bef-ab89-4a87-ba6e-98309c90695b Nov 04 11:10:25 devstack sudo[107096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:10:25 devstack sudo[107096]: pam_unix(sudo:session): session closed for user root Nov 04 11:10:26 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-24d17074-2a21-4770-ae90-4b18eac61fc9 tempest-VolumeDependencyTests-1837957763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-e8ee4bef-ab89-4a87-ba6e-98309c90695b" returned: 0 in 0.270s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:10:26 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-24d17074-2a21-4770-ae90-4b18eac61fc9 tempest-VolumeDependencyTests-1837957763 None] Lock "cinder-quobyte-e8ee4bef-ab89-4a87-ba6e-98309c90695b" released by "_copy_volume_from_snapshot" :: held 9.504s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 11:10:26 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-24d17074-2a21-4770-ae90-4b18eac61fc9 tempest-VolumeDependencyTests-1837957763 None] Lock "cinder-quobyte-81a511a0-3a36-4ca1-8000-83297231be06-e8ee4bef-ab89-4a87-ba6e-98309c90695b" released by "_create_volume_from_snapshot" :: held 9.595s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 11:10:26 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-24d17074-2a21-4770-ae90-4b18eac61fc9 tempest-VolumeDependencyTests-1837957763 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.644s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 11:10:26 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-74a8453e-965d-4ee6-9b76-bd7b21c4b21d tempest-CinderUnicodeTest-1637078103 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.532s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 11:10:26 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-74a8453e-965d-4ee6-9b76-bd7b21c4b21d tempest-CinderUnicodeTest-1637078103 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T10:10:18Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1791077885',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a4a53855-2b8d-46ee-a1df-13fc73836800,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a5071e824678406e81d1ca9e69f311b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T10:10:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T10:10:18Z,use_quota=True,user_id='61e2043c08da4cd8a362208d402dfb4f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8989e4f-21e3-4f0a-9584-0d818784e883),volume_type_id=f8989e4f-21e3-4f0a-9584-0d818784e883)}" {{(pid=87272) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 04 11:10:26 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.remotefs [None req-74a8453e-965d-4ee6-9b76-bd7b21c4b21d tempest-CinderUnicodeTest-1637078103 None] Creating volume a4a53855-2b8d-46ee-a1df-13fc73836800 {{(pid=87272) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 11:10:26 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-74a8453e-965d-4ee6-9b76-bd7b21c4b21d tempest-CinderUnicodeTest-1637078103 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 11:10:26 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-74a8453e-965d-4ee6-9b76-bd7b21c4b21d tempest-CinderUnicodeTest-1637078103 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 11:10:26 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-74a8453e-965d-4ee6-9b76-bd7b21c4b21d tempest-CinderUnicodeTest-1637078103 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898': None} {{(pid=87272) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 11:10:26 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-74a8453e-965d-4ee6-9b76-bd7b21c4b21d tempest-CinderUnicodeTest-1637078103 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'] {{(pid=87272) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 11:10:26 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-74a8453e-965d-4ee6-9b76-bd7b21c4b21d tempest-CinderUnicodeTest-1637078103 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 11:10:26 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-74a8453e-965d-4ee6-9b76-bd7b21c4b21d tempest-CinderUnicodeTest-1637078103 None] Selected osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898 as target Quobyte volume. {{(pid=87272) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 11:10:26 devstack cinder-volume[87272]: INFO cinder.volume.drivers.remotefs [None req-74a8453e-965d-4ee6-9b76-bd7b21c4b21d tempest-CinderUnicodeTest-1637078103 None] casted to osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898 Nov 04 11:10:26 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-74a8453e-965d-4ee6-9b76-bd7b21c4b21d tempest-CinderUnicodeTest-1637078103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-a4a53855-2b8d-46ee-a1df-13fc73836800 1073741824 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:10:26 devstack sudo[107099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-a4a53855-2b8d-46ee-a1df-13fc73836800 1073741824 Nov 04 11:10:26 devstack sudo[107099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:10:26 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-24d17074-2a21-4770-ae90-4b18eac61fc9 tempest-VolumeDependencyTests-1837957763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (020e28ab-858a-45b4-998e-87b2c5e87a12) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e8ee4bef-ab89-4a87-ba6e-98309c90695b', 'volume_size': 1, 'snapshot_id': '81a511a0-3a36-4ca1-8000-83297231be06'}' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:10:26 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-24d17074-2a21-4770-ae90-4b18eac61fc9 tempest-VolumeDependencyTests-1837957763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a70493fa-cd51-4aa7-bece-5289a52edaa5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:10:26 devstack cinder-volume[87272]: INFO cinder.volume.flows.manager.create_volume [None req-24d17074-2a21-4770-ae90-4b18eac61fc9 tempest-VolumeDependencyTests-1837957763 None] Volume volume-e8ee4bef-ab89-4a87-ba6e-98309c90695b (e8ee4bef-ab89-4a87-ba6e-98309c90695b): created successfully Nov 04 11:10:26 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-24d17074-2a21-4770-ae90-4b18eac61fc9 tempest-VolumeDependencyTests-1837957763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a70493fa-cd51-4aa7-bece-5289a52edaa5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:10:26 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-24d17074-2a21-4770-ae90-4b18eac61fc9 tempest-VolumeDependencyTests-1837957763 None] Flow 'volume_create_manager' (2c38b697-b2ea-474f-9b59-f65a3fd458aa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87272) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 11:10:26 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-24d17074-2a21-4770-ae90-4b18eac61fc9 tempest-VolumeDependencyTests-1837957763 None] Created volume successfully. Nov 04 11:10:26 devstack sudo[107099]: pam_unix(sudo:session): session closed for user root Nov 04 11:10:26 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-74a8453e-965d-4ee6-9b76-bd7b21c4b21d tempest-CinderUnicodeTest-1637078103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-a4a53855-2b8d-46ee-a1df-13fc73836800 1073741824" returned: 0 in 0.556s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:10:26 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-74a8453e-965d-4ee6-9b76-bd7b21c4b21d tempest-CinderUnicodeTest-1637078103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-a4a53855-2b8d-46ee-a1df-13fc73836800 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:10:26 devstack sudo[107106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-a4a53855-2b8d-46ee-a1df-13fc73836800 Nov 04 11:10:26 devstack sudo[107106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:10:26 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-83f94fff-b27d-48b9-a65f-97200cdb6bc2 tempest-VolumeDependencyTests-1837957763 None] Acquiring lock "cinder-81a511a0-3a36-4ca1-8000-83297231be06-delete_snapshot" by "delete_snapshot" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 11:10:26 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-83f94fff-b27d-48b9-a65f-97200cdb6bc2 tempest-VolumeDependencyTests-1837957763 None] Lock "cinder-81a511a0-3a36-4ca1-8000-83297231be06-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 11:10:26 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-83f94fff-b27d-48b9-a65f-97200cdb6bc2 tempest-VolumeDependencyTests-1837957763 None] Acquiring lock "cinder-quobyte-c7281d58-bcc7-4a93-a593-e684f3310577" by "delete_snapshot" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 11:10:26 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-83f94fff-b27d-48b9-a65f-97200cdb6bc2 tempest-VolumeDependencyTests-1837957763 None] Lock "cinder-quobyte-c7281d58-bcc7-4a93-a593-e684f3310577" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 11:10:26 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-83f94fff-b27d-48b9-a65f-97200cdb6bc2 tempest-VolumeDependencyTests-1837957763 None] Acquiring lock "cinder-quobyte-81a511a0-3a36-4ca1-8000-83297231be06" by "_delete_snapshot" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 11:10:26 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-83f94fff-b27d-48b9-a65f-97200cdb6bc2 tempest-VolumeDependencyTests-1837957763 None] Lock "cinder-quobyte-81a511a0-3a36-4ca1-8000-83297231be06" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 11:10:26 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.remotefs [None req-83f94fff-b27d-48b9-a65f-97200cdb6bc2 tempest-VolumeDependencyTests-1837957763 None] Deleting offline snapshot 81a511a0-3a36-4ca1-8000-83297231be06 of volume c7281d58-bcc7-4a93-a593-e684f3310577 {{(pid=87272) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 04 11:10:27 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.remotefs [None req-83f94fff-b27d-48b9-a65f-97200cdb6bc2 tempest-VolumeDependencyTests-1837957763 None] snapshot_file for this snap is: volume-c7281d58-bcc7-4a93-a593-e684f3310577.81a511a0-3a36-4ca1-8000-83297231be06 {{(pid=87272) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 04 11:10:27 devstack cinder-volume[87272]: DEBUG oslo.privsep.daemon [-] privsep: reply[24dfae73-7fac-4576-9dbe-b9a856ea15ad]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 11:10:27 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-83f94fff-b27d-48b9-a65f-97200cdb6bc2 tempest-VolumeDependencyTests-1837957763 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-c7281d58-bcc7-4a93-a593-e684f3310577.81a511a0-3a36-4ca1-8000-83297231be06 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:10:27 devstack sudo[107106]: pam_unix(sudo:session): session closed for user root Nov 04 11:10:27 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-74a8453e-965d-4ee6-9b76-bd7b21c4b21d tempest-CinderUnicodeTest-1637078103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-a4a53855-2b8d-46ee-a1df-13fc73836800" returned: 0 in 0.386s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:10:27 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-74a8453e-965d-4ee6-9b76-bd7b21c4b21d tempest-CinderUnicodeTest-1637078103 None] <== create_volume: return (996ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'} {{(pid=87272) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 04 11:10:27 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-74a8453e-965d-4ee6-9b76-bd7b21c4b21d tempest-CinderUnicodeTest-1637078103 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.000s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 11:10:27 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-74a8453e-965d-4ee6-9b76-bd7b21c4b21d tempest-CinderUnicodeTest-1637078103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67205a7f-63c8-48e5-843f-77260abda8e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a4a53855-2b8d-46ee-a1df-13fc73836800', 'volume_size': 1}' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:10:27 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-74a8453e-965d-4ee6-9b76-bd7b21c4b21d tempest-CinderUnicodeTest-1637078103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a632c1f-d340-4c10-a0fb-a97aba174df0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:10:27 devstack cinder-volume[87272]: INFO cinder.volume.flows.manager.create_volume [None req-74a8453e-965d-4ee6-9b76-bd7b21c4b21d tempest-CinderUnicodeTest-1637078103 None] Volume volume-a4a53855-2b8d-46ee-a1df-13fc73836800 (a4a53855-2b8d-46ee-a1df-13fc73836800): created successfully Nov 04 11:10:27 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-74a8453e-965d-4ee6-9b76-bd7b21c4b21d tempest-CinderUnicodeTest-1637078103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a632c1f-d340-4c10-a0fb-a97aba174df0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:10:27 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-74a8453e-965d-4ee6-9b76-bd7b21c4b21d tempest-CinderUnicodeTest-1637078103 None] Flow 'volume_create_manager' (d530b4eb-1767-4baf-9c4c-1aca285c9f5d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87272) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 11:10:27 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-74a8453e-965d-4ee6-9b76-bd7b21c4b21d tempest-CinderUnicodeTest-1637078103 None] Created volume successfully. Nov 04 11:10:27 devstack sudo[107110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-c7281d58-bcc7-4a93-a593-e684f3310577.81a511a0-3a36-4ca1-8000-83297231be06 Nov 04 11:10:27 devstack sudo[107110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:10:27 devstack sudo[107110]: pam_unix(sudo:session): session closed for user root Nov 04 11:10:27 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-83f94fff-b27d-48b9-a65f-97200cdb6bc2 tempest-VolumeDependencyTests-1837957763 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-c7281d58-bcc7-4a93-a593-e684f3310577.81a511a0-3a36-4ca1-8000-83297231be06" returned: 0 in 0.379s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:10:27 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.remotefs [None req-83f94fff-b27d-48b9-a65f-97200cdb6bc2 tempest-VolumeDependencyTests-1837957763 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c7281d58-bcc7-4a93-a593-e684f3310577(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87272) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 11:10:27 devstack cinder-volume[87272]: DEBUG oslo.privsep.daemon [-] privsep: reply[4228dce4-8e2b-45f2-8b9f-73121d48929a]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 11:10:27 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-83f94fff-b27d-48b9-a65f-97200cdb6bc2 tempest-VolumeDependencyTests-1837957763 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-c7281d58-bcc7-4a93-a593-e684f3310577 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:10:27 devstack sudo[107115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-c7281d58-bcc7-4a93-a593-e684f3310577 Nov 04 11:10:27 devstack sudo[107115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:10:28 devstack sudo[107115]: pam_unix(sudo:session): session closed for user root Nov 04 11:10:28 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-83f94fff-b27d-48b9-a65f-97200cdb6bc2 tempest-VolumeDependencyTests-1837957763 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-c7281d58-bcc7-4a93-a593-e684f3310577" returned: 0 in 0.572s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:10:28 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-83f94fff-b27d-48b9-a65f-97200cdb6bc2 tempest-VolumeDependencyTests-1837957763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-c7281d58-bcc7-4a93-a593-e684f3310577.81a511a0-3a36-4ca1-8000-83297231be06 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:10:28 devstack sudo[107120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-c7281d58-bcc7-4a93-a593-e684f3310577.81a511a0-3a36-4ca1-8000-83297231be06 Nov 04 11:10:28 devstack sudo[107120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:10:28 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-1671ef3e-c699-4329-bd6d-16d021da01ed tempest-CinderUnicodeTest-1637078103 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 11:10:28 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-1671ef3e-c699-4329-bd6d-16d021da01ed tempest-CinderUnicodeTest-1637078103 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 11:10:28 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.remotefs [None req-1671ef3e-c699-4329-bd6d-16d021da01ed tempest-CinderUnicodeTest-1637078103 None] Creating offline snapshot ec8fafc8-5fcf-4043-a121-3babebc0ee7c of volume a4a53855-2b8d-46ee-a1df-13fc73836800 {{(pid=87272) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 04 11:10:28 devstack sudo[107120]: pam_unix(sudo:session): session closed for user root Nov 04 11:10:28 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-83f94fff-b27d-48b9-a65f-97200cdb6bc2 tempest-VolumeDependencyTests-1837957763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-c7281d58-bcc7-4a93-a593-e684f3310577.81a511a0-3a36-4ca1-8000-83297231be06" returned: 0 in 0.435s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:10:28 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-83f94fff-b27d-48b9-a65f-97200cdb6bc2 tempest-VolumeDependencyTests-1837957763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-c7281d58-bcc7-4a93-a593-e684f3310577.81a511a0-3a36-4ca1-8000-83297231be06 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:10:28 devstack cinder-volume[87272]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d76da53-7d00-4a69-80d2-7ef86f7427f9]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 11:10:28 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-1671ef3e-c699-4329-bd6d-16d021da01ed tempest-CinderUnicodeTest-1637078103 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-a4a53855-2b8d-46ee-a1df-13fc73836800 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:10:28 devstack sudo[107125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-c7281d58-bcc7-4a93-a593-e684f3310577.81a511a0-3a36-4ca1-8000-83297231be06 Nov 04 11:10:28 devstack sudo[107125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:10:28 devstack sudo[107126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-a4a53855-2b8d-46ee-a1df-13fc73836800 Nov 04 11:10:28 devstack sudo[107126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:10:28 devstack sudo[107125]: pam_unix(sudo:session): session closed for user root Nov 04 11:10:28 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-83f94fff-b27d-48b9-a65f-97200cdb6bc2 tempest-VolumeDependencyTests-1837957763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-c7281d58-bcc7-4a93-a593-e684f3310577.81a511a0-3a36-4ca1-8000-83297231be06" returned: 0 in 0.355s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:10:28 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-83f94fff-b27d-48b9-a65f-97200cdb6bc2 tempest-VolumeDependencyTests-1837957763 None] Lock "cinder-quobyte-81a511a0-3a36-4ca1-8000-83297231be06" released by "_delete_snapshot" :: held 1.886s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 11:10:28 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-83f94fff-b27d-48b9-a65f-97200cdb6bc2 tempest-VolumeDependencyTests-1837957763 None] Lock "cinder-quobyte-c7281d58-bcc7-4a93-a593-e684f3310577" released by "delete_snapshot" :: held 1.914s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 11:10:28 devstack sudo[107126]: pam_unix(sudo:session): session closed for user root Nov 04 11:10:28 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-1671ef3e-c699-4329-bd6d-16d021da01ed tempest-CinderUnicodeTest-1637078103 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-a4a53855-2b8d-46ee-a1df-13fc73836800" returned: 0 in 0.481s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:10:28 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-1671ef3e-c699-4329-bd6d-16d021da01ed tempest-CinderUnicodeTest-1637078103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-a4a53855-2b8d-46ee-a1df-13fc73836800,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-a4a53855-2b8d-46ee-a1df-13fc73836800.ec8fafc8-5fcf-4043-a121-3babebc0ee7c 1G {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:10:28 devstack cinder-volume[87272]: DEBUG cinder.quota [None req-83f94fff-b27d-48b9-a65f-97200cdb6bc2 tempest-VolumeDependencyTests-1837957763 None] Created reservations ['d3ddef10-0c67-4040-934a-06afd570fb76', '98904668-f5d5-4b96-94c9-a697c340c463', 'bcac4cc4-f254-4dd3-a0d6-e4de7d9093ba', '14ec42ee-ccc0-41e3-b1ac-2e22164ae73d'] {{(pid=87272) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 11:10:28 devstack sudo[107133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-a4a53855-2b8d-46ee-a1df-13fc73836800,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-a4a53855-2b8d-46ee-a1df-13fc73836800.ec8fafc8-5fcf-4043-a121-3babebc0ee7c 1G Nov 04 11:10:28 devstack sudo[107133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:10:29 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-83f94fff-b27d-48b9-a65f-97200cdb6bc2 tempest-VolumeDependencyTests-1837957763 None] Delete snapshot completed successfully. Nov 04 11:10:29 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-83f94fff-b27d-48b9-a65f-97200cdb6bc2 tempest-VolumeDependencyTests-1837957763 None] Lock "cinder-81a511a0-3a36-4ca1-8000-83297231be06-delete_snapshot" released by "delete_snapshot" :: held 2.117s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 11:10:29 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-f6c11e5d-611e-41be-a4bd-a7049021f4be tempest-VolumeDependencyTests-1837957763 None] Acquiring lock "cinder-c7281d58-bcc7-4a93-a593-e684f3310577-delete_volume" by "delete_volume" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 11:10:29 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-f6c11e5d-611e-41be-a4bd-a7049021f4be tempest-VolumeDependencyTests-1837957763 None] Lock "cinder-c7281d58-bcc7-4a93-a593-e684f3310577-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 11:10:29 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-f6c11e5d-611e-41be-a4bd-a7049021f4be tempest-VolumeDependencyTests-1837957763 None] Acquiring lock "cinder-quobyte-c7281d58-bcc7-4a93-a593-e684f3310577" by "delete_volume" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 11:10:29 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-f6c11e5d-611e-41be-a4bd-a7049021f4be tempest-VolumeDependencyTests-1837957763 None] Lock "cinder-quobyte-c7281d58-bcc7-4a93-a593-e684f3310577" acquired by "delete_volume" :: waited 0.028s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 11:10:29 devstack cinder-volume[87272]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd7eb0d2-71b0-4940-8d06-dd656fa45791]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 11:10:29 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-f6c11e5d-611e-41be-a4bd-a7049021f4be tempest-VolumeDependencyTests-1837957763 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-c7281d58-bcc7-4a93-a593-e684f3310577 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:10:29 devstack sudo[107139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-c7281d58-bcc7-4a93-a593-e684f3310577 Nov 04 11:10:29 devstack sudo[107139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:10:29 devstack sudo[107133]: pam_unix(sudo:session): session closed for user root Nov 04 11:10:29 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-1671ef3e-c699-4329-bd6d-16d021da01ed tempest-CinderUnicodeTest-1637078103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-a4a53855-2b8d-46ee-a1df-13fc73836800,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-a4a53855-2b8d-46ee-a1df-13fc73836800.ec8fafc8-5fcf-4043-a121-3babebc0ee7c 1G" returned: 0 in 0.540s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:10:29 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-1671ef3e-c699-4329-bd6d-16d021da01ed tempest-CinderUnicodeTest-1637078103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a4a53855-2b8d-46ee-a1df-13fc73836800 -F qcow2 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-a4a53855-2b8d-46ee-a1df-13fc73836800.ec8fafc8-5fcf-4043-a121-3babebc0ee7c {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:10:29 devstack sudo[107141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a4a53855-2b8d-46ee-a1df-13fc73836800 -F qcow2 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-a4a53855-2b8d-46ee-a1df-13fc73836800.ec8fafc8-5fcf-4043-a121-3babebc0ee7c Nov 04 11:10:29 devstack sudo[107141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:10:29 devstack sudo[107139]: pam_unix(sudo:session): session closed for user root Nov 04 11:10:29 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-f6c11e5d-611e-41be-a4bd-a7049021f4be tempest-VolumeDependencyTests-1837957763 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-c7281d58-bcc7-4a93-a593-e684f3310577" returned: 0 in 0.416s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:10:29 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-f6c11e5d-611e-41be-a4bd-a7049021f4be tempest-VolumeDependencyTests-1837957763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-c7281d58-bcc7-4a93-a593-e684f3310577 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:10:29 devstack sudo[107146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-c7281d58-bcc7-4a93-a593-e684f3310577 Nov 04 11:10:29 devstack sudo[107146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:10:29 devstack sudo[107141]: pam_unix(sudo:session): session closed for user root Nov 04 11:10:29 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-1671ef3e-c699-4329-bd6d-16d021da01ed tempest-CinderUnicodeTest-1637078103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a4a53855-2b8d-46ee-a1df-13fc73836800 -F qcow2 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-a4a53855-2b8d-46ee-a1df-13fc73836800.ec8fafc8-5fcf-4043-a121-3babebc0ee7c" returned: 0 in 0.321s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:10:29 devstack cinder-volume[87272]: WARNING cinder.volume.drivers.remotefs [None req-1671ef3e-c699-4329-bd6d-16d021da01ed tempest-CinderUnicodeTest-1637078103 None] /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-a4a53855-2b8d-46ee-a1df-13fc73836800.ec8fafc8-5fcf-4043-a121-3babebc0ee7c is being set with open permissions: ugo+rw Nov 04 11:10:29 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-1671ef3e-c699-4329-bd6d-16d021da01ed tempest-CinderUnicodeTest-1637078103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-a4a53855-2b8d-46ee-a1df-13fc73836800.ec8fafc8-5fcf-4043-a121-3babebc0ee7c {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:10:29 devstack sudo[107151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-a4a53855-2b8d-46ee-a1df-13fc73836800.ec8fafc8-5fcf-4043-a121-3babebc0ee7c Nov 04 11:10:29 devstack sudo[107151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:10:29 devstack sudo[107146]: pam_unix(sudo:session): session closed for user root Nov 04 11:10:29 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-f6c11e5d-611e-41be-a4bd-a7049021f4be tempest-VolumeDependencyTests-1837957763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-c7281d58-bcc7-4a93-a593-e684f3310577" returned: 0 in 0.273s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:10:29 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-f6c11e5d-611e-41be-a4bd-a7049021f4be tempest-VolumeDependencyTests-1837957763 None] Lock "cinder-quobyte-c7281d58-bcc7-4a93-a593-e684f3310577" released by "delete_volume" :: held 0.783s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 11:10:30 devstack cinder-volume[87272]: DEBUG cinder.quota [None req-f6c11e5d-611e-41be-a4bd-a7049021f4be tempest-VolumeDependencyTests-1837957763 None] Created reservations ['1d5ba734-521a-4b33-95de-3bbbd811a109', '55e67e7a-9083-499a-b058-9102a84a6356', 'ba0ff712-f49e-4d3f-b978-eac2b8f6fc01', '68fa972c-ce4b-4b7a-8fdd-1e84a2088365'] {{(pid=87272) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 11:10:30 devstack sudo[107151]: pam_unix(sudo:session): session closed for user root Nov 04 11:10:30 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-1671ef3e-c699-4329-bd6d-16d021da01ed tempest-CinderUnicodeTest-1637078103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-a4a53855-2b8d-46ee-a1df-13fc73836800.ec8fafc8-5fcf-4043-a121-3babebc0ee7c" returned: 0 in 0.315s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:10:30 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-f6c11e5d-611e-41be-a4bd-a7049021f4be tempest-VolumeDependencyTests-1837957763 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 11:10:30 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-f6c11e5d-611e-41be-a4bd-a7049021f4be tempest-VolumeDependencyTests-1837957763 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 11:10:30 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-f6c11e5d-611e-41be-a4bd-a7049021f4be tempest-VolumeDependencyTests-1837957763 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898': None} {{(pid=87272) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 11:10:30 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-f6c11e5d-611e-41be-a4bd-a7049021f4be tempest-VolumeDependencyTests-1837957763 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'] {{(pid=87272) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 11:10:30 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-f6c11e5d-611e-41be-a4bd-a7049021f4be tempest-VolumeDependencyTests-1837957763 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 11:10:30 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-f6c11e5d-611e-41be-a4bd-a7049021f4be tempest-VolumeDependencyTests-1837957763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:10:30 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-1671ef3e-c699-4329-bd6d-16d021da01ed tempest-CinderUnicodeTest-1637078103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-a4a53855-2b8d-46ee-a1df-13fc73836800.info {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:10:30 devstack sudo[107155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1 Nov 04 11:10:30 devstack sudo[107155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:10:30 devstack sudo[107157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-a4a53855-2b8d-46ee-a1df-13fc73836800.info Nov 04 11:10:30 devstack sudo[107157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:10:30 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-4a6e0ad5-83cf-4a9e-bbcf-d11d5a29385f tempest-VolumeDependencyTests-1837957763 None] Acquiring lock "cinder-e8ee4bef-ab89-4a87-ba6e-98309c90695b-delete_volume" by "delete_volume" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 11:10:30 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-4a6e0ad5-83cf-4a9e-bbcf-d11d5a29385f tempest-VolumeDependencyTests-1837957763 None] Lock "cinder-e8ee4bef-ab89-4a87-ba6e-98309c90695b-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 11:10:30 devstack sudo[107155]: pam_unix(sudo:session): session closed for user root Nov 04 11:10:30 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-f6c11e5d-611e-41be-a4bd-a7049021f4be tempest-VolumeDependencyTests-1837957763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1" returned: 0 in 0.374s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:10:30 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-4a6e0ad5-83cf-4a9e-bbcf-d11d5a29385f tempest-VolumeDependencyTests-1837957763 None] Acquiring lock "cinder-quobyte-e8ee4bef-ab89-4a87-ba6e-98309c90695b" by "delete_volume" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 11:10:30 devstack cinder-volume[87272]: DEBUG cinder.manager [None req-f6c11e5d-611e-41be-a4bd-a7049021f4be tempest-VolumeDependencyTests-1837957763 None] Notifying Schedulers of capabilities ... {{(pid=87272) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 11:10:30 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-f6c11e5d-611e-41be-a4bd-a7049021f4be tempest-VolumeDependencyTests-1837957763 None] Deleted volume successfully. Nov 04 11:10:30 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-4a6e0ad5-83cf-4a9e-bbcf-d11d5a29385f tempest-VolumeDependencyTests-1837957763 None] Lock "cinder-quobyte-e8ee4bef-ab89-4a87-ba6e-98309c90695b" acquired by "delete_volume" :: waited 0.039s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 11:10:30 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-f6c11e5d-611e-41be-a4bd-a7049021f4be tempest-VolumeDependencyTests-1837957763 None] Lock "cinder-c7281d58-bcc7-4a93-a593-e684f3310577-delete_volume" released by "delete_volume" :: held 1.477s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 11:10:30 devstack cinder-volume[87272]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f2ff620-06cb-410d-bce9-563e8ce96af9]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 11:10:30 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-4a6e0ad5-83cf-4a9e-bbcf-d11d5a29385f tempest-VolumeDependencyTests-1837957763 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-e8ee4bef-ab89-4a87-ba6e-98309c90695b {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:10:30 devstack sudo[107157]: pam_unix(sudo:session): session closed for user root Nov 04 11:10:30 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-1671ef3e-c699-4329-bd6d-16d021da01ed tempest-CinderUnicodeTest-1637078103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-a4a53855-2b8d-46ee-a1df-13fc73836800.info" returned: 0 in 0.479s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:10:30 devstack cinder-volume[87272]: WARNING cinder.volume.drivers.remotefs [None req-1671ef3e-c699-4329-bd6d-16d021da01ed tempest-CinderUnicodeTest-1637078103 None] /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-a4a53855-2b8d-46ee-a1df-13fc73836800.info is being set with open permissions: ugo+rw Nov 04 11:10:30 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-1671ef3e-c699-4329-bd6d-16d021da01ed tempest-CinderUnicodeTest-1637078103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-a4a53855-2b8d-46ee-a1df-13fc73836800.info {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:10:30 devstack sudo[107162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-a4a53855-2b8d-46ee-a1df-13fc73836800.info Nov 04 11:10:30 devstack sudo[107162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:10:30 devstack sudo[107161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-e8ee4bef-ab89-4a87-ba6e-98309c90695b Nov 04 11:10:30 devstack sudo[107161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:10:30 devstack sudo[107162]: pam_unix(sudo:session): session closed for user root Nov 04 11:10:30 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-1671ef3e-c699-4329-bd6d-16d021da01ed tempest-CinderUnicodeTest-1637078103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-a4a53855-2b8d-46ee-a1df-13fc73836800.info" returned: 0 in 0.314s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:10:31 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-1671ef3e-c699-4329-bd6d-16d021da01ed tempest-CinderUnicodeTest-1637078103 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.610s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 11:10:31 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-1671ef3e-c699-4329-bd6d-16d021da01ed tempest-CinderUnicodeTest-1637078103 None] Create snapshot completed successfully Nov 04 11:10:31 devstack sudo[107161]: pam_unix(sudo:session): session closed for user root Nov 04 11:10:31 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-4a6e0ad5-83cf-4a9e-bbcf-d11d5a29385f tempest-VolumeDependencyTests-1837957763 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-e8ee4bef-ab89-4a87-ba6e-98309c90695b" returned: 0 in 0.488s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:10:31 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-4a6e0ad5-83cf-4a9e-bbcf-d11d5a29385f tempest-VolumeDependencyTests-1837957763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-e8ee4bef-ab89-4a87-ba6e-98309c90695b {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:10:31 devstack sudo[107169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-e8ee4bef-ab89-4a87-ba6e-98309c90695b Nov 04 11:10:31 devstack sudo[107169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:10:31 devstack sudo[107169]: pam_unix(sudo:session): session closed for user root Nov 04 11:10:31 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-4a6e0ad5-83cf-4a9e-bbcf-d11d5a29385f tempest-VolumeDependencyTests-1837957763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-e8ee4bef-ab89-4a87-ba6e-98309c90695b" returned: 0 in 0.253s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:10:31 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-4a6e0ad5-83cf-4a9e-bbcf-d11d5a29385f tempest-VolumeDependencyTests-1837957763 None] Lock "cinder-quobyte-e8ee4bef-ab89-4a87-ba6e-98309c90695b" released by "delete_volume" :: held 0.804s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 11:10:31 devstack cinder-volume[87272]: DEBUG cinder.quota [None req-4a6e0ad5-83cf-4a9e-bbcf-d11d5a29385f tempest-VolumeDependencyTests-1837957763 None] Created reservations ['b2841506-5e6a-4de6-b2ae-df72f54847d0', '8640db62-4b97-4bd4-84b9-223fd8b23525', 'cbf79236-49c6-45ad-8b1a-336a2f67c69b', '898db317-ada0-4cd8-91d6-6b7e2696805b'] {{(pid=87272) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 11:10:31 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-4a6e0ad5-83cf-4a9e-bbcf-d11d5a29385f tempest-VolumeDependencyTests-1837957763 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 11:10:31 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-4a6e0ad5-83cf-4a9e-bbcf-d11d5a29385f tempest-VolumeDependencyTests-1837957763 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 11:10:31 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-4a6e0ad5-83cf-4a9e-bbcf-d11d5a29385f tempest-VolumeDependencyTests-1837957763 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898': None} {{(pid=87272) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 11:10:31 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-4a6e0ad5-83cf-4a9e-bbcf-d11d5a29385f tempest-VolumeDependencyTests-1837957763 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'] {{(pid=87272) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 11:10:31 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-4a6e0ad5-83cf-4a9e-bbcf-d11d5a29385f tempest-VolumeDependencyTests-1837957763 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 11:10:31 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-4a6e0ad5-83cf-4a9e-bbcf-d11d5a29385f tempest-VolumeDependencyTests-1837957763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:10:31 devstack sudo[107172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1 Nov 04 11:10:31 devstack sudo[107172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:10:31 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-84a5f3ec-0b53-49be-8ac4-ff2d517065eb tempest-CinderUnicodeTest-1637078103 None] Acquiring lock "cinder-ec8fafc8-5fcf-4043-a121-3babebc0ee7c-delete_snapshot" by "delete_snapshot" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 11:10:31 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-84a5f3ec-0b53-49be-8ac4-ff2d517065eb tempest-CinderUnicodeTest-1637078103 None] Lock "cinder-ec8fafc8-5fcf-4043-a121-3babebc0ee7c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.037s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 11:10:31 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-84a5f3ec-0b53-49be-8ac4-ff2d517065eb tempest-CinderUnicodeTest-1637078103 None] Acquiring lock "cinder-quobyte-a4a53855-2b8d-46ee-a1df-13fc73836800" by "delete_snapshot" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 11:10:31 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-84a5f3ec-0b53-49be-8ac4-ff2d517065eb tempest-CinderUnicodeTest-1637078103 None] Lock "cinder-quobyte-a4a53855-2b8d-46ee-a1df-13fc73836800" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 11:10:31 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-84a5f3ec-0b53-49be-8ac4-ff2d517065eb tempest-CinderUnicodeTest-1637078103 None] Acquiring lock "cinder-quobyte-ec8fafc8-5fcf-4043-a121-3babebc0ee7c" by "_delete_snapshot" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 11:10:31 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-84a5f3ec-0b53-49be-8ac4-ff2d517065eb tempest-CinderUnicodeTest-1637078103 None] Lock "cinder-quobyte-ec8fafc8-5fcf-4043-a121-3babebc0ee7c" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 11:10:31 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.remotefs [None req-84a5f3ec-0b53-49be-8ac4-ff2d517065eb tempest-CinderUnicodeTest-1637078103 None] Deleting offline snapshot ec8fafc8-5fcf-4043-a121-3babebc0ee7c of volume a4a53855-2b8d-46ee-a1df-13fc73836800 {{(pid=87272) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 04 11:10:31 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.remotefs [None req-84a5f3ec-0b53-49be-8ac4-ff2d517065eb tempest-CinderUnicodeTest-1637078103 None] snapshot_file for this snap is: volume-a4a53855-2b8d-46ee-a1df-13fc73836800.ec8fafc8-5fcf-4043-a121-3babebc0ee7c {{(pid=87272) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 04 11:10:31 devstack cinder-volume[87272]: DEBUG oslo.privsep.daemon [-] privsep: reply[73c7bb27-a053-4591-aae3-19f03a6a07aa]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 11:10:31 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-84a5f3ec-0b53-49be-8ac4-ff2d517065eb tempest-CinderUnicodeTest-1637078103 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-a4a53855-2b8d-46ee-a1df-13fc73836800.ec8fafc8-5fcf-4043-a121-3babebc0ee7c {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:10:31 devstack sudo[107174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-a4a53855-2b8d-46ee-a1df-13fc73836800.ec8fafc8-5fcf-4043-a121-3babebc0ee7c Nov 04 11:10:31 devstack sudo[107174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:10:31 devstack sudo[107172]: pam_unix(sudo:session): session closed for user root Nov 04 11:10:31 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-4a6e0ad5-83cf-4a9e-bbcf-d11d5a29385f tempest-VolumeDependencyTests-1837957763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1" returned: 0 in 0.360s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:10:31 devstack cinder-volume[87272]: DEBUG cinder.manager [None req-4a6e0ad5-83cf-4a9e-bbcf-d11d5a29385f tempest-VolumeDependencyTests-1837957763 None] Notifying Schedulers of capabilities ... {{(pid=87272) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 11:10:31 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-4a6e0ad5-83cf-4a9e-bbcf-d11d5a29385f tempest-VolumeDependencyTests-1837957763 None] Deleted volume successfully. Nov 04 11:10:31 devstack cinder-volume[87272]: DEBUG cinder.volume.flows.manager.create_volume [None req-8675f083-5bb6-4a47-be7c-9d8aa068cb73 tempest-VolumeImageDependencyTests-550591154 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87272) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 11:10:31 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-8675f083-5bb6-4a47-be7c-9d8aa068cb73 tempest-VolumeImageDependencyTests-550591154 None] Flow 'volume_create_manager' (2605579b-d20e-4750-87f0-e69e830bd33b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 11:10:31 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-8675f083-5bb6-4a47-be7c-9d8aa068cb73 tempest-VolumeImageDependencyTests-550591154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00206062-9b73-40bb-8215-aa8589052877) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:10:31 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-8675f083-5bb6-4a47-be7c-9d8aa068cb73 tempest-VolumeImageDependencyTests-550591154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00206062-9b73-40bb-8215-aa8589052877) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T10:10:32Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=95be210c-ee9b-4400-a455-ea079688ef12,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='89f06bfab7c44ed8bb6226f3ab914dcc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T10:10:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T10:10:32Z,use_quota=True,user_id='c9a29e08a0c9415ab007e7ebef9dfa84',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8989e4f-21e3-4f0a-9584-0d818784e883),volume_type_id=f8989e4f-21e3-4f0a-9584-0d818784e883)' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:10:31 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-8675f083-5bb6-4a47-be7c-9d8aa068cb73 tempest-VolumeImageDependencyTests-550591154 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb9c88e0-bfec-413f-beaa-09ad60bc9408) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:10:32 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-8675f083-5bb6-4a47-be7c-9d8aa068cb73 tempest-VolumeImageDependencyTests-550591154 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb9c88e0-bfec-413f-beaa-09ad60bc9408) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:10:32 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-8675f083-5bb6-4a47-be7c-9d8aa068cb73 tempest-VolumeImageDependencyTests-550591154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36a06bb3-f570-4b3f-950a-e813b4abfbfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:10:32 devstack cinder-volume[87272]: DEBUG cinder.image.glance [None req-8675f083-5bb6-4a47-be7c-9d8aa068cb73 tempest-VolumeImageDependencyTests-550591154 None] Creating Keystone auth plugin from conf {{(pid=87272) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 04 11:10:32 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-4a6e0ad5-83cf-4a9e-bbcf-d11d5a29385f tempest-VolumeDependencyTests-1837957763 None] Lock "cinder-e8ee4bef-ab89-4a87-ba6e-98309c90695b-delete_volume" released by "delete_volume" :: held 1.580s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 11:10:32 devstack sudo[107174]: pam_unix(sudo:session): session closed for user root Nov 04 11:10:32 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-84a5f3ec-0b53-49be-8ac4-ff2d517065eb tempest-CinderUnicodeTest-1637078103 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-a4a53855-2b8d-46ee-a1df-13fc73836800.ec8fafc8-5fcf-4043-a121-3babebc0ee7c" returned: 0 in 0.452s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:10:32 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.remotefs [None req-84a5f3ec-0b53-49be-8ac4-ff2d517065eb tempest-CinderUnicodeTest-1637078103 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a4a53855-2b8d-46ee-a1df-13fc73836800(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87272) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 11:10:32 devstack cinder-volume[87272]: DEBUG oslo.privsep.daemon [-] privsep: reply[54cd8e5a-e7bf-43fa-b7f6-23c50c882f2a]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 11:10:32 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-84a5f3ec-0b53-49be-8ac4-ff2d517065eb tempest-CinderUnicodeTest-1637078103 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-a4a53855-2b8d-46ee-a1df-13fc73836800 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:10:32 devstack sudo[107180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-a4a53855-2b8d-46ee-a1df-13fc73836800 Nov 04 11:10:32 devstack sudo[107180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:10:32 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-8675f083-5bb6-4a47-be7c-9d8aa068cb73 tempest-VolumeImageDependencyTests-550591154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36a06bb3-f570-4b3f-950a-e813b4abfbfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '95be210c-ee9b-4400-a455-ea079688ef12', 'volume_name': 'volume-95be210c-ee9b-4400-a455-ea079688ef12', 'volume_size': 1, 'image_id': '123bccac-644a-4526-8fd7-abd144c53891', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/123bccac-644a-4526-8fd7-abd144c53891', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '716b17b7a833b9cea981db984647c2bd', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '89f06bfab7c44ed8bb6226f3ab914dcc', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'f9b6c2addeb0053c7730e29f710c20c2d8734febe04e394861b088948b6fe59aaf7d9957610773d0b44fe5c7a31b28a82961254c2a30503f76e29f7c1cbf18ff', 'id': '123bccac-644a-4526-8fd7-abd144c53891', 'created_at': datetime.datetime(2026, 11, 4, 10, 10, 29, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 4, 10, 10, 31, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/123bccac-644a-4526-8fd7-abd144c53891/file', 'properties': {}}, 'image_service': }' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:10:32 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-8675f083-5bb6-4a47-be7c-9d8aa068cb73 tempest-VolumeImageDependencyTests-550591154 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f9a4fea-764b-4c3d-a4c3-32e8a329a1b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:10:32 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-8675f083-5bb6-4a47-be7c-9d8aa068cb73 tempest-VolumeImageDependencyTests-550591154 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f9a4fea-764b-4c3d-a4c3-32e8a329a1b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:10:32 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-8675f083-5bb6-4a47-be7c-9d8aa068cb73 tempest-VolumeImageDependencyTests-550591154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77c227ef-068d-44dd-b318-9ec653048804) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:10:32 devstack cinder-volume[87272]: INFO cinder.volume.flows.manager.create_volume [None req-8675f083-5bb6-4a47-be7c-9d8aa068cb73 tempest-VolumeImageDependencyTests-550591154 None] Volume 95be210c-ee9b-4400-a455-ea079688ef12: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-95be210c-ee9b-4400-a455-ea079688ef12', 'volume_size': 1, 'image_id': '123bccac-644a-4526-8fd7-abd144c53891', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/123bccac-644a-4526-8fd7-abd144c53891', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '716b17b7a833b9cea981db984647c2bd', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '89f06bfab7c44ed8bb6226f3ab914dcc', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'f9b6c2addeb0053c7730e29f710c20c2d8734febe04e394861b088948b6fe59aaf7d9957610773d0b44fe5c7a31b28a82961254c2a30503f76e29f7c1cbf18ff', 'id': '123bccac-644a-4526-8fd7-abd144c53891', 'created_at': datetime.datetime(2026, 11, 4, 10, 10, 29, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 4, 10, 10, 31, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/123bccac-644a-4526-8fd7-abd144c53891/file', 'properties': {}}, 'image_service': } Nov 04 11:10:32 devstack cinder-volume[87272]: DEBUG cinder.volume.flows.manager.create_volume [None req-8675f083-5bb6-4a47-be7c-9d8aa068cb73 tempest-VolumeImageDependencyTests-550591154 None] Trying to clone 95be210c-ee9b-4400-a455-ea079688ef12 from image 123bccac-644a-4526-8fd7-abd144c53891 at location (None, [{'url': 'file:///opt/stack/data/glance/images/123bccac-644a-4526-8fd7-abd144c53891', 'metadata': {}}]). {{(pid=87272) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 04 11:10:32 devstack cinder-volume[87272]: DEBUG cinder.image.image_utils [None req-8675f083-5bb6-4a47-be7c-9d8aa068cb73 tempest-VolumeImageDependencyTests-550591154 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_123bccac-644a-4526-8fd7-abd144c53891_oz6n31widevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87272) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Nov 04 11:10:32 devstack cinder-volume[87272]: INFO cinder.image.image_utils [None req-8675f083-5bb6-4a47-be7c-9d8aa068cb73 tempest-VolumeImageDependencyTests-550591154 None] Image download 0.00 MB at 0.00 MB/s Nov 04 11:10:32 devstack sudo[107180]: pam_unix(sudo:session): session closed for user root Nov 04 11:10:32 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-84a5f3ec-0b53-49be-8ac4-ff2d517065eb tempest-CinderUnicodeTest-1637078103 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-a4a53855-2b8d-46ee-a1df-13fc73836800" returned: 0 in 0.466s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:10:32 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-84a5f3ec-0b53-49be-8ac4-ff2d517065eb tempest-CinderUnicodeTest-1637078103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-a4a53855-2b8d-46ee-a1df-13fc73836800.ec8fafc8-5fcf-4043-a121-3babebc0ee7c {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:10:32 devstack cinder-volume[87272]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e461c76-7de9-4d6b-934a-44877b254337]: (4, 'raw') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 11:10:32 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-8675f083-5bb6-4a47-be7c-9d8aa068cb73 tempest-VolumeImageDependencyTests-550591154 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_123bccac-644a-4526-8fd7-abd144c53891_oz6n31widevstack@QuobyteHD {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:10:32 devstack sudo[107185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-a4a53855-2b8d-46ee-a1df-13fc73836800.ec8fafc8-5fcf-4043-a121-3babebc0ee7c Nov 04 11:10:32 devstack sudo[107185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:10:32 devstack sudo[107186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_123bccac-644a-4526-8fd7-abd144c53891_oz6n31widevstack@QuobyteHD Nov 04 11:10:32 devstack sudo[107186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:10:33 devstack sudo[107185]: pam_unix(sudo:session): session closed for user root Nov 04 11:10:33 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-84a5f3ec-0b53-49be-8ac4-ff2d517065eb tempest-CinderUnicodeTest-1637078103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-a4a53855-2b8d-46ee-a1df-13fc73836800.ec8fafc8-5fcf-4043-a121-3babebc0ee7c" returned: 0 in 0.466s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:10:33 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-84a5f3ec-0b53-49be-8ac4-ff2d517065eb tempest-CinderUnicodeTest-1637078103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-a4a53855-2b8d-46ee-a1df-13fc73836800.ec8fafc8-5fcf-4043-a121-3babebc0ee7c {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:10:33 devstack sudo[107227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-a4a53855-2b8d-46ee-a1df-13fc73836800.ec8fafc8-5fcf-4043-a121-3babebc0ee7c Nov 04 11:10:33 devstack sudo[107227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:10:33 devstack sudo[107186]: pam_unix(sudo:session): session closed for user root Nov 04 11:10:33 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-8675f083-5bb6-4a47-be7c-9d8aa068cb73 tempest-VolumeImageDependencyTests-550591154 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_123bccac-644a-4526-8fd7-abd144c53891_oz6n31widevstack@QuobyteHD" returned: 0 in 0.554s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:10:33 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-8675f083-5bb6-4a47-be7c-9d8aa068cb73 tempest-VolumeImageDependencyTests-550591154 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_123bccac-644a-4526-8fd7-abd144c53891_oz6n31widevstack@QuobyteHD {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:10:33 devstack sudo[107231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_123bccac-644a-4526-8fd7-abd144c53891_oz6n31widevstack@QuobyteHD Nov 04 11:10:33 devstack sudo[107231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:10:33 devstack sudo[107227]: pam_unix(sudo:session): session closed for user root Nov 04 11:10:33 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-84a5f3ec-0b53-49be-8ac4-ff2d517065eb tempest-CinderUnicodeTest-1637078103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-a4a53855-2b8d-46ee-a1df-13fc73836800.ec8fafc8-5fcf-4043-a121-3babebc0ee7c" returned: 0 in 0.368s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:10:33 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-84a5f3ec-0b53-49be-8ac4-ff2d517065eb tempest-CinderUnicodeTest-1637078103 None] Lock "cinder-quobyte-ec8fafc8-5fcf-4043-a121-3babebc0ee7c" released by "_delete_snapshot" :: held 1.944s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 11:10:33 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-84a5f3ec-0b53-49be-8ac4-ff2d517065eb tempest-CinderUnicodeTest-1637078103 None] Lock "cinder-quobyte-a4a53855-2b8d-46ee-a1df-13fc73836800" released by "delete_snapshot" :: held 1.984s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 11:10:33 devstack cinder-volume[87272]: DEBUG cinder.quota [None req-84a5f3ec-0b53-49be-8ac4-ff2d517065eb tempest-CinderUnicodeTest-1637078103 None] Created reservations ['6cb3969d-2739-4871-88fc-f4a25e240b27', '3c6097db-597d-4a47-9f35-ed9f86543548', 'b81ada87-5c87-4585-92db-3560a8170534', 'fad1a170-ee66-44d1-a95e-b4f08ba9aa5e'] {{(pid=87272) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 11:10:33 devstack sudo[107231]: pam_unix(sudo:session): session closed for user root Nov 04 11:10:33 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-8675f083-5bb6-4a47-be7c-9d8aa068cb73 tempest-VolumeImageDependencyTests-550591154 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_123bccac-644a-4526-8fd7-abd144c53891_oz6n31widevstack@QuobyteHD" returned: 1 in 0.480s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:10:33 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-8675f083-5bb6-4a47-be7c-9d8aa068cb73 tempest-VolumeImageDependencyTests-550591154 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_123bccac-644a-4526-8fd7-abd144c53891_oz6n31widevstack@QuobyteHD' failed. Not Retrying. {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 04 11:10:33 devstack cinder-volume[87272]: DEBUG cinder.image.image_utils [None req-8675f083-5bb6-4a47-be7c-9d8aa068cb73 tempest-VolumeImageDependencyTests-550591154 None] Temporary image 123bccac-644a-4526-8fd7-abd144c53891 is fetched for user c9a29e08a0c9415ab007e7ebef9dfa84. {{(pid=87272) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Nov 04 11:10:33 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-84a5f3ec-0b53-49be-8ac4-ff2d517065eb tempest-CinderUnicodeTest-1637078103 None] Delete snapshot completed successfully. Nov 04 11:10:33 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-84a5f3ec-0b53-49be-8ac4-ff2d517065eb tempest-CinderUnicodeTest-1637078103 None] Lock "cinder-ec8fafc8-5fcf-4043-a121-3babebc0ee7c-delete_snapshot" released by "delete_snapshot" :: held 2.225s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 11:10:33 devstack cinder-volume[87272]: DEBUG oslo.privsep.daemon [-] privsep: reply[46134f7e-5243-4058-a46d-1883b74da676]: (4, 'raw') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 11:10:33 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-8675f083-5bb6-4a47-be7c-9d8aa068cb73 tempest-VolumeImageDependencyTests-550591154 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_123bccac-644a-4526-8fd7-abd144c53891_oz6n31widevstack@QuobyteHD {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:10:34 devstack sudo[107239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_123bccac-644a-4526-8fd7-abd144c53891_oz6n31widevstack@QuobyteHD Nov 04 11:10:34 devstack sudo[107239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:10:34 devstack sudo[107239]: pam_unix(sudo:session): session closed for user root Nov 04 11:10:34 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-8675f083-5bb6-4a47-be7c-9d8aa068cb73 tempest-VolumeImageDependencyTests-550591154 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_123bccac-644a-4526-8fd7-abd144c53891_oz6n31widevstack@QuobyteHD" returned: 0 in 0.383s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:10:34 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-8675f083-5bb6-4a47-be7c-9d8aa068cb73 tempest-VolumeImageDependencyTests-550591154 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_123bccac-644a-4526-8fd7-abd144c53891_oz6n31widevstack@QuobyteHD {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:10:34 devstack sudo[107243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_123bccac-644a-4526-8fd7-abd144c53891_oz6n31widevstack@QuobyteHD Nov 04 11:10:34 devstack sudo[107243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:10:34 devstack sudo[107243]: pam_unix(sudo:session): session closed for user root Nov 04 11:10:34 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-8675f083-5bb6-4a47-be7c-9d8aa068cb73 tempest-VolumeImageDependencyTests-550591154 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_123bccac-644a-4526-8fd7-abd144c53891_oz6n31widevstack@QuobyteHD" returned: 1 in 0.363s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:10:34 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-8675f083-5bb6-4a47-be7c-9d8aa068cb73 tempest-VolumeImageDependencyTests-550591154 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_123bccac-644a-4526-8fd7-abd144c53891_oz6n31widevstack@QuobyteHD' failed. Not Retrying. {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 04 11:10:34 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-8675f083-5bb6-4a47-be7c-9d8aa068cb73 tempest-VolumeImageDependencyTests-550591154 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 11:10:34 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-8675f083-5bb6-4a47-be7c-9d8aa068cb73 tempest-VolumeImageDependencyTests-550591154 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 11:10:34 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-8675f083-5bb6-4a47-be7c-9d8aa068cb73 tempest-VolumeImageDependencyTests-550591154 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T10:10:32Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=95be210c-ee9b-4400-a455-ea079688ef12,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='89f06bfab7c44ed8bb6226f3ab914dcc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T10:10:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T10:10:32Z,use_quota=True,user_id='c9a29e08a0c9415ab007e7ebef9dfa84',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8989e4f-21e3-4f0a-9584-0d818784e883),volume_type_id=f8989e4f-21e3-4f0a-9584-0d818784e883)}" {{(pid=87272) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 04 11:10:34 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.remotefs [None req-8675f083-5bb6-4a47-be7c-9d8aa068cb73 tempest-VolumeImageDependencyTests-550591154 None] Creating volume 95be210c-ee9b-4400-a455-ea079688ef12 {{(pid=87272) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 11:10:34 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-8675f083-5bb6-4a47-be7c-9d8aa068cb73 tempest-VolumeImageDependencyTests-550591154 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 11:10:34 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-8675f083-5bb6-4a47-be7c-9d8aa068cb73 tempest-VolumeImageDependencyTests-550591154 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 11:10:34 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-8675f083-5bb6-4a47-be7c-9d8aa068cb73 tempest-VolumeImageDependencyTests-550591154 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898': None} {{(pid=87272) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 11:10:34 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-8675f083-5bb6-4a47-be7c-9d8aa068cb73 tempest-VolumeImageDependencyTests-550591154 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'] {{(pid=87272) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 11:10:34 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-8675f083-5bb6-4a47-be7c-9d8aa068cb73 tempest-VolumeImageDependencyTests-550591154 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 11:10:34 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-8675f083-5bb6-4a47-be7c-9d8aa068cb73 tempest-VolumeImageDependencyTests-550591154 None] Selected osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898 as target Quobyte volume. {{(pid=87272) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 11:10:34 devstack cinder-volume[87272]: INFO cinder.volume.drivers.remotefs [None req-8675f083-5bb6-4a47-be7c-9d8aa068cb73 tempest-VolumeImageDependencyTests-550591154 None] casted to osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898 Nov 04 11:10:34 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-8675f083-5bb6-4a47-be7c-9d8aa068cb73 tempest-VolumeImageDependencyTests-550591154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-95be210c-ee9b-4400-a455-ea079688ef12 1073741824 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:10:34 devstack sudo[107248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-95be210c-ee9b-4400-a455-ea079688ef12 1073741824 Nov 04 11:10:34 devstack sudo[107248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:10:34 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-64612ec9-578a-4305-97e5-48b196af6b74 tempest-CinderUnicodeTest-1637078103 None] Acquiring lock "cinder-a4a53855-2b8d-46ee-a1df-13fc73836800-delete_volume" by "delete_volume" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 11:10:34 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-64612ec9-578a-4305-97e5-48b196af6b74 tempest-CinderUnicodeTest-1637078103 None] Lock "cinder-a4a53855-2b8d-46ee-a1df-13fc73836800-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 11:10:34 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-64612ec9-578a-4305-97e5-48b196af6b74 tempest-CinderUnicodeTest-1637078103 None] Acquiring lock "cinder-quobyte-a4a53855-2b8d-46ee-a1df-13fc73836800" by "delete_volume" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 11:10:35 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-64612ec9-578a-4305-97e5-48b196af6b74 tempest-CinderUnicodeTest-1637078103 None] Lock "cinder-quobyte-a4a53855-2b8d-46ee-a1df-13fc73836800" acquired by "delete_volume" :: waited 0.021s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 11:10:35 devstack cinder-volume[87272]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c948846-0272-4096-8121-9b483c8defa9]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 11:10:35 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-64612ec9-578a-4305-97e5-48b196af6b74 tempest-CinderUnicodeTest-1637078103 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-a4a53855-2b8d-46ee-a1df-13fc73836800 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:10:35 devstack sudo[107254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-a4a53855-2b8d-46ee-a1df-13fc73836800 Nov 04 11:10:35 devstack sudo[107254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:10:35 devstack sudo[107248]: pam_unix(sudo:session): session closed for user root Nov 04 11:10:35 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-8675f083-5bb6-4a47-be7c-9d8aa068cb73 tempest-VolumeImageDependencyTests-550591154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-95be210c-ee9b-4400-a455-ea079688ef12 1073741824" returned: 0 in 0.565s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:10:35 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-8675f083-5bb6-4a47-be7c-9d8aa068cb73 tempest-VolumeImageDependencyTests-550591154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-95be210c-ee9b-4400-a455-ea079688ef12 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:10:35 devstack sudo[107256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-95be210c-ee9b-4400-a455-ea079688ef12 Nov 04 11:10:35 devstack sudo[107256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:10:35 devstack sudo[107254]: pam_unix(sudo:session): session closed for user root Nov 04 11:10:35 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-64612ec9-578a-4305-97e5-48b196af6b74 tempest-CinderUnicodeTest-1637078103 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-a4a53855-2b8d-46ee-a1df-13fc73836800" returned: 0 in 0.431s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:10:35 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-64612ec9-578a-4305-97e5-48b196af6b74 tempest-CinderUnicodeTest-1637078103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-a4a53855-2b8d-46ee-a1df-13fc73836800 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:10:35 devstack sudo[107261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-a4a53855-2b8d-46ee-a1df-13fc73836800 Nov 04 11:10:35 devstack sudo[107261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:10:35 devstack sudo[107256]: pam_unix(sudo:session): session closed for user root Nov 04 11:10:35 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-8675f083-5bb6-4a47-be7c-9d8aa068cb73 tempest-VolumeImageDependencyTests-550591154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-95be210c-ee9b-4400-a455-ea079688ef12" returned: 0 in 0.294s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:10:35 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-8675f083-5bb6-4a47-be7c-9d8aa068cb73 tempest-VolumeImageDependencyTests-550591154 None] <== create_volume: return (908ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'} {{(pid=87272) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 04 11:10:35 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-8675f083-5bb6-4a47-be7c-9d8aa068cb73 tempest-VolumeImageDependencyTests-550591154 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.911s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 11:10:35 devstack cinder-volume[87272]: DEBUG cinder.volume.volume_utils [None req-8675f083-5bb6-4a47-be7c-9d8aa068cb73 tempest-VolumeImageDependencyTests-550591154 None] Attempting download of 123bccac-644a-4526-8fd7-abd144c53891 ((None, [{'url': 'file:///opt/stack/data/glance/images/123bccac-644a-4526-8fd7-abd144c53891', 'metadata': {}}])) to volume 95be210c-ee9b-4400-a455-ea079688ef12. {{(pid=87272) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Nov 04 11:10:35 devstack cinder-volume[87272]: DEBUG oslo.privsep.daemon [-] privsep: reply[d83529a1-5ef7-4a96-bbae-55804daecafd]: (4, 'raw') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 11:10:35 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-8675f083-5bb6-4a47-be7c-9d8aa068cb73 tempest-VolumeImageDependencyTests-550591154 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_123bccac-644a-4526-8fd7-abd144c53891_bpn3da1u {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:10:35 devstack sudo[107264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_123bccac-644a-4526-8fd7-abd144c53891_bpn3da1u Nov 04 11:10:35 devstack sudo[107264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:10:35 devstack sudo[107261]: pam_unix(sudo:session): session closed for user root Nov 04 11:10:35 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-64612ec9-578a-4305-97e5-48b196af6b74 tempest-CinderUnicodeTest-1637078103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-a4a53855-2b8d-46ee-a1df-13fc73836800" returned: 0 in 0.303s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:10:35 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-64612ec9-578a-4305-97e5-48b196af6b74 tempest-CinderUnicodeTest-1637078103 None] Lock "cinder-quobyte-a4a53855-2b8d-46ee-a1df-13fc73836800" released by "delete_volume" :: held 0.825s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 11:10:35 devstack cinder-volume[87272]: DEBUG cinder.quota [None req-64612ec9-578a-4305-97e5-48b196af6b74 tempest-CinderUnicodeTest-1637078103 None] Created reservations ['4f0a573d-972f-46ac-9ed1-715ce4c3b555', 'fd77cca0-d8b9-41d3-9bee-836984add01c', '526d546a-1731-4739-b3bd-4ec65149b4de', '2f18bc9f-b4a4-494b-8fc1-9503d3f8ddbc'] {{(pid=87272) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 11:10:35 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-64612ec9-578a-4305-97e5-48b196af6b74 tempest-CinderUnicodeTest-1637078103 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 11:10:35 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-64612ec9-578a-4305-97e5-48b196af6b74 tempest-CinderUnicodeTest-1637078103 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 11:10:35 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-64612ec9-578a-4305-97e5-48b196af6b74 tempest-CinderUnicodeTest-1637078103 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898': None} {{(pid=87272) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 11:10:35 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-64612ec9-578a-4305-97e5-48b196af6b74 tempest-CinderUnicodeTest-1637078103 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'] {{(pid=87272) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 11:10:35 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-64612ec9-578a-4305-97e5-48b196af6b74 tempest-CinderUnicodeTest-1637078103 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 11:10:35 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-64612ec9-578a-4305-97e5-48b196af6b74 tempest-CinderUnicodeTest-1637078103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:10:36 devstack sudo[107269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1 Nov 04 11:10:36 devstack sudo[107269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:10:36 devstack sudo[107264]: pam_unix(sudo:session): session closed for user root Nov 04 11:10:36 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-8675f083-5bb6-4a47-be7c-9d8aa068cb73 tempest-VolumeImageDependencyTests-550591154 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_123bccac-644a-4526-8fd7-abd144c53891_bpn3da1u" returned: 0 in 0.356s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:10:36 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-8675f083-5bb6-4a47-be7c-9d8aa068cb73 tempest-VolumeImageDependencyTests-550591154 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_123bccac-644a-4526-8fd7-abd144c53891_bpn3da1u {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:10:36 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-7cc0d428-440a-466b-83a5-819d4988cb80 tempest-CinderUnicodeTest-1637078103 None] Acquiring lock "cinder-919a00f7-1435-4bef-b0eb-da8f4738a3bd-delete_volume" by "delete_volume" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 11:10:36 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-7cc0d428-440a-466b-83a5-819d4988cb80 tempest-CinderUnicodeTest-1637078103 None] Lock "cinder-919a00f7-1435-4bef-b0eb-da8f4738a3bd-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 11:10:36 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-7cc0d428-440a-466b-83a5-819d4988cb80 tempest-CinderUnicodeTest-1637078103 None] Acquiring lock "cinder-quobyte-919a00f7-1435-4bef-b0eb-da8f4738a3bd" by "delete_volume" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 11:10:36 devstack sudo[107271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_123bccac-644a-4526-8fd7-abd144c53891_bpn3da1u Nov 04 11:10:36 devstack sudo[107271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:10:36 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-7cc0d428-440a-466b-83a5-819d4988cb80 tempest-CinderUnicodeTest-1637078103 None] Lock "cinder-quobyte-919a00f7-1435-4bef-b0eb-da8f4738a3bd" acquired by "delete_volume" :: waited 0.041s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 11:10:36 devstack cinder-volume[87272]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ef91340-b25a-416c-88ca-bce65913d25c]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 11:10:36 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-7cc0d428-440a-466b-83a5-819d4988cb80 tempest-CinderUnicodeTest-1637078103 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-919a00f7-1435-4bef-b0eb-da8f4738a3bd {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:10:36 devstack sudo[107269]: pam_unix(sudo:session): session closed for user root Nov 04 11:10:36 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-64612ec9-578a-4305-97e5-48b196af6b74 tempest-CinderUnicodeTest-1637078103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1" returned: 0 in 0.446s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:10:36 devstack cinder-volume[87272]: DEBUG cinder.manager [None req-64612ec9-578a-4305-97e5-48b196af6b74 tempest-CinderUnicodeTest-1637078103 None] Notifying Schedulers of capabilities ... {{(pid=87272) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 11:10:36 devstack sudo[107273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-919a00f7-1435-4bef-b0eb-da8f4738a3bd Nov 04 11:10:36 devstack sudo[107273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:10:36 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-64612ec9-578a-4305-97e5-48b196af6b74 tempest-CinderUnicodeTest-1637078103 None] Deleted volume successfully. Nov 04 11:10:36 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-64612ec9-578a-4305-97e5-48b196af6b74 tempest-CinderUnicodeTest-1637078103 None] Lock "cinder-a4a53855-2b8d-46ee-a1df-13fc73836800-delete_volume" released by "delete_volume" :: held 1.586s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 11:10:36 devstack sudo[107271]: pam_unix(sudo:session): session closed for user root Nov 04 11:10:36 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-8675f083-5bb6-4a47-be7c-9d8aa068cb73 tempest-VolumeImageDependencyTests-550591154 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_123bccac-644a-4526-8fd7-abd144c53891_bpn3da1u" returned: 1 in 0.459s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:10:36 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-8675f083-5bb6-4a47-be7c-9d8aa068cb73 tempest-VolumeImageDependencyTests-550591154 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_123bccac-644a-4526-8fd7-abd144c53891_bpn3da1u' failed. Not Retrying. {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 04 11:10:36 devstack cinder-volume[87272]: DEBUG oslo.privsep.daemon [-] privsep: reply[a21b3da6-a7ed-4f10-b3e1-3002d3221350]: (4, 'raw') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 11:10:36 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-8675f083-5bb6-4a47-be7c-9d8aa068cb73 tempest-VolumeImageDependencyTests-550591154 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_123bccac-644a-4526-8fd7-abd144c53891_oz6n31widevstack@QuobyteHD {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:10:36 devstack sudo[107278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_123bccac-644a-4526-8fd7-abd144c53891_oz6n31widevstack@QuobyteHD Nov 04 11:10:36 devstack sudo[107278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:10:36 devstack sudo[107273]: pam_unix(sudo:session): session closed for user root Nov 04 11:10:36 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-7cc0d428-440a-466b-83a5-819d4988cb80 tempest-CinderUnicodeTest-1637078103 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-919a00f7-1435-4bef-b0eb-da8f4738a3bd" returned: 0 in 0.441s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:10:36 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-7cc0d428-440a-466b-83a5-819d4988cb80 tempest-CinderUnicodeTest-1637078103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-919a00f7-1435-4bef-b0eb-da8f4738a3bd {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:10:36 devstack sudo[107284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-919a00f7-1435-4bef-b0eb-da8f4738a3bd Nov 04 11:10:36 devstack sudo[107284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:10:36 devstack sudo[107278]: pam_unix(sudo:session): session closed for user root Nov 04 11:10:36 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-8675f083-5bb6-4a47-be7c-9d8aa068cb73 tempest-VolumeImageDependencyTests-550591154 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_123bccac-644a-4526-8fd7-abd144c53891_oz6n31widevstack@QuobyteHD" returned: 0 in 0.375s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:10:36 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-8675f083-5bb6-4a47-be7c-9d8aa068cb73 tempest-VolumeImageDependencyTests-550591154 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_123bccac-644a-4526-8fd7-abd144c53891_oz6n31widevstack@QuobyteHD {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:10:37 devstack sudo[107288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_123bccac-644a-4526-8fd7-abd144c53891_oz6n31widevstack@QuobyteHD Nov 04 11:10:37 devstack sudo[107288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:10:37 devstack sudo[107284]: pam_unix(sudo:session): session closed for user root Nov 04 11:10:37 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-7cc0d428-440a-466b-83a5-819d4988cb80 tempest-CinderUnicodeTest-1637078103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-919a00f7-1435-4bef-b0eb-da8f4738a3bd" returned: 0 in 0.344s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:10:37 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-7cc0d428-440a-466b-83a5-819d4988cb80 tempest-CinderUnicodeTest-1637078103 None] Lock "cinder-quobyte-919a00f7-1435-4bef-b0eb-da8f4738a3bd" released by "delete_volume" :: held 0.843s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 11:10:37 devstack cinder-volume[87272]: DEBUG cinder.quota [None req-7cc0d428-440a-466b-83a5-819d4988cb80 tempest-CinderUnicodeTest-1637078103 None] Created reservations ['761e1fff-17b1-4262-af00-314bd36ed898', '233a5adf-00e8-4197-991a-651c4c8dc889', '5264b875-121c-4e47-8804-69d8cff66990', '251f6389-43aa-44e4-a9dc-e45d8e1e3a49'] {{(pid=87272) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 11:10:37 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-7cc0d428-440a-466b-83a5-819d4988cb80 tempest-CinderUnicodeTest-1637078103 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 11:10:37 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-7cc0d428-440a-466b-83a5-819d4988cb80 tempest-CinderUnicodeTest-1637078103 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 11:10:37 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-7cc0d428-440a-466b-83a5-819d4988cb80 tempest-CinderUnicodeTest-1637078103 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898': None} {{(pid=87272) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 11:10:37 devstack sudo[107288]: pam_unix(sudo:session): session closed for user root Nov 04 11:10:37 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-7cc0d428-440a-466b-83a5-819d4988cb80 tempest-CinderUnicodeTest-1637078103 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'] {{(pid=87272) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 11:10:37 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-7cc0d428-440a-466b-83a5-819d4988cb80 tempest-CinderUnicodeTest-1637078103 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 11:10:37 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-7cc0d428-440a-466b-83a5-819d4988cb80 tempest-CinderUnicodeTest-1637078103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:10:37 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-8675f083-5bb6-4a47-be7c-9d8aa068cb73 tempest-VolumeImageDependencyTests-550591154 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_123bccac-644a-4526-8fd7-abd144c53891_oz6n31widevstack@QuobyteHD" returned: 1 in 0.452s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:10:37 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-8675f083-5bb6-4a47-be7c-9d8aa068cb73 tempest-VolumeImageDependencyTests-550591154 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_123bccac-644a-4526-8fd7-abd144c53891_oz6n31widevstack@QuobyteHD' failed. Not Retrying. {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 04 11:10:37 devstack cinder-volume[87272]: DEBUG cinder.image.image_utils [None req-8675f083-5bb6-4a47-be7c-9d8aa068cb73 tempest-VolumeImageDependencyTests-550591154 None] 123bccac-644a-4526-8fd7-abd144c53891 was raw, converting to qcow2 {{(pid=87272) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Nov 04 11:10:37 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-8675f083-5bb6-4a47-be7c-9d8aa068cb73 tempest-VolumeImageDependencyTests-550591154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_123bccac-644a-4526-8fd7-abd144c53891_oz6n31widevstack@QuobyteHD /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-95be210c-ee9b-4400-a455-ea079688ef12 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:10:37 devstack sudo[107294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1 Nov 04 11:10:37 devstack sudo[107294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:10:37 devstack cinder-volume[87272]: DEBUG cinder.volume.flows.manager.create_volume [None req-0492ec31-7e0d-4fd1-9cae-bf9426be4b68 tempest-ProjectReaderTests-438802722 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87272) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 11:10:37 devstack sudo[107295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_123bccac-644a-4526-8fd7-abd144c53891_oz6n31widevstack@QuobyteHD /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-95be210c-ee9b-4400-a455-ea079688ef12 Nov 04 11:10:37 devstack sudo[107295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:10:37 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-0492ec31-7e0d-4fd1-9cae-bf9426be4b68 tempest-ProjectReaderTests-438802722 None] Flow 'volume_create_manager' (edddd609-868e-451a-902c-997157e46120) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 11:10:37 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-0492ec31-7e0d-4fd1-9cae-bf9426be4b68 tempest-ProjectReaderTests-438802722 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (22ca8fdc-ee03-418a-b42a-49a134625ede) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:10:37 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-0492ec31-7e0d-4fd1-9cae-bf9426be4b68 tempest-ProjectReaderTests-438802722 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (22ca8fdc-ee03-418a-b42a-49a134625ede) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T10:10:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-328180200',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5a9235c2-20e7-4b1f-ac6e-f996dcf1f70b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='124610963c8d407ba84f85419514324c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T10:10:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T10:10:37Z,use_quota=True,user_id='097085883c2d47479d2bb6bf8ea9ef1e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8989e4f-21e3-4f0a-9584-0d818784e883),volume_type_id=f8989e4f-21e3-4f0a-9584-0d818784e883)' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:10:37 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-0492ec31-7e0d-4fd1-9cae-bf9426be4b68 tempest-ProjectReaderTests-438802722 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f0035617-f411-4983-81ff-87e6d042b65f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:10:37 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-0492ec31-7e0d-4fd1-9cae-bf9426be4b68 tempest-ProjectReaderTests-438802722 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f0035617-f411-4983-81ff-87e6d042b65f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:10:37 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-0492ec31-7e0d-4fd1-9cae-bf9426be4b68 tempest-ProjectReaderTests-438802722 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec826cc4-5854-4a0c-a787-ab28c18ebada) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:10:37 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-0492ec31-7e0d-4fd1-9cae-bf9426be4b68 tempest-ProjectReaderTests-438802722 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec826cc4-5854-4a0c-a787-ab28c18ebada) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5a9235c2-20e7-4b1f-ac6e-f996dcf1f70b', 'volume_name': 'volume-5a9235c2-20e7-4b1f-ac6e-f996dcf1f70b', 'volume_size': 1}' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:10:37 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-0492ec31-7e0d-4fd1-9cae-bf9426be4b68 tempest-ProjectReaderTests-438802722 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a393f96d-a8bc-472b-830c-f7bc8a131f26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:10:37 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-0492ec31-7e0d-4fd1-9cae-bf9426be4b68 tempest-ProjectReaderTests-438802722 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a393f96d-a8bc-472b-830c-f7bc8a131f26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:10:37 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-0492ec31-7e0d-4fd1-9cae-bf9426be4b68 tempest-ProjectReaderTests-438802722 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd1278de-614d-4df1-96de-0ee1777e7e92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:10:37 devstack cinder-volume[87272]: INFO cinder.volume.flows.manager.create_volume [None req-0492ec31-7e0d-4fd1-9cae-bf9426be4b68 tempest-ProjectReaderTests-438802722 None] Volume 5a9235c2-20e7-4b1f-ac6e-f996dcf1f70b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5a9235c2-20e7-4b1f-ac6e-f996dcf1f70b', 'volume_size': 1} Nov 04 11:10:37 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-0492ec31-7e0d-4fd1-9cae-bf9426be4b68 tempest-ProjectReaderTests-438802722 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 11:10:37 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-0492ec31-7e0d-4fd1-9cae-bf9426be4b68 tempest-ProjectReaderTests-438802722 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 11:10:37 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-0492ec31-7e0d-4fd1-9cae-bf9426be4b68 tempest-ProjectReaderTests-438802722 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T10:10:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-328180200',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5a9235c2-20e7-4b1f-ac6e-f996dcf1f70b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='124610963c8d407ba84f85419514324c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T10:10:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T10:10:37Z,use_quota=True,user_id='097085883c2d47479d2bb6bf8ea9ef1e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8989e4f-21e3-4f0a-9584-0d818784e883),volume_type_id=f8989e4f-21e3-4f0a-9584-0d818784e883)}" {{(pid=87272) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 04 11:10:37 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.remotefs [None req-0492ec31-7e0d-4fd1-9cae-bf9426be4b68 tempest-ProjectReaderTests-438802722 None] Creating volume 5a9235c2-20e7-4b1f-ac6e-f996dcf1f70b {{(pid=87272) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 11:10:37 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-0492ec31-7e0d-4fd1-9cae-bf9426be4b68 tempest-ProjectReaderTests-438802722 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 11:10:37 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-0492ec31-7e0d-4fd1-9cae-bf9426be4b68 tempest-ProjectReaderTests-438802722 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 11:10:37 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-0492ec31-7e0d-4fd1-9cae-bf9426be4b68 tempest-ProjectReaderTests-438802722 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898': None} {{(pid=87272) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 11:10:37 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-0492ec31-7e0d-4fd1-9cae-bf9426be4b68 tempest-ProjectReaderTests-438802722 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'] {{(pid=87272) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 11:10:37 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-0492ec31-7e0d-4fd1-9cae-bf9426be4b68 tempest-ProjectReaderTests-438802722 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 11:10:37 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-0492ec31-7e0d-4fd1-9cae-bf9426be4b68 tempest-ProjectReaderTests-438802722 None] Selected osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898 as target Quobyte volume. {{(pid=87272) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 11:10:37 devstack cinder-volume[87272]: INFO cinder.volume.drivers.remotefs [None req-0492ec31-7e0d-4fd1-9cae-bf9426be4b68 tempest-ProjectReaderTests-438802722 None] casted to osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898 Nov 04 11:10:37 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-0492ec31-7e0d-4fd1-9cae-bf9426be4b68 tempest-ProjectReaderTests-438802722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-5a9235c2-20e7-4b1f-ac6e-f996dcf1f70b 1073741824 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:10:37 devstack cinder-volume[87272]: DEBUG cinder.volume.flows.manager.create_volume [None req-82bddb2b-71a9-4e2b-9e6d-c8e19af58091 tempest-ProjectMemberTests-186486462 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87272) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 11:10:37 devstack sudo[107294]: pam_unix(sudo:session): session closed for user root Nov 04 11:10:37 devstack sudo[107299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-5a9235c2-20e7-4b1f-ac6e-f996dcf1f70b 1073741824 Nov 04 11:10:37 devstack sudo[107299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:10:37 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-82bddb2b-71a9-4e2b-9e6d-c8e19af58091 tempest-ProjectMemberTests-186486462 None] Flow 'volume_create_manager' (9e0f9211-806c-4ec5-837d-ad7bdc2c5176) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 11:10:37 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-82bddb2b-71a9-4e2b-9e6d-c8e19af58091 tempest-ProjectMemberTests-186486462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d1589b1-91aa-4f21-be61-ae96a88a8f64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:10:37 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-7cc0d428-440a-466b-83a5-819d4988cb80 tempest-CinderUnicodeTest-1637078103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1" returned: 0 in 0.325s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:10:37 devstack cinder-volume[87272]: DEBUG cinder.manager [None req-7cc0d428-440a-466b-83a5-819d4988cb80 tempest-CinderUnicodeTest-1637078103 None] Notifying Schedulers of capabilities ... {{(pid=87272) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 11:10:37 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-7cc0d428-440a-466b-83a5-819d4988cb80 tempest-CinderUnicodeTest-1637078103 None] Deleted volume successfully. Nov 04 11:10:37 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-82bddb2b-71a9-4e2b-9e6d-c8e19af58091 tempest-ProjectMemberTests-186486462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d1589b1-91aa-4f21-be61-ae96a88a8f64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T10:10:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1182899992',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f64df19c-4e64-4c82-96c5-f5228ea99dc0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8457b114a6264c47af483fad6a8bf18b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T10:10:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T10:10:37Z,use_quota=True,user_id='70a59e5f7c684c0b88977c66a4e36afb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8989e4f-21e3-4f0a-9584-0d818784e883),volume_type_id=f8989e4f-21e3-4f0a-9584-0d818784e883)' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:10:37 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-82bddb2b-71a9-4e2b-9e6d-c8e19af58091 tempest-ProjectMemberTests-186486462 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32452534-2970-4b9f-aaff-d7d8362f2f55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:10:37 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-82bddb2b-71a9-4e2b-9e6d-c8e19af58091 tempest-ProjectMemberTests-186486462 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32452534-2970-4b9f-aaff-d7d8362f2f55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:10:37 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-82bddb2b-71a9-4e2b-9e6d-c8e19af58091 tempest-ProjectMemberTests-186486462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e9ba200-6048-4afe-adc5-66b251506583) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:10:37 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-82bddb2b-71a9-4e2b-9e6d-c8e19af58091 tempest-ProjectMemberTests-186486462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e9ba200-6048-4afe-adc5-66b251506583) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f64df19c-4e64-4c82-96c5-f5228ea99dc0', 'volume_name': 'volume-f64df19c-4e64-4c82-96c5-f5228ea99dc0', 'volume_size': 1}' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:10:37 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-82bddb2b-71a9-4e2b-9e6d-c8e19af58091 tempest-ProjectMemberTests-186486462 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a36a67b2-bb4b-4735-85fd-3f8df35fd950) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:10:37 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-82bddb2b-71a9-4e2b-9e6d-c8e19af58091 tempest-ProjectMemberTests-186486462 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a36a67b2-bb4b-4735-85fd-3f8df35fd950) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:10:37 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-82bddb2b-71a9-4e2b-9e6d-c8e19af58091 tempest-ProjectMemberTests-186486462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (102a9c06-be07-4278-9ac1-bbea7123c77c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:10:37 devstack cinder-volume[87272]: INFO cinder.volume.flows.manager.create_volume [None req-82bddb2b-71a9-4e2b-9e6d-c8e19af58091 tempest-ProjectMemberTests-186486462 None] Volume f64df19c-4e64-4c82-96c5-f5228ea99dc0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f64df19c-4e64-4c82-96c5-f5228ea99dc0', 'volume_size': 1} Nov 04 11:10:37 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-82bddb2b-71a9-4e2b-9e6d-c8e19af58091 tempest-ProjectMemberTests-186486462 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 11:10:37 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-7cc0d428-440a-466b-83a5-819d4988cb80 tempest-CinderUnicodeTest-1637078103 None] Lock "cinder-919a00f7-1435-4bef-b0eb-da8f4738a3bd-delete_volume" released by "delete_volume" :: held 1.560s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 11:10:37 devstack sudo[107295]: pam_unix(sudo:session): session closed for user root Nov 04 11:10:37 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-8675f083-5bb6-4a47-be7c-9d8aa068cb73 tempest-VolumeImageDependencyTests-550591154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_123bccac-644a-4526-8fd7-abd144c53891_oz6n31widevstack@QuobyteHD /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-95be210c-ee9b-4400-a455-ea079688ef12" returned: 0 in 0.615s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:10:37 devstack cinder-volume[87272]: DEBUG cinder.image.image_utils [None req-8675f083-5bb6-4a47-be7c-9d8aa068cb73 tempest-VolumeImageDependencyTests-550591154 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_123bccac-644a-4526-8fd7-abd144c53891_oz6n31widevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-95be210c-ee9b-4400-a455-ea079688ef12 {{(pid=87272) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Nov 04 11:10:37 devstack cinder-volume[87272]: INFO cinder.image.image_utils [None req-8675f083-5bb6-4a47-be7c-9d8aa068cb73 tempest-VolumeImageDependencyTests-550591154 None] Converted 0.00 MB image at 0.00 MB/s Nov 04 11:10:37 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-8675f083-5bb6-4a47-be7c-9d8aa068cb73 tempest-VolumeImageDependencyTests-550591154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-95be210c-ee9b-4400-a455-ea079688ef12 1G {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:10:37 devstack sudo[107309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-95be210c-ee9b-4400-a455-ea079688ef12 1G Nov 04 11:10:37 devstack sudo[107309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:10:38 devstack sudo[107299]: pam_unix(sudo:session): session closed for user root Nov 04 11:10:38 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-0492ec31-7e0d-4fd1-9cae-bf9426be4b68 tempest-ProjectReaderTests-438802722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-5a9235c2-20e7-4b1f-ac6e-f996dcf1f70b 1073741824" returned: 0 in 0.527s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:10:38 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-0492ec31-7e0d-4fd1-9cae-bf9426be4b68 tempest-ProjectReaderTests-438802722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-5a9235c2-20e7-4b1f-ac6e-f996dcf1f70b {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:10:38 devstack sudo[107311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-5a9235c2-20e7-4b1f-ac6e-f996dcf1f70b Nov 04 11:10:38 devstack sudo[107311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:10:38 devstack sudo[107309]: pam_unix(sudo:session): session closed for user root Nov 04 11:10:38 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-8675f083-5bb6-4a47-be7c-9d8aa068cb73 tempest-VolumeImageDependencyTests-550591154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-95be210c-ee9b-4400-a455-ea079688ef12 1G" returned: 0 in 0.413s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:10:38 devstack cinder-volume[87272]: DEBUG cinder.volume.volume_utils [None req-8675f083-5bb6-4a47-be7c-9d8aa068cb73 tempest-VolumeImageDependencyTests-550591154 None] Downloaded image 123bccac-644a-4526-8fd7-abd144c53891 ((None, [{'url': 'file:///opt/stack/data/glance/images/123bccac-644a-4526-8fd7-abd144c53891', 'metadata': {}}])) to volume 95be210c-ee9b-4400-a455-ea079688ef12 successfully. {{(pid=87272) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Nov 04 11:10:38 devstack cinder-volume[87272]: DEBUG cinder.image.image_utils [None req-8675f083-5bb6-4a47-be7c-9d8aa068cb73 tempest-VolumeImageDependencyTests-550591154 None] Temporary image 123bccac-644a-4526-8fd7-abd144c53891 for user c9a29e08a0c9415ab007e7ebef9dfa84 is deleted. {{(pid=87272) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Nov 04 11:10:38 devstack cinder-volume[87272]: DEBUG cinder.volume.volume_utils [None req-8675f083-5bb6-4a47-be7c-9d8aa068cb73 tempest-VolumeImageDependencyTests-550591154 None] Marking volume 95be210c-ee9b-4400-a455-ea079688ef12 as bootable. {{(pid=87272) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Nov 04 11:10:38 devstack cinder-volume[87272]: DEBUG cinder.volume.flows.manager.create_volume [None req-8675f083-5bb6-4a47-be7c-9d8aa068cb73 tempest-VolumeImageDependencyTests-550591154 None] Copying metadata from image 123bccac-644a-4526-8fd7-abd144c53891 to 95be210c-ee9b-4400-a455-ea079688ef12. {{(pid=87272) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 04 11:10:38 devstack cinder-volume[87272]: DEBUG cinder.volume.flows.manager.create_volume [None req-8675f083-5bb6-4a47-be7c-9d8aa068cb73 tempest-VolumeImageDependencyTests-550591154 None] Creating volume glance metadata for volume 95be210c-ee9b-4400-a455-ea079688ef12 backed by image 123bccac-644a-4526-8fd7-abd144c53891 with: {'image_id': '123bccac-644a-4526-8fd7-abd144c53891', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '716b17b7a833b9cea981db984647c2bd', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87272) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 04 11:10:38 devstack sudo[107311]: pam_unix(sudo:session): session closed for user root Nov 04 11:10:38 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-0492ec31-7e0d-4fd1-9cae-bf9426be4b68 tempest-ProjectReaderTests-438802722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-5a9235c2-20e7-4b1f-ac6e-f996dcf1f70b" returned: 0 in 0.304s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:10:38 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-0492ec31-7e0d-4fd1-9cae-bf9426be4b68 tempest-ProjectReaderTests-438802722 None] <== create_volume: return (899ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'} {{(pid=87272) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 04 11:10:38 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-0492ec31-7e0d-4fd1-9cae-bf9426be4b68 tempest-ProjectReaderTests-438802722 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.902s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 11:10:38 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-82bddb2b-71a9-4e2b-9e6d-c8e19af58091 tempest-ProjectMemberTests-186486462 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.751s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 11:10:38 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-82bddb2b-71a9-4e2b-9e6d-c8e19af58091 tempest-ProjectMemberTests-186486462 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T10:10:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1182899992',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f64df19c-4e64-4c82-96c5-f5228ea99dc0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8457b114a6264c47af483fad6a8bf18b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T10:10:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T10:10:37Z,use_quota=True,user_id='70a59e5f7c684c0b88977c66a4e36afb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8989e4f-21e3-4f0a-9584-0d818784e883),volume_type_id=f8989e4f-21e3-4f0a-9584-0d818784e883)}" {{(pid=87272) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 04 11:10:38 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.remotefs [None req-82bddb2b-71a9-4e2b-9e6d-c8e19af58091 tempest-ProjectMemberTests-186486462 None] Creating volume f64df19c-4e64-4c82-96c5-f5228ea99dc0 {{(pid=87272) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 11:10:38 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-82bddb2b-71a9-4e2b-9e6d-c8e19af58091 tempest-ProjectMemberTests-186486462 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 11:10:38 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-82bddb2b-71a9-4e2b-9e6d-c8e19af58091 tempest-ProjectMemberTests-186486462 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 11:10:38 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-82bddb2b-71a9-4e2b-9e6d-c8e19af58091 tempest-ProjectMemberTests-186486462 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898': None} {{(pid=87272) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 11:10:38 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-82bddb2b-71a9-4e2b-9e6d-c8e19af58091 tempest-ProjectMemberTests-186486462 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'] {{(pid=87272) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 11:10:38 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-82bddb2b-71a9-4e2b-9e6d-c8e19af58091 tempest-ProjectMemberTests-186486462 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 11:10:38 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-82bddb2b-71a9-4e2b-9e6d-c8e19af58091 tempest-ProjectMemberTests-186486462 None] Selected osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898 as target Quobyte volume. {{(pid=87272) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 11:10:38 devstack cinder-volume[87272]: INFO cinder.volume.drivers.remotefs [None req-82bddb2b-71a9-4e2b-9e6d-c8e19af58091 tempest-ProjectMemberTests-186486462 None] casted to osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898 Nov 04 11:10:38 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-82bddb2b-71a9-4e2b-9e6d-c8e19af58091 tempest-ProjectMemberTests-186486462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-f64df19c-4e64-4c82-96c5-f5228ea99dc0 1073741824 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:10:38 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-0492ec31-7e0d-4fd1-9cae-bf9426be4b68 tempest-ProjectReaderTests-438802722 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd1278de-614d-4df1-96de-0ee1777e7e92) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5a9235c2-20e7-4b1f-ac6e-f996dcf1f70b', 'volume_size': 1}' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:10:38 devstack sudo[107317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-f64df19c-4e64-4c82-96c5-f5228ea99dc0 1073741824 Nov 04 11:10:38 devstack sudo[107317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:10:38 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-0492ec31-7e0d-4fd1-9cae-bf9426be4b68 tempest-ProjectReaderTests-438802722 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b3d8fa4d-69ad-4428-a910-37d579e126dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:10:38 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-8675f083-5bb6-4a47-be7c-9d8aa068cb73 tempest-VolumeImageDependencyTests-550591154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77c227ef-068d-44dd-b318-9ec653048804) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-95be210c-ee9b-4400-a455-ea079688ef12', 'volume_size': 1, 'image_id': '123bccac-644a-4526-8fd7-abd144c53891', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/123bccac-644a-4526-8fd7-abd144c53891', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '716b17b7a833b9cea981db984647c2bd', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '89f06bfab7c44ed8bb6226f3ab914dcc', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'f9b6c2addeb0053c7730e29f710c20c2d8734febe04e394861b088948b6fe59aaf7d9957610773d0b44fe5c7a31b28a82961254c2a30503f76e29f7c1cbf18ff', 'id': '123bccac-644a-4526-8fd7-abd144c53891', 'created_at': datetime.datetime(2026, 11, 4, 10, 10, 29, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 4, 10, 10, 31, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/123bccac-644a-4526-8fd7-abd144c53891/file', 'properties': {}}, 'image_service': }' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:10:38 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-8675f083-5bb6-4a47-be7c-9d8aa068cb73 tempest-VolumeImageDependencyTests-550591154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c965ae19-9e8e-4db7-a852-0e01c0b3e0c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:10:38 devstack cinder-volume[87272]: INFO cinder.volume.flows.manager.create_volume [None req-0492ec31-7e0d-4fd1-9cae-bf9426be4b68 tempest-ProjectReaderTests-438802722 None] Volume volume-5a9235c2-20e7-4b1f-ac6e-f996dcf1f70b (5a9235c2-20e7-4b1f-ac6e-f996dcf1f70b): created successfully Nov 04 11:10:38 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-0492ec31-7e0d-4fd1-9cae-bf9426be4b68 tempest-ProjectReaderTests-438802722 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b3d8fa4d-69ad-4428-a910-37d579e126dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:10:38 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-0492ec31-7e0d-4fd1-9cae-bf9426be4b68 tempest-ProjectReaderTests-438802722 None] Flow 'volume_create_manager' (edddd609-868e-451a-902c-997157e46120) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87272) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 11:10:38 devstack cinder-volume[87272]: INFO cinder.volume.flows.manager.create_volume [None req-8675f083-5bb6-4a47-be7c-9d8aa068cb73 tempest-VolumeImageDependencyTests-550591154 None] Volume volume-95be210c-ee9b-4400-a455-ea079688ef12 (95be210c-ee9b-4400-a455-ea079688ef12): created successfully Nov 04 11:10:38 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-8675f083-5bb6-4a47-be7c-9d8aa068cb73 tempest-VolumeImageDependencyTests-550591154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c965ae19-9e8e-4db7-a852-0e01c0b3e0c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:10:38 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-8675f083-5bb6-4a47-be7c-9d8aa068cb73 tempest-VolumeImageDependencyTests-550591154 None] Flow 'volume_create_manager' (2605579b-d20e-4750-87f0-e69e830bd33b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87272) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 11:10:38 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-0492ec31-7e0d-4fd1-9cae-bf9426be4b68 tempest-ProjectReaderTests-438802722 None] Created volume successfully. Nov 04 11:10:38 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-8675f083-5bb6-4a47-be7c-9d8aa068cb73 tempest-VolumeImageDependencyTests-550591154 None] Created volume successfully. Nov 04 11:10:38 devstack sudo[107317]: pam_unix(sudo:session): session closed for user root Nov 04 11:10:38 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-82bddb2b-71a9-4e2b-9e6d-c8e19af58091 tempest-ProjectMemberTests-186486462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-f64df19c-4e64-4c82-96c5-f5228ea99dc0 1073741824" returned: 0 in 0.476s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:10:38 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-82bddb2b-71a9-4e2b-9e6d-c8e19af58091 tempest-ProjectMemberTests-186486462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-f64df19c-4e64-4c82-96c5-f5228ea99dc0 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:10:38 devstack sudo[107323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-f64df19c-4e64-4c82-96c5-f5228ea99dc0 Nov 04 11:10:38 devstack sudo[107323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:10:39 devstack sudo[107323]: pam_unix(sudo:session): session closed for user root Nov 04 11:10:39 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-82bddb2b-71a9-4e2b-9e6d-c8e19af58091 tempest-ProjectMemberTests-186486462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-f64df19c-4e64-4c82-96c5-f5228ea99dc0" returned: 0 in 0.247s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:10:39 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-82bddb2b-71a9-4e2b-9e6d-c8e19af58091 tempest-ProjectMemberTests-186486462 None] <== create_volume: return (760ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'} {{(pid=87272) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 04 11:10:39 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-82bddb2b-71a9-4e2b-9e6d-c8e19af58091 tempest-ProjectMemberTests-186486462 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.764s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 11:10:39 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-82bddb2b-71a9-4e2b-9e6d-c8e19af58091 tempest-ProjectMemberTests-186486462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (102a9c06-be07-4278-9ac1-bbea7123c77c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f64df19c-4e64-4c82-96c5-f5228ea99dc0', 'volume_size': 1}' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:10:39 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-82bddb2b-71a9-4e2b-9e6d-c8e19af58091 tempest-ProjectMemberTests-186486462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b8bec79a-4d3a-435f-8b26-b474a96a1381) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:10:39 devstack cinder-volume[87272]: INFO cinder.volume.flows.manager.create_volume [None req-82bddb2b-71a9-4e2b-9e6d-c8e19af58091 tempest-ProjectMemberTests-186486462 None] Volume volume-f64df19c-4e64-4c82-96c5-f5228ea99dc0 (f64df19c-4e64-4c82-96c5-f5228ea99dc0): created successfully Nov 04 11:10:39 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-82bddb2b-71a9-4e2b-9e6d-c8e19af58091 tempest-ProjectMemberTests-186486462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b8bec79a-4d3a-435f-8b26-b474a96a1381) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:10:39 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-82bddb2b-71a9-4e2b-9e6d-c8e19af58091 tempest-ProjectMemberTests-186486462 None] Flow 'volume_create_manager' (9e0f9211-806c-4ec5-837d-ad7bdc2c5176) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87272) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 11:10:39 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-82bddb2b-71a9-4e2b-9e6d-c8e19af58091 tempest-ProjectMemberTests-186486462 None] Created volume successfully. Nov 04 11:10:39 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-100e7d7e-7434-4682-b8dc-6fa719d422c5 tempest-ProjectReaderTests-438802722 None] Acquiring lock "cinder-5a9235c2-20e7-4b1f-ac6e-f996dcf1f70b-delete_volume" by "delete_volume" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 11:10:39 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-100e7d7e-7434-4682-b8dc-6fa719d422c5 tempest-ProjectReaderTests-438802722 None] Lock "cinder-5a9235c2-20e7-4b1f-ac6e-f996dcf1f70b-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 11:10:39 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-100e7d7e-7434-4682-b8dc-6fa719d422c5 tempest-ProjectReaderTests-438802722 None] Acquiring lock "cinder-quobyte-5a9235c2-20e7-4b1f-ac6e-f996dcf1f70b" by "delete_volume" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 11:10:39 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-100e7d7e-7434-4682-b8dc-6fa719d422c5 tempest-ProjectReaderTests-438802722 None] Lock "cinder-quobyte-5a9235c2-20e7-4b1f-ac6e-f996dcf1f70b" acquired by "delete_volume" :: waited 0.022s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 11:10:39 devstack cinder-volume[87272]: DEBUG oslo.privsep.daemon [-] privsep: reply[26f3cb89-d7e6-46fe-84d8-5fe4989f2514]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 11:10:39 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-100e7d7e-7434-4682-b8dc-6fa719d422c5 tempest-ProjectReaderTests-438802722 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-5a9235c2-20e7-4b1f-ac6e-f996dcf1f70b {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:10:39 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-fe4d74d6-f2bc-4c44-8194-8a66d2b4365f tempest-VolumeImageDependencyTests-550591154 None] Acquiring lock "cinder-95be210c-ee9b-4400-a455-ea079688ef12-delete_volume" by "delete_volume" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 11:10:39 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-fe4d74d6-f2bc-4c44-8194-8a66d2b4365f tempest-VolumeImageDependencyTests-550591154 None] Lock "cinder-95be210c-ee9b-4400-a455-ea079688ef12-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 11:10:39 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-b13e4f38-651f-427b-8deb-7f0657d6d254 tempest-ProjectMemberTests-186486462 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 11:10:39 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-b13e4f38-651f-427b-8deb-7f0657d6d254 tempest-ProjectMemberTests-186486462 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 11:10:39 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.remotefs [None req-b13e4f38-651f-427b-8deb-7f0657d6d254 tempest-ProjectMemberTests-186486462 None] Creating offline snapshot 4ab56bab-7a7c-40b3-a026-15ee73cf8e00 of volume f64df19c-4e64-4c82-96c5-f5228ea99dc0 {{(pid=87272) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 04 11:10:39 devstack sudo[107326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-5a9235c2-20e7-4b1f-ac6e-f996dcf1f70b Nov 04 11:10:39 devstack sudo[107326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:10:39 devstack cinder-volume[87272]: DEBUG oslo.privsep.daemon [-] privsep: reply[6977848b-5789-4be3-a2ef-bf4784013226]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 11:10:39 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-b13e4f38-651f-427b-8deb-7f0657d6d254 tempest-ProjectMemberTests-186486462 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-f64df19c-4e64-4c82-96c5-f5228ea99dc0 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:10:40 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-fe4d74d6-f2bc-4c44-8194-8a66d2b4365f tempest-VolumeImageDependencyTests-550591154 None] Acquiring lock "cinder-quobyte-95be210c-ee9b-4400-a455-ea079688ef12" by "delete_volume" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 11:10:40 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-fe4d74d6-f2bc-4c44-8194-8a66d2b4365f tempest-VolumeImageDependencyTests-550591154 None] Lock "cinder-quobyte-95be210c-ee9b-4400-a455-ea079688ef12" acquired by "delete_volume" :: waited 0.023s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 11:10:40 devstack cinder-volume[87272]: DEBUG oslo.privsep.daemon [-] privsep: reply[718c5d01-a4f3-40a1-86c8-4bb2faf71be1]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 11:10:40 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-fe4d74d6-f2bc-4c44-8194-8a66d2b4365f tempest-VolumeImageDependencyTests-550591154 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-95be210c-ee9b-4400-a455-ea079688ef12 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:10:40 devstack sudo[107328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-f64df19c-4e64-4c82-96c5-f5228ea99dc0 Nov 04 11:10:40 devstack sudo[107328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:10:40 devstack sudo[107329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-95be210c-ee9b-4400-a455-ea079688ef12 Nov 04 11:10:40 devstack sudo[107329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:10:40 devstack sudo[107326]: pam_unix(sudo:session): session closed for user root Nov 04 11:10:40 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-100e7d7e-7434-4682-b8dc-6fa719d422c5 tempest-ProjectReaderTests-438802722 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-5a9235c2-20e7-4b1f-ac6e-f996dcf1f70b" returned: 0 in 0.462s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:10:40 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-100e7d7e-7434-4682-b8dc-6fa719d422c5 tempest-ProjectReaderTests-438802722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-5a9235c2-20e7-4b1f-ac6e-f996dcf1f70b {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:10:40 devstack sudo[107336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-5a9235c2-20e7-4b1f-ac6e-f996dcf1f70b Nov 04 11:10:40 devstack sudo[107336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:10:40 devstack sudo[107328]: pam_unix(sudo:session): session closed for user root Nov 04 11:10:40 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-b13e4f38-651f-427b-8deb-7f0657d6d254 tempest-ProjectMemberTests-186486462 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-f64df19c-4e64-4c82-96c5-f5228ea99dc0" returned: 0 in 0.526s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:10:40 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-b13e4f38-651f-427b-8deb-7f0657d6d254 tempest-ProjectMemberTests-186486462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-f64df19c-4e64-4c82-96c5-f5228ea99dc0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-f64df19c-4e64-4c82-96c5-f5228ea99dc0.4ab56bab-7a7c-40b3-a026-15ee73cf8e00 1G {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:10:40 devstack sudo[107329]: pam_unix(sudo:session): session closed for user root Nov 04 11:10:40 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-fe4d74d6-f2bc-4c44-8194-8a66d2b4365f tempest-VolumeImageDependencyTests-550591154 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-95be210c-ee9b-4400-a455-ea079688ef12" returned: 0 in 0.476s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:10:40 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-fe4d74d6-f2bc-4c44-8194-8a66d2b4365f tempest-VolumeImageDependencyTests-550591154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-95be210c-ee9b-4400-a455-ea079688ef12 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:10:40 devstack sudo[107344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-f64df19c-4e64-4c82-96c5-f5228ea99dc0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-f64df19c-4e64-4c82-96c5-f5228ea99dc0.4ab56bab-7a7c-40b3-a026-15ee73cf8e00 1G Nov 04 11:10:40 devstack sudo[107344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:10:40 devstack sudo[107346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-95be210c-ee9b-4400-a455-ea079688ef12 Nov 04 11:10:40 devstack sudo[107346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:10:40 devstack sudo[107336]: pam_unix(sudo:session): session closed for user root Nov 04 11:10:40 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-100e7d7e-7434-4682-b8dc-6fa719d422c5 tempest-ProjectReaderTests-438802722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-5a9235c2-20e7-4b1f-ac6e-f996dcf1f70b" returned: 0 in 0.327s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:10:40 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-100e7d7e-7434-4682-b8dc-6fa719d422c5 tempest-ProjectReaderTests-438802722 None] Lock "cinder-quobyte-5a9235c2-20e7-4b1f-ac6e-f996dcf1f70b" released by "delete_volume" :: held 0.871s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 11:10:40 devstack cinder-volume[87272]: DEBUG cinder.quota [None req-100e7d7e-7434-4682-b8dc-6fa719d422c5 tempest-ProjectReaderTests-438802722 None] Created reservations ['a1842b97-5998-4bc9-af7a-b086f5265015', 'd36e456b-dd6f-4ffd-8611-a014d098af31', '2708d529-0444-4dd3-a2e2-5210493ddeab', '0c21a6da-0736-405c-960a-57c462b97e06'] {{(pid=87272) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 11:10:40 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-100e7d7e-7434-4682-b8dc-6fa719d422c5 tempest-ProjectReaderTests-438802722 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 11:10:40 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-100e7d7e-7434-4682-b8dc-6fa719d422c5 tempest-ProjectReaderTests-438802722 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 11:10:40 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-100e7d7e-7434-4682-b8dc-6fa719d422c5 tempest-ProjectReaderTests-438802722 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898': None} {{(pid=87272) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 11:10:40 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-100e7d7e-7434-4682-b8dc-6fa719d422c5 tempest-ProjectReaderTests-438802722 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'] {{(pid=87272) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 11:10:40 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-100e7d7e-7434-4682-b8dc-6fa719d422c5 tempest-ProjectReaderTests-438802722 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 11:10:40 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-100e7d7e-7434-4682-b8dc-6fa719d422c5 tempest-ProjectReaderTests-438802722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:10:40 devstack sudo[107352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1 Nov 04 11:10:40 devstack sudo[107352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:10:40 devstack sudo[107346]: pam_unix(sudo:session): session closed for user root Nov 04 11:10:40 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-fe4d74d6-f2bc-4c44-8194-8a66d2b4365f tempest-VolumeImageDependencyTests-550591154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-95be210c-ee9b-4400-a455-ea079688ef12" returned: 0 in 0.376s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:10:40 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-fe4d74d6-f2bc-4c44-8194-8a66d2b4365f tempest-VolumeImageDependencyTests-550591154 None] Lock "cinder-quobyte-95be210c-ee9b-4400-a455-ea079688ef12" released by "delete_volume" :: held 0.912s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 11:10:41 devstack cinder-volume[87272]: DEBUG cinder.quota [None req-fe4d74d6-f2bc-4c44-8194-8a66d2b4365f tempest-VolumeImageDependencyTests-550591154 None] Created reservations ['b38d3515-3653-4d42-a8c7-517d853278d7', 'e798509a-f88b-4584-a00f-f0cdcc024515', 'cf977ceb-967b-481b-b721-0a352de795ba', 'cde8ea51-7951-4963-9cea-8083835b2e3a'] {{(pid=87272) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 11:10:41 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-fe4d74d6-f2bc-4c44-8194-8a66d2b4365f tempest-VolumeImageDependencyTests-550591154 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 11:10:41 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-fe4d74d6-f2bc-4c44-8194-8a66d2b4365f tempest-VolumeImageDependencyTests-550591154 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 11:10:41 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-fe4d74d6-f2bc-4c44-8194-8a66d2b4365f tempest-VolumeImageDependencyTests-550591154 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898': None} {{(pid=87272) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 11:10:41 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-fe4d74d6-f2bc-4c44-8194-8a66d2b4365f tempest-VolumeImageDependencyTests-550591154 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'] {{(pid=87272) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 11:10:41 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-fe4d74d6-f2bc-4c44-8194-8a66d2b4365f tempest-VolumeImageDependencyTests-550591154 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 11:10:41 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-fe4d74d6-f2bc-4c44-8194-8a66d2b4365f tempest-VolumeImageDependencyTests-550591154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:10:41 devstack sudo[107355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1 Nov 04 11:10:41 devstack sudo[107355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:10:41 devstack sudo[107344]: pam_unix(sudo:session): session closed for user root Nov 04 11:10:41 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-b13e4f38-651f-427b-8deb-7f0657d6d254 tempest-ProjectMemberTests-186486462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-f64df19c-4e64-4c82-96c5-f5228ea99dc0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-f64df19c-4e64-4c82-96c5-f5228ea99dc0.4ab56bab-7a7c-40b3-a026-15ee73cf8e00 1G" returned: 0 in 0.689s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:10:41 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-b13e4f38-651f-427b-8deb-7f0657d6d254 tempest-ProjectMemberTests-186486462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f64df19c-4e64-4c82-96c5-f5228ea99dc0 -F qcow2 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-f64df19c-4e64-4c82-96c5-f5228ea99dc0.4ab56bab-7a7c-40b3-a026-15ee73cf8e00 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:10:41 devstack sudo[107352]: pam_unix(sudo:session): session closed for user root Nov 04 11:10:41 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-100e7d7e-7434-4682-b8dc-6fa719d422c5 tempest-ProjectReaderTests-438802722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1" returned: 0 in 0.409s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:10:41 devstack cinder-volume[87272]: DEBUG cinder.manager [None req-100e7d7e-7434-4682-b8dc-6fa719d422c5 tempest-ProjectReaderTests-438802722 None] Notifying Schedulers of capabilities ... {{(pid=87272) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 11:10:41 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-100e7d7e-7434-4682-b8dc-6fa719d422c5 tempest-ProjectReaderTests-438802722 None] Deleted volume successfully. Nov 04 11:10:41 devstack sudo[107358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f64df19c-4e64-4c82-96c5-f5228ea99dc0 -F qcow2 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-f64df19c-4e64-4c82-96c5-f5228ea99dc0.4ab56bab-7a7c-40b3-a026-15ee73cf8e00 Nov 04 11:10:41 devstack sudo[107358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:10:41 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-100e7d7e-7434-4682-b8dc-6fa719d422c5 tempest-ProjectReaderTests-438802722 None] Lock "cinder-5a9235c2-20e7-4b1f-ac6e-f996dcf1f70b-delete_volume" released by "delete_volume" :: held 1.576s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 11:10:41 devstack sudo[107355]: pam_unix(sudo:session): session closed for user root Nov 04 11:10:41 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-fe4d74d6-f2bc-4c44-8194-8a66d2b4365f tempest-VolumeImageDependencyTests-550591154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1" returned: 0 in 0.375s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:10:41 devstack cinder-volume[87272]: DEBUG cinder.manager [None req-fe4d74d6-f2bc-4c44-8194-8a66d2b4365f tempest-VolumeImageDependencyTests-550591154 None] Notifying Schedulers of capabilities ... {{(pid=87272) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 11:10:41 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-fe4d74d6-f2bc-4c44-8194-8a66d2b4365f tempest-VolumeImageDependencyTests-550591154 None] Deleted volume successfully. Nov 04 11:10:41 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-fe4d74d6-f2bc-4c44-8194-8a66d2b4365f tempest-VolumeImageDependencyTests-550591154 None] Lock "cinder-95be210c-ee9b-4400-a455-ea079688ef12-delete_volume" released by "delete_volume" :: held 1.646s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 11:10:41 devstack cinder-volume[87272]: DEBUG cinder.volume.flows.manager.create_volume [None req-a6d5f120-3acb-432d-9707-a35c816e2732 tempest-ProjectReaderTests-438802722 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87272) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 11:10:41 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-a6d5f120-3acb-432d-9707-a35c816e2732 tempest-ProjectReaderTests-438802722 None] Flow 'volume_create_manager' (61a8c4cf-f247-4106-9da2-9f337a334d5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 11:10:41 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-a6d5f120-3acb-432d-9707-a35c816e2732 tempest-ProjectReaderTests-438802722 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e4bf5b7-623c-4c95-b034-faeddba5ff45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:10:41 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-a6d5f120-3acb-432d-9707-a35c816e2732 tempest-ProjectReaderTests-438802722 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e4bf5b7-623c-4c95-b034-faeddba5ff45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T10:10:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1007845772',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=768358b7-f58f-496b-9a2e-226268195bc8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='124610963c8d407ba84f85419514324c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T10:10:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T10:10:42Z,use_quota=True,user_id='097085883c2d47479d2bb6bf8ea9ef1e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8989e4f-21e3-4f0a-9584-0d818784e883),volume_type_id=f8989e4f-21e3-4f0a-9584-0d818784e883)' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:10:41 devstack sudo[107358]: pam_unix(sudo:session): session closed for user root Nov 04 11:10:41 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-a6d5f120-3acb-432d-9707-a35c816e2732 tempest-ProjectReaderTests-438802722 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (74b636e4-f21c-4a4b-be24-dfbd84e9c7d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:10:41 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-a6d5f120-3acb-432d-9707-a35c816e2732 tempest-ProjectReaderTests-438802722 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (74b636e4-f21c-4a4b-be24-dfbd84e9c7d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:10:41 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-a6d5f120-3acb-432d-9707-a35c816e2732 tempest-ProjectReaderTests-438802722 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ca08523-be89-4d00-9c26-ccd66bd59f74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:10:41 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-a6d5f120-3acb-432d-9707-a35c816e2732 tempest-ProjectReaderTests-438802722 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ca08523-be89-4d00-9c26-ccd66bd59f74) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '768358b7-f58f-496b-9a2e-226268195bc8', 'volume_name': 'volume-768358b7-f58f-496b-9a2e-226268195bc8', 'volume_size': 1}' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:10:41 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-a6d5f120-3acb-432d-9707-a35c816e2732 tempest-ProjectReaderTests-438802722 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e8be6e1a-04d8-47d5-97a2-089537c9b38f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:10:41 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-a6d5f120-3acb-432d-9707-a35c816e2732 tempest-ProjectReaderTests-438802722 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e8be6e1a-04d8-47d5-97a2-089537c9b38f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:10:41 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-a6d5f120-3acb-432d-9707-a35c816e2732 tempest-ProjectReaderTests-438802722 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc95668f-24b8-4460-865a-ecea69bf1b56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:10:41 devstack cinder-volume[87272]: INFO cinder.volume.flows.manager.create_volume [None req-a6d5f120-3acb-432d-9707-a35c816e2732 tempest-ProjectReaderTests-438802722 None] Volume 768358b7-f58f-496b-9a2e-226268195bc8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-768358b7-f58f-496b-9a2e-226268195bc8', 'volume_size': 1} Nov 04 11:10:41 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-a6d5f120-3acb-432d-9707-a35c816e2732 tempest-ProjectReaderTests-438802722 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 11:10:41 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-b13e4f38-651f-427b-8deb-7f0657d6d254 tempest-ProjectMemberTests-186486462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f64df19c-4e64-4c82-96c5-f5228ea99dc0 -F qcow2 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-f64df19c-4e64-4c82-96c5-f5228ea99dc0.4ab56bab-7a7c-40b3-a026-15ee73cf8e00" returned: 0 in 0.465s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:10:41 devstack cinder-volume[87272]: WARNING cinder.volume.drivers.remotefs [None req-b13e4f38-651f-427b-8deb-7f0657d6d254 tempest-ProjectMemberTests-186486462 None] /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-f64df19c-4e64-4c82-96c5-f5228ea99dc0.4ab56bab-7a7c-40b3-a026-15ee73cf8e00 is being set with open permissions: ugo+rw Nov 04 11:10:41 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-b13e4f38-651f-427b-8deb-7f0657d6d254 tempest-ProjectMemberTests-186486462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-f64df19c-4e64-4c82-96c5-f5228ea99dc0.4ab56bab-7a7c-40b3-a026-15ee73cf8e00 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:10:41 devstack sudo[107364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-f64df19c-4e64-4c82-96c5-f5228ea99dc0.4ab56bab-7a7c-40b3-a026-15ee73cf8e00 Nov 04 11:10:41 devstack sudo[107364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:10:41 devstack sudo[107364]: pam_unix(sudo:session): session closed for user root Nov 04 11:10:41 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-b13e4f38-651f-427b-8deb-7f0657d6d254 tempest-ProjectMemberTests-186486462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-f64df19c-4e64-4c82-96c5-f5228ea99dc0.4ab56bab-7a7c-40b3-a026-15ee73cf8e00" returned: 0 in 0.248s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:10:41 devstack cinder-volume[87272]: DEBUG dbcounter [-] [87272] Writing DB stats cinder:UPDATE=292,cinder:SELECT=214,cinder:INSERT=77,cinder:DELETE=30 {{(pid=87272) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 11:10:41 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-b13e4f38-651f-427b-8deb-7f0657d6d254 tempest-ProjectMemberTests-186486462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-f64df19c-4e64-4c82-96c5-f5228ea99dc0.info {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:10:42 devstack sudo[107367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-f64df19c-4e64-4c82-96c5-f5228ea99dc0.info Nov 04 11:10:42 devstack sudo[107367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:10:42 devstack sudo[107367]: pam_unix(sudo:session): session closed for user root Nov 04 11:10:42 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-b13e4f38-651f-427b-8deb-7f0657d6d254 tempest-ProjectMemberTests-186486462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-f64df19c-4e64-4c82-96c5-f5228ea99dc0.info" returned: 0 in 0.275s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:10:42 devstack cinder-volume[87272]: WARNING cinder.volume.drivers.remotefs [None req-b13e4f38-651f-427b-8deb-7f0657d6d254 tempest-ProjectMemberTests-186486462 None] /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-f64df19c-4e64-4c82-96c5-f5228ea99dc0.info is being set with open permissions: ugo+rw Nov 04 11:10:42 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-b13e4f38-651f-427b-8deb-7f0657d6d254 tempest-ProjectMemberTests-186486462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-f64df19c-4e64-4c82-96c5-f5228ea99dc0.info {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:10:42 devstack sudo[107370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-f64df19c-4e64-4c82-96c5-f5228ea99dc0.info Nov 04 11:10:42 devstack sudo[107370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:10:42 devstack sudo[107370]: pam_unix(sudo:session): session closed for user root Nov 04 11:10:42 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-b13e4f38-651f-427b-8deb-7f0657d6d254 tempest-ProjectMemberTests-186486462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-f64df19c-4e64-4c82-96c5-f5228ea99dc0.info" returned: 0 in 0.275s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:10:42 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-b13e4f38-651f-427b-8deb-7f0657d6d254 tempest-ProjectMemberTests-186486462 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.620s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 11:10:42 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-a6d5f120-3acb-432d-9707-a35c816e2732 tempest-ProjectReaderTests-438802722 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.875s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 11:10:42 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-a6d5f120-3acb-432d-9707-a35c816e2732 tempest-ProjectReaderTests-438802722 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T10:10:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1007845772',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=768358b7-f58f-496b-9a2e-226268195bc8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='124610963c8d407ba84f85419514324c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T10:10:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T10:10:42Z,use_quota=True,user_id='097085883c2d47479d2bb6bf8ea9ef1e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8989e4f-21e3-4f0a-9584-0d818784e883),volume_type_id=f8989e4f-21e3-4f0a-9584-0d818784e883)}" {{(pid=87272) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 04 11:10:42 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.remotefs [None req-a6d5f120-3acb-432d-9707-a35c816e2732 tempest-ProjectReaderTests-438802722 None] Creating volume 768358b7-f58f-496b-9a2e-226268195bc8 {{(pid=87272) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 11:10:42 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-a6d5f120-3acb-432d-9707-a35c816e2732 tempest-ProjectReaderTests-438802722 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 11:10:42 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-a6d5f120-3acb-432d-9707-a35c816e2732 tempest-ProjectReaderTests-438802722 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 11:10:42 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-a6d5f120-3acb-432d-9707-a35c816e2732 tempest-ProjectReaderTests-438802722 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898': None} {{(pid=87272) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 11:10:42 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-a6d5f120-3acb-432d-9707-a35c816e2732 tempest-ProjectReaderTests-438802722 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'] {{(pid=87272) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 11:10:42 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-a6d5f120-3acb-432d-9707-a35c816e2732 tempest-ProjectReaderTests-438802722 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 11:10:42 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-a6d5f120-3acb-432d-9707-a35c816e2732 tempest-ProjectReaderTests-438802722 None] Selected osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898 as target Quobyte volume. {{(pid=87272) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 11:10:42 devstack cinder-volume[87272]: INFO cinder.volume.drivers.remotefs [None req-a6d5f120-3acb-432d-9707-a35c816e2732 tempest-ProjectReaderTests-438802722 None] casted to osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898 Nov 04 11:10:42 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-a6d5f120-3acb-432d-9707-a35c816e2732 tempest-ProjectReaderTests-438802722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-768358b7-f58f-496b-9a2e-226268195bc8 1073741824 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:10:42 devstack cinder-volume[87272]: DEBUG dbcounter [-] [87272] Writing DB stats cinder:SELECT=215,cinder:UPDATE=293,cinder:DELETE=22,cinder:INSERT=79 {{(pid=87272) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 11:10:42 devstack sudo[107373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-768358b7-f58f-496b-9a2e-226268195bc8 1073741824 Nov 04 11:10:42 devstack sudo[107373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:10:42 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-b13e4f38-651f-427b-8deb-7f0657d6d254 tempest-ProjectMemberTests-186486462 None] Create snapshot completed successfully Nov 04 11:10:43 devstack sudo[107373]: pam_unix(sudo:session): session closed for user root Nov 04 11:10:43 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-a6d5f120-3acb-432d-9707-a35c816e2732 tempest-ProjectReaderTests-438802722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-768358b7-f58f-496b-9a2e-226268195bc8 1073741824" returned: 0 in 0.494s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:10:43 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-10b74d25-fb04-4c01-9ae3-014fcdebcc98 tempest-ProjectMemberTests-186486462 None] Acquiring lock "cinder-4ab56bab-7a7c-40b3-a026-15ee73cf8e00-delete_snapshot" by "delete_snapshot" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 11:10:43 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-a6d5f120-3acb-432d-9707-a35c816e2732 tempest-ProjectReaderTests-438802722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-768358b7-f58f-496b-9a2e-226268195bc8 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:10:43 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-10b74d25-fb04-4c01-9ae3-014fcdebcc98 tempest-ProjectMemberTests-186486462 None] Lock "cinder-4ab56bab-7a7c-40b3-a026-15ee73cf8e00-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 11:10:43 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-10b74d25-fb04-4c01-9ae3-014fcdebcc98 tempest-ProjectMemberTests-186486462 None] Acquiring lock "cinder-quobyte-f64df19c-4e64-4c82-96c5-f5228ea99dc0" by "delete_snapshot" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 11:10:43 devstack sudo[107379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-768358b7-f58f-496b-9a2e-226268195bc8 Nov 04 11:10:43 devstack sudo[107379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:10:43 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-10b74d25-fb04-4c01-9ae3-014fcdebcc98 tempest-ProjectMemberTests-186486462 None] Lock "cinder-quobyte-f64df19c-4e64-4c82-96c5-f5228ea99dc0" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 11:10:43 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-10b74d25-fb04-4c01-9ae3-014fcdebcc98 tempest-ProjectMemberTests-186486462 None] Acquiring lock "cinder-quobyte-4ab56bab-7a7c-40b3-a026-15ee73cf8e00" by "_delete_snapshot" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 11:10:43 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-10b74d25-fb04-4c01-9ae3-014fcdebcc98 tempest-ProjectMemberTests-186486462 None] Lock "cinder-quobyte-4ab56bab-7a7c-40b3-a026-15ee73cf8e00" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 11:10:43 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.remotefs [None req-10b74d25-fb04-4c01-9ae3-014fcdebcc98 tempest-ProjectMemberTests-186486462 None] Deleting offline snapshot 4ab56bab-7a7c-40b3-a026-15ee73cf8e00 of volume f64df19c-4e64-4c82-96c5-f5228ea99dc0 {{(pid=87272) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 04 11:10:43 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.remotefs [None req-10b74d25-fb04-4c01-9ae3-014fcdebcc98 tempest-ProjectMemberTests-186486462 None] snapshot_file for this snap is: volume-f64df19c-4e64-4c82-96c5-f5228ea99dc0.4ab56bab-7a7c-40b3-a026-15ee73cf8e00 {{(pid=87272) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 04 11:10:43 devstack cinder-volume[87272]: DEBUG oslo.privsep.daemon [-] privsep: reply[872d74d5-7808-4991-adae-bf4a419c3c3b]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 11:10:43 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-10b74d25-fb04-4c01-9ae3-014fcdebcc98 tempest-ProjectMemberTests-186486462 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-f64df19c-4e64-4c82-96c5-f5228ea99dc0.4ab56bab-7a7c-40b3-a026-15ee73cf8e00 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:10:43 devstack sudo[107381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-f64df19c-4e64-4c82-96c5-f5228ea99dc0.4ab56bab-7a7c-40b3-a026-15ee73cf8e00 Nov 04 11:10:43 devstack sudo[107381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:10:43 devstack sudo[107379]: pam_unix(sudo:session): session closed for user root Nov 04 11:10:43 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-a6d5f120-3acb-432d-9707-a35c816e2732 tempest-ProjectReaderTests-438802722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-768358b7-f58f-496b-9a2e-226268195bc8" returned: 0 in 0.432s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:10:43 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-a6d5f120-3acb-432d-9707-a35c816e2732 tempest-ProjectReaderTests-438802722 None] <== create_volume: return (990ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'} {{(pid=87272) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 04 11:10:43 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-a6d5f120-3acb-432d-9707-a35c816e2732 tempest-ProjectReaderTests-438802722 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.996s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 11:10:43 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-a6d5f120-3acb-432d-9707-a35c816e2732 tempest-ProjectReaderTests-438802722 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc95668f-24b8-4460-865a-ecea69bf1b56) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-768358b7-f58f-496b-9a2e-226268195bc8', 'volume_size': 1}' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:10:43 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-a6d5f120-3acb-432d-9707-a35c816e2732 tempest-ProjectReaderTests-438802722 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bedffd91-af82-4c66-8b99-604ed35a045c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:10:43 devstack cinder-volume[87272]: INFO cinder.volume.flows.manager.create_volume [None req-a6d5f120-3acb-432d-9707-a35c816e2732 tempest-ProjectReaderTests-438802722 None] Volume volume-768358b7-f58f-496b-9a2e-226268195bc8 (768358b7-f58f-496b-9a2e-226268195bc8): created successfully Nov 04 11:10:43 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-a6d5f120-3acb-432d-9707-a35c816e2732 tempest-ProjectReaderTests-438802722 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bedffd91-af82-4c66-8b99-604ed35a045c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:10:43 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-a6d5f120-3acb-432d-9707-a35c816e2732 tempest-ProjectReaderTests-438802722 None] Flow 'volume_create_manager' (61a8c4cf-f247-4106-9da2-9f337a334d5c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87272) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 11:10:43 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-a6d5f120-3acb-432d-9707-a35c816e2732 tempest-ProjectReaderTests-438802722 None] Created volume successfully. Nov 04 11:10:43 devstack sudo[107381]: pam_unix(sudo:session): session closed for user root Nov 04 11:10:43 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-10b74d25-fb04-4c01-9ae3-014fcdebcc98 tempest-ProjectMemberTests-186486462 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-f64df19c-4e64-4c82-96c5-f5228ea99dc0.4ab56bab-7a7c-40b3-a026-15ee73cf8e00" returned: 0 in 0.483s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:10:43 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.remotefs [None req-10b74d25-fb04-4c01-9ae3-014fcdebcc98 tempest-ProjectMemberTests-186486462 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f64df19c-4e64-4c82-96c5-f5228ea99dc0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87272) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 11:10:43 devstack cinder-volume[87272]: DEBUG oslo.privsep.daemon [-] privsep: reply[85c17ac4-faa2-4584-9153-62914030b780]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 11:10:43 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-10b74d25-fb04-4c01-9ae3-014fcdebcc98 tempest-ProjectMemberTests-186486462 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-f64df19c-4e64-4c82-96c5-f5228ea99dc0 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:10:43 devstack sudo[107388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-f64df19c-4e64-4c82-96c5-f5228ea99dc0 Nov 04 11:10:43 devstack sudo[107388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:10:44 devstack sudo[107388]: pam_unix(sudo:session): session closed for user root Nov 04 11:10:44 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-10b74d25-fb04-4c01-9ae3-014fcdebcc98 tempest-ProjectMemberTests-186486462 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-f64df19c-4e64-4c82-96c5-f5228ea99dc0" returned: 0 in 0.416s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:10:44 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-10b74d25-fb04-4c01-9ae3-014fcdebcc98 tempest-ProjectMemberTests-186486462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-f64df19c-4e64-4c82-96c5-f5228ea99dc0.4ab56bab-7a7c-40b3-a026-15ee73cf8e00 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:10:44 devstack sudo[107394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-f64df19c-4e64-4c82-96c5-f5228ea99dc0.4ab56bab-7a7c-40b3-a026-15ee73cf8e00 Nov 04 11:10:44 devstack sudo[107394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:10:44 devstack sudo[107394]: pam_unix(sudo:session): session closed for user root Nov 04 11:10:44 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-10b74d25-fb04-4c01-9ae3-014fcdebcc98 tempest-ProjectMemberTests-186486462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-f64df19c-4e64-4c82-96c5-f5228ea99dc0.4ab56bab-7a7c-40b3-a026-15ee73cf8e00" returned: 0 in 0.395s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:10:44 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-10b74d25-fb04-4c01-9ae3-014fcdebcc98 tempest-ProjectMemberTests-186486462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-f64df19c-4e64-4c82-96c5-f5228ea99dc0.4ab56bab-7a7c-40b3-a026-15ee73cf8e00 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:10:44 devstack sudo[107399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-f64df19c-4e64-4c82-96c5-f5228ea99dc0.4ab56bab-7a7c-40b3-a026-15ee73cf8e00 Nov 04 11:10:44 devstack sudo[107399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:10:44 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-c707987c-fe5a-4657-bbf5-7343ba471e92 tempest-ProjectReaderTests-438802722 None] Acquiring lock "cinder-768358b7-f58f-496b-9a2e-226268195bc8-delete_volume" by "delete_volume" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 11:10:44 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-c707987c-fe5a-4657-bbf5-7343ba471e92 tempest-ProjectReaderTests-438802722 None] Lock "cinder-768358b7-f58f-496b-9a2e-226268195bc8-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 11:10:44 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-c707987c-fe5a-4657-bbf5-7343ba471e92 tempest-ProjectReaderTests-438802722 None] Acquiring lock "cinder-quobyte-768358b7-f58f-496b-9a2e-226268195bc8" by "delete_volume" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 11:10:44 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-c707987c-fe5a-4657-bbf5-7343ba471e92 tempest-ProjectReaderTests-438802722 None] Lock "cinder-quobyte-768358b7-f58f-496b-9a2e-226268195bc8" acquired by "delete_volume" :: waited 0.020s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 11:10:44 devstack sudo[107399]: pam_unix(sudo:session): session closed for user root Nov 04 11:10:44 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-10b74d25-fb04-4c01-9ae3-014fcdebcc98 tempest-ProjectMemberTests-186486462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-f64df19c-4e64-4c82-96c5-f5228ea99dc0.4ab56bab-7a7c-40b3-a026-15ee73cf8e00" returned: 0 in 0.354s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:10:44 devstack cinder-volume[87272]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6aa9c72-33eb-4df1-a696-66198236ca74]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 11:10:44 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-c707987c-fe5a-4657-bbf5-7343ba471e92 tempest-ProjectReaderTests-438802722 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-768358b7-f58f-496b-9a2e-226268195bc8 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:10:44 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-10b74d25-fb04-4c01-9ae3-014fcdebcc98 tempest-ProjectMemberTests-186486462 None] Lock "cinder-quobyte-4ab56bab-7a7c-40b3-a026-15ee73cf8e00" released by "_delete_snapshot" :: held 1.801s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 11:10:44 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-10b74d25-fb04-4c01-9ae3-014fcdebcc98 tempest-ProjectMemberTests-186486462 None] Lock "cinder-quobyte-f64df19c-4e64-4c82-96c5-f5228ea99dc0" released by "delete_snapshot" :: held 1.831s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 11:10:45 devstack cinder-volume[87272]: DEBUG cinder.quota [None req-10b74d25-fb04-4c01-9ae3-014fcdebcc98 tempest-ProjectMemberTests-186486462 None] Created reservations ['a733c311-d67a-4437-9d79-d9f3db56c3f2', 'ae36e371-6279-4145-8e7d-b788ccf58a02', '3cb24a55-3543-4872-a45e-50e77aa07ad8', 'd63117af-1767-495f-bf4b-3f8ad88be4c2'] {{(pid=87272) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 11:10:45 devstack sudo[107402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-768358b7-f58f-496b-9a2e-226268195bc8 Nov 04 11:10:45 devstack sudo[107402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:10:45 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-10b74d25-fb04-4c01-9ae3-014fcdebcc98 tempest-ProjectMemberTests-186486462 None] Delete snapshot completed successfully. Nov 04 11:10:45 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-10b74d25-fb04-4c01-9ae3-014fcdebcc98 tempest-ProjectMemberTests-186486462 None] Lock "cinder-4ab56bab-7a7c-40b3-a026-15ee73cf8e00-delete_snapshot" released by "delete_snapshot" :: held 2.008s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 11:10:45 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-a72724da-901d-4c22-b793-ba418ff11b8f tempest-ProjectMemberTests-186486462 None] Acquiring lock "cinder-f64df19c-4e64-4c82-96c5-f5228ea99dc0-delete_volume" by "delete_volume" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 11:10:45 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-a72724da-901d-4c22-b793-ba418ff11b8f tempest-ProjectMemberTests-186486462 None] Lock "cinder-f64df19c-4e64-4c82-96c5-f5228ea99dc0-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 11:10:45 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-a72724da-901d-4c22-b793-ba418ff11b8f tempest-ProjectMemberTests-186486462 None] Acquiring lock "cinder-quobyte-f64df19c-4e64-4c82-96c5-f5228ea99dc0" by "delete_volume" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 11:10:45 devstack sudo[107402]: pam_unix(sudo:session): session closed for user root Nov 04 11:10:45 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-c707987c-fe5a-4657-bbf5-7343ba471e92 tempest-ProjectReaderTests-438802722 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-768358b7-f58f-496b-9a2e-226268195bc8" returned: 0 in 0.536s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:10:45 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-c707987c-fe5a-4657-bbf5-7343ba471e92 tempest-ProjectReaderTests-438802722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-768358b7-f58f-496b-9a2e-226268195bc8 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:10:45 devstack sudo[107407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-768358b7-f58f-496b-9a2e-226268195bc8 Nov 04 11:10:45 devstack sudo[107407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:10:45 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-a72724da-901d-4c22-b793-ba418ff11b8f tempest-ProjectMemberTests-186486462 None] Lock "cinder-quobyte-f64df19c-4e64-4c82-96c5-f5228ea99dc0" acquired by "delete_volume" :: waited 0.051s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 11:10:45 devstack cinder-volume[87272]: DEBUG oslo.privsep.daemon [-] privsep: reply[352cb81c-e26b-41e3-9f4c-df7351080689]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 11:10:45 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-a72724da-901d-4c22-b793-ba418ff11b8f tempest-ProjectMemberTests-186486462 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-f64df19c-4e64-4c82-96c5-f5228ea99dc0 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:10:45 devstack sudo[107409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-f64df19c-4e64-4c82-96c5-f5228ea99dc0 Nov 04 11:10:45 devstack sudo[107409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:10:45 devstack sudo[107407]: pam_unix(sudo:session): session closed for user root Nov 04 11:10:45 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-c707987c-fe5a-4657-bbf5-7343ba471e92 tempest-ProjectReaderTests-438802722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-768358b7-f58f-496b-9a2e-226268195bc8" returned: 0 in 0.280s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:10:45 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-c707987c-fe5a-4657-bbf5-7343ba471e92 tempest-ProjectReaderTests-438802722 None] Lock "cinder-quobyte-768358b7-f58f-496b-9a2e-226268195bc8" released by "delete_volume" :: held 0.903s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 11:10:45 devstack cinder-volume[87272]: DEBUG cinder.quota [None req-c707987c-fe5a-4657-bbf5-7343ba471e92 tempest-ProjectReaderTests-438802722 None] Created reservations ['49ded653-a9d4-4517-8723-2e1200456b70', '4ef26233-6721-461c-b455-19fcfe9820a4', 'fd1a45c6-5b0f-4744-b550-67a72906b4df', '2dbc6442-6d96-46a4-8f98-23d2ab802b0d'] {{(pid=87272) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 11:10:45 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-c707987c-fe5a-4657-bbf5-7343ba471e92 tempest-ProjectReaderTests-438802722 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 11:10:45 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-c707987c-fe5a-4657-bbf5-7343ba471e92 tempest-ProjectReaderTests-438802722 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 11:10:45 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-c707987c-fe5a-4657-bbf5-7343ba471e92 tempest-ProjectReaderTests-438802722 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898': None} {{(pid=87272) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 11:10:45 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-c707987c-fe5a-4657-bbf5-7343ba471e92 tempest-ProjectReaderTests-438802722 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'] {{(pid=87272) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 11:10:45 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-c707987c-fe5a-4657-bbf5-7343ba471e92 tempest-ProjectReaderTests-438802722 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 11:10:45 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-c707987c-fe5a-4657-bbf5-7343ba471e92 tempest-ProjectReaderTests-438802722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:10:45 devstack sudo[107412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1 Nov 04 11:10:45 devstack sudo[107412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:10:46 devstack sudo[107409]: pam_unix(sudo:session): session closed for user root Nov 04 11:10:46 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-a72724da-901d-4c22-b793-ba418ff11b8f tempest-ProjectMemberTests-186486462 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-f64df19c-4e64-4c82-96c5-f5228ea99dc0" returned: 0 in 0.572s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:10:46 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-a72724da-901d-4c22-b793-ba418ff11b8f tempest-ProjectMemberTests-186486462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-f64df19c-4e64-4c82-96c5-f5228ea99dc0 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:10:46 devstack sudo[107417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-f64df19c-4e64-4c82-96c5-f5228ea99dc0 Nov 04 11:10:46 devstack sudo[107417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:10:46 devstack sudo[107412]: pam_unix(sudo:session): session closed for user root Nov 04 11:10:46 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-c707987c-fe5a-4657-bbf5-7343ba471e92 tempest-ProjectReaderTests-438802722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1" returned: 0 in 0.367s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:10:46 devstack cinder-volume[87272]: DEBUG cinder.manager [None req-c707987c-fe5a-4657-bbf5-7343ba471e92 tempest-ProjectReaderTests-438802722 None] Notifying Schedulers of capabilities ... {{(pid=87272) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 11:10:46 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-c707987c-fe5a-4657-bbf5-7343ba471e92 tempest-ProjectReaderTests-438802722 None] Deleted volume successfully. Nov 04 11:10:46 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-c707987c-fe5a-4657-bbf5-7343ba471e92 tempest-ProjectReaderTests-438802722 None] Lock "cinder-768358b7-f58f-496b-9a2e-226268195bc8-delete_volume" released by "delete_volume" :: held 1.553s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 11:10:46 devstack sudo[107417]: pam_unix(sudo:session): session closed for user root Nov 04 11:10:46 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-a72724da-901d-4c22-b793-ba418ff11b8f tempest-ProjectMemberTests-186486462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-f64df19c-4e64-4c82-96c5-f5228ea99dc0" returned: 0 in 0.395s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:10:46 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-a72724da-901d-4c22-b793-ba418ff11b8f tempest-ProjectMemberTests-186486462 None] Lock "cinder-quobyte-f64df19c-4e64-4c82-96c5-f5228ea99dc0" released by "delete_volume" :: held 1.061s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 11:10:46 devstack cinder-volume[87272]: DEBUG cinder.quota [None req-a72724da-901d-4c22-b793-ba418ff11b8f tempest-ProjectMemberTests-186486462 None] Created reservations ['20ec9282-9c97-4759-807f-bbfa7a0ba9d7', '5b239aa0-c9ba-4a22-aea1-6142663d13c8', '41ffd363-400f-4340-9c62-69b04ee76540', '46b0357b-3157-4d9b-a029-f025e11206c3'] {{(pid=87272) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 11:10:46 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-a72724da-901d-4c22-b793-ba418ff11b8f tempest-ProjectMemberTests-186486462 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 11:10:46 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-a72724da-901d-4c22-b793-ba418ff11b8f tempest-ProjectMemberTests-186486462 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 11:10:46 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-a72724da-901d-4c22-b793-ba418ff11b8f tempest-ProjectMemberTests-186486462 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898': None} {{(pid=87272) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 11:10:46 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-a72724da-901d-4c22-b793-ba418ff11b8f tempest-ProjectMemberTests-186486462 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'] {{(pid=87272) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 11:10:46 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-a72724da-901d-4c22-b793-ba418ff11b8f tempest-ProjectMemberTests-186486462 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 11:10:46 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-a72724da-901d-4c22-b793-ba418ff11b8f tempest-ProjectMemberTests-186486462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:10:46 devstack sudo[107422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1 Nov 04 11:10:46 devstack sudo[107422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:10:47 devstack sudo[107422]: pam_unix(sudo:session): session closed for user root Nov 04 11:10:47 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-a72724da-901d-4c22-b793-ba418ff11b8f tempest-ProjectMemberTests-186486462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1" returned: 0 in 0.309s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:10:47 devstack cinder-volume[87272]: DEBUG cinder.manager [None req-a72724da-901d-4c22-b793-ba418ff11b8f tempest-ProjectMemberTests-186486462 None] Notifying Schedulers of capabilities ... {{(pid=87272) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 11:10:47 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-a72724da-901d-4c22-b793-ba418ff11b8f tempest-ProjectMemberTests-186486462 None] Deleted volume successfully. Nov 04 11:10:47 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-a72724da-901d-4c22-b793-ba418ff11b8f tempest-ProjectMemberTests-186486462 None] Lock "cinder-f64df19c-4e64-4c82-96c5-f5228ea99dc0-delete_volume" released by "delete_volume" :: held 1.675s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 11:10:48 devstack cinder-volume[87272]: DEBUG cinder.volume.flows.manager.create_volume [None req-028655cf-67cd-49bf-a7f4-f4b6f371c81d tempest-ProjectMemberTests-186486462 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87272) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 11:10:48 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-028655cf-67cd-49bf-a7f4-f4b6f371c81d tempest-ProjectMemberTests-186486462 None] Flow 'volume_create_manager' (770ca136-94c4-49fd-ba0e-1dea47a343ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 11:10:48 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-028655cf-67cd-49bf-a7f4-f4b6f371c81d tempest-ProjectMemberTests-186486462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9b28d37-9b3a-4796-a89f-fd60e5f84934) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:10:48 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-028655cf-67cd-49bf-a7f4-f4b6f371c81d tempest-ProjectMemberTests-186486462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9b28d37-9b3a-4796-a89f-fd60e5f84934) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T10:10:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1550218454',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=99439f84-9073-4d3e-a78d-9fe6965956ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8457b114a6264c47af483fad6a8bf18b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T10:10:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T10:10:48Z,use_quota=True,user_id='70a59e5f7c684c0b88977c66a4e36afb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8989e4f-21e3-4f0a-9584-0d818784e883),volume_type_id=f8989e4f-21e3-4f0a-9584-0d818784e883)' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:10:48 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-028655cf-67cd-49bf-a7f4-f4b6f371c81d tempest-ProjectMemberTests-186486462 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec8c7e72-5baa-4df6-b703-efeda5f90625) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:10:48 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-028655cf-67cd-49bf-a7f4-f4b6f371c81d tempest-ProjectMemberTests-186486462 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec8c7e72-5baa-4df6-b703-efeda5f90625) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:10:48 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-028655cf-67cd-49bf-a7f4-f4b6f371c81d tempest-ProjectMemberTests-186486462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (236465a0-fe05-4b62-a764-c5e42d4a8072) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:10:48 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-028655cf-67cd-49bf-a7f4-f4b6f371c81d tempest-ProjectMemberTests-186486462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (236465a0-fe05-4b62-a764-c5e42d4a8072) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '99439f84-9073-4d3e-a78d-9fe6965956ee', 'volume_name': 'volume-99439f84-9073-4d3e-a78d-9fe6965956ee', 'volume_size': 1}' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:10:48 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-028655cf-67cd-49bf-a7f4-f4b6f371c81d tempest-ProjectMemberTests-186486462 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc3177b6-101f-4afc-b846-0050492fc124) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:10:48 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-028655cf-67cd-49bf-a7f4-f4b6f371c81d tempest-ProjectMemberTests-186486462 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc3177b6-101f-4afc-b846-0050492fc124) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:10:48 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-028655cf-67cd-49bf-a7f4-f4b6f371c81d tempest-ProjectMemberTests-186486462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1801134b-33ac-492f-874e-468e77fd540b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:10:48 devstack cinder-volume[87272]: INFO cinder.volume.flows.manager.create_volume [None req-028655cf-67cd-49bf-a7f4-f4b6f371c81d tempest-ProjectMemberTests-186486462 None] Volume 99439f84-9073-4d3e-a78d-9fe6965956ee: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-99439f84-9073-4d3e-a78d-9fe6965956ee', 'volume_size': 1} Nov 04 11:10:48 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-028655cf-67cd-49bf-a7f4-f4b6f371c81d tempest-ProjectMemberTests-186486462 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 11:10:48 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-028655cf-67cd-49bf-a7f4-f4b6f371c81d tempest-ProjectMemberTests-186486462 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 11:10:48 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-028655cf-67cd-49bf-a7f4-f4b6f371c81d tempest-ProjectMemberTests-186486462 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T10:10:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1550218454',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=99439f84-9073-4d3e-a78d-9fe6965956ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8457b114a6264c47af483fad6a8bf18b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T10:10:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T10:10:48Z,use_quota=True,user_id='70a59e5f7c684c0b88977c66a4e36afb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8989e4f-21e3-4f0a-9584-0d818784e883),volume_type_id=f8989e4f-21e3-4f0a-9584-0d818784e883)}" {{(pid=87272) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 04 11:10:48 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.remotefs [None req-028655cf-67cd-49bf-a7f4-f4b6f371c81d tempest-ProjectMemberTests-186486462 None] Creating volume 99439f84-9073-4d3e-a78d-9fe6965956ee {{(pid=87272) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 11:10:48 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-028655cf-67cd-49bf-a7f4-f4b6f371c81d tempest-ProjectMemberTests-186486462 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 11:10:48 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-028655cf-67cd-49bf-a7f4-f4b6f371c81d tempest-ProjectMemberTests-186486462 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 11:10:48 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-028655cf-67cd-49bf-a7f4-f4b6f371c81d tempest-ProjectMemberTests-186486462 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898': None} {{(pid=87272) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 11:10:48 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-028655cf-67cd-49bf-a7f4-f4b6f371c81d tempest-ProjectMemberTests-186486462 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'] {{(pid=87272) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 11:10:48 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-028655cf-67cd-49bf-a7f4-f4b6f371c81d tempest-ProjectMemberTests-186486462 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 11:10:48 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-028655cf-67cd-49bf-a7f4-f4b6f371c81d tempest-ProjectMemberTests-186486462 None] Selected osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898 as target Quobyte volume. {{(pid=87272) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 11:10:48 devstack cinder-volume[87272]: INFO cinder.volume.drivers.remotefs [None req-028655cf-67cd-49bf-a7f4-f4b6f371c81d tempest-ProjectMemberTests-186486462 None] casted to osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898 Nov 04 11:10:48 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-028655cf-67cd-49bf-a7f4-f4b6f371c81d tempest-ProjectMemberTests-186486462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-99439f84-9073-4d3e-a78d-9fe6965956ee 1073741824 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:10:48 devstack sudo[107425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-99439f84-9073-4d3e-a78d-9fe6965956ee 1073741824 Nov 04 11:10:48 devstack sudo[107425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:10:48 devstack sudo[107425]: pam_unix(sudo:session): session closed for user root Nov 04 11:10:48 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-028655cf-67cd-49bf-a7f4-f4b6f371c81d tempest-ProjectMemberTests-186486462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-99439f84-9073-4d3e-a78d-9fe6965956ee 1073741824" returned: 0 in 0.583s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:10:48 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-028655cf-67cd-49bf-a7f4-f4b6f371c81d tempest-ProjectMemberTests-186486462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-99439f84-9073-4d3e-a78d-9fe6965956ee {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:10:49 devstack sudo[107431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-99439f84-9073-4d3e-a78d-9fe6965956ee Nov 04 11:10:49 devstack sudo[107431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:10:49 devstack sudo[107431]: pam_unix(sudo:session): session closed for user root Nov 04 11:10:49 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-028655cf-67cd-49bf-a7f4-f4b6f371c81d tempest-ProjectMemberTests-186486462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-99439f84-9073-4d3e-a78d-9fe6965956ee" returned: 0 in 0.338s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:10:49 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-028655cf-67cd-49bf-a7f4-f4b6f371c81d tempest-ProjectMemberTests-186486462 None] <== create_volume: return (997ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'} {{(pid=87272) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 04 11:10:49 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-028655cf-67cd-49bf-a7f4-f4b6f371c81d tempest-ProjectMemberTests-186486462 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.001s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 11:10:49 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-028655cf-67cd-49bf-a7f4-f4b6f371c81d tempest-ProjectMemberTests-186486462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1801134b-33ac-492f-874e-468e77fd540b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-99439f84-9073-4d3e-a78d-9fe6965956ee', 'volume_size': 1}' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:10:49 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-028655cf-67cd-49bf-a7f4-f4b6f371c81d tempest-ProjectMemberTests-186486462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ce7b48a-948e-4c4c-88e0-5f90a3123d07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:10:49 devstack cinder-volume[87272]: INFO cinder.volume.flows.manager.create_volume [None req-028655cf-67cd-49bf-a7f4-f4b6f371c81d tempest-ProjectMemberTests-186486462 None] Volume volume-99439f84-9073-4d3e-a78d-9fe6965956ee (99439f84-9073-4d3e-a78d-9fe6965956ee): created successfully Nov 04 11:10:49 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-028655cf-67cd-49bf-a7f4-f4b6f371c81d tempest-ProjectMemberTests-186486462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ce7b48a-948e-4c4c-88e0-5f90a3123d07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:10:49 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-028655cf-67cd-49bf-a7f4-f4b6f371c81d tempest-ProjectMemberTests-186486462 None] Flow 'volume_create_manager' (770ca136-94c4-49fd-ba0e-1dea47a343ee) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87272) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 11:10:49 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-028655cf-67cd-49bf-a7f4-f4b6f371c81d tempest-ProjectMemberTests-186486462 None] Created volume successfully. Nov 04 11:10:50 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-0851a54f-f337-4b0d-83c0-e0f9f45e7b32 tempest-ProjectMemberTests-186486462 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 11:10:50 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-0851a54f-f337-4b0d-83c0-e0f9f45e7b32 tempest-ProjectMemberTests-186486462 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 11:10:50 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.remotefs [None req-0851a54f-f337-4b0d-83c0-e0f9f45e7b32 tempest-ProjectMemberTests-186486462 None] Creating offline snapshot e8ac0f85-d330-41ff-acee-f905457a2019 of volume 99439f84-9073-4d3e-a78d-9fe6965956ee {{(pid=87272) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 04 11:10:50 devstack cinder-volume[87272]: DEBUG oslo.privsep.daemon [-] privsep: reply[c83fa9b8-f9e6-46f8-b891-06c058db0b21]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 11:10:50 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-0851a54f-f337-4b0d-83c0-e0f9f45e7b32 tempest-ProjectMemberTests-186486462 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-99439f84-9073-4d3e-a78d-9fe6965956ee {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:10:50 devstack sudo[107435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-99439f84-9073-4d3e-a78d-9fe6965956ee Nov 04 11:10:50 devstack sudo[107435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:10:51 devstack sudo[107435]: pam_unix(sudo:session): session closed for user root Nov 04 11:10:51 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-0851a54f-f337-4b0d-83c0-e0f9f45e7b32 tempest-ProjectMemberTests-186486462 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-99439f84-9073-4d3e-a78d-9fe6965956ee" returned: 0 in 0.419s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:10:51 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-0851a54f-f337-4b0d-83c0-e0f9f45e7b32 tempest-ProjectMemberTests-186486462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-99439f84-9073-4d3e-a78d-9fe6965956ee,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-99439f84-9073-4d3e-a78d-9fe6965956ee.e8ac0f85-d330-41ff-acee-f905457a2019 1G {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:10:51 devstack sudo[107440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-99439f84-9073-4d3e-a78d-9fe6965956ee,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-99439f84-9073-4d3e-a78d-9fe6965956ee.e8ac0f85-d330-41ff-acee-f905457a2019 1G Nov 04 11:10:51 devstack sudo[107440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:10:51 devstack cinder-volume[87272]: DEBUG cinder.volume.flows.manager.create_volume [None req-a2ae19eb-3009-42f3-a0e5-3973fe705034 tempest-ProjectReaderTests-1709054323 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87272) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 11:10:51 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-a2ae19eb-3009-42f3-a0e5-3973fe705034 tempest-ProjectReaderTests-1709054323 None] Flow 'volume_create_manager' (10564af3-1260-417b-9457-4e656af700c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 11:10:51 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-a2ae19eb-3009-42f3-a0e5-3973fe705034 tempest-ProjectReaderTests-1709054323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d79776e6-f499-4c77-8730-f3d77bfe90da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:10:51 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-a2ae19eb-3009-42f3-a0e5-3973fe705034 tempest-ProjectReaderTests-1709054323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d79776e6-f499-4c77-8730-f3d77bfe90da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T10:10:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1027738558',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=54cec801-0e18-4373-9e7b-7b555af59d62,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='07a715a078e04e65b5f74a9bd90b072b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T10:10:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T10:10:51Z,use_quota=True,user_id='0169aff07937486d9b7fd77a06536766',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8989e4f-21e3-4f0a-9584-0d818784e883),volume_type_id=f8989e4f-21e3-4f0a-9584-0d818784e883)' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:10:51 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-a2ae19eb-3009-42f3-a0e5-3973fe705034 tempest-ProjectReaderTests-1709054323 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ed12565-a334-4895-a693-6681a9175bab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:10:51 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-a2ae19eb-3009-42f3-a0e5-3973fe705034 tempest-ProjectReaderTests-1709054323 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ed12565-a334-4895-a693-6681a9175bab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:10:51 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-a2ae19eb-3009-42f3-a0e5-3973fe705034 tempest-ProjectReaderTests-1709054323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f26c8b4-0f10-49ee-b359-481195ebf6c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:10:51 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-a2ae19eb-3009-42f3-a0e5-3973fe705034 tempest-ProjectReaderTests-1709054323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f26c8b4-0f10-49ee-b359-481195ebf6c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '54cec801-0e18-4373-9e7b-7b555af59d62', 'volume_name': 'volume-54cec801-0e18-4373-9e7b-7b555af59d62', 'volume_size': 1}' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:10:51 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-a2ae19eb-3009-42f3-a0e5-3973fe705034 tempest-ProjectReaderTests-1709054323 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (55fd6cc7-6ddf-4109-b9ce-4b3136bd8f8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:10:51 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-a2ae19eb-3009-42f3-a0e5-3973fe705034 tempest-ProjectReaderTests-1709054323 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (55fd6cc7-6ddf-4109-b9ce-4b3136bd8f8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:10:51 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-a2ae19eb-3009-42f3-a0e5-3973fe705034 tempest-ProjectReaderTests-1709054323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98bf6d44-0cdc-40d5-862a-884d3b0e087c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:10:51 devstack cinder-volume[87272]: INFO cinder.volume.flows.manager.create_volume [None req-a2ae19eb-3009-42f3-a0e5-3973fe705034 tempest-ProjectReaderTests-1709054323 None] Volume 54cec801-0e18-4373-9e7b-7b555af59d62: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-54cec801-0e18-4373-9e7b-7b555af59d62', 'volume_size': 1} Nov 04 11:10:51 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-a2ae19eb-3009-42f3-a0e5-3973fe705034 tempest-ProjectReaderTests-1709054323 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 11:10:51 devstack sudo[107440]: pam_unix(sudo:session): session closed for user root Nov 04 11:10:51 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-0851a54f-f337-4b0d-83c0-e0f9f45e7b32 tempest-ProjectMemberTests-186486462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-99439f84-9073-4d3e-a78d-9fe6965956ee,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-99439f84-9073-4d3e-a78d-9fe6965956ee.e8ac0f85-d330-41ff-acee-f905457a2019 1G" returned: 0 in 0.642s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:10:51 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-0851a54f-f337-4b0d-83c0-e0f9f45e7b32 tempest-ProjectMemberTests-186486462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-99439f84-9073-4d3e-a78d-9fe6965956ee -F qcow2 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-99439f84-9073-4d3e-a78d-9fe6965956ee.e8ac0f85-d330-41ff-acee-f905457a2019 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:10:51 devstack sudo[107446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-99439f84-9073-4d3e-a78d-9fe6965956ee -F qcow2 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-99439f84-9073-4d3e-a78d-9fe6965956ee.e8ac0f85-d330-41ff-acee-f905457a2019 Nov 04 11:10:51 devstack sudo[107446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:10:52 devstack sudo[107446]: pam_unix(sudo:session): session closed for user root Nov 04 11:10:52 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-0851a54f-f337-4b0d-83c0-e0f9f45e7b32 tempest-ProjectMemberTests-186486462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-99439f84-9073-4d3e-a78d-9fe6965956ee -F qcow2 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-99439f84-9073-4d3e-a78d-9fe6965956ee.e8ac0f85-d330-41ff-acee-f905457a2019" returned: 0 in 0.357s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:10:52 devstack cinder-volume[87272]: WARNING cinder.volume.drivers.remotefs [None req-0851a54f-f337-4b0d-83c0-e0f9f45e7b32 tempest-ProjectMemberTests-186486462 None] /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-99439f84-9073-4d3e-a78d-9fe6965956ee.e8ac0f85-d330-41ff-acee-f905457a2019 is being set with open permissions: ugo+rw Nov 04 11:10:52 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-0851a54f-f337-4b0d-83c0-e0f9f45e7b32 tempest-ProjectMemberTests-186486462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-99439f84-9073-4d3e-a78d-9fe6965956ee.e8ac0f85-d330-41ff-acee-f905457a2019 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:10:52 devstack sudo[107451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-99439f84-9073-4d3e-a78d-9fe6965956ee.e8ac0f85-d330-41ff-acee-f905457a2019 Nov 04 11:10:52 devstack sudo[107451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:10:52 devstack sudo[107451]: pam_unix(sudo:session): session closed for user root Nov 04 11:10:52 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-0851a54f-f337-4b0d-83c0-e0f9f45e7b32 tempest-ProjectMemberTests-186486462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-99439f84-9073-4d3e-a78d-9fe6965956ee.e8ac0f85-d330-41ff-acee-f905457a2019" returned: 0 in 0.317s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:10:52 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-0851a54f-f337-4b0d-83c0-e0f9f45e7b32 tempest-ProjectMemberTests-186486462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-99439f84-9073-4d3e-a78d-9fe6965956ee.info {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:10:52 devstack sudo[107454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-99439f84-9073-4d3e-a78d-9fe6965956ee.info Nov 04 11:10:52 devstack sudo[107454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:10:52 devstack sudo[107454]: pam_unix(sudo:session): session closed for user root Nov 04 11:10:52 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-0851a54f-f337-4b0d-83c0-e0f9f45e7b32 tempest-ProjectMemberTests-186486462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-99439f84-9073-4d3e-a78d-9fe6965956ee.info" returned: 0 in 0.303s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:10:52 devstack cinder-volume[87272]: WARNING cinder.volume.drivers.remotefs [None req-0851a54f-f337-4b0d-83c0-e0f9f45e7b32 tempest-ProjectMemberTests-186486462 None] /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-99439f84-9073-4d3e-a78d-9fe6965956ee.info is being set with open permissions: ugo+rw Nov 04 11:10:52 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-0851a54f-f337-4b0d-83c0-e0f9f45e7b32 tempest-ProjectMemberTests-186486462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-99439f84-9073-4d3e-a78d-9fe6965956ee.info {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:10:52 devstack sudo[107457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-99439f84-9073-4d3e-a78d-9fe6965956ee.info Nov 04 11:10:52 devstack sudo[107457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:10:52 devstack sudo[107457]: pam_unix(sudo:session): session closed for user root Nov 04 11:10:52 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-0851a54f-f337-4b0d-83c0-e0f9f45e7b32 tempest-ProjectMemberTests-186486462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-99439f84-9073-4d3e-a78d-9fe6965956ee.info" returned: 0 in 0.285s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:10:53 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-0851a54f-f337-4b0d-83c0-e0f9f45e7b32 tempest-ProjectMemberTests-186486462 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.443s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 11:10:53 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-a2ae19eb-3009-42f3-a0e5-3973fe705034 tempest-ProjectReaderTests-1709054323 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.522s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 11:10:53 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-a2ae19eb-3009-42f3-a0e5-3973fe705034 tempest-ProjectReaderTests-1709054323 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T10:10:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1027738558',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=54cec801-0e18-4373-9e7b-7b555af59d62,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='07a715a078e04e65b5f74a9bd90b072b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T10:10:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T10:10:51Z,use_quota=True,user_id='0169aff07937486d9b7fd77a06536766',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8989e4f-21e3-4f0a-9584-0d818784e883),volume_type_id=f8989e4f-21e3-4f0a-9584-0d818784e883)}" {{(pid=87272) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 04 11:10:53 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.remotefs [None req-a2ae19eb-3009-42f3-a0e5-3973fe705034 tempest-ProjectReaderTests-1709054323 None] Creating volume 54cec801-0e18-4373-9e7b-7b555af59d62 {{(pid=87272) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 11:10:53 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-a2ae19eb-3009-42f3-a0e5-3973fe705034 tempest-ProjectReaderTests-1709054323 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 11:10:53 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-a2ae19eb-3009-42f3-a0e5-3973fe705034 tempest-ProjectReaderTests-1709054323 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 11:10:53 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-a2ae19eb-3009-42f3-a0e5-3973fe705034 tempest-ProjectReaderTests-1709054323 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898': None} {{(pid=87272) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 11:10:53 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-a2ae19eb-3009-42f3-a0e5-3973fe705034 tempest-ProjectReaderTests-1709054323 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'] {{(pid=87272) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 11:10:53 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-a2ae19eb-3009-42f3-a0e5-3973fe705034 tempest-ProjectReaderTests-1709054323 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 11:10:53 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-a2ae19eb-3009-42f3-a0e5-3973fe705034 tempest-ProjectReaderTests-1709054323 None] Selected osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898 as target Quobyte volume. {{(pid=87272) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 11:10:53 devstack cinder-volume[87272]: INFO cinder.volume.drivers.remotefs [None req-a2ae19eb-3009-42f3-a0e5-3973fe705034 tempest-ProjectReaderTests-1709054323 None] casted to osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898 Nov 04 11:10:53 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-a2ae19eb-3009-42f3-a0e5-3973fe705034 tempest-ProjectReaderTests-1709054323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-54cec801-0e18-4373-9e7b-7b555af59d62 1073741824 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:10:53 devstack sudo[107460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-54cec801-0e18-4373-9e7b-7b555af59d62 1073741824 Nov 04 11:10:53 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-0851a54f-f337-4b0d-83c0-e0f9f45e7b32 tempest-ProjectMemberTests-186486462 None] Create snapshot completed successfully Nov 04 11:10:53 devstack sudo[107460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:10:53 devstack sudo[107460]: pam_unix(sudo:session): session closed for user root Nov 04 11:10:53 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-27821995-f483-43fb-9a81-b41b67924979 tempest-ProjectMemberTests-186486462 None] Acquiring lock "cinder-e8ac0f85-d330-41ff-acee-f905457a2019-delete_snapshot" by "delete_snapshot" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 11:10:53 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-a2ae19eb-3009-42f3-a0e5-3973fe705034 tempest-ProjectReaderTests-1709054323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-54cec801-0e18-4373-9e7b-7b555af59d62 1073741824" returned: 0 in 0.698s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:10:53 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-27821995-f483-43fb-9a81-b41b67924979 tempest-ProjectMemberTests-186486462 None] Lock "cinder-e8ac0f85-d330-41ff-acee-f905457a2019-delete_snapshot" acquired by "delete_snapshot" :: waited 0.049s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 11:10:53 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-27821995-f483-43fb-9a81-b41b67924979 tempest-ProjectMemberTests-186486462 None] Acquiring lock "cinder-quobyte-99439f84-9073-4d3e-a78d-9fe6965956ee" by "delete_snapshot" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 11:10:53 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-27821995-f483-43fb-9a81-b41b67924979 tempest-ProjectMemberTests-186486462 None] Lock "cinder-quobyte-99439f84-9073-4d3e-a78d-9fe6965956ee" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 11:10:53 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-27821995-f483-43fb-9a81-b41b67924979 tempest-ProjectMemberTests-186486462 None] Acquiring lock "cinder-quobyte-e8ac0f85-d330-41ff-acee-f905457a2019" by "_delete_snapshot" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 11:10:53 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-a2ae19eb-3009-42f3-a0e5-3973fe705034 tempest-ProjectReaderTests-1709054323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-54cec801-0e18-4373-9e7b-7b555af59d62 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:10:53 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-27821995-f483-43fb-9a81-b41b67924979 tempest-ProjectMemberTests-186486462 None] Lock "cinder-quobyte-e8ac0f85-d330-41ff-acee-f905457a2019" acquired by "_delete_snapshot" :: waited 0.036s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 11:10:53 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.remotefs [None req-27821995-f483-43fb-9a81-b41b67924979 tempest-ProjectMemberTests-186486462 None] Deleting offline snapshot e8ac0f85-d330-41ff-acee-f905457a2019 of volume 99439f84-9073-4d3e-a78d-9fe6965956ee {{(pid=87272) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 04 11:10:53 devstack sudo[107466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-54cec801-0e18-4373-9e7b-7b555af59d62 Nov 04 11:10:53 devstack sudo[107466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:10:53 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.remotefs [None req-27821995-f483-43fb-9a81-b41b67924979 tempest-ProjectMemberTests-186486462 None] snapshot_file for this snap is: volume-99439f84-9073-4d3e-a78d-9fe6965956ee.e8ac0f85-d330-41ff-acee-f905457a2019 {{(pid=87272) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 04 11:10:53 devstack cinder-volume[87272]: DEBUG oslo.privsep.daemon [-] privsep: reply[97c8782c-e180-4f09-b3c6-a8f653c89e36]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 11:10:53 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-27821995-f483-43fb-9a81-b41b67924979 tempest-ProjectMemberTests-186486462 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-99439f84-9073-4d3e-a78d-9fe6965956ee.e8ac0f85-d330-41ff-acee-f905457a2019 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:10:54 devstack sudo[107468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-99439f84-9073-4d3e-a78d-9fe6965956ee.e8ac0f85-d330-41ff-acee-f905457a2019 Nov 04 11:10:54 devstack sudo[107468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:10:54 devstack sudo[107466]: pam_unix(sudo:session): session closed for user root Nov 04 11:10:54 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-a2ae19eb-3009-42f3-a0e5-3973fe705034 tempest-ProjectReaderTests-1709054323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-54cec801-0e18-4373-9e7b-7b555af59d62" returned: 0 in 0.372s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:10:54 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-a2ae19eb-3009-42f3-a0e5-3973fe705034 tempest-ProjectReaderTests-1709054323 None] <== create_volume: return (1158ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'} {{(pid=87272) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 04 11:10:54 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-a2ae19eb-3009-42f3-a0e5-3973fe705034 tempest-ProjectReaderTests-1709054323 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.165s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 11:10:54 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-a2ae19eb-3009-42f3-a0e5-3973fe705034 tempest-ProjectReaderTests-1709054323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98bf6d44-0cdc-40d5-862a-884d3b0e087c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-54cec801-0e18-4373-9e7b-7b555af59d62', 'volume_size': 1}' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:10:54 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-a2ae19eb-3009-42f3-a0e5-3973fe705034 tempest-ProjectReaderTests-1709054323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (baf9c657-ba35-412b-ab53-6b6b145d1230) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:10:54 devstack cinder-volume[87272]: INFO cinder.volume.flows.manager.create_volume [None req-a2ae19eb-3009-42f3-a0e5-3973fe705034 tempest-ProjectReaderTests-1709054323 None] Volume volume-54cec801-0e18-4373-9e7b-7b555af59d62 (54cec801-0e18-4373-9e7b-7b555af59d62): created successfully Nov 04 11:10:54 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-a2ae19eb-3009-42f3-a0e5-3973fe705034 tempest-ProjectReaderTests-1709054323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (baf9c657-ba35-412b-ab53-6b6b145d1230) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:10:54 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-a2ae19eb-3009-42f3-a0e5-3973fe705034 tempest-ProjectReaderTests-1709054323 None] Flow 'volume_create_manager' (10564af3-1260-417b-9457-4e656af700c4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87272) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 11:10:54 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-a2ae19eb-3009-42f3-a0e5-3973fe705034 tempest-ProjectReaderTests-1709054323 None] Created volume successfully. Nov 04 11:10:54 devstack sudo[107468]: pam_unix(sudo:session): session closed for user root Nov 04 11:10:54 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-27821995-f483-43fb-9a81-b41b67924979 tempest-ProjectMemberTests-186486462 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-99439f84-9073-4d3e-a78d-9fe6965956ee.e8ac0f85-d330-41ff-acee-f905457a2019" returned: 0 in 0.586s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:10:54 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.remotefs [None req-27821995-f483-43fb-9a81-b41b67924979 tempest-ProjectMemberTests-186486462 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-99439f84-9073-4d3e-a78d-9fe6965956ee(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87272) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 11:10:54 devstack cinder-volume[87272]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5dc7b34-bbb4-4039-ba28-81a56ffef0c5]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 11:10:54 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-27821995-f483-43fb-9a81-b41b67924979 tempest-ProjectMemberTests-186486462 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-99439f84-9073-4d3e-a78d-9fe6965956ee {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:10:54 devstack sudo[107475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-99439f84-9073-4d3e-a78d-9fe6965956ee Nov 04 11:10:54 devstack sudo[107475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:10:54 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-525c702f-8176-42fd-bb33-658db3a8a038 tempest-ProjectReaderTests-1709054323 None] Acquiring lock "cinder-54cec801-0e18-4373-9e7b-7b555af59d62-delete_volume" by "delete_volume" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 11:10:55 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-525c702f-8176-42fd-bb33-658db3a8a038 tempest-ProjectReaderTests-1709054323 None] Lock "cinder-54cec801-0e18-4373-9e7b-7b555af59d62-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 11:10:55 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-525c702f-8176-42fd-bb33-658db3a8a038 tempest-ProjectReaderTests-1709054323 None] Acquiring lock "cinder-quobyte-54cec801-0e18-4373-9e7b-7b555af59d62" by "delete_volume" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 11:10:55 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-525c702f-8176-42fd-bb33-658db3a8a038 tempest-ProjectReaderTests-1709054323 None] Lock "cinder-quobyte-54cec801-0e18-4373-9e7b-7b555af59d62" acquired by "delete_volume" :: waited 0.034s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 11:10:55 devstack cinder-volume[87272]: DEBUG oslo.privsep.daemon [-] privsep: reply[743095ac-4125-45f0-bb23-bd19512771bb]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 11:10:55 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-525c702f-8176-42fd-bb33-658db3a8a038 tempest-ProjectReaderTests-1709054323 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-54cec801-0e18-4373-9e7b-7b555af59d62 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:10:55 devstack sudo[107475]: pam_unix(sudo:session): session closed for user root Nov 04 11:10:55 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-27821995-f483-43fb-9a81-b41b67924979 tempest-ProjectMemberTests-186486462 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-99439f84-9073-4d3e-a78d-9fe6965956ee" returned: 0 in 0.712s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:10:55 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-27821995-f483-43fb-9a81-b41b67924979 tempest-ProjectMemberTests-186486462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-99439f84-9073-4d3e-a78d-9fe6965956ee.e8ac0f85-d330-41ff-acee-f905457a2019 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:10:55 devstack sudo[107481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-99439f84-9073-4d3e-a78d-9fe6965956ee.e8ac0f85-d330-41ff-acee-f905457a2019 Nov 04 11:10:55 devstack sudo[107481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:10:55 devstack sudo[107480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-54cec801-0e18-4373-9e7b-7b555af59d62 Nov 04 11:10:55 devstack sudo[107480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:10:55 devstack sudo[107480]: pam_unix(sudo:session): session closed for user root Nov 04 11:10:55 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-525c702f-8176-42fd-bb33-658db3a8a038 tempest-ProjectReaderTests-1709054323 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-54cec801-0e18-4373-9e7b-7b555af59d62" returned: 0 in 0.547s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:10:55 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-525c702f-8176-42fd-bb33-658db3a8a038 tempest-ProjectReaderTests-1709054323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-54cec801-0e18-4373-9e7b-7b555af59d62 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:10:55 devstack sudo[107481]: pam_unix(sudo:session): session closed for user root Nov 04 11:10:55 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-27821995-f483-43fb-9a81-b41b67924979 tempest-ProjectMemberTests-186486462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-99439f84-9073-4d3e-a78d-9fe6965956ee.e8ac0f85-d330-41ff-acee-f905457a2019" returned: 0 in 0.529s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:10:55 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-27821995-f483-43fb-9a81-b41b67924979 tempest-ProjectMemberTests-186486462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-99439f84-9073-4d3e-a78d-9fe6965956ee.e8ac0f85-d330-41ff-acee-f905457a2019 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:10:55 devstack sudo[107490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-54cec801-0e18-4373-9e7b-7b555af59d62 Nov 04 11:10:55 devstack sudo[107490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:10:55 devstack sudo[107491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-99439f84-9073-4d3e-a78d-9fe6965956ee.e8ac0f85-d330-41ff-acee-f905457a2019 Nov 04 11:10:55 devstack sudo[107491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:10:56 devstack sudo[107490]: pam_unix(sudo:session): session closed for user root Nov 04 11:10:56 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-525c702f-8176-42fd-bb33-658db3a8a038 tempest-ProjectReaderTests-1709054323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-54cec801-0e18-4373-9e7b-7b555af59d62" returned: 0 in 0.295s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:10:56 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-525c702f-8176-42fd-bb33-658db3a8a038 tempest-ProjectReaderTests-1709054323 None] Lock "cinder-quobyte-54cec801-0e18-4373-9e7b-7b555af59d62" released by "delete_volume" :: held 0.940s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 11:10:56 devstack sudo[107491]: pam_unix(sudo:session): session closed for user root Nov 04 11:10:56 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-27821995-f483-43fb-9a81-b41b67924979 tempest-ProjectMemberTests-186486462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-99439f84-9073-4d3e-a78d-9fe6965956ee.e8ac0f85-d330-41ff-acee-f905457a2019" returned: 0 in 0.359s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:10:56 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-27821995-f483-43fb-9a81-b41b67924979 tempest-ProjectMemberTests-186486462 None] Lock "cinder-quobyte-e8ac0f85-d330-41ff-acee-f905457a2019" released by "_delete_snapshot" :: held 2.395s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 11:10:56 devstack cinder-volume[87272]: DEBUG cinder.quota [None req-525c702f-8176-42fd-bb33-658db3a8a038 tempest-ProjectReaderTests-1709054323 None] Created reservations ['60d57e95-f78d-4c77-b237-8e3439558b93', 'a3e5ff69-5db2-4140-b932-218a09b5b33f', '975bd3de-5dce-40ca-add2-e60a27da5964', '2bf07dea-3b0d-4eb1-af39-c49b574379d5'] {{(pid=87272) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 11:10:56 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-27821995-f483-43fb-9a81-b41b67924979 tempest-ProjectMemberTests-186486462 None] Lock "cinder-quobyte-99439f84-9073-4d3e-a78d-9fe6965956ee" released by "delete_snapshot" :: held 2.445s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 11:10:56 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-525c702f-8176-42fd-bb33-658db3a8a038 tempest-ProjectReaderTests-1709054323 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 11:10:56 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-525c702f-8176-42fd-bb33-658db3a8a038 tempest-ProjectReaderTests-1709054323 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 11:10:56 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-525c702f-8176-42fd-bb33-658db3a8a038 tempest-ProjectReaderTests-1709054323 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898': None} {{(pid=87272) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 11:10:56 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-525c702f-8176-42fd-bb33-658db3a8a038 tempest-ProjectReaderTests-1709054323 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'] {{(pid=87272) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 11:10:56 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-525c702f-8176-42fd-bb33-658db3a8a038 tempest-ProjectReaderTests-1709054323 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 11:10:56 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-525c702f-8176-42fd-bb33-658db3a8a038 tempest-ProjectReaderTests-1709054323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:10:56 devstack cinder-volume[87272]: DEBUG cinder.quota [None req-27821995-f483-43fb-9a81-b41b67924979 tempest-ProjectMemberTests-186486462 None] Created reservations ['030d506a-a460-410f-9ac8-e8d255dc67bc', '871b04a4-f598-465d-a56d-43190c44104f', 'd6e4e604-1f1d-4b2b-952d-e695ec26e579', '7e6b06e8-45ae-4a4a-9afd-5fe41b8c52d7'] {{(pid=87272) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 11:10:56 devstack sudo[107496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1 Nov 04 11:10:56 devstack sudo[107496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:10:56 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-27821995-f483-43fb-9a81-b41b67924979 tempest-ProjectMemberTests-186486462 None] Delete snapshot completed successfully. Nov 04 11:10:56 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-27821995-f483-43fb-9a81-b41b67924979 tempest-ProjectMemberTests-186486462 None] Lock "cinder-e8ac0f85-d330-41ff-acee-f905457a2019-delete_snapshot" released by "delete_snapshot" :: held 2.803s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 11:10:56 devstack sudo[107496]: pam_unix(sudo:session): session closed for user root Nov 04 11:10:56 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-525c702f-8176-42fd-bb33-658db3a8a038 tempest-ProjectReaderTests-1709054323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1" returned: 0 in 0.374s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:10:56 devstack cinder-volume[87272]: DEBUG cinder.manager [None req-525c702f-8176-42fd-bb33-658db3a8a038 tempest-ProjectReaderTests-1709054323 None] Notifying Schedulers of capabilities ... {{(pid=87272) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 11:10:56 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-525c702f-8176-42fd-bb33-658db3a8a038 tempest-ProjectReaderTests-1709054323 None] Deleted volume successfully. Nov 04 11:10:56 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-525c702f-8176-42fd-bb33-658db3a8a038 tempest-ProjectReaderTests-1709054323 None] Lock "cinder-54cec801-0e18-4373-9e7b-7b555af59d62-delete_volume" released by "delete_volume" :: held 1.771s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 11:10:57 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-36c79f9e-c0ac-46f2-8b0e-432df50e7e66 tempest-ProjectMemberTests-186486462 None] Acquiring lock "cinder-99439f84-9073-4d3e-a78d-9fe6965956ee-delete_volume" by "delete_volume" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 11:10:57 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-36c79f9e-c0ac-46f2-8b0e-432df50e7e66 tempest-ProjectMemberTests-186486462 None] Lock "cinder-99439f84-9073-4d3e-a78d-9fe6965956ee-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 11:10:57 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-36c79f9e-c0ac-46f2-8b0e-432df50e7e66 tempest-ProjectMemberTests-186486462 None] Acquiring lock "cinder-quobyte-99439f84-9073-4d3e-a78d-9fe6965956ee" by "delete_volume" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 11:10:57 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-36c79f9e-c0ac-46f2-8b0e-432df50e7e66 tempest-ProjectMemberTests-186486462 None] Lock "cinder-quobyte-99439f84-9073-4d3e-a78d-9fe6965956ee" acquired by "delete_volume" :: waited 0.017s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 11:10:57 devstack cinder-volume[87272]: DEBUG oslo.privsep.daemon [-] privsep: reply[acb76853-1a9b-4a54-8584-7b9d3b53133d]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 11:10:57 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-36c79f9e-c0ac-46f2-8b0e-432df50e7e66 tempest-ProjectMemberTests-186486462 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-99439f84-9073-4d3e-a78d-9fe6965956ee {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:10:57 devstack sudo[107500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-99439f84-9073-4d3e-a78d-9fe6965956ee Nov 04 11:10:57 devstack sudo[107500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:10:57 devstack sudo[107500]: pam_unix(sudo:session): session closed for user root Nov 04 11:10:57 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-36c79f9e-c0ac-46f2-8b0e-432df50e7e66 tempest-ProjectMemberTests-186486462 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-99439f84-9073-4d3e-a78d-9fe6965956ee" returned: 0 in 0.542s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:10:57 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-36c79f9e-c0ac-46f2-8b0e-432df50e7e66 tempest-ProjectMemberTests-186486462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-99439f84-9073-4d3e-a78d-9fe6965956ee {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:10:57 devstack sudo[107505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-99439f84-9073-4d3e-a78d-9fe6965956ee Nov 04 11:10:57 devstack sudo[107505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:10:57 devstack cinder-volume[87272]: DEBUG cinder.volume.flows.manager.create_volume [None req-6d58f3c6-62ec-444f-9c22-f3207e0faa2f tempest-ProjectReaderTests-1709054323 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87272) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 11:10:57 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-6d58f3c6-62ec-444f-9c22-f3207e0faa2f tempest-ProjectReaderTests-1709054323 None] Flow 'volume_create_manager' (bacf40d4-949b-4851-aec8-3e32fa8a96d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 11:10:57 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-6d58f3c6-62ec-444f-9c22-f3207e0faa2f tempest-ProjectReaderTests-1709054323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2557178a-a274-4cb4-8d54-54f7f7abf648) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:10:58 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-6d58f3c6-62ec-444f-9c22-f3207e0faa2f tempest-ProjectReaderTests-1709054323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2557178a-a274-4cb4-8d54-54f7f7abf648) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T10:10:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-839113787',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=77be3f8a-f348-454a-807b-67f09d5df68d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='07a715a078e04e65b5f74a9bd90b072b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T10:10:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T10:10:58Z,use_quota=True,user_id='0169aff07937486d9b7fd77a06536766',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8989e4f-21e3-4f0a-9584-0d818784e883),volume_type_id=f8989e4f-21e3-4f0a-9584-0d818784e883)' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:10:58 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-6d58f3c6-62ec-444f-9c22-f3207e0faa2f tempest-ProjectReaderTests-1709054323 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1492282a-c48b-4c44-a682-6c233befe637) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:10:58 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-6d58f3c6-62ec-444f-9c22-f3207e0faa2f tempest-ProjectReaderTests-1709054323 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1492282a-c48b-4c44-a682-6c233befe637) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:10:58 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-6d58f3c6-62ec-444f-9c22-f3207e0faa2f tempest-ProjectReaderTests-1709054323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71945928-98a0-486c-949e-bb1eec79dd11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:10:58 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-6d58f3c6-62ec-444f-9c22-f3207e0faa2f tempest-ProjectReaderTests-1709054323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71945928-98a0-486c-949e-bb1eec79dd11) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '77be3f8a-f348-454a-807b-67f09d5df68d', 'volume_name': 'volume-77be3f8a-f348-454a-807b-67f09d5df68d', 'volume_size': 1}' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:10:58 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-6d58f3c6-62ec-444f-9c22-f3207e0faa2f tempest-ProjectReaderTests-1709054323 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75da2d7d-fe97-4a3f-995f-e0748a2704b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:10:58 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-6d58f3c6-62ec-444f-9c22-f3207e0faa2f tempest-ProjectReaderTests-1709054323 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75da2d7d-fe97-4a3f-995f-e0748a2704b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:10:58 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-6d58f3c6-62ec-444f-9c22-f3207e0faa2f tempest-ProjectReaderTests-1709054323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f23ac512-ba1a-4a3b-b362-1aca90c0a31b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:10:58 devstack cinder-volume[87272]: INFO cinder.volume.flows.manager.create_volume [None req-6d58f3c6-62ec-444f-9c22-f3207e0faa2f tempest-ProjectReaderTests-1709054323 None] Volume 77be3f8a-f348-454a-807b-67f09d5df68d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-77be3f8a-f348-454a-807b-67f09d5df68d', 'volume_size': 1} Nov 04 11:10:58 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-6d58f3c6-62ec-444f-9c22-f3207e0faa2f tempest-ProjectReaderTests-1709054323 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 11:10:58 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-6d58f3c6-62ec-444f-9c22-f3207e0faa2f tempest-ProjectReaderTests-1709054323 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 11:10:58 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-6d58f3c6-62ec-444f-9c22-f3207e0faa2f tempest-ProjectReaderTests-1709054323 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T10:10:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-839113787',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=77be3f8a-f348-454a-807b-67f09d5df68d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='07a715a078e04e65b5f74a9bd90b072b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T10:10:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T10:10:58Z,use_quota=True,user_id='0169aff07937486d9b7fd77a06536766',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8989e4f-21e3-4f0a-9584-0d818784e883),volume_type_id=f8989e4f-21e3-4f0a-9584-0d818784e883)}" {{(pid=87272) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 04 11:10:58 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.remotefs [None req-6d58f3c6-62ec-444f-9c22-f3207e0faa2f tempest-ProjectReaderTests-1709054323 None] Creating volume 77be3f8a-f348-454a-807b-67f09d5df68d {{(pid=87272) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 11:10:58 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-6d58f3c6-62ec-444f-9c22-f3207e0faa2f tempest-ProjectReaderTests-1709054323 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 11:10:58 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-6d58f3c6-62ec-444f-9c22-f3207e0faa2f tempest-ProjectReaderTests-1709054323 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 11:10:58 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-6d58f3c6-62ec-444f-9c22-f3207e0faa2f tempest-ProjectReaderTests-1709054323 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898': None} {{(pid=87272) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 11:10:58 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-6d58f3c6-62ec-444f-9c22-f3207e0faa2f tempest-ProjectReaderTests-1709054323 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'] {{(pid=87272) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 11:10:58 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-6d58f3c6-62ec-444f-9c22-f3207e0faa2f tempest-ProjectReaderTests-1709054323 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 11:10:58 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-6d58f3c6-62ec-444f-9c22-f3207e0faa2f tempest-ProjectReaderTests-1709054323 None] Selected osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898 as target Quobyte volume. {{(pid=87272) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 11:10:58 devstack cinder-volume[87272]: INFO cinder.volume.drivers.remotefs [None req-6d58f3c6-62ec-444f-9c22-f3207e0faa2f tempest-ProjectReaderTests-1709054323 None] casted to osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898 Nov 04 11:10:58 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-6d58f3c6-62ec-444f-9c22-f3207e0faa2f tempest-ProjectReaderTests-1709054323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-77be3f8a-f348-454a-807b-67f09d5df68d 1073741824 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:10:58 devstack sudo[107505]: pam_unix(sudo:session): session closed for user root Nov 04 11:10:58 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-36c79f9e-c0ac-46f2-8b0e-432df50e7e66 tempest-ProjectMemberTests-186486462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-99439f84-9073-4d3e-a78d-9fe6965956ee" returned: 0 in 0.370s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:10:58 devstack sudo[107508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-77be3f8a-f348-454a-807b-67f09d5df68d 1073741824 Nov 04 11:10:58 devstack sudo[107508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:10:58 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-36c79f9e-c0ac-46f2-8b0e-432df50e7e66 tempest-ProjectMemberTests-186486462 None] Lock "cinder-quobyte-99439f84-9073-4d3e-a78d-9fe6965956ee" released by "delete_volume" :: held 0.999s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 11:10:58 devstack cinder-volume[87272]: DEBUG cinder.quota [None req-36c79f9e-c0ac-46f2-8b0e-432df50e7e66 tempest-ProjectMemberTests-186486462 None] Created reservations ['ea01ef3f-bbbc-45e4-9144-9f9f18c35cd3', '08feda19-8ca2-45af-8e0c-bc66b1d812c3', '5d57c4dd-654c-4c6d-ab9e-501f37f593dd', '706e1c2c-a4aa-4b78-a5cb-334f7e309efa'] {{(pid=87272) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 11:10:58 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-36c79f9e-c0ac-46f2-8b0e-432df50e7e66 tempest-ProjectMemberTests-186486462 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 11:10:58 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-36c79f9e-c0ac-46f2-8b0e-432df50e7e66 tempest-ProjectMemberTests-186486462 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 11:10:58 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-36c79f9e-c0ac-46f2-8b0e-432df50e7e66 tempest-ProjectMemberTests-186486462 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898': None} {{(pid=87272) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 11:10:58 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-36c79f9e-c0ac-46f2-8b0e-432df50e7e66 tempest-ProjectMemberTests-186486462 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'] {{(pid=87272) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 11:10:58 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-36c79f9e-c0ac-46f2-8b0e-432df50e7e66 tempest-ProjectMemberTests-186486462 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 11:10:58 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-36c79f9e-c0ac-46f2-8b0e-432df50e7e66 tempest-ProjectMemberTests-186486462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:10:58 devstack sudo[107510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1 Nov 04 11:10:58 devstack sudo[107510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:10:58 devstack sudo[107508]: pam_unix(sudo:session): session closed for user root Nov 04 11:10:58 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-6d58f3c6-62ec-444f-9c22-f3207e0faa2f tempest-ProjectReaderTests-1709054323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-77be3f8a-f348-454a-807b-67f09d5df68d 1073741824" returned: 0 in 0.604s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:10:58 devstack sudo[107510]: pam_unix(sudo:session): session closed for user root Nov 04 11:10:58 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-36c79f9e-c0ac-46f2-8b0e-432df50e7e66 tempest-ProjectMemberTests-186486462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1" returned: 0 in 0.351s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:10:58 devstack cinder-volume[87272]: DEBUG cinder.manager [None req-36c79f9e-c0ac-46f2-8b0e-432df50e7e66 tempest-ProjectMemberTests-186486462 None] Notifying Schedulers of capabilities ... {{(pid=87272) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 11:10:58 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-36c79f9e-c0ac-46f2-8b0e-432df50e7e66 tempest-ProjectMemberTests-186486462 None] Deleted volume successfully. Nov 04 11:10:58 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-6d58f3c6-62ec-444f-9c22-f3207e0faa2f tempest-ProjectReaderTests-1709054323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-77be3f8a-f348-454a-807b-67f09d5df68d {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:10:58 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-36c79f9e-c0ac-46f2-8b0e-432df50e7e66 tempest-ProjectMemberTests-186486462 None] Lock "cinder-99439f84-9073-4d3e-a78d-9fe6965956ee-delete_volume" released by "delete_volume" :: held 1.686s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 11:10:58 devstack sudo[107517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-77be3f8a-f348-454a-807b-67f09d5df68d Nov 04 11:10:58 devstack sudo[107517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:10:59 devstack sudo[107517]: pam_unix(sudo:session): session closed for user root Nov 04 11:10:59 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-6d58f3c6-62ec-444f-9c22-f3207e0faa2f tempest-ProjectReaderTests-1709054323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-77be3f8a-f348-454a-807b-67f09d5df68d" returned: 0 in 0.366s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:10:59 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-6d58f3c6-62ec-444f-9c22-f3207e0faa2f tempest-ProjectReaderTests-1709054323 None] <== create_volume: return (1038ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'} {{(pid=87272) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 04 11:10:59 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-6d58f3c6-62ec-444f-9c22-f3207e0faa2f tempest-ProjectReaderTests-1709054323 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.041s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 11:10:59 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-6d58f3c6-62ec-444f-9c22-f3207e0faa2f tempest-ProjectReaderTests-1709054323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f23ac512-ba1a-4a3b-b362-1aca90c0a31b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-77be3f8a-f348-454a-807b-67f09d5df68d', 'volume_size': 1}' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:10:59 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-6d58f3c6-62ec-444f-9c22-f3207e0faa2f tempest-ProjectReaderTests-1709054323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f6589bc-cf53-4988-bff7-986b4c23fb45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:10:59 devstack cinder-volume[87272]: INFO cinder.volume.flows.manager.create_volume [None req-6d58f3c6-62ec-444f-9c22-f3207e0faa2f tempest-ProjectReaderTests-1709054323 None] Volume volume-77be3f8a-f348-454a-807b-67f09d5df68d (77be3f8a-f348-454a-807b-67f09d5df68d): created successfully Nov 04 11:10:59 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-6d58f3c6-62ec-444f-9c22-f3207e0faa2f tempest-ProjectReaderTests-1709054323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f6589bc-cf53-4988-bff7-986b4c23fb45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:10:59 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-6d58f3c6-62ec-444f-9c22-f3207e0faa2f tempest-ProjectReaderTests-1709054323 None] Flow 'volume_create_manager' (bacf40d4-949b-4851-aec8-3e32fa8a96d4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87272) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 11:10:59 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-6d58f3c6-62ec-444f-9c22-f3207e0faa2f tempest-ProjectReaderTests-1709054323 None] Created volume successfully. Nov 04 11:10:59 devstack cinder-volume[87272]: DEBUG cinder.volume.flows.manager.create_volume [None req-3e8b5d9a-3ea2-4e29-95b7-073deedb1003 tempest-ProjectMemberTests-186486462 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87272) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 11:11:00 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-3e8b5d9a-3ea2-4e29-95b7-073deedb1003 tempest-ProjectMemberTests-186486462 None] Flow 'volume_create_manager' (44d2c85b-b5bb-4204-92da-ee33d37e3566) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 11:11:00 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-3e8b5d9a-3ea2-4e29-95b7-073deedb1003 tempest-ProjectMemberTests-186486462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f3714f5-d04e-41c4-a982-b86485379371) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:11:00 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-3e8b5d9a-3ea2-4e29-95b7-073deedb1003 tempest-ProjectMemberTests-186486462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f3714f5-d04e-41c4-a982-b86485379371) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T10:11:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1509533640',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f953b092-4e94-40eb-8e32-bd2858bab620,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8457b114a6264c47af483fad6a8bf18b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T10:11:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T10:11:00Z,use_quota=True,user_id='70a59e5f7c684c0b88977c66a4e36afb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8989e4f-21e3-4f0a-9584-0d818784e883),volume_type_id=f8989e4f-21e3-4f0a-9584-0d818784e883)' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:11:00 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-3e8b5d9a-3ea2-4e29-95b7-073deedb1003 tempest-ProjectMemberTests-186486462 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0555942-1e40-4eb6-bc54-d55d8de9bc16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:11:00 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-3e8b5d9a-3ea2-4e29-95b7-073deedb1003 tempest-ProjectMemberTests-186486462 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0555942-1e40-4eb6-bc54-d55d8de9bc16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:11:00 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-3e8b5d9a-3ea2-4e29-95b7-073deedb1003 tempest-ProjectMemberTests-186486462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (46c8aaa6-4a8c-42e8-8c08-e85a58c4c4ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:11:00 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-3e8b5d9a-3ea2-4e29-95b7-073deedb1003 tempest-ProjectMemberTests-186486462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (46c8aaa6-4a8c-42e8-8c08-e85a58c4c4ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f953b092-4e94-40eb-8e32-bd2858bab620', 'volume_name': 'volume-f953b092-4e94-40eb-8e32-bd2858bab620', 'volume_size': 1}' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:11:00 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-3e8b5d9a-3ea2-4e29-95b7-073deedb1003 tempest-ProjectMemberTests-186486462 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (549b1a29-1c6a-4edf-b4ec-8c08e66d4c95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:11:00 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-3e8b5d9a-3ea2-4e29-95b7-073deedb1003 tempest-ProjectMemberTests-186486462 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (549b1a29-1c6a-4edf-b4ec-8c08e66d4c95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:11:00 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-3e8b5d9a-3ea2-4e29-95b7-073deedb1003 tempest-ProjectMemberTests-186486462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8903402b-cf15-4207-add6-a0a3510975d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:11:00 devstack cinder-volume[87272]: INFO cinder.volume.flows.manager.create_volume [None req-3e8b5d9a-3ea2-4e29-95b7-073deedb1003 tempest-ProjectMemberTests-186486462 None] Volume f953b092-4e94-40eb-8e32-bd2858bab620: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f953b092-4e94-40eb-8e32-bd2858bab620', 'volume_size': 1} Nov 04 11:11:00 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-3e8b5d9a-3ea2-4e29-95b7-073deedb1003 tempest-ProjectMemberTests-186486462 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 11:11:00 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-3e8b5d9a-3ea2-4e29-95b7-073deedb1003 tempest-ProjectMemberTests-186486462 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 11:11:00 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-3e8b5d9a-3ea2-4e29-95b7-073deedb1003 tempest-ProjectMemberTests-186486462 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T10:11:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1509533640',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f953b092-4e94-40eb-8e32-bd2858bab620,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8457b114a6264c47af483fad6a8bf18b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T10:11:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T10:11:00Z,use_quota=True,user_id='70a59e5f7c684c0b88977c66a4e36afb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8989e4f-21e3-4f0a-9584-0d818784e883),volume_type_id=f8989e4f-21e3-4f0a-9584-0d818784e883)}" {{(pid=87272) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 04 11:11:00 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.remotefs [None req-3e8b5d9a-3ea2-4e29-95b7-073deedb1003 tempest-ProjectMemberTests-186486462 None] Creating volume f953b092-4e94-40eb-8e32-bd2858bab620 {{(pid=87272) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 11:11:00 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-3e8b5d9a-3ea2-4e29-95b7-073deedb1003 tempest-ProjectMemberTests-186486462 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 11:11:00 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-3e8b5d9a-3ea2-4e29-95b7-073deedb1003 tempest-ProjectMemberTests-186486462 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 11:11:00 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-3e8b5d9a-3ea2-4e29-95b7-073deedb1003 tempest-ProjectMemberTests-186486462 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898': None} {{(pid=87272) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 11:11:00 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-3e8b5d9a-3ea2-4e29-95b7-073deedb1003 tempest-ProjectMemberTests-186486462 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'] {{(pid=87272) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 11:11:00 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-3e8b5d9a-3ea2-4e29-95b7-073deedb1003 tempest-ProjectMemberTests-186486462 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 11:11:00 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-3e8b5d9a-3ea2-4e29-95b7-073deedb1003 tempest-ProjectMemberTests-186486462 None] Selected osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898 as target Quobyte volume. {{(pid=87272) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 11:11:00 devstack cinder-volume[87272]: INFO cinder.volume.drivers.remotefs [None req-3e8b5d9a-3ea2-4e29-95b7-073deedb1003 tempest-ProjectMemberTests-186486462 None] casted to osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898 Nov 04 11:11:00 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-3e8b5d9a-3ea2-4e29-95b7-073deedb1003 tempest-ProjectMemberTests-186486462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-f953b092-4e94-40eb-8e32-bd2858bab620 1073741824 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:11:00 devstack sudo[107522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-f953b092-4e94-40eb-8e32-bd2858bab620 1073741824 Nov 04 11:11:00 devstack sudo[107522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:11:00 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-521467cc-8d5a-454c-8144-6abb64aa4d81 tempest-ProjectReaderTests-1709054323 None] Acquiring lock "cinder-77be3f8a-f348-454a-807b-67f09d5df68d-delete_volume" by "delete_volume" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 11:11:00 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-521467cc-8d5a-454c-8144-6abb64aa4d81 tempest-ProjectReaderTests-1709054323 None] Lock "cinder-77be3f8a-f348-454a-807b-67f09d5df68d-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 11:11:00 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-521467cc-8d5a-454c-8144-6abb64aa4d81 tempest-ProjectReaderTests-1709054323 None] Acquiring lock "cinder-quobyte-77be3f8a-f348-454a-807b-67f09d5df68d" by "delete_volume" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 11:11:00 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-521467cc-8d5a-454c-8144-6abb64aa4d81 tempest-ProjectReaderTests-1709054323 None] Lock "cinder-quobyte-77be3f8a-f348-454a-807b-67f09d5df68d" acquired by "delete_volume" :: waited 0.035s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 11:11:00 devstack cinder-volume[87272]: DEBUG oslo.privsep.daemon [-] privsep: reply[22eff652-4bf0-4af9-8eb3-b8c8a19dcb9b]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 11:11:00 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-521467cc-8d5a-454c-8144-6abb64aa4d81 tempest-ProjectReaderTests-1709054323 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-77be3f8a-f348-454a-807b-67f09d5df68d {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:11:00 devstack sudo[107524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-77be3f8a-f348-454a-807b-67f09d5df68d Nov 04 11:11:00 devstack sudo[107524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:11:00 devstack sudo[107522]: pam_unix(sudo:session): session closed for user root Nov 04 11:11:00 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-3e8b5d9a-3ea2-4e29-95b7-073deedb1003 tempest-ProjectMemberTests-186486462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-f953b092-4e94-40eb-8e32-bd2858bab620 1073741824" returned: 0 in 0.740s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:11:00 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-3e8b5d9a-3ea2-4e29-95b7-073deedb1003 tempest-ProjectMemberTests-186486462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-f953b092-4e94-40eb-8e32-bd2858bab620 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:11:00 devstack sudo[107533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-f953b092-4e94-40eb-8e32-bd2858bab620 Nov 04 11:11:00 devstack sudo[107533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:11:00 devstack sudo[107524]: pam_unix(sudo:session): session closed for user root Nov 04 11:11:00 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-521467cc-8d5a-454c-8144-6abb64aa4d81 tempest-ProjectReaderTests-1709054323 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-77be3f8a-f348-454a-807b-67f09d5df68d" returned: 0 in 0.599s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:11:00 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-521467cc-8d5a-454c-8144-6abb64aa4d81 tempest-ProjectReaderTests-1709054323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-77be3f8a-f348-454a-807b-67f09d5df68d {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:11:00 devstack sudo[107535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-77be3f8a-f348-454a-807b-67f09d5df68d Nov 04 11:11:00 devstack sudo[107535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:11:01 devstack sudo[107533]: pam_unix(sudo:session): session closed for user root Nov 04 11:11:01 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-3e8b5d9a-3ea2-4e29-95b7-073deedb1003 tempest-ProjectMemberTests-186486462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-f953b092-4e94-40eb-8e32-bd2858bab620" returned: 0 in 0.277s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:11:01 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-3e8b5d9a-3ea2-4e29-95b7-073deedb1003 tempest-ProjectMemberTests-186486462 None] <== create_volume: return (1102ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'} {{(pid=87272) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 04 11:11:01 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-3e8b5d9a-3ea2-4e29-95b7-073deedb1003 tempest-ProjectMemberTests-186486462 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.107s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 11:11:01 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-3e8b5d9a-3ea2-4e29-95b7-073deedb1003 tempest-ProjectMemberTests-186486462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8903402b-cf15-4207-add6-a0a3510975d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f953b092-4e94-40eb-8e32-bd2858bab620', 'volume_size': 1}' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:11:01 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-3e8b5d9a-3ea2-4e29-95b7-073deedb1003 tempest-ProjectMemberTests-186486462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (05372e65-3396-4d2e-9bd5-2d26bc45d702) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:11:01 devstack sudo[107535]: pam_unix(sudo:session): session closed for user root Nov 04 11:11:01 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-521467cc-8d5a-454c-8144-6abb64aa4d81 tempest-ProjectReaderTests-1709054323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-77be3f8a-f348-454a-807b-67f09d5df68d" returned: 0 in 0.280s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:11:01 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-521467cc-8d5a-454c-8144-6abb64aa4d81 tempest-ProjectReaderTests-1709054323 None] Lock "cinder-quobyte-77be3f8a-f348-454a-807b-67f09d5df68d" released by "delete_volume" :: held 0.938s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 11:11:01 devstack cinder-volume[87272]: INFO cinder.volume.flows.manager.create_volume [None req-3e8b5d9a-3ea2-4e29-95b7-073deedb1003 tempest-ProjectMemberTests-186486462 None] Volume volume-f953b092-4e94-40eb-8e32-bd2858bab620 (f953b092-4e94-40eb-8e32-bd2858bab620): created successfully Nov 04 11:11:01 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-3e8b5d9a-3ea2-4e29-95b7-073deedb1003 tempest-ProjectMemberTests-186486462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (05372e65-3396-4d2e-9bd5-2d26bc45d702) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:11:01 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-3e8b5d9a-3ea2-4e29-95b7-073deedb1003 tempest-ProjectMemberTests-186486462 None] Flow 'volume_create_manager' (44d2c85b-b5bb-4204-92da-ee33d37e3566) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87272) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 11:11:01 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-3e8b5d9a-3ea2-4e29-95b7-073deedb1003 tempest-ProjectMemberTests-186486462 None] Created volume successfully. Nov 04 11:11:01 devstack cinder-volume[87272]: DEBUG cinder.quota [None req-521467cc-8d5a-454c-8144-6abb64aa4d81 tempest-ProjectReaderTests-1709054323 None] Created reservations ['f472378a-296c-4111-a155-fa48873307df', 'bfc6daaf-47ae-4b38-a431-2d4c018190d5', 'fabc0593-b7de-426c-ac01-aabc44d25885', '24b3a2e4-073a-4b70-b03f-8c59ee831779'] {{(pid=87272) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 11:11:01 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-521467cc-8d5a-454c-8144-6abb64aa4d81 tempest-ProjectReaderTests-1709054323 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 11:11:01 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-521467cc-8d5a-454c-8144-6abb64aa4d81 tempest-ProjectReaderTests-1709054323 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 11:11:01 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-521467cc-8d5a-454c-8144-6abb64aa4d81 tempest-ProjectReaderTests-1709054323 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898': None} {{(pid=87272) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 11:11:01 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-521467cc-8d5a-454c-8144-6abb64aa4d81 tempest-ProjectReaderTests-1709054323 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'] {{(pid=87272) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 11:11:01 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-521467cc-8d5a-454c-8144-6abb64aa4d81 tempest-ProjectReaderTests-1709054323 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 11:11:01 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-521467cc-8d5a-454c-8144-6abb64aa4d81 tempest-ProjectReaderTests-1709054323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:11:01 devstack sudo[107539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1 Nov 04 11:11:01 devstack sudo[107539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:11:01 devstack sudo[107539]: pam_unix(sudo:session): session closed for user root Nov 04 11:11:01 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-521467cc-8d5a-454c-8144-6abb64aa4d81 tempest-ProjectReaderTests-1709054323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1" returned: 0 in 0.288s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:11:01 devstack cinder-volume[87272]: DEBUG cinder.manager [None req-521467cc-8d5a-454c-8144-6abb64aa4d81 tempest-ProjectReaderTests-1709054323 None] Notifying Schedulers of capabilities ... {{(pid=87272) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 11:11:01 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-521467cc-8d5a-454c-8144-6abb64aa4d81 tempest-ProjectReaderTests-1709054323 None] Deleted volume successfully. Nov 04 11:11:01 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-521467cc-8d5a-454c-8144-6abb64aa4d81 tempest-ProjectReaderTests-1709054323 None] Lock "cinder-77be3f8a-f348-454a-807b-67f09d5df68d-delete_volume" released by "delete_volume" :: held 1.563s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 11:11:02 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-aeb490fa-ea05-49bc-9220-60ad2d92fe0c tempest-ProjectMemberTests-186486462 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 11:11:02 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-aeb490fa-ea05-49bc-9220-60ad2d92fe0c tempest-ProjectMemberTests-186486462 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 11:11:02 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.remotefs [None req-aeb490fa-ea05-49bc-9220-60ad2d92fe0c tempest-ProjectMemberTests-186486462 None] Creating offline snapshot e743d5cc-1b4a-4dba-af52-413ddbaf4088 of volume f953b092-4e94-40eb-8e32-bd2858bab620 {{(pid=87272) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 04 11:11:02 devstack cinder-volume[87272]: DEBUG oslo.privsep.daemon [-] privsep: reply[9045bca5-7097-416d-880e-adf4f38a21cf]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 11:11:02 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-aeb490fa-ea05-49bc-9220-60ad2d92fe0c tempest-ProjectMemberTests-186486462 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-f953b092-4e94-40eb-8e32-bd2858bab620 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:11:02 devstack sudo[107542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-f953b092-4e94-40eb-8e32-bd2858bab620 Nov 04 11:11:02 devstack sudo[107542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:11:02 devstack sudo[107542]: pam_unix(sudo:session): session closed for user root Nov 04 11:11:02 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-aeb490fa-ea05-49bc-9220-60ad2d92fe0c tempest-ProjectMemberTests-186486462 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-f953b092-4e94-40eb-8e32-bd2858bab620" returned: 0 in 0.473s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:11:02 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-aeb490fa-ea05-49bc-9220-60ad2d92fe0c tempest-ProjectMemberTests-186486462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-f953b092-4e94-40eb-8e32-bd2858bab620,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-f953b092-4e94-40eb-8e32-bd2858bab620.e743d5cc-1b4a-4dba-af52-413ddbaf4088 1G {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:11:02 devstack sudo[107547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-f953b092-4e94-40eb-8e32-bd2858bab620,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-f953b092-4e94-40eb-8e32-bd2858bab620.e743d5cc-1b4a-4dba-af52-413ddbaf4088 1G Nov 04 11:11:02 devstack sudo[107547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:11:03 devstack cinder-volume[87272]: DEBUG cinder.volume.flows.manager.create_volume [None req-979f03c2-9ff0-46e0-bc6c-bd1590feb9e3 tempest-ProjectReaderTests-1709054323 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87272) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 11:11:03 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-979f03c2-9ff0-46e0-bc6c-bd1590feb9e3 tempest-ProjectReaderTests-1709054323 None] Flow 'volume_create_manager' (17d3171c-7c0d-4ccb-a61f-395f82b5cde3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 11:11:03 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-979f03c2-9ff0-46e0-bc6c-bd1590feb9e3 tempest-ProjectReaderTests-1709054323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1885642c-f72d-41a5-b7d7-e4f3bb97b8c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:11:03 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-979f03c2-9ff0-46e0-bc6c-bd1590feb9e3 tempest-ProjectReaderTests-1709054323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1885642c-f72d-41a5-b7d7-e4f3bb97b8c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T10:11:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1533192715',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=def1b9f6-1420-4c0a-bc35-2cbe6f33c6ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='07a715a078e04e65b5f74a9bd90b072b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T10:11:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T10:11:03Z,use_quota=True,user_id='0169aff07937486d9b7fd77a06536766',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8989e4f-21e3-4f0a-9584-0d818784e883),volume_type_id=f8989e4f-21e3-4f0a-9584-0d818784e883)' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:11:03 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-979f03c2-9ff0-46e0-bc6c-bd1590feb9e3 tempest-ProjectReaderTests-1709054323 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (49a8cc28-ae73-4d50-8003-c5d708c14222) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:11:03 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-979f03c2-9ff0-46e0-bc6c-bd1590feb9e3 tempest-ProjectReaderTests-1709054323 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (49a8cc28-ae73-4d50-8003-c5d708c14222) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:11:03 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-979f03c2-9ff0-46e0-bc6c-bd1590feb9e3 tempest-ProjectReaderTests-1709054323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11e4ddb6-ef4a-4314-83c2-4a789d1e2d43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:11:03 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-979f03c2-9ff0-46e0-bc6c-bd1590feb9e3 tempest-ProjectReaderTests-1709054323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11e4ddb6-ef4a-4314-83c2-4a789d1e2d43) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'def1b9f6-1420-4c0a-bc35-2cbe6f33c6ae', 'volume_name': 'volume-def1b9f6-1420-4c0a-bc35-2cbe6f33c6ae', 'volume_size': 1}' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:11:03 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-979f03c2-9ff0-46e0-bc6c-bd1590feb9e3 tempest-ProjectReaderTests-1709054323 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc3dd359-356f-4c64-af29-f103660bdd1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:11:03 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-979f03c2-9ff0-46e0-bc6c-bd1590feb9e3 tempest-ProjectReaderTests-1709054323 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc3dd359-356f-4c64-af29-f103660bdd1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:11:03 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-979f03c2-9ff0-46e0-bc6c-bd1590feb9e3 tempest-ProjectReaderTests-1709054323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d8e9ed81-4e39-4208-a1be-8bb561cb8e07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:11:03 devstack cinder-volume[87272]: INFO cinder.volume.flows.manager.create_volume [None req-979f03c2-9ff0-46e0-bc6c-bd1590feb9e3 tempest-ProjectReaderTests-1709054323 None] Volume def1b9f6-1420-4c0a-bc35-2cbe6f33c6ae: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-def1b9f6-1420-4c0a-bc35-2cbe6f33c6ae', 'volume_size': 1} Nov 04 11:11:03 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-979f03c2-9ff0-46e0-bc6c-bd1590feb9e3 tempest-ProjectReaderTests-1709054323 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 11:11:03 devstack sudo[107547]: pam_unix(sudo:session): session closed for user root Nov 04 11:11:03 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-aeb490fa-ea05-49bc-9220-60ad2d92fe0c tempest-ProjectMemberTests-186486462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-f953b092-4e94-40eb-8e32-bd2858bab620,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-f953b092-4e94-40eb-8e32-bd2858bab620.e743d5cc-1b4a-4dba-af52-413ddbaf4088 1G" returned: 0 in 0.515s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:11:03 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-aeb490fa-ea05-49bc-9220-60ad2d92fe0c tempest-ProjectMemberTests-186486462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f953b092-4e94-40eb-8e32-bd2858bab620 -F qcow2 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-f953b092-4e94-40eb-8e32-bd2858bab620.e743d5cc-1b4a-4dba-af52-413ddbaf4088 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:11:03 devstack sudo[107553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f953b092-4e94-40eb-8e32-bd2858bab620 -F qcow2 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-f953b092-4e94-40eb-8e32-bd2858bab620.e743d5cc-1b4a-4dba-af52-413ddbaf4088 Nov 04 11:11:03 devstack sudo[107553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:11:03 devstack sudo[107553]: pam_unix(sudo:session): session closed for user root Nov 04 11:11:03 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-aeb490fa-ea05-49bc-9220-60ad2d92fe0c tempest-ProjectMemberTests-186486462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f953b092-4e94-40eb-8e32-bd2858bab620 -F qcow2 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-f953b092-4e94-40eb-8e32-bd2858bab620.e743d5cc-1b4a-4dba-af52-413ddbaf4088" returned: 0 in 0.496s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:11:03 devstack cinder-volume[87272]: WARNING cinder.volume.drivers.remotefs [None req-aeb490fa-ea05-49bc-9220-60ad2d92fe0c tempest-ProjectMemberTests-186486462 None] /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-f953b092-4e94-40eb-8e32-bd2858bab620.e743d5cc-1b4a-4dba-af52-413ddbaf4088 is being set with open permissions: ugo+rw Nov 04 11:11:03 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-aeb490fa-ea05-49bc-9220-60ad2d92fe0c tempest-ProjectMemberTests-186486462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-f953b092-4e94-40eb-8e32-bd2858bab620.e743d5cc-1b4a-4dba-af52-413ddbaf4088 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:11:03 devstack sudo[107559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-f953b092-4e94-40eb-8e32-bd2858bab620.e743d5cc-1b4a-4dba-af52-413ddbaf4088 Nov 04 11:11:03 devstack sudo[107559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:11:04 devstack sudo[107559]: pam_unix(sudo:session): session closed for user root Nov 04 11:11:04 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-aeb490fa-ea05-49bc-9220-60ad2d92fe0c tempest-ProjectMemberTests-186486462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-f953b092-4e94-40eb-8e32-bd2858bab620.e743d5cc-1b4a-4dba-af52-413ddbaf4088" returned: 0 in 0.352s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:11:04 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-aeb490fa-ea05-49bc-9220-60ad2d92fe0c tempest-ProjectMemberTests-186486462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-f953b092-4e94-40eb-8e32-bd2858bab620.info {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:11:04 devstack sudo[107562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-f953b092-4e94-40eb-8e32-bd2858bab620.info Nov 04 11:11:04 devstack sudo[107562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:11:04 devstack sudo[107562]: pam_unix(sudo:session): session closed for user root Nov 04 11:11:04 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-aeb490fa-ea05-49bc-9220-60ad2d92fe0c tempest-ProjectMemberTests-186486462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-f953b092-4e94-40eb-8e32-bd2858bab620.info" returned: 0 in 0.333s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:11:04 devstack cinder-volume[87272]: WARNING cinder.volume.drivers.remotefs [None req-aeb490fa-ea05-49bc-9220-60ad2d92fe0c tempest-ProjectMemberTests-186486462 None] /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-f953b092-4e94-40eb-8e32-bd2858bab620.info is being set with open permissions: ugo+rw Nov 04 11:11:04 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-aeb490fa-ea05-49bc-9220-60ad2d92fe0c tempest-ProjectMemberTests-186486462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-f953b092-4e94-40eb-8e32-bd2858bab620.info {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:11:04 devstack sudo[107565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-f953b092-4e94-40eb-8e32-bd2858bab620.info Nov 04 11:11:04 devstack sudo[107565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:11:04 devstack sudo[107565]: pam_unix(sudo:session): session closed for user root Nov 04 11:11:04 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-aeb490fa-ea05-49bc-9220-60ad2d92fe0c tempest-ProjectMemberTests-186486462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-f953b092-4e94-40eb-8e32-bd2858bab620.info" returned: 0 in 0.263s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:11:04 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-aeb490fa-ea05-49bc-9220-60ad2d92fe0c tempest-ProjectMemberTests-186486462 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.557s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 11:11:04 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-979f03c2-9ff0-46e0-bc6c-bd1590feb9e3 tempest-ProjectReaderTests-1709054323 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.643s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 11:11:04 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-979f03c2-9ff0-46e0-bc6c-bd1590feb9e3 tempest-ProjectReaderTests-1709054323 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T10:11:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1533192715',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=def1b9f6-1420-4c0a-bc35-2cbe6f33c6ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='07a715a078e04e65b5f74a9bd90b072b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T10:11:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T10:11:03Z,use_quota=True,user_id='0169aff07937486d9b7fd77a06536766',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8989e4f-21e3-4f0a-9584-0d818784e883),volume_type_id=f8989e4f-21e3-4f0a-9584-0d818784e883)}" {{(pid=87272) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 04 11:11:04 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.remotefs [None req-979f03c2-9ff0-46e0-bc6c-bd1590feb9e3 tempest-ProjectReaderTests-1709054323 None] Creating volume def1b9f6-1420-4c0a-bc35-2cbe6f33c6ae {{(pid=87272) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 11:11:04 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-979f03c2-9ff0-46e0-bc6c-bd1590feb9e3 tempest-ProjectReaderTests-1709054323 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 11:11:04 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-979f03c2-9ff0-46e0-bc6c-bd1590feb9e3 tempest-ProjectReaderTests-1709054323 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 11:11:04 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-979f03c2-9ff0-46e0-bc6c-bd1590feb9e3 tempest-ProjectReaderTests-1709054323 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898': None} {{(pid=87272) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 11:11:04 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-979f03c2-9ff0-46e0-bc6c-bd1590feb9e3 tempest-ProjectReaderTests-1709054323 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'] {{(pid=87272) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 11:11:04 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-979f03c2-9ff0-46e0-bc6c-bd1590feb9e3 tempest-ProjectReaderTests-1709054323 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 11:11:04 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-979f03c2-9ff0-46e0-bc6c-bd1590feb9e3 tempest-ProjectReaderTests-1709054323 None] Selected osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898 as target Quobyte volume. {{(pid=87272) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 11:11:04 devstack cinder-volume[87272]: INFO cinder.volume.drivers.remotefs [None req-979f03c2-9ff0-46e0-bc6c-bd1590feb9e3 tempest-ProjectReaderTests-1709054323 None] casted to osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898 Nov 04 11:11:04 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-979f03c2-9ff0-46e0-bc6c-bd1590feb9e3 tempest-ProjectReaderTests-1709054323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-def1b9f6-1420-4c0a-bc35-2cbe6f33c6ae 1073741824 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:11:04 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-aeb490fa-ea05-49bc-9220-60ad2d92fe0c tempest-ProjectMemberTests-186486462 None] Create snapshot completed successfully Nov 04 11:11:04 devstack sudo[107568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-def1b9f6-1420-4c0a-bc35-2cbe6f33c6ae 1073741824 Nov 04 11:11:04 devstack sudo[107568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:11:05 devstack sudo[107568]: pam_unix(sudo:session): session closed for user root Nov 04 11:11:05 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-979f03c2-9ff0-46e0-bc6c-bd1590feb9e3 tempest-ProjectReaderTests-1709054323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-def1b9f6-1420-4c0a-bc35-2cbe6f33c6ae 1073741824" returned: 0 in 0.608s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:11:05 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-494da81e-0f88-4174-b236-15da0b2944ec tempest-ProjectMemberTests-186486462 None] Acquiring lock "cinder-e743d5cc-1b4a-4dba-af52-413ddbaf4088-delete_snapshot" by "delete_snapshot" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 11:11:05 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-979f03c2-9ff0-46e0-bc6c-bd1590feb9e3 tempest-ProjectReaderTests-1709054323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-def1b9f6-1420-4c0a-bc35-2cbe6f33c6ae {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:11:05 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-494da81e-0f88-4174-b236-15da0b2944ec tempest-ProjectMemberTests-186486462 None] Lock "cinder-e743d5cc-1b4a-4dba-af52-413ddbaf4088-delete_snapshot" acquired by "delete_snapshot" :: waited 0.051s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 11:11:05 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-494da81e-0f88-4174-b236-15da0b2944ec tempest-ProjectMemberTests-186486462 None] Acquiring lock "cinder-quobyte-f953b092-4e94-40eb-8e32-bd2858bab620" by "delete_snapshot" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 11:11:05 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-494da81e-0f88-4174-b236-15da0b2944ec tempest-ProjectMemberTests-186486462 None] Lock "cinder-quobyte-f953b092-4e94-40eb-8e32-bd2858bab620" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 11:11:05 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-494da81e-0f88-4174-b236-15da0b2944ec tempest-ProjectMemberTests-186486462 None] Acquiring lock "cinder-quobyte-e743d5cc-1b4a-4dba-af52-413ddbaf4088" by "_delete_snapshot" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 11:11:05 devstack sudo[107573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-def1b9f6-1420-4c0a-bc35-2cbe6f33c6ae Nov 04 11:11:05 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-494da81e-0f88-4174-b236-15da0b2944ec tempest-ProjectMemberTests-186486462 None] Lock "cinder-quobyte-e743d5cc-1b4a-4dba-af52-413ddbaf4088" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 11:11:05 devstack sudo[107573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:11:05 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.remotefs [None req-494da81e-0f88-4174-b236-15da0b2944ec tempest-ProjectMemberTests-186486462 None] Deleting offline snapshot e743d5cc-1b4a-4dba-af52-413ddbaf4088 of volume f953b092-4e94-40eb-8e32-bd2858bab620 {{(pid=87272) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 04 11:11:05 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.remotefs [None req-494da81e-0f88-4174-b236-15da0b2944ec tempest-ProjectMemberTests-186486462 None] snapshot_file for this snap is: volume-f953b092-4e94-40eb-8e32-bd2858bab620.e743d5cc-1b4a-4dba-af52-413ddbaf4088 {{(pid=87272) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 04 11:11:05 devstack cinder-volume[87272]: DEBUG oslo.privsep.daemon [-] privsep: reply[17d48e99-0d0d-4e91-8070-cddf80386fb8]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 11:11:05 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-494da81e-0f88-4174-b236-15da0b2944ec tempest-ProjectMemberTests-186486462 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-f953b092-4e94-40eb-8e32-bd2858bab620.e743d5cc-1b4a-4dba-af52-413ddbaf4088 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:11:05 devstack sudo[107575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-f953b092-4e94-40eb-8e32-bd2858bab620.e743d5cc-1b4a-4dba-af52-413ddbaf4088 Nov 04 11:11:05 devstack sudo[107575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:11:05 devstack sudo[107573]: pam_unix(sudo:session): session closed for user root Nov 04 11:11:05 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-979f03c2-9ff0-46e0-bc6c-bd1590feb9e3 tempest-ProjectReaderTests-1709054323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-def1b9f6-1420-4c0a-bc35-2cbe6f33c6ae" returned: 0 in 0.371s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:11:05 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-979f03c2-9ff0-46e0-bc6c-bd1590feb9e3 tempest-ProjectReaderTests-1709054323 None] <== create_volume: return (1083ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'} {{(pid=87272) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 04 11:11:05 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-979f03c2-9ff0-46e0-bc6c-bd1590feb9e3 tempest-ProjectReaderTests-1709054323 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.090s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 11:11:05 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-979f03c2-9ff0-46e0-bc6c-bd1590feb9e3 tempest-ProjectReaderTests-1709054323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d8e9ed81-4e39-4208-a1be-8bb561cb8e07) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-def1b9f6-1420-4c0a-bc35-2cbe6f33c6ae', 'volume_size': 1}' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:11:05 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-979f03c2-9ff0-46e0-bc6c-bd1590feb9e3 tempest-ProjectReaderTests-1709054323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cdc81274-326b-4fff-9925-2430568bf7c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:11:05 devstack cinder-volume[87272]: INFO cinder.volume.flows.manager.create_volume [None req-979f03c2-9ff0-46e0-bc6c-bd1590feb9e3 tempest-ProjectReaderTests-1709054323 None] Volume volume-def1b9f6-1420-4c0a-bc35-2cbe6f33c6ae (def1b9f6-1420-4c0a-bc35-2cbe6f33c6ae): created successfully Nov 04 11:11:05 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-979f03c2-9ff0-46e0-bc6c-bd1590feb9e3 tempest-ProjectReaderTests-1709054323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cdc81274-326b-4fff-9925-2430568bf7c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:11:06 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-979f03c2-9ff0-46e0-bc6c-bd1590feb9e3 tempest-ProjectReaderTests-1709054323 None] Flow 'volume_create_manager' (17d3171c-7c0d-4ccb-a61f-395f82b5cde3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87272) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 11:11:06 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-979f03c2-9ff0-46e0-bc6c-bd1590feb9e3 tempest-ProjectReaderTests-1709054323 None] Created volume successfully. Nov 04 11:11:06 devstack sudo[107575]: pam_unix(sudo:session): session closed for user root Nov 04 11:11:06 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-494da81e-0f88-4174-b236-15da0b2944ec tempest-ProjectMemberTests-186486462 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-f953b092-4e94-40eb-8e32-bd2858bab620.e743d5cc-1b4a-4dba-af52-413ddbaf4088" returned: 0 in 0.531s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:11:06 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.remotefs [None req-494da81e-0f88-4174-b236-15da0b2944ec tempest-ProjectMemberTests-186486462 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f953b092-4e94-40eb-8e32-bd2858bab620(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87272) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 11:11:06 devstack cinder-volume[87272]: DEBUG oslo.privsep.daemon [-] privsep: reply[08a7d961-55d1-4f80-aab2-e1e4e1d304fb]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 11:11:06 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-494da81e-0f88-4174-b236-15da0b2944ec tempest-ProjectMemberTests-186486462 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-f953b092-4e94-40eb-8e32-bd2858bab620 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:11:06 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-5a1cf17b-79a9-4fef-84b2-c4413b7a0e09 tempest-ProjectReaderTests-1709054323 None] Acquiring lock "cinder-def1b9f6-1420-4c0a-bc35-2cbe6f33c6ae-delete_volume" by "delete_volume" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 11:11:06 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-5a1cf17b-79a9-4fef-84b2-c4413b7a0e09 tempest-ProjectReaderTests-1709054323 None] Lock "cinder-def1b9f6-1420-4c0a-bc35-2cbe6f33c6ae-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 11:11:06 devstack sudo[107582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-f953b092-4e94-40eb-8e32-bd2858bab620 Nov 04 11:11:06 devstack sudo[107582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:11:06 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-5a1cf17b-79a9-4fef-84b2-c4413b7a0e09 tempest-ProjectReaderTests-1709054323 None] Acquiring lock "cinder-quobyte-def1b9f6-1420-4c0a-bc35-2cbe6f33c6ae" by "delete_volume" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 11:11:06 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-5a1cf17b-79a9-4fef-84b2-c4413b7a0e09 tempest-ProjectReaderTests-1709054323 None] Lock "cinder-quobyte-def1b9f6-1420-4c0a-bc35-2cbe6f33c6ae" acquired by "delete_volume" :: waited 0.030s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 11:11:06 devstack cinder-volume[87272]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e22d91a-2a08-481b-9f2f-810549013168]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 11:11:06 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-5a1cf17b-79a9-4fef-84b2-c4413b7a0e09 tempest-ProjectReaderTests-1709054323 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-def1b9f6-1420-4c0a-bc35-2cbe6f33c6ae {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:11:06 devstack sudo[107584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-def1b9f6-1420-4c0a-bc35-2cbe6f33c6ae Nov 04 11:11:06 devstack sudo[107584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:11:06 devstack sudo[107582]: pam_unix(sudo:session): session closed for user root Nov 04 11:11:06 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-494da81e-0f88-4174-b236-15da0b2944ec tempest-ProjectMemberTests-186486462 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-f953b092-4e94-40eb-8e32-bd2858bab620" returned: 0 in 0.567s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:11:06 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-494da81e-0f88-4174-b236-15da0b2944ec tempest-ProjectMemberTests-186486462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-f953b092-4e94-40eb-8e32-bd2858bab620.e743d5cc-1b4a-4dba-af52-413ddbaf4088 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:11:06 devstack sudo[107590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-f953b092-4e94-40eb-8e32-bd2858bab620.e743d5cc-1b4a-4dba-af52-413ddbaf4088 Nov 04 11:11:06 devstack sudo[107590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:11:07 devstack sudo[107584]: pam_unix(sudo:session): session closed for user root Nov 04 11:11:07 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-5a1cf17b-79a9-4fef-84b2-c4413b7a0e09 tempest-ProjectReaderTests-1709054323 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-def1b9f6-1420-4c0a-bc35-2cbe6f33c6ae" returned: 0 in 0.451s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:11:07 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-5a1cf17b-79a9-4fef-84b2-c4413b7a0e09 tempest-ProjectReaderTests-1709054323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-def1b9f6-1420-4c0a-bc35-2cbe6f33c6ae {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:11:07 devstack sudo[107595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-def1b9f6-1420-4c0a-bc35-2cbe6f33c6ae Nov 04 11:11:07 devstack sudo[107595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:11:07 devstack sudo[107590]: pam_unix(sudo:session): session closed for user root Nov 04 11:11:07 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-494da81e-0f88-4174-b236-15da0b2944ec tempest-ProjectMemberTests-186486462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-f953b092-4e94-40eb-8e32-bd2858bab620.e743d5cc-1b4a-4dba-af52-413ddbaf4088" returned: 0 in 0.422s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:11:07 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-494da81e-0f88-4174-b236-15da0b2944ec tempest-ProjectMemberTests-186486462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-f953b092-4e94-40eb-8e32-bd2858bab620.e743d5cc-1b4a-4dba-af52-413ddbaf4088 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:11:07 devstack sudo[107602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-f953b092-4e94-40eb-8e32-bd2858bab620.e743d5cc-1b4a-4dba-af52-413ddbaf4088 Nov 04 11:11:07 devstack sudo[107602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:11:07 devstack sudo[107595]: pam_unix(sudo:session): session closed for user root Nov 04 11:11:07 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-5a1cf17b-79a9-4fef-84b2-c4413b7a0e09 tempest-ProjectReaderTests-1709054323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-def1b9f6-1420-4c0a-bc35-2cbe6f33c6ae" returned: 0 in 0.269s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:11:07 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-5a1cf17b-79a9-4fef-84b2-c4413b7a0e09 tempest-ProjectReaderTests-1709054323 None] Lock "cinder-quobyte-def1b9f6-1420-4c0a-bc35-2cbe6f33c6ae" released by "delete_volume" :: held 0.807s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 11:11:07 devstack cinder-volume[87272]: DEBUG cinder.quota [None req-5a1cf17b-79a9-4fef-84b2-c4413b7a0e09 tempest-ProjectReaderTests-1709054323 None] Created reservations ['5f58a196-9f2d-4032-af9b-076c2190272f', 'e0c4fe4c-bc3e-4da7-90d6-48e2907018de', '13feede9-149a-4b63-8cc4-0c55f1fa6447', '614c662e-5f89-465c-8773-8799e42acac8'] {{(pid=87272) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 11:11:07 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-5a1cf17b-79a9-4fef-84b2-c4413b7a0e09 tempest-ProjectReaderTests-1709054323 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 11:11:07 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-5a1cf17b-79a9-4fef-84b2-c4413b7a0e09 tempest-ProjectReaderTests-1709054323 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 11:11:07 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-5a1cf17b-79a9-4fef-84b2-c4413b7a0e09 tempest-ProjectReaderTests-1709054323 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898': None} {{(pid=87272) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 11:11:07 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-5a1cf17b-79a9-4fef-84b2-c4413b7a0e09 tempest-ProjectReaderTests-1709054323 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'] {{(pid=87272) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 11:11:07 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-5a1cf17b-79a9-4fef-84b2-c4413b7a0e09 tempest-ProjectReaderTests-1709054323 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 11:11:07 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-5a1cf17b-79a9-4fef-84b2-c4413b7a0e09 tempest-ProjectReaderTests-1709054323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:11:07 devstack sudo[107604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1 Nov 04 11:11:07 devstack sudo[107604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:11:07 devstack sudo[107602]: pam_unix(sudo:session): session closed for user root Nov 04 11:11:07 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-494da81e-0f88-4174-b236-15da0b2944ec tempest-ProjectMemberTests-186486462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-f953b092-4e94-40eb-8e32-bd2858bab620.e743d5cc-1b4a-4dba-af52-413ddbaf4088" returned: 0 in 0.330s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:11:07 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-494da81e-0f88-4174-b236-15da0b2944ec tempest-ProjectMemberTests-186486462 None] Lock "cinder-quobyte-e743d5cc-1b4a-4dba-af52-413ddbaf4088" released by "_delete_snapshot" :: held 2.048s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 11:11:07 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-494da81e-0f88-4174-b236-15da0b2944ec tempest-ProjectMemberTests-186486462 None] Lock "cinder-quobyte-f953b092-4e94-40eb-8e32-bd2858bab620" released by "delete_snapshot" :: held 2.084s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 11:11:07 devstack cinder-volume[87272]: DEBUG cinder.quota [None req-494da81e-0f88-4174-b236-15da0b2944ec tempest-ProjectMemberTests-186486462 None] Created reservations ['5cfb2e59-4f3f-4ce1-8a0e-9562361b8991', 'b1208f06-95db-4796-9769-56b035616a5d', '80cf25aa-3ad0-4086-a7e7-79aaedfc914f', 'c95f7c6b-7db4-4e90-8569-78fa544f7d62'] {{(pid=87272) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 11:11:07 devstack sudo[107604]: pam_unix(sudo:session): session closed for user root Nov 04 11:11:07 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-5a1cf17b-79a9-4fef-84b2-c4413b7a0e09 tempest-ProjectReaderTests-1709054323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1" returned: 0 in 0.359s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:11:07 devstack cinder-volume[87272]: DEBUG cinder.manager [None req-5a1cf17b-79a9-4fef-84b2-c4413b7a0e09 tempest-ProjectReaderTests-1709054323 None] Notifying Schedulers of capabilities ... {{(pid=87272) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 11:11:07 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-494da81e-0f88-4174-b236-15da0b2944ec tempest-ProjectMemberTests-186486462 None] Delete snapshot completed successfully. Nov 04 11:11:07 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-5a1cf17b-79a9-4fef-84b2-c4413b7a0e09 tempest-ProjectReaderTests-1709054323 None] Deleted volume successfully. Nov 04 11:11:07 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-494da81e-0f88-4174-b236-15da0b2944ec tempest-ProjectMemberTests-186486462 None] Lock "cinder-e743d5cc-1b4a-4dba-af52-413ddbaf4088-delete_snapshot" released by "delete_snapshot" :: held 2.307s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 11:11:07 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-5a1cf17b-79a9-4fef-84b2-c4413b7a0e09 tempest-ProjectReaderTests-1709054323 None] Lock "cinder-def1b9f6-1420-4c0a-bc35-2cbe6f33c6ae-delete_volume" released by "delete_volume" :: held 1.460s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 11:11:08 devstack cinder-volume[87272]: DEBUG cinder.volume.flows.manager.create_volume [None req-db117e17-dd24-4a1c-be61-e0f30a4fb762 tempest-ProjectReaderTests-1709054323 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87272) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 11:11:08 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-db117e17-dd24-4a1c-be61-e0f30a4fb762 tempest-ProjectReaderTests-1709054323 None] Flow 'volume_create_manager' (561d93f3-a2cf-4101-91b0-c064f744307c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 11:11:08 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-db117e17-dd24-4a1c-be61-e0f30a4fb762 tempest-ProjectReaderTests-1709054323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (68ef79ed-c6aa-4f3a-b6ff-cd15c64af755) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:11:08 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-db117e17-dd24-4a1c-be61-e0f30a4fb762 tempest-ProjectReaderTests-1709054323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (68ef79ed-c6aa-4f3a-b6ff-cd15c64af755) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T10:11:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-620453878',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=71013d9c-264c-446d-9511-211bf225dfd3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='07a715a078e04e65b5f74a9bd90b072b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T10:11:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T10:11:08Z,use_quota=True,user_id='0169aff07937486d9b7fd77a06536766',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8989e4f-21e3-4f0a-9584-0d818784e883),volume_type_id=f8989e4f-21e3-4f0a-9584-0d818784e883)' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:11:08 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-db117e17-dd24-4a1c-be61-e0f30a4fb762 tempest-ProjectReaderTests-1709054323 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee2a7538-e1ce-4024-9722-66701e281619) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:11:08 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-db117e17-dd24-4a1c-be61-e0f30a4fb762 tempest-ProjectReaderTests-1709054323 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee2a7538-e1ce-4024-9722-66701e281619) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:11:08 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-db117e17-dd24-4a1c-be61-e0f30a4fb762 tempest-ProjectReaderTests-1709054323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a963013-1e4a-470b-b88f-1d428593a6a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:11:08 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-db117e17-dd24-4a1c-be61-e0f30a4fb762 tempest-ProjectReaderTests-1709054323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a963013-1e4a-470b-b88f-1d428593a6a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '71013d9c-264c-446d-9511-211bf225dfd3', 'volume_name': 'volume-71013d9c-264c-446d-9511-211bf225dfd3', 'volume_size': 1}' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:11:08 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-db117e17-dd24-4a1c-be61-e0f30a4fb762 tempest-ProjectReaderTests-1709054323 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93e1e31e-cc4d-408f-8ef0-4a6746313a22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:11:08 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-db117e17-dd24-4a1c-be61-e0f30a4fb762 tempest-ProjectReaderTests-1709054323 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93e1e31e-cc4d-408f-8ef0-4a6746313a22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:11:08 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-db117e17-dd24-4a1c-be61-e0f30a4fb762 tempest-ProjectReaderTests-1709054323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (037c5e7c-34f5-4afc-878a-05712a6c0121) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:11:08 devstack cinder-volume[87272]: INFO cinder.volume.flows.manager.create_volume [None req-db117e17-dd24-4a1c-be61-e0f30a4fb762 tempest-ProjectReaderTests-1709054323 None] Volume 71013d9c-264c-446d-9511-211bf225dfd3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-71013d9c-264c-446d-9511-211bf225dfd3', 'volume_size': 1} Nov 04 11:11:08 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-db117e17-dd24-4a1c-be61-e0f30a4fb762 tempest-ProjectReaderTests-1709054323 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 11:11:08 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-db117e17-dd24-4a1c-be61-e0f30a4fb762 tempest-ProjectReaderTests-1709054323 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 11:11:08 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-db117e17-dd24-4a1c-be61-e0f30a4fb762 tempest-ProjectReaderTests-1709054323 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T10:11:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-620453878',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=71013d9c-264c-446d-9511-211bf225dfd3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='07a715a078e04e65b5f74a9bd90b072b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T10:11:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T10:11:08Z,use_quota=True,user_id='0169aff07937486d9b7fd77a06536766',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8989e4f-21e3-4f0a-9584-0d818784e883),volume_type_id=f8989e4f-21e3-4f0a-9584-0d818784e883)}" {{(pid=87272) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 04 11:11:08 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.remotefs [None req-db117e17-dd24-4a1c-be61-e0f30a4fb762 tempest-ProjectReaderTests-1709054323 None] Creating volume 71013d9c-264c-446d-9511-211bf225dfd3 {{(pid=87272) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 11:11:08 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-db117e17-dd24-4a1c-be61-e0f30a4fb762 tempest-ProjectReaderTests-1709054323 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 11:11:08 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-db117e17-dd24-4a1c-be61-e0f30a4fb762 tempest-ProjectReaderTests-1709054323 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 11:11:08 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-db117e17-dd24-4a1c-be61-e0f30a4fb762 tempest-ProjectReaderTests-1709054323 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898': None} {{(pid=87272) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 11:11:08 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-db117e17-dd24-4a1c-be61-e0f30a4fb762 tempest-ProjectReaderTests-1709054323 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'] {{(pid=87272) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 11:11:08 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-db117e17-dd24-4a1c-be61-e0f30a4fb762 tempest-ProjectReaderTests-1709054323 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 11:11:08 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-db117e17-dd24-4a1c-be61-e0f30a4fb762 tempest-ProjectReaderTests-1709054323 None] Selected osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898 as target Quobyte volume. {{(pid=87272) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 11:11:08 devstack cinder-volume[87272]: INFO cinder.volume.drivers.remotefs [None req-db117e17-dd24-4a1c-be61-e0f30a4fb762 tempest-ProjectReaderTests-1709054323 None] casted to osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898 Nov 04 11:11:08 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-db117e17-dd24-4a1c-be61-e0f30a4fb762 tempest-ProjectReaderTests-1709054323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-71013d9c-264c-446d-9511-211bf225dfd3 1073741824 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:11:08 devstack sudo[107608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-71013d9c-264c-446d-9511-211bf225dfd3 1073741824 Nov 04 11:11:08 devstack sudo[107608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:11:08 devstack sudo[107608]: pam_unix(sudo:session): session closed for user root Nov 04 11:11:08 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-db117e17-dd24-4a1c-be61-e0f30a4fb762 tempest-ProjectReaderTests-1709054323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-71013d9c-264c-446d-9511-211bf225dfd3 1073741824" returned: 0 in 0.491s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:11:08 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-db117e17-dd24-4a1c-be61-e0f30a4fb762 tempest-ProjectReaderTests-1709054323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-71013d9c-264c-446d-9511-211bf225dfd3 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:11:08 devstack sudo[107613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-71013d9c-264c-446d-9511-211bf225dfd3 Nov 04 11:11:08 devstack sudo[107613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:11:08 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-c590998b-4780-4604-b947-273ed45aefab tempest-ProjectMemberTests-186486462 None] Acquiring lock "cinder-f953b092-4e94-40eb-8e32-bd2858bab620-delete_volume" by "delete_volume" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 11:11:08 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-c590998b-4780-4604-b947-273ed45aefab tempest-ProjectMemberTests-186486462 None] Lock "cinder-f953b092-4e94-40eb-8e32-bd2858bab620-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 11:11:08 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-c590998b-4780-4604-b947-273ed45aefab tempest-ProjectMemberTests-186486462 None] Acquiring lock "cinder-quobyte-f953b092-4e94-40eb-8e32-bd2858bab620" by "delete_volume" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 11:11:08 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-c590998b-4780-4604-b947-273ed45aefab tempest-ProjectMemberTests-186486462 None] Lock "cinder-quobyte-f953b092-4e94-40eb-8e32-bd2858bab620" acquired by "delete_volume" :: waited 0.024s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 11:11:08 devstack cinder-volume[87272]: DEBUG oslo.privsep.daemon [-] privsep: reply[98d4a27a-1858-4f57-8403-b6a97a5cab06]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 11:11:08 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-c590998b-4780-4604-b947-273ed45aefab tempest-ProjectMemberTests-186486462 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-f953b092-4e94-40eb-8e32-bd2858bab620 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:11:08 devstack sudo[107613]: pam_unix(sudo:session): session closed for user root Nov 04 11:11:08 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-db117e17-dd24-4a1c-be61-e0f30a4fb762 tempest-ProjectReaderTests-1709054323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-71013d9c-264c-446d-9511-211bf225dfd3" returned: 0 in 0.281s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:11:08 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-db117e17-dd24-4a1c-be61-e0f30a4fb762 tempest-ProjectReaderTests-1709054323 None] <== create_volume: return (818ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'} {{(pid=87272) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 04 11:11:08 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-db117e17-dd24-4a1c-be61-e0f30a4fb762 tempest-ProjectReaderTests-1709054323 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.821s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 11:11:09 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-db117e17-dd24-4a1c-be61-e0f30a4fb762 tempest-ProjectReaderTests-1709054323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (037c5e7c-34f5-4afc-878a-05712a6c0121) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-71013d9c-264c-446d-9511-211bf225dfd3', 'volume_size': 1}' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:11:09 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-db117e17-dd24-4a1c-be61-e0f30a4fb762 tempest-ProjectReaderTests-1709054323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5596c18c-5ec6-4abd-a3aa-903a16177154) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:11:09 devstack cinder-volume[87272]: INFO cinder.volume.flows.manager.create_volume [None req-db117e17-dd24-4a1c-be61-e0f30a4fb762 tempest-ProjectReaderTests-1709054323 None] Volume volume-71013d9c-264c-446d-9511-211bf225dfd3 (71013d9c-264c-446d-9511-211bf225dfd3): created successfully Nov 04 11:11:09 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-db117e17-dd24-4a1c-be61-e0f30a4fb762 tempest-ProjectReaderTests-1709054323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5596c18c-5ec6-4abd-a3aa-903a16177154) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:11:09 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-db117e17-dd24-4a1c-be61-e0f30a4fb762 tempest-ProjectReaderTests-1709054323 None] Flow 'volume_create_manager' (561d93f3-a2cf-4101-91b0-c064f744307c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87272) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 11:11:09 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-db117e17-dd24-4a1c-be61-e0f30a4fb762 tempest-ProjectReaderTests-1709054323 None] Created volume successfully. Nov 04 11:11:09 devstack sudo[107616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-f953b092-4e94-40eb-8e32-bd2858bab620 Nov 04 11:11:09 devstack sudo[107616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:11:09 devstack sudo[107616]: pam_unix(sudo:session): session closed for user root Nov 04 11:11:09 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-c590998b-4780-4604-b947-273ed45aefab tempest-ProjectMemberTests-186486462 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-f953b092-4e94-40eb-8e32-bd2858bab620" returned: 0 in 0.407s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:11:09 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-c590998b-4780-4604-b947-273ed45aefab tempest-ProjectMemberTests-186486462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-f953b092-4e94-40eb-8e32-bd2858bab620 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:11:09 devstack sudo[107621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-f953b092-4e94-40eb-8e32-bd2858bab620 Nov 04 11:11:09 devstack sudo[107621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:11:09 devstack sudo[107621]: pam_unix(sudo:session): session closed for user root Nov 04 11:11:09 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-c590998b-4780-4604-b947-273ed45aefab tempest-ProjectMemberTests-186486462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-f953b092-4e94-40eb-8e32-bd2858bab620" returned: 0 in 0.253s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:11:09 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-c590998b-4780-4604-b947-273ed45aefab tempest-ProjectMemberTests-186486462 None] Lock "cinder-quobyte-f953b092-4e94-40eb-8e32-bd2858bab620" released by "delete_volume" :: held 0.732s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 11:11:09 devstack cinder-volume[87272]: DEBUG cinder.quota [None req-c590998b-4780-4604-b947-273ed45aefab tempest-ProjectMemberTests-186486462 None] Created reservations ['8526cf48-b7de-4028-8ca2-d006e084875b', 'b2394abb-56ec-4929-9ba1-4027e8d55133', 'f52f5f17-3df2-4c35-9cb9-6e2579e833c4', 'b11a162c-30b2-4075-8d63-4c4655d5c21e'] {{(pid=87272) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 11:11:09 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-c590998b-4780-4604-b947-273ed45aefab tempest-ProjectMemberTests-186486462 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 11:11:09 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-c590998b-4780-4604-b947-273ed45aefab tempest-ProjectMemberTests-186486462 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 11:11:09 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-c590998b-4780-4604-b947-273ed45aefab tempest-ProjectMemberTests-186486462 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898': None} {{(pid=87272) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 11:11:09 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-c590998b-4780-4604-b947-273ed45aefab tempest-ProjectMemberTests-186486462 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'] {{(pid=87272) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 11:11:09 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-c590998b-4780-4604-b947-273ed45aefab tempest-ProjectMemberTests-186486462 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 11:11:09 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-c590998b-4780-4604-b947-273ed45aefab tempest-ProjectMemberTests-186486462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:11:09 devstack sudo[107624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1 Nov 04 11:11:09 devstack sudo[107624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:11:10 devstack sudo[107624]: pam_unix(sudo:session): session closed for user root Nov 04 11:11:10 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-c590998b-4780-4604-b947-273ed45aefab tempest-ProjectMemberTests-186486462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1" returned: 0 in 0.337s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:11:10 devstack cinder-volume[87272]: DEBUG cinder.manager [None req-c590998b-4780-4604-b947-273ed45aefab tempest-ProjectMemberTests-186486462 None] Notifying Schedulers of capabilities ... {{(pid=87272) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 11:11:10 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-c590998b-4780-4604-b947-273ed45aefab tempest-ProjectMemberTests-186486462 None] Deleted volume successfully. Nov 04 11:11:10 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-c590998b-4780-4604-b947-273ed45aefab tempest-ProjectMemberTests-186486462 None] Lock "cinder-f953b092-4e94-40eb-8e32-bd2858bab620-delete_volume" released by "delete_volume" :: held 1.386s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 11:11:10 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-4763cd01-257e-405c-b3be-269618a9a717 tempest-ProjectReaderTests-1709054323 None] Acquiring lock "cinder-71013d9c-264c-446d-9511-211bf225dfd3-delete_volume" by "delete_volume" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 11:11:10 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-4763cd01-257e-405c-b3be-269618a9a717 tempest-ProjectReaderTests-1709054323 None] Lock "cinder-71013d9c-264c-446d-9511-211bf225dfd3-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 11:11:10 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-4763cd01-257e-405c-b3be-269618a9a717 tempest-ProjectReaderTests-1709054323 None] Acquiring lock "cinder-quobyte-71013d9c-264c-446d-9511-211bf225dfd3" by "delete_volume" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 11:11:10 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-4763cd01-257e-405c-b3be-269618a9a717 tempest-ProjectReaderTests-1709054323 None] Lock "cinder-quobyte-71013d9c-264c-446d-9511-211bf225dfd3" acquired by "delete_volume" :: waited 0.023s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 11:11:10 devstack cinder-volume[87272]: DEBUG oslo.privsep.daemon [-] privsep: reply[cab9737b-3681-4268-9a5a-83ce4f67625c]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 11:11:10 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-4763cd01-257e-405c-b3be-269618a9a717 tempest-ProjectReaderTests-1709054323 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-71013d9c-264c-446d-9511-211bf225dfd3 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:11:10 devstack sudo[107627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-71013d9c-264c-446d-9511-211bf225dfd3 Nov 04 11:11:10 devstack sudo[107627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:11:10 devstack cinder-volume[87272]: DEBUG cinder.volume.flows.manager.create_volume [None req-c1da4c88-5ab3-4dde-8535-13243aa218c5 tempest-ProjectMemberTests-186486462 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87272) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 11:11:10 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-c1da4c88-5ab3-4dde-8535-13243aa218c5 tempest-ProjectMemberTests-186486462 None] Flow 'volume_create_manager' (cbedfdd7-1fad-4b3a-a9d2-0e215185c39f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 11:11:10 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-c1da4c88-5ab3-4dde-8535-13243aa218c5 tempest-ProjectMemberTests-186486462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62875109-4757-4288-be44-66ad645616f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:11:10 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-c1da4c88-5ab3-4dde-8535-13243aa218c5 tempest-ProjectMemberTests-186486462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62875109-4757-4288-be44-66ad645616f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T10:11:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1523710281',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d0f74b7b-2d20-4135-a7aa-1e0ec982c35b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8457b114a6264c47af483fad6a8bf18b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T10:11:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T10:11:11Z,use_quota=True,user_id='70a59e5f7c684c0b88977c66a4e36afb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8989e4f-21e3-4f0a-9584-0d818784e883),volume_type_id=f8989e4f-21e3-4f0a-9584-0d818784e883)' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:11:10 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-c1da4c88-5ab3-4dde-8535-13243aa218c5 tempest-ProjectMemberTests-186486462 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a93afdcb-d038-4f77-b915-3ac61981d630) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:11:10 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-c1da4c88-5ab3-4dde-8535-13243aa218c5 tempest-ProjectMemberTests-186486462 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a93afdcb-d038-4f77-b915-3ac61981d630) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:11:10 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-c1da4c88-5ab3-4dde-8535-13243aa218c5 tempest-ProjectMemberTests-186486462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ddb0b104-c8f6-49a5-8217-7e0328be9328) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:11:10 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-c1da4c88-5ab3-4dde-8535-13243aa218c5 tempest-ProjectMemberTests-186486462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ddb0b104-c8f6-49a5-8217-7e0328be9328) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd0f74b7b-2d20-4135-a7aa-1e0ec982c35b', 'volume_name': 'volume-d0f74b7b-2d20-4135-a7aa-1e0ec982c35b', 'volume_size': 1}' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:11:10 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-c1da4c88-5ab3-4dde-8535-13243aa218c5 tempest-ProjectMemberTests-186486462 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a09dd853-bee0-414e-8413-66949b40bf1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:11:10 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-c1da4c88-5ab3-4dde-8535-13243aa218c5 tempest-ProjectMemberTests-186486462 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a09dd853-bee0-414e-8413-66949b40bf1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:11:10 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-c1da4c88-5ab3-4dde-8535-13243aa218c5 tempest-ProjectMemberTests-186486462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (885b359f-b127-476a-aa8e-69fbd2020107) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:11:10 devstack cinder-volume[87272]: INFO cinder.volume.flows.manager.create_volume [None req-c1da4c88-5ab3-4dde-8535-13243aa218c5 tempest-ProjectMemberTests-186486462 None] Volume d0f74b7b-2d20-4135-a7aa-1e0ec982c35b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d0f74b7b-2d20-4135-a7aa-1e0ec982c35b', 'volume_size': 1} Nov 04 11:11:10 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-c1da4c88-5ab3-4dde-8535-13243aa218c5 tempest-ProjectMemberTests-186486462 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 11:11:10 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-c1da4c88-5ab3-4dde-8535-13243aa218c5 tempest-ProjectMemberTests-186486462 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 11:11:10 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-c1da4c88-5ab3-4dde-8535-13243aa218c5 tempest-ProjectMemberTests-186486462 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T10:11:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1523710281',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d0f74b7b-2d20-4135-a7aa-1e0ec982c35b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8457b114a6264c47af483fad6a8bf18b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T10:11:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T10:11:11Z,use_quota=True,user_id='70a59e5f7c684c0b88977c66a4e36afb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8989e4f-21e3-4f0a-9584-0d818784e883),volume_type_id=f8989e4f-21e3-4f0a-9584-0d818784e883)}" {{(pid=87272) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 04 11:11:10 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.remotefs [None req-c1da4c88-5ab3-4dde-8535-13243aa218c5 tempest-ProjectMemberTests-186486462 None] Creating volume d0f74b7b-2d20-4135-a7aa-1e0ec982c35b {{(pid=87272) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 11:11:10 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-c1da4c88-5ab3-4dde-8535-13243aa218c5 tempest-ProjectMemberTests-186486462 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 11:11:10 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-c1da4c88-5ab3-4dde-8535-13243aa218c5 tempest-ProjectMemberTests-186486462 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 11:11:10 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-c1da4c88-5ab3-4dde-8535-13243aa218c5 tempest-ProjectMemberTests-186486462 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898': None} {{(pid=87272) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 11:11:10 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-c1da4c88-5ab3-4dde-8535-13243aa218c5 tempest-ProjectMemberTests-186486462 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'] {{(pid=87272) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 11:11:10 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-c1da4c88-5ab3-4dde-8535-13243aa218c5 tempest-ProjectMemberTests-186486462 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 11:11:10 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-c1da4c88-5ab3-4dde-8535-13243aa218c5 tempest-ProjectMemberTests-186486462 None] Selected osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898 as target Quobyte volume. {{(pid=87272) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 11:11:10 devstack cinder-volume[87272]: INFO cinder.volume.drivers.remotefs [None req-c1da4c88-5ab3-4dde-8535-13243aa218c5 tempest-ProjectMemberTests-186486462 None] casted to osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898 Nov 04 11:11:10 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-c1da4c88-5ab3-4dde-8535-13243aa218c5 tempest-ProjectMemberTests-186486462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-d0f74b7b-2d20-4135-a7aa-1e0ec982c35b 1073741824 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:11:10 devstack sudo[107631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-d0f74b7b-2d20-4135-a7aa-1e0ec982c35b 1073741824 Nov 04 11:11:10 devstack sudo[107631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:11:10 devstack sudo[107627]: pam_unix(sudo:session): session closed for user root Nov 04 11:11:10 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-4763cd01-257e-405c-b3be-269618a9a717 tempest-ProjectReaderTests-1709054323 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-71013d9c-264c-446d-9511-211bf225dfd3" returned: 0 in 0.450s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:11:10 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-4763cd01-257e-405c-b3be-269618a9a717 tempest-ProjectReaderTests-1709054323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-71013d9c-264c-446d-9511-211bf225dfd3 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:11:10 devstack sudo[107634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-71013d9c-264c-446d-9511-211bf225dfd3 Nov 04 11:11:10 devstack sudo[107634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:11:11 devstack sudo[107634]: pam_unix(sudo:session): session closed for user root Nov 04 11:11:11 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-4763cd01-257e-405c-b3be-269618a9a717 tempest-ProjectReaderTests-1709054323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-71013d9c-264c-446d-9511-211bf225dfd3" returned: 0 in 0.263s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:11:11 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-4763cd01-257e-405c-b3be-269618a9a717 tempest-ProjectReaderTests-1709054323 None] Lock "cinder-quobyte-71013d9c-264c-446d-9511-211bf225dfd3" released by "delete_volume" :: held 0.788s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 11:11:11 devstack cinder-volume[87272]: DEBUG cinder.quota [None req-4763cd01-257e-405c-b3be-269618a9a717 tempest-ProjectReaderTests-1709054323 None] Created reservations ['593b6331-5d82-4816-ba74-e126f3e60ed8', '820a26d3-77c9-435a-83dc-478ca3e045d3', '0f1b8b93-1563-4ec7-aec5-e66ab320fdf9', 'e4766650-cd15-487e-a11f-7a65e0a1f89d'] {{(pid=87272) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 11:11:11 devstack cinder-volume[87272]: DEBUG cinder.volume.flows.manager.create_volume [None req-9abedc91-3ba7-4aa3-9a68-5b17a0af250c tempest-SnapshotDependencyTests-443959516 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87272) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 11:11:11 devstack sudo[107631]: pam_unix(sudo:session): session closed for user root Nov 04 11:11:11 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-9abedc91-3ba7-4aa3-9a68-5b17a0af250c tempest-SnapshotDependencyTests-443959516 None] Flow 'volume_create_manager' (9783e38c-761a-41ad-8c45-738d71ac4e23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 11:11:11 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-9abedc91-3ba7-4aa3-9a68-5b17a0af250c tempest-SnapshotDependencyTests-443959516 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (30c94811-25ad-4faf-9bfa-caa13eccf8b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:11:11 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-c1da4c88-5ab3-4dde-8535-13243aa218c5 tempest-ProjectMemberTests-186486462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-d0f74b7b-2d20-4135-a7aa-1e0ec982c35b 1073741824" returned: 0 in 0.557s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:11:11 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-9abedc91-3ba7-4aa3-9a68-5b17a0af250c tempest-SnapshotDependencyTests-443959516 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (30c94811-25ad-4faf-9bfa-caa13eccf8b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T10:11:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1898265832',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9bbb0157-8288-4324-bf66-4246f1a52040,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='210a23cdf124476dba9b8d7002b8359f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T10:11:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T10:11:11Z,use_quota=True,user_id='1959122cbeab47939e5a32e51a28e26d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8989e4f-21e3-4f0a-9584-0d818784e883),volume_type_id=f8989e4f-21e3-4f0a-9584-0d818784e883)' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:11:11 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-9abedc91-3ba7-4aa3-9a68-5b17a0af250c tempest-SnapshotDependencyTests-443959516 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (60762bdd-e9d4-4082-b300-9de21aad574a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:11:11 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-9abedc91-3ba7-4aa3-9a68-5b17a0af250c tempest-SnapshotDependencyTests-443959516 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (60762bdd-e9d4-4082-b300-9de21aad574a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:11:11 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-9abedc91-3ba7-4aa3-9a68-5b17a0af250c tempest-SnapshotDependencyTests-443959516 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (99415b2f-3578-4d60-b8c5-0031f678ad00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:11:11 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-9abedc91-3ba7-4aa3-9a68-5b17a0af250c tempest-SnapshotDependencyTests-443959516 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (99415b2f-3578-4d60-b8c5-0031f678ad00) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9bbb0157-8288-4324-bf66-4246f1a52040', 'volume_name': 'volume-9bbb0157-8288-4324-bf66-4246f1a52040', 'volume_size': 1}' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:11:11 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-9abedc91-3ba7-4aa3-9a68-5b17a0af250c tempest-SnapshotDependencyTests-443959516 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f7be520-260d-499a-991d-ab9b8080ea3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:11:11 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-9abedc91-3ba7-4aa3-9a68-5b17a0af250c tempest-SnapshotDependencyTests-443959516 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f7be520-260d-499a-991d-ab9b8080ea3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:11:11 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-9abedc91-3ba7-4aa3-9a68-5b17a0af250c tempest-SnapshotDependencyTests-443959516 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (425d8c66-f84e-4acd-9596-493927c4802b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:11:11 devstack cinder-volume[87272]: INFO cinder.volume.flows.manager.create_volume [None req-9abedc91-3ba7-4aa3-9a68-5b17a0af250c tempest-SnapshotDependencyTests-443959516 None] Volume 9bbb0157-8288-4324-bf66-4246f1a52040: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9bbb0157-8288-4324-bf66-4246f1a52040', 'volume_size': 1} Nov 04 11:11:11 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-9abedc91-3ba7-4aa3-9a68-5b17a0af250c tempest-SnapshotDependencyTests-443959516 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 11:11:11 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-4763cd01-257e-405c-b3be-269618a9a717 tempest-ProjectReaderTests-1709054323 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 11:11:11 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-4763cd01-257e-405c-b3be-269618a9a717 tempest-ProjectReaderTests-1709054323 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 11:11:11 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-4763cd01-257e-405c-b3be-269618a9a717 tempest-ProjectReaderTests-1709054323 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898': None} {{(pid=87272) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 11:11:11 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-4763cd01-257e-405c-b3be-269618a9a717 tempest-ProjectReaderTests-1709054323 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'] {{(pid=87272) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 11:11:11 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-4763cd01-257e-405c-b3be-269618a9a717 tempest-ProjectReaderTests-1709054323 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 11:11:11 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-4763cd01-257e-405c-b3be-269618a9a717 tempest-ProjectReaderTests-1709054323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:11:11 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-c1da4c88-5ab3-4dde-8535-13243aa218c5 tempest-ProjectMemberTests-186486462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-d0f74b7b-2d20-4135-a7aa-1e0ec982c35b {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:11:11 devstack sudo[107641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1 Nov 04 11:11:11 devstack sudo[107641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:11:11 devstack sudo[107643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-d0f74b7b-2d20-4135-a7aa-1e0ec982c35b Nov 04 11:11:11 devstack sudo[107643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:11:11 devstack sudo[107641]: pam_unix(sudo:session): session closed for user root Nov 04 11:11:11 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-4763cd01-257e-405c-b3be-269618a9a717 tempest-ProjectReaderTests-1709054323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1" returned: 0 in 0.260s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:11:11 devstack cinder-volume[87272]: DEBUG cinder.manager [None req-4763cd01-257e-405c-b3be-269618a9a717 tempest-ProjectReaderTests-1709054323 None] Notifying Schedulers of capabilities ... {{(pid=87272) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 11:11:11 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-4763cd01-257e-405c-b3be-269618a9a717 tempest-ProjectReaderTests-1709054323 None] Deleted volume successfully. Nov 04 11:11:11 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-4763cd01-257e-405c-b3be-269618a9a717 tempest-ProjectReaderTests-1709054323 None] Lock "cinder-71013d9c-264c-446d-9511-211bf225dfd3-delete_volume" released by "delete_volume" :: held 1.462s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 11:11:11 devstack sudo[107643]: pam_unix(sudo:session): session closed for user root Nov 04 11:11:11 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-c1da4c88-5ab3-4dde-8535-13243aa218c5 tempest-ProjectMemberTests-186486462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-d0f74b7b-2d20-4135-a7aa-1e0ec982c35b" returned: 0 in 0.280s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:11:11 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-c1da4c88-5ab3-4dde-8535-13243aa218c5 tempest-ProjectMemberTests-186486462 None] <== create_volume: return (974ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'} {{(pid=87272) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 04 11:11:11 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-c1da4c88-5ab3-4dde-8535-13243aa218c5 tempest-ProjectMemberTests-186486462 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.977s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 11:11:11 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-9abedc91-3ba7-4aa3-9a68-5b17a0af250c tempest-SnapshotDependencyTests-443959516 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.347s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 11:11:11 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-9abedc91-3ba7-4aa3-9a68-5b17a0af250c tempest-SnapshotDependencyTests-443959516 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T10:11:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1898265832',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9bbb0157-8288-4324-bf66-4246f1a52040,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='210a23cdf124476dba9b8d7002b8359f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T10:11:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T10:11:11Z,use_quota=True,user_id='1959122cbeab47939e5a32e51a28e26d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8989e4f-21e3-4f0a-9584-0d818784e883),volume_type_id=f8989e4f-21e3-4f0a-9584-0d818784e883)}" {{(pid=87272) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 04 11:11:11 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.remotefs [None req-9abedc91-3ba7-4aa3-9a68-5b17a0af250c tempest-SnapshotDependencyTests-443959516 None] Creating volume 9bbb0157-8288-4324-bf66-4246f1a52040 {{(pid=87272) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 11:11:11 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-9abedc91-3ba7-4aa3-9a68-5b17a0af250c tempest-SnapshotDependencyTests-443959516 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 11:11:11 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-9abedc91-3ba7-4aa3-9a68-5b17a0af250c tempest-SnapshotDependencyTests-443959516 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 11:11:11 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-9abedc91-3ba7-4aa3-9a68-5b17a0af250c tempest-SnapshotDependencyTests-443959516 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898': None} {{(pid=87272) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 11:11:11 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-9abedc91-3ba7-4aa3-9a68-5b17a0af250c tempest-SnapshotDependencyTests-443959516 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'] {{(pid=87272) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 11:11:11 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-9abedc91-3ba7-4aa3-9a68-5b17a0af250c tempest-SnapshotDependencyTests-443959516 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 11:11:11 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-9abedc91-3ba7-4aa3-9a68-5b17a0af250c tempest-SnapshotDependencyTests-443959516 None] Selected osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898 as target Quobyte volume. {{(pid=87272) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 11:11:11 devstack cinder-volume[87272]: INFO cinder.volume.drivers.remotefs [None req-9abedc91-3ba7-4aa3-9a68-5b17a0af250c tempest-SnapshotDependencyTests-443959516 None] casted to osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898 Nov 04 11:11:11 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-9abedc91-3ba7-4aa3-9a68-5b17a0af250c tempest-SnapshotDependencyTests-443959516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-9bbb0157-8288-4324-bf66-4246f1a52040 1073741824 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:11:11 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-c1da4c88-5ab3-4dde-8535-13243aa218c5 tempest-ProjectMemberTests-186486462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (885b359f-b127-476a-aa8e-69fbd2020107) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d0f74b7b-2d20-4135-a7aa-1e0ec982c35b', 'volume_size': 1}' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:11:11 devstack sudo[107647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-9bbb0157-8288-4324-bf66-4246f1a52040 1073741824 Nov 04 11:11:11 devstack sudo[107647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:11:11 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-c1da4c88-5ab3-4dde-8535-13243aa218c5 tempest-ProjectMemberTests-186486462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a70add52-0ae9-4714-b320-e1b9a153835e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:11:11 devstack cinder-volume[87272]: INFO cinder.volume.flows.manager.create_volume [None req-c1da4c88-5ab3-4dde-8535-13243aa218c5 tempest-ProjectMemberTests-186486462 None] Volume volume-d0f74b7b-2d20-4135-a7aa-1e0ec982c35b (d0f74b7b-2d20-4135-a7aa-1e0ec982c35b): created successfully Nov 04 11:11:11 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-c1da4c88-5ab3-4dde-8535-13243aa218c5 tempest-ProjectMemberTests-186486462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a70add52-0ae9-4714-b320-e1b9a153835e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:11:11 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-c1da4c88-5ab3-4dde-8535-13243aa218c5 tempest-ProjectMemberTests-186486462 None] Flow 'volume_create_manager' (cbedfdd7-1fad-4b3a-a9d2-0e215185c39f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87272) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 11:11:11 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-c1da4c88-5ab3-4dde-8535-13243aa218c5 tempest-ProjectMemberTests-186486462 None] Created volume successfully. Nov 04 11:11:12 devstack sudo[107647]: pam_unix(sudo:session): session closed for user root Nov 04 11:11:12 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-9abedc91-3ba7-4aa3-9a68-5b17a0af250c tempest-SnapshotDependencyTests-443959516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-9bbb0157-8288-4324-bf66-4246f1a52040 1073741824" returned: 0 in 0.467s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:11:12 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-9abedc91-3ba7-4aa3-9a68-5b17a0af250c tempest-SnapshotDependencyTests-443959516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-9bbb0157-8288-4324-bf66-4246f1a52040 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:11:12 devstack sudo[107653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-9bbb0157-8288-4324-bf66-4246f1a52040 Nov 04 11:11:12 devstack sudo[107653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:11:12 devstack sudo[107653]: pam_unix(sudo:session): session closed for user root Nov 04 11:11:12 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-9abedc91-3ba7-4aa3-9a68-5b17a0af250c tempest-SnapshotDependencyTests-443959516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-9bbb0157-8288-4324-bf66-4246f1a52040" returned: 0 in 0.275s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:11:12 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-9abedc91-3ba7-4aa3-9a68-5b17a0af250c tempest-SnapshotDependencyTests-443959516 None] <== create_volume: return (779ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'} {{(pid=87272) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 04 11:11:12 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-9abedc91-3ba7-4aa3-9a68-5b17a0af250c tempest-SnapshotDependencyTests-443959516 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.782s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 11:11:12 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-9abedc91-3ba7-4aa3-9a68-5b17a0af250c tempest-SnapshotDependencyTests-443959516 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (425d8c66-f84e-4acd-9596-493927c4802b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9bbb0157-8288-4324-bf66-4246f1a52040', 'volume_size': 1}' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:11:12 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-9abedc91-3ba7-4aa3-9a68-5b17a0af250c tempest-SnapshotDependencyTests-443959516 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f5d4c55-14ce-4586-b992-6e35b879f350) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:11:12 devstack cinder-volume[87272]: INFO cinder.volume.flows.manager.create_volume [None req-9abedc91-3ba7-4aa3-9a68-5b17a0af250c tempest-SnapshotDependencyTests-443959516 None] Volume volume-9bbb0157-8288-4324-bf66-4246f1a52040 (9bbb0157-8288-4324-bf66-4246f1a52040): created successfully Nov 04 11:11:12 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-9abedc91-3ba7-4aa3-9a68-5b17a0af250c tempest-SnapshotDependencyTests-443959516 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f5d4c55-14ce-4586-b992-6e35b879f350) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:11:12 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-9abedc91-3ba7-4aa3-9a68-5b17a0af250c tempest-SnapshotDependencyTests-443959516 None] Flow 'volume_create_manager' (9783e38c-761a-41ad-8c45-738d71ac4e23) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87272) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 11:11:12 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-9abedc91-3ba7-4aa3-9a68-5b17a0af250c tempest-SnapshotDependencyTests-443959516 None] Created volume successfully. Nov 04 11:11:12 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-8320fd27-82d0-4919-ad64-7fec366021a6 tempest-ProjectMemberTests-186486462 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 11:11:12 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-8320fd27-82d0-4919-ad64-7fec366021a6 tempest-ProjectMemberTests-186486462 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 11:11:12 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.remotefs [None req-8320fd27-82d0-4919-ad64-7fec366021a6 tempest-ProjectMemberTests-186486462 None] Creating offline snapshot 32772e51-d891-4e89-bebb-c402694e97fe of volume d0f74b7b-2d20-4135-a7aa-1e0ec982c35b {{(pid=87272) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 04 11:11:12 devstack cinder-volume[87272]: DEBUG oslo.privsep.daemon [-] privsep: reply[deea7376-f13b-4f81-8259-34ca2a7230cd]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 11:11:12 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-8320fd27-82d0-4919-ad64-7fec366021a6 tempest-ProjectMemberTests-186486462 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-d0f74b7b-2d20-4135-a7aa-1e0ec982c35b {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:11:13 devstack sudo[107656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-d0f74b7b-2d20-4135-a7aa-1e0ec982c35b Nov 04 11:11:13 devstack sudo[107656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:11:13 devstack sudo[107656]: pam_unix(sudo:session): session closed for user root Nov 04 11:11:13 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-8320fd27-82d0-4919-ad64-7fec366021a6 tempest-ProjectMemberTests-186486462 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-d0f74b7b-2d20-4135-a7aa-1e0ec982c35b" returned: 0 in 0.406s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:11:13 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-8320fd27-82d0-4919-ad64-7fec366021a6 tempest-ProjectMemberTests-186486462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-d0f74b7b-2d20-4135-a7aa-1e0ec982c35b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-d0f74b7b-2d20-4135-a7aa-1e0ec982c35b.32772e51-d891-4e89-bebb-c402694e97fe 1G {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:11:13 devstack sudo[107661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-d0f74b7b-2d20-4135-a7aa-1e0ec982c35b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-d0f74b7b-2d20-4135-a7aa-1e0ec982c35b.32772e51-d891-4e89-bebb-c402694e97fe 1G Nov 04 11:11:13 devstack sudo[107661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:11:13 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-e4d4470a-d3a5-4f8e-9f19-7d385ed635dd tempest-SnapshotDependencyTests-443959516 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 11:11:13 devstack sudo[107661]: pam_unix(sudo:session): session closed for user root Nov 04 11:11:13 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-8320fd27-82d0-4919-ad64-7fec366021a6 tempest-ProjectMemberTests-186486462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-d0f74b7b-2d20-4135-a7aa-1e0ec982c35b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-d0f74b7b-2d20-4135-a7aa-1e0ec982c35b.32772e51-d891-4e89-bebb-c402694e97fe 1G" returned: 0 in 0.454s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:11:13 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-8320fd27-82d0-4919-ad64-7fec366021a6 tempest-ProjectMemberTests-186486462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d0f74b7b-2d20-4135-a7aa-1e0ec982c35b -F qcow2 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-d0f74b7b-2d20-4135-a7aa-1e0ec982c35b.32772e51-d891-4e89-bebb-c402694e97fe {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:11:13 devstack sudo[107666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d0f74b7b-2d20-4135-a7aa-1e0ec982c35b -F qcow2 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-d0f74b7b-2d20-4135-a7aa-1e0ec982c35b.32772e51-d891-4e89-bebb-c402694e97fe Nov 04 11:11:13 devstack sudo[107666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:11:14 devstack sudo[107666]: pam_unix(sudo:session): session closed for user root Nov 04 11:11:14 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-8320fd27-82d0-4919-ad64-7fec366021a6 tempest-ProjectMemberTests-186486462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d0f74b7b-2d20-4135-a7aa-1e0ec982c35b -F qcow2 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-d0f74b7b-2d20-4135-a7aa-1e0ec982c35b.32772e51-d891-4e89-bebb-c402694e97fe" returned: 0 in 0.280s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:11:14 devstack cinder-volume[87272]: WARNING cinder.volume.drivers.remotefs [None req-8320fd27-82d0-4919-ad64-7fec366021a6 tempest-ProjectMemberTests-186486462 None] /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-d0f74b7b-2d20-4135-a7aa-1e0ec982c35b.32772e51-d891-4e89-bebb-c402694e97fe is being set with open permissions: ugo+rw Nov 04 11:11:14 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-8320fd27-82d0-4919-ad64-7fec366021a6 tempest-ProjectMemberTests-186486462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-d0f74b7b-2d20-4135-a7aa-1e0ec982c35b.32772e51-d891-4e89-bebb-c402694e97fe {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:11:14 devstack sudo[107672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-d0f74b7b-2d20-4135-a7aa-1e0ec982c35b.32772e51-d891-4e89-bebb-c402694e97fe Nov 04 11:11:14 devstack sudo[107672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:11:14 devstack cinder-volume[87272]: DEBUG oslo_service.periodic_task [None req-236af0be-7f9d-4c80-b3d7-d645a9cd0dd1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87272) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 04 11:11:14 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-236af0be-7f9d-4c80-b3d7-d645a9cd0dd1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 11:11:14 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-236af0be-7f9d-4c80-b3d7-d645a9cd0dd1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 11:11:14 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-236af0be-7f9d-4c80-b3d7-d645a9cd0dd1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898': None} {{(pid=87272) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 11:11:14 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-236af0be-7f9d-4c80-b3d7-d645a9cd0dd1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'] {{(pid=87272) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 11:11:14 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-236af0be-7f9d-4c80-b3d7-d645a9cd0dd1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 11:11:14 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-236af0be-7f9d-4c80-b3d7-d645a9cd0dd1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:11:14 devstack sudo[107674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1 Nov 04 11:11:14 devstack sudo[107674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:11:14 devstack sudo[107672]: pam_unix(sudo:session): session closed for user root Nov 04 11:11:14 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-8320fd27-82d0-4919-ad64-7fec366021a6 tempest-ProjectMemberTests-186486462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-d0f74b7b-2d20-4135-a7aa-1e0ec982c35b.32772e51-d891-4e89-bebb-c402694e97fe" returned: 0 in 0.250s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:11:14 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-8320fd27-82d0-4919-ad64-7fec366021a6 tempest-ProjectMemberTests-186486462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-d0f74b7b-2d20-4135-a7aa-1e0ec982c35b.info {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:11:14 devstack sudo[107677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-d0f74b7b-2d20-4135-a7aa-1e0ec982c35b.info Nov 04 11:11:14 devstack sudo[107677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:11:14 devstack sudo[107674]: pam_unix(sudo:session): session closed for user root Nov 04 11:11:14 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-236af0be-7f9d-4c80-b3d7-d645a9cd0dd1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1" returned: 0 in 0.237s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:11:14 devstack cinder-volume[87272]: DEBUG cinder.manager [None req-236af0be-7f9d-4c80-b3d7-d645a9cd0dd1 None None] Notifying Schedulers of capabilities ... {{(pid=87272) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 11:11:14 devstack cinder-volume[87272]: DEBUG oslo_service.periodic_task [None req-236af0be-7f9d-4c80-b3d7-d645a9cd0dd1 None None] Running periodic task VolumeManager._thread_info {{(pid=87272) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 04 11:11:14 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-236af0be-7f9d-4c80-b3d7-d645a9cd0dd1 None None] thread count: 28 {{(pid=87272) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 04 11:11:14 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-236af0be-7f9d-4c80-b3d7-d645a9cd0dd1 None None] thread info: [<_MainThread(MainThread, started 127085713244288)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87272) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 04 11:11:14 devstack sudo[107677]: pam_unix(sudo:session): session closed for user root Nov 04 11:11:14 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-8320fd27-82d0-4919-ad64-7fec366021a6 tempest-ProjectMemberTests-186486462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-d0f74b7b-2d20-4135-a7aa-1e0ec982c35b.info" returned: 0 in 0.256s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:11:14 devstack cinder-volume[87272]: WARNING cinder.volume.drivers.remotefs [None req-8320fd27-82d0-4919-ad64-7fec366021a6 tempest-ProjectMemberTests-186486462 None] /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-d0f74b7b-2d20-4135-a7aa-1e0ec982c35b.info is being set with open permissions: ugo+rw Nov 04 11:11:14 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-8320fd27-82d0-4919-ad64-7fec366021a6 tempest-ProjectMemberTests-186486462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-d0f74b7b-2d20-4135-a7aa-1e0ec982c35b.info {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:11:14 devstack sudo[107681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-d0f74b7b-2d20-4135-a7aa-1e0ec982c35b.info Nov 04 11:11:14 devstack sudo[107681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:11:14 devstack sudo[107681]: pam_unix(sudo:session): session closed for user root Nov 04 11:11:14 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-8320fd27-82d0-4919-ad64-7fec366021a6 tempest-ProjectMemberTests-186486462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-d0f74b7b-2d20-4135-a7aa-1e0ec982c35b.info" returned: 0 in 0.238s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:11:14 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-8320fd27-82d0-4919-ad64-7fec366021a6 tempest-ProjectMemberTests-186486462 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.977s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 11:11:14 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-e4d4470a-d3a5-4f8e-9f19-7d385ed635dd tempest-SnapshotDependencyTests-443959516 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.161s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 11:11:14 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.remotefs [None req-e4d4470a-d3a5-4f8e-9f19-7d385ed635dd tempest-SnapshotDependencyTests-443959516 None] Creating offline snapshot 112c226c-ef73-405c-95db-91b9002200a9 of volume 9bbb0157-8288-4324-bf66-4246f1a52040 {{(pid=87272) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 04 11:11:14 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-8320fd27-82d0-4919-ad64-7fec366021a6 tempest-ProjectMemberTests-186486462 None] Create snapshot completed successfully Nov 04 11:11:14 devstack cinder-volume[87272]: DEBUG oslo.privsep.daemon [-] privsep: reply[b247a53b-068d-4674-b812-733de2596cbb]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 11:11:14 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-e4d4470a-d3a5-4f8e-9f19-7d385ed635dd tempest-SnapshotDependencyTests-443959516 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-9bbb0157-8288-4324-bf66-4246f1a52040 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:11:15 devstack sudo[107684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-9bbb0157-8288-4324-bf66-4246f1a52040 Nov 04 11:11:15 devstack sudo[107684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:11:15 devstack sudo[107684]: pam_unix(sudo:session): session closed for user root Nov 04 11:11:15 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-e4d4470a-d3a5-4f8e-9f19-7d385ed635dd tempest-SnapshotDependencyTests-443959516 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-9bbb0157-8288-4324-bf66-4246f1a52040" returned: 0 in 0.361s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:11:15 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-e4d4470a-d3a5-4f8e-9f19-7d385ed635dd tempest-SnapshotDependencyTests-443959516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-9bbb0157-8288-4324-bf66-4246f1a52040,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-9bbb0157-8288-4324-bf66-4246f1a52040.112c226c-ef73-405c-95db-91b9002200a9 1G {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:11:15 devstack sudo[107689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-9bbb0157-8288-4324-bf66-4246f1a52040,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-9bbb0157-8288-4324-bf66-4246f1a52040.112c226c-ef73-405c-95db-91b9002200a9 1G Nov 04 11:11:15 devstack sudo[107689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:11:15 devstack sudo[107689]: pam_unix(sudo:session): session closed for user root Nov 04 11:11:15 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-e4d4470a-d3a5-4f8e-9f19-7d385ed635dd tempest-SnapshotDependencyTests-443959516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-9bbb0157-8288-4324-bf66-4246f1a52040,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-9bbb0157-8288-4324-bf66-4246f1a52040.112c226c-ef73-405c-95db-91b9002200a9 1G" returned: 0 in 0.398s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:11:15 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-e4d4470a-d3a5-4f8e-9f19-7d385ed635dd tempest-SnapshotDependencyTests-443959516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9bbb0157-8288-4324-bf66-4246f1a52040 -F qcow2 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-9bbb0157-8288-4324-bf66-4246f1a52040.112c226c-ef73-405c-95db-91b9002200a9 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:11:15 devstack sudo[107694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9bbb0157-8288-4324-bf66-4246f1a52040 -F qcow2 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-9bbb0157-8288-4324-bf66-4246f1a52040.112c226c-ef73-405c-95db-91b9002200a9 Nov 04 11:11:15 devstack sudo[107694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:11:15 devstack sudo[107694]: pam_unix(sudo:session): session closed for user root Nov 04 11:11:15 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-e4d4470a-d3a5-4f8e-9f19-7d385ed635dd tempest-SnapshotDependencyTests-443959516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9bbb0157-8288-4324-bf66-4246f1a52040 -F qcow2 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-9bbb0157-8288-4324-bf66-4246f1a52040.112c226c-ef73-405c-95db-91b9002200a9" returned: 0 in 0.291s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:11:15 devstack cinder-volume[87272]: WARNING cinder.volume.drivers.remotefs [None req-e4d4470a-d3a5-4f8e-9f19-7d385ed635dd tempest-SnapshotDependencyTests-443959516 None] /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-9bbb0157-8288-4324-bf66-4246f1a52040.112c226c-ef73-405c-95db-91b9002200a9 is being set with open permissions: ugo+rw Nov 04 11:11:15 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-e4d4470a-d3a5-4f8e-9f19-7d385ed635dd tempest-SnapshotDependencyTests-443959516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-9bbb0157-8288-4324-bf66-4246f1a52040.112c226c-ef73-405c-95db-91b9002200a9 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:11:15 devstack sudo[107699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-9bbb0157-8288-4324-bf66-4246f1a52040.112c226c-ef73-405c-95db-91b9002200a9 Nov 04 11:11:15 devstack sudo[107699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:11:16 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-a2c2217e-3d56-41d2-9a73-82c9b5ff0f82 tempest-ProjectMemberTests-186486462 None] Acquiring lock "cinder-32772e51-d891-4e89-bebb-c402694e97fe-delete_snapshot" by "delete_snapshot" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 11:11:16 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-a2c2217e-3d56-41d2-9a73-82c9b5ff0f82 tempest-ProjectMemberTests-186486462 None] Lock "cinder-32772e51-d891-4e89-bebb-c402694e97fe-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 11:11:16 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-a2c2217e-3d56-41d2-9a73-82c9b5ff0f82 tempest-ProjectMemberTests-186486462 None] Acquiring lock "cinder-quobyte-d0f74b7b-2d20-4135-a7aa-1e0ec982c35b" by "delete_snapshot" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 11:11:16 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-a2c2217e-3d56-41d2-9a73-82c9b5ff0f82 tempest-ProjectMemberTests-186486462 None] Lock "cinder-quobyte-d0f74b7b-2d20-4135-a7aa-1e0ec982c35b" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 11:11:16 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-a2c2217e-3d56-41d2-9a73-82c9b5ff0f82 tempest-ProjectMemberTests-186486462 None] Acquiring lock "cinder-quobyte-32772e51-d891-4e89-bebb-c402694e97fe" by "_delete_snapshot" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 11:11:16 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-a2c2217e-3d56-41d2-9a73-82c9b5ff0f82 tempest-ProjectMemberTests-186486462 None] Lock "cinder-quobyte-32772e51-d891-4e89-bebb-c402694e97fe" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 11:11:16 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.remotefs [None req-a2c2217e-3d56-41d2-9a73-82c9b5ff0f82 tempest-ProjectMemberTests-186486462 None] Deleting offline snapshot 32772e51-d891-4e89-bebb-c402694e97fe of volume d0f74b7b-2d20-4135-a7aa-1e0ec982c35b {{(pid=87272) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 04 11:11:16 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.remotefs [None req-a2c2217e-3d56-41d2-9a73-82c9b5ff0f82 tempest-ProjectMemberTests-186486462 None] snapshot_file for this snap is: volume-d0f74b7b-2d20-4135-a7aa-1e0ec982c35b.32772e51-d891-4e89-bebb-c402694e97fe {{(pid=87272) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 04 11:11:16 devstack cinder-volume[87272]: DEBUG oslo.privsep.daemon [-] privsep: reply[08e2fd3b-2c4f-4e28-8428-7688c1d1ff58]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 11:11:16 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-a2c2217e-3d56-41d2-9a73-82c9b5ff0f82 tempest-ProjectMemberTests-186486462 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-d0f74b7b-2d20-4135-a7aa-1e0ec982c35b.32772e51-d891-4e89-bebb-c402694e97fe {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:11:16 devstack sudo[107699]: pam_unix(sudo:session): session closed for user root Nov 04 11:11:16 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-e4d4470a-d3a5-4f8e-9f19-7d385ed635dd tempest-SnapshotDependencyTests-443959516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-9bbb0157-8288-4324-bf66-4246f1a52040.112c226c-ef73-405c-95db-91b9002200a9" returned: 0 in 0.260s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:11:16 devstack sudo[107701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-d0f74b7b-2d20-4135-a7aa-1e0ec982c35b.32772e51-d891-4e89-bebb-c402694e97fe Nov 04 11:11:16 devstack sudo[107701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:11:16 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-e4d4470a-d3a5-4f8e-9f19-7d385ed635dd tempest-SnapshotDependencyTests-443959516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-9bbb0157-8288-4324-bf66-4246f1a52040.info {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:11:16 devstack sudo[107704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-9bbb0157-8288-4324-bf66-4246f1a52040.info Nov 04 11:11:16 devstack sudo[107704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:11:16 devstack sudo[107704]: pam_unix(sudo:session): session closed for user root Nov 04 11:11:16 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-e4d4470a-d3a5-4f8e-9f19-7d385ed635dd tempest-SnapshotDependencyTests-443959516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-9bbb0157-8288-4324-bf66-4246f1a52040.info" returned: 0 in 0.255s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:11:16 devstack cinder-volume[87272]: WARNING cinder.volume.drivers.remotefs [None req-e4d4470a-d3a5-4f8e-9f19-7d385ed635dd tempest-SnapshotDependencyTests-443959516 None] /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-9bbb0157-8288-4324-bf66-4246f1a52040.info is being set with open permissions: ugo+rw Nov 04 11:11:16 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-e4d4470a-d3a5-4f8e-9f19-7d385ed635dd tempest-SnapshotDependencyTests-443959516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-9bbb0157-8288-4324-bf66-4246f1a52040.info {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:11:16 devstack sudo[107701]: pam_unix(sudo:session): session closed for user root Nov 04 11:11:16 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-a2c2217e-3d56-41d2-9a73-82c9b5ff0f82 tempest-ProjectMemberTests-186486462 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-d0f74b7b-2d20-4135-a7aa-1e0ec982c35b.32772e51-d891-4e89-bebb-c402694e97fe" returned: 0 in 0.374s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:11:16 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.remotefs [None req-a2c2217e-3d56-41d2-9a73-82c9b5ff0f82 tempest-ProjectMemberTests-186486462 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d0f74b7b-2d20-4135-a7aa-1e0ec982c35b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87272) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 11:11:16 devstack sudo[107710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-9bbb0157-8288-4324-bf66-4246f1a52040.info Nov 04 11:11:16 devstack sudo[107710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:11:16 devstack cinder-volume[87272]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebdf6f8c-55e6-455b-9752-a21db1231b9e]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 11:11:16 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-a2c2217e-3d56-41d2-9a73-82c9b5ff0f82 tempest-ProjectMemberTests-186486462 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-d0f74b7b-2d20-4135-a7aa-1e0ec982c35b {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:11:16 devstack sudo[107712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-d0f74b7b-2d20-4135-a7aa-1e0ec982c35b Nov 04 11:11:16 devstack sudo[107712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:11:16 devstack sudo[107710]: pam_unix(sudo:session): session closed for user root Nov 04 11:11:16 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-e4d4470a-d3a5-4f8e-9f19-7d385ed635dd tempest-SnapshotDependencyTests-443959516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-9bbb0157-8288-4324-bf66-4246f1a52040.info" returned: 0 in 0.255s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:11:16 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-e4d4470a-d3a5-4f8e-9f19-7d385ed635dd tempest-SnapshotDependencyTests-443959516 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.925s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 11:11:16 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-e4d4470a-d3a5-4f8e-9f19-7d385ed635dd tempest-SnapshotDependencyTests-443959516 None] Create snapshot completed successfully Nov 04 11:11:16 devstack sudo[107712]: pam_unix(sudo:session): session closed for user root Nov 04 11:11:16 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-a2c2217e-3d56-41d2-9a73-82c9b5ff0f82 tempest-ProjectMemberTests-186486462 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-d0f74b7b-2d20-4135-a7aa-1e0ec982c35b" returned: 0 in 0.361s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:11:16 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-a2c2217e-3d56-41d2-9a73-82c9b5ff0f82 tempest-ProjectMemberTests-186486462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-d0f74b7b-2d20-4135-a7aa-1e0ec982c35b.32772e51-d891-4e89-bebb-c402694e97fe {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:11:16 devstack sudo[107720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-d0f74b7b-2d20-4135-a7aa-1e0ec982c35b.32772e51-d891-4e89-bebb-c402694e97fe Nov 04 11:11:16 devstack sudo[107720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:11:17 devstack sudo[107720]: pam_unix(sudo:session): session closed for user root Nov 04 11:11:17 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-a2c2217e-3d56-41d2-9a73-82c9b5ff0f82 tempest-ProjectMemberTests-186486462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-d0f74b7b-2d20-4135-a7aa-1e0ec982c35b.32772e51-d891-4e89-bebb-c402694e97fe" returned: 0 in 0.316s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:11:17 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-a2c2217e-3d56-41d2-9a73-82c9b5ff0f82 tempest-ProjectMemberTests-186486462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-d0f74b7b-2d20-4135-a7aa-1e0ec982c35b.32772e51-d891-4e89-bebb-c402694e97fe {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:11:17 devstack sudo[107725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-d0f74b7b-2d20-4135-a7aa-1e0ec982c35b.32772e51-d891-4e89-bebb-c402694e97fe Nov 04 11:11:17 devstack sudo[107725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:11:17 devstack sudo[107725]: pam_unix(sudo:session): session closed for user root Nov 04 11:11:17 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-a2c2217e-3d56-41d2-9a73-82c9b5ff0f82 tempest-ProjectMemberTests-186486462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-d0f74b7b-2d20-4135-a7aa-1e0ec982c35b.32772e51-d891-4e89-bebb-c402694e97fe" returned: 0 in 0.254s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:11:17 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-a2c2217e-3d56-41d2-9a73-82c9b5ff0f82 tempest-ProjectMemberTests-186486462 None] Lock "cinder-quobyte-32772e51-d891-4e89-bebb-c402694e97fe" released by "_delete_snapshot" :: held 1.424s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 11:11:17 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-a2c2217e-3d56-41d2-9a73-82c9b5ff0f82 tempest-ProjectMemberTests-186486462 None] Lock "cinder-quobyte-d0f74b7b-2d20-4135-a7aa-1e0ec982c35b" released by "delete_snapshot" :: held 1.455s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 11:11:17 devstack cinder-volume[87272]: DEBUG cinder.quota [None req-a2c2217e-3d56-41d2-9a73-82c9b5ff0f82 tempest-ProjectMemberTests-186486462 None] Created reservations ['9faac85c-a8a5-4145-b80b-c7cd5a8a7a45', 'e8fcef47-b462-41a2-b752-9359dc4d916a', 'a07fd202-a5f4-4aa8-a8dd-2ca753f167ac', '15e02ff4-5eda-424e-bfdb-71900fe878cb'] {{(pid=87272) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 11:11:17 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-a2c2217e-3d56-41d2-9a73-82c9b5ff0f82 tempest-ProjectMemberTests-186486462 None] Delete snapshot completed successfully. Nov 04 11:11:17 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-a2c2217e-3d56-41d2-9a73-82c9b5ff0f82 tempest-ProjectMemberTests-186486462 None] Lock "cinder-32772e51-d891-4e89-bebb-c402694e97fe-delete_snapshot" released by "delete_snapshot" :: held 1.592s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 11:11:18 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-f246af61-f15a-4d6f-9881-0c7e43e6444b tempest-ProjectMemberTests-186486462 None] Acquiring lock "cinder-d0f74b7b-2d20-4135-a7aa-1e0ec982c35b-delete_volume" by "delete_volume" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 11:11:18 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-f246af61-f15a-4d6f-9881-0c7e43e6444b tempest-ProjectMemberTests-186486462 None] Lock "cinder-d0f74b7b-2d20-4135-a7aa-1e0ec982c35b-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 11:11:18 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-f246af61-f15a-4d6f-9881-0c7e43e6444b tempest-ProjectMemberTests-186486462 None] Acquiring lock "cinder-quobyte-d0f74b7b-2d20-4135-a7aa-1e0ec982c35b" by "delete_volume" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 11:11:18 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-f246af61-f15a-4d6f-9881-0c7e43e6444b tempest-ProjectMemberTests-186486462 None] Lock "cinder-quobyte-d0f74b7b-2d20-4135-a7aa-1e0ec982c35b" acquired by "delete_volume" :: waited 0.017s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 11:11:18 devstack cinder-volume[87272]: DEBUG oslo.privsep.daemon [-] privsep: reply[caeceb0e-f826-413c-8c63-768ab2a26e5e]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 11:11:18 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-f246af61-f15a-4d6f-9881-0c7e43e6444b tempest-ProjectMemberTests-186486462 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-d0f74b7b-2d20-4135-a7aa-1e0ec982c35b {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:11:18 devstack cinder-volume[87272]: DEBUG cinder.volume.flows.manager.create_volume [None req-13f11eaf-fcd5-4b50-8d5a-ccbb3f840c3f tempest-SnapshotDependencyTests-443959516 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87272) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 11:11:18 devstack sudo[107728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-d0f74b7b-2d20-4135-a7aa-1e0ec982c35b Nov 04 11:11:18 devstack sudo[107728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:11:18 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-13f11eaf-fcd5-4b50-8d5a-ccbb3f840c3f tempest-SnapshotDependencyTests-443959516 None] Flow 'volume_create_manager' (7b816ff3-425b-4521-9640-3b97abf6f39b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 11:11:18 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-13f11eaf-fcd5-4b50-8d5a-ccbb3f840c3f tempest-SnapshotDependencyTests-443959516 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (738bc969-d38f-4b47-b5ff-2a0de4163ba3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:11:18 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-13f11eaf-fcd5-4b50-8d5a-ccbb3f840c3f tempest-SnapshotDependencyTests-443959516 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (738bc969-d38f-4b47-b5ff-2a0de4163ba3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T10:11:18Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d9d8acbd-fd5a-4320-9713-ec97c60d0e54,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='210a23cdf124476dba9b8d7002b8359f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T10:11:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=112c226c-ef73-405c-95db-91b9002200a9,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T10:11:18Z,use_quota=True,user_id='1959122cbeab47939e5a32e51a28e26d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8989e4f-21e3-4f0a-9584-0d818784e883),volume_type_id=f8989e4f-21e3-4f0a-9584-0d818784e883)' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:11:18 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-13f11eaf-fcd5-4b50-8d5a-ccbb3f840c3f tempest-SnapshotDependencyTests-443959516 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (44fc810c-f050-40c4-81e8-4f063f0dfa9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:11:18 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-13f11eaf-fcd5-4b50-8d5a-ccbb3f840c3f tempest-SnapshotDependencyTests-443959516 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (44fc810c-f050-40c4-81e8-4f063f0dfa9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:11:18 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-13f11eaf-fcd5-4b50-8d5a-ccbb3f840c3f tempest-SnapshotDependencyTests-443959516 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b139d5a4-7e75-454f-bf19-7b5241f53c46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:11:18 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-13f11eaf-fcd5-4b50-8d5a-ccbb3f840c3f tempest-SnapshotDependencyTests-443959516 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b139d5a4-7e75-454f-bf19-7b5241f53c46) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'd9d8acbd-fd5a-4320-9713-ec97c60d0e54', 'volume_name': 'volume-d9d8acbd-fd5a-4320-9713-ec97c60d0e54', 'volume_size': 1, 'snapshot_id': '112c226c-ef73-405c-95db-91b9002200a9'}' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:11:18 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-13f11eaf-fcd5-4b50-8d5a-ccbb3f840c3f tempest-SnapshotDependencyTests-443959516 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3154100e-9d68-41e0-94db-814d431284d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:11:18 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-13f11eaf-fcd5-4b50-8d5a-ccbb3f840c3f tempest-SnapshotDependencyTests-443959516 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3154100e-9d68-41e0-94db-814d431284d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:11:18 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-13f11eaf-fcd5-4b50-8d5a-ccbb3f840c3f tempest-SnapshotDependencyTests-443959516 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e873ced-51ec-486c-9aae-3bfc03571c52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:11:18 devstack cinder-volume[87272]: INFO cinder.volume.flows.manager.create_volume [None req-13f11eaf-fcd5-4b50-8d5a-ccbb3f840c3f tempest-SnapshotDependencyTests-443959516 None] Volume d9d8acbd-fd5a-4320-9713-ec97c60d0e54: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-d9d8acbd-fd5a-4320-9713-ec97c60d0e54', 'volume_size': 1, 'snapshot_id': '112c226c-ef73-405c-95db-91b9002200a9'} Nov 04 11:11:18 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-13f11eaf-fcd5-4b50-8d5a-ccbb3f840c3f tempest-SnapshotDependencyTests-443959516 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 11:11:18 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-13f11eaf-fcd5-4b50-8d5a-ccbb3f840c3f tempest-SnapshotDependencyTests-443959516 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 11:11:18 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-13f11eaf-fcd5-4b50-8d5a-ccbb3f840c3f tempest-SnapshotDependencyTests-443959516 None] Acquiring lock "cinder-quobyte-112c226c-ef73-405c-95db-91b9002200a9-d9d8acbd-fd5a-4320-9713-ec97c60d0e54" by "_create_volume_from_snapshot" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 11:11:18 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-13f11eaf-fcd5-4b50-8d5a-ccbb3f840c3f tempest-SnapshotDependencyTests-443959516 None] Lock "cinder-quobyte-112c226c-ef73-405c-95db-91b9002200a9-d9d8acbd-fd5a-4320-9713-ec97c60d0e54" acquired by "_create_volume_from_snapshot" :: waited 0.015s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 11:11:18 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-13f11eaf-fcd5-4b50-8d5a-ccbb3f840c3f tempest-SnapshotDependencyTests-443959516 None] Creating volume d9d8acbd-fd5a-4320-9713-ec97c60d0e54 from snapshot 112c226c-ef73-405c-95db-91b9002200a9 {{(pid=87272) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 04 11:11:18 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-13f11eaf-fcd5-4b50-8d5a-ccbb3f840c3f tempest-SnapshotDependencyTests-443959516 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 11:11:18 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-13f11eaf-fcd5-4b50-8d5a-ccbb3f840c3f tempest-SnapshotDependencyTests-443959516 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 11:11:18 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-13f11eaf-fcd5-4b50-8d5a-ccbb3f840c3f tempest-SnapshotDependencyTests-443959516 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898': None} {{(pid=87272) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 11:11:18 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-13f11eaf-fcd5-4b50-8d5a-ccbb3f840c3f tempest-SnapshotDependencyTests-443959516 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'] {{(pid=87272) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 11:11:18 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-13f11eaf-fcd5-4b50-8d5a-ccbb3f840c3f tempest-SnapshotDependencyTests-443959516 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 11:11:18 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-13f11eaf-fcd5-4b50-8d5a-ccbb3f840c3f tempest-SnapshotDependencyTests-443959516 None] Selected osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898 as target Quobyte volume. {{(pid=87272) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 11:11:18 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-13f11eaf-fcd5-4b50-8d5a-ccbb3f840c3f tempest-SnapshotDependencyTests-443959516 None] Acquiring lock "cinder-quobyte-d9d8acbd-fd5a-4320-9713-ec97c60d0e54" by "_copy_volume_from_snapshot" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 11:11:18 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-13f11eaf-fcd5-4b50-8d5a-ccbb3f840c3f tempest-SnapshotDependencyTests-443959516 None] Lock "cinder-quobyte-d9d8acbd-fd5a-4320-9713-ec97c60d0e54" acquired by "_copy_volume_from_snapshot" :: waited 0.013s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 11:11:18 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-13f11eaf-fcd5-4b50-8d5a-ccbb3f840c3f tempest-SnapshotDependencyTests-443959516 None] snapshot: 112c226c-ef73-405c-95db-91b9002200a9, volume: d9d8acbd-fd5a-4320-9713-ec97c60d0e54, {{(pid=87272) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 04 11:11:18 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-13f11eaf-fcd5-4b50-8d5a-ccbb3f840c3f tempest-SnapshotDependencyTests-443959516 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 11:11:18 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-13f11eaf-fcd5-4b50-8d5a-ccbb3f840c3f tempest-SnapshotDependencyTests-443959516 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 11:11:18 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-13f11eaf-fcd5-4b50-8d5a-ccbb3f840c3f tempest-SnapshotDependencyTests-443959516 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898': None} {{(pid=87272) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 11:11:18 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-13f11eaf-fcd5-4b50-8d5a-ccbb3f840c3f tempest-SnapshotDependencyTests-443959516 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'] {{(pid=87272) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 11:11:18 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-13f11eaf-fcd5-4b50-8d5a-ccbb3f840c3f tempest-SnapshotDependencyTests-443959516 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 11:11:18 devstack cinder-volume[87272]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2a7882d-b0bb-4aff-9f5d-57b980192f6f]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 11:11:18 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-13f11eaf-fcd5-4b50-8d5a-ccbb3f840c3f tempest-SnapshotDependencyTests-443959516 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-9bbb0157-8288-4324-bf66-4246f1a52040.112c226c-ef73-405c-95db-91b9002200a9 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:11:18 devstack sudo[107728]: pam_unix(sudo:session): session closed for user root Nov 04 11:11:18 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-f246af61-f15a-4d6f-9881-0c7e43e6444b tempest-ProjectMemberTests-186486462 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-d0f74b7b-2d20-4135-a7aa-1e0ec982c35b" returned: 0 in 0.367s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:11:18 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-f246af61-f15a-4d6f-9881-0c7e43e6444b tempest-ProjectMemberTests-186486462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-d0f74b7b-2d20-4135-a7aa-1e0ec982c35b {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:11:18 devstack sudo[107734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-d0f74b7b-2d20-4135-a7aa-1e0ec982c35b Nov 04 11:11:18 devstack sudo[107734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:11:18 devstack sudo[107731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-9bbb0157-8288-4324-bf66-4246f1a52040.112c226c-ef73-405c-95db-91b9002200a9 Nov 04 11:11:18 devstack sudo[107731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:11:18 devstack sudo[107734]: pam_unix(sudo:session): session closed for user root Nov 04 11:11:18 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-f246af61-f15a-4d6f-9881-0c7e43e6444b tempest-ProjectMemberTests-186486462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-d0f74b7b-2d20-4135-a7aa-1e0ec982c35b" returned: 0 in 0.243s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:11:18 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-f246af61-f15a-4d6f-9881-0c7e43e6444b tempest-ProjectMemberTests-186486462 None] Lock "cinder-quobyte-d0f74b7b-2d20-4135-a7aa-1e0ec982c35b" released by "delete_volume" :: held 0.681s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 11:11:19 devstack sudo[107731]: pam_unix(sudo:session): session closed for user root Nov 04 11:11:19 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-13f11eaf-fcd5-4b50-8d5a-ccbb3f840c3f tempest-SnapshotDependencyTests-443959516 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-9bbb0157-8288-4324-bf66-4246f1a52040.112c226c-ef73-405c-95db-91b9002200a9" returned: 0 in 0.383s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:11:19 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.remotefs [None req-13f11eaf-fcd5-4b50-8d5a-ccbb3f840c3f tempest-SnapshotDependencyTests-443959516 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9bbb0157-8288-4324-bf66-4246f1a52040(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87272) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 11:11:19 devstack cinder-volume[87272]: DEBUG cinder.quota [None req-f246af61-f15a-4d6f-9881-0c7e43e6444b tempest-ProjectMemberTests-186486462 None] Created reservations ['57e742c1-313e-4823-a459-541610b1bb44', '9c049f33-d38d-48e6-b702-1c754806da28', 'd6a40ac5-a7ea-4e44-a86d-480c10b44009', 'a53c08c0-784f-4bd2-bcce-6bf09977bd5d'] {{(pid=87272) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 11:11:19 devstack cinder-volume[87272]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4b15154-9c7b-4656-aeff-94da340d20f6]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 11:11:19 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-13f11eaf-fcd5-4b50-8d5a-ccbb3f840c3f tempest-SnapshotDependencyTests-443959516 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-9bbb0157-8288-4324-bf66-4246f1a52040 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:11:19 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-f246af61-f15a-4d6f-9881-0c7e43e6444b tempest-ProjectMemberTests-186486462 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 11:11:19 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-f246af61-f15a-4d6f-9881-0c7e43e6444b tempest-ProjectMemberTests-186486462 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 11:11:19 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-f246af61-f15a-4d6f-9881-0c7e43e6444b tempest-ProjectMemberTests-186486462 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898': None} {{(pid=87272) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 11:11:19 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-f246af61-f15a-4d6f-9881-0c7e43e6444b tempest-ProjectMemberTests-186486462 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'] {{(pid=87272) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 11:11:19 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-f246af61-f15a-4d6f-9881-0c7e43e6444b tempest-ProjectMemberTests-186486462 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 11:11:19 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-f246af61-f15a-4d6f-9881-0c7e43e6444b tempest-ProjectMemberTests-186486462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:11:19 devstack sudo[107743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1 Nov 04 11:11:19 devstack sudo[107743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:11:19 devstack sudo[107742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-9bbb0157-8288-4324-bf66-4246f1a52040 Nov 04 11:11:19 devstack sudo[107742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:11:19 devstack sudo[107743]: pam_unix(sudo:session): session closed for user root Nov 04 11:11:19 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-f246af61-f15a-4d6f-9881-0c7e43e6444b tempest-ProjectMemberTests-186486462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1" returned: 0 in 0.271s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:11:19 devstack cinder-volume[87272]: DEBUG cinder.manager [None req-f246af61-f15a-4d6f-9881-0c7e43e6444b tempest-ProjectMemberTests-186486462 None] Notifying Schedulers of capabilities ... {{(pid=87272) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 11:11:19 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-f246af61-f15a-4d6f-9881-0c7e43e6444b tempest-ProjectMemberTests-186486462 None] Deleted volume successfully. Nov 04 11:11:19 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-f246af61-f15a-4d6f-9881-0c7e43e6444b tempest-ProjectMemberTests-186486462 None] Lock "cinder-d0f74b7b-2d20-4135-a7aa-1e0ec982c35b-delete_volume" released by "delete_volume" :: held 1.191s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 11:11:19 devstack sudo[107742]: pam_unix(sudo:session): session closed for user root Nov 04 11:11:19 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-13f11eaf-fcd5-4b50-8d5a-ccbb3f840c3f tempest-SnapshotDependencyTests-443959516 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-9bbb0157-8288-4324-bf66-4246f1a52040" returned: 0 in 0.389s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:11:19 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-13f11eaf-fcd5-4b50-8d5a-ccbb3f840c3f tempest-SnapshotDependencyTests-443959516 None] will copy from snapshot at /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-9bbb0157-8288-4324-bf66-4246f1a52040 {{(pid=87272) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 04 11:11:19 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-13f11eaf-fcd5-4b50-8d5a-ccbb3f840c3f tempest-SnapshotDependencyTests-443959516 None] Creating direct copy from snapshot {{(pid=87272) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 04 11:11:19 devstack cinder-volume[87272]: DEBUG cinder.utils [None req-13f11eaf-fcd5-4b50-8d5a-ccbb3f840c3f tempest-SnapshotDependencyTests-443959516 None] Path /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-d9d8acbd-fd5a-4320-9713-ec97c60d0e54 not found in is_blk_device check {{(pid=87272) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Nov 04 11:11:19 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-13f11eaf-fcd5-4b50-8d5a-ccbb3f840c3f tempest-SnapshotDependencyTests-443959516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-9bbb0157-8288-4324-bf66-4246f1a52040 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-d9d8acbd-fd5a-4320-9713-ec97c60d0e54 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:11:19 devstack sudo[107750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-9bbb0157-8288-4324-bf66-4246f1a52040 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-d9d8acbd-fd5a-4320-9713-ec97c60d0e54 Nov 04 11:11:19 devstack sudo[107750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:11:19 devstack cinder-volume[87272]: DEBUG cinder.volume.flows.manager.create_volume [None req-c9848cfc-829b-4816-90ef-a79ed661250e tempest-ProjectMemberTests-186486462 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87272) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 11:11:19 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-c9848cfc-829b-4816-90ef-a79ed661250e tempest-ProjectMemberTests-186486462 None] Flow 'volume_create_manager' (283d34dd-5e13-4324-ab4a-c45a70359f75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 11:11:19 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-c9848cfc-829b-4816-90ef-a79ed661250e tempest-ProjectMemberTests-186486462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e9311e9-5c2e-46c7-863c-d257caf6ee6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:11:19 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-c9848cfc-829b-4816-90ef-a79ed661250e tempest-ProjectMemberTests-186486462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e9311e9-5c2e-46c7-863c-d257caf6ee6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T10:11:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-487802396',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb4c61a6-bb88-4f34-971e-c7a35987c877,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8457b114a6264c47af483fad6a8bf18b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T10:11:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T10:11:20Z,use_quota=True,user_id='70a59e5f7c684c0b88977c66a4e36afb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8989e4f-21e3-4f0a-9584-0d818784e883),volume_type_id=f8989e4f-21e3-4f0a-9584-0d818784e883)' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:11:19 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-c9848cfc-829b-4816-90ef-a79ed661250e tempest-ProjectMemberTests-186486462 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad892794-6cd9-4ff1-ac67-6d20d5e3fc13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:11:19 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-c9848cfc-829b-4816-90ef-a79ed661250e tempest-ProjectMemberTests-186486462 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad892794-6cd9-4ff1-ac67-6d20d5e3fc13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:11:19 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-c9848cfc-829b-4816-90ef-a79ed661250e tempest-ProjectMemberTests-186486462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cfc331b1-766a-43a1-85cd-c9f82adae9ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:11:19 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-c9848cfc-829b-4816-90ef-a79ed661250e tempest-ProjectMemberTests-186486462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cfc331b1-766a-43a1-85cd-c9f82adae9ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cb4c61a6-bb88-4f34-971e-c7a35987c877', 'volume_name': 'volume-cb4c61a6-bb88-4f34-971e-c7a35987c877', 'volume_size': 1}' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:11:19 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-c9848cfc-829b-4816-90ef-a79ed661250e tempest-ProjectMemberTests-186486462 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (57e0a533-c6ae-4493-a51c-10d3daa5c9cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:11:19 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-c9848cfc-829b-4816-90ef-a79ed661250e tempest-ProjectMemberTests-186486462 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (57e0a533-c6ae-4493-a51c-10d3daa5c9cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:11:19 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-c9848cfc-829b-4816-90ef-a79ed661250e tempest-ProjectMemberTests-186486462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58ee82de-f9c9-45f7-a3c2-fccf1eb84bff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:11:19 devstack cinder-volume[87272]: INFO cinder.volume.flows.manager.create_volume [None req-c9848cfc-829b-4816-90ef-a79ed661250e tempest-ProjectMemberTests-186486462 None] Volume cb4c61a6-bb88-4f34-971e-c7a35987c877: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cb4c61a6-bb88-4f34-971e-c7a35987c877', 'volume_size': 1} Nov 04 11:11:19 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-c9848cfc-829b-4816-90ef-a79ed661250e tempest-ProjectMemberTests-186486462 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 11:11:25 devstack sudo[107750]: pam_unix(sudo:session): session closed for user root Nov 04 11:11:25 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-13f11eaf-fcd5-4b50-8d5a-ccbb3f840c3f tempest-SnapshotDependencyTests-443959516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-9bbb0157-8288-4324-bf66-4246f1a52040 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-d9d8acbd-fd5a-4320-9713-ec97c60d0e54" returned: 0 in 6.097s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:11:25 devstack cinder-volume[87272]: DEBUG cinder.image.image_utils [None req-13f11eaf-fcd5-4b50-8d5a-ccbb3f840c3f tempest-SnapshotDependencyTests-443959516 None] Image conversion details: src /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-9bbb0157-8288-4324-bf66-4246f1a52040, size 1024.00 MB, duration 6.10 sec, destination /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-d9d8acbd-fd5a-4320-9713-ec97c60d0e54 {{(pid=87272) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Nov 04 11:11:25 devstack cinder-volume[87272]: INFO cinder.image.image_utils [None req-13f11eaf-fcd5-4b50-8d5a-ccbb3f840c3f tempest-SnapshotDependencyTests-443959516 None] Converted 1024.00 MB image at 167.92 MB/s Nov 04 11:11:25 devstack cinder-volume[87272]: WARNING cinder.volume.drivers.remotefs [None req-13f11eaf-fcd5-4b50-8d5a-ccbb3f840c3f tempest-SnapshotDependencyTests-443959516 None] /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-d9d8acbd-fd5a-4320-9713-ec97c60d0e54 is being set with open permissions: ugo+rw Nov 04 11:11:25 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-13f11eaf-fcd5-4b50-8d5a-ccbb3f840c3f tempest-SnapshotDependencyTests-443959516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-d9d8acbd-fd5a-4320-9713-ec97c60d0e54 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:11:25 devstack sudo[107772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-d9d8acbd-fd5a-4320-9713-ec97c60d0e54 Nov 04 11:11:25 devstack sudo[107772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:11:25 devstack sudo[107772]: pam_unix(sudo:session): session closed for user root Nov 04 11:11:25 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-13f11eaf-fcd5-4b50-8d5a-ccbb3f840c3f tempest-SnapshotDependencyTests-443959516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-d9d8acbd-fd5a-4320-9713-ec97c60d0e54" returned: 0 in 0.232s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:11:25 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-13f11eaf-fcd5-4b50-8d5a-ccbb3f840c3f tempest-SnapshotDependencyTests-443959516 None] Lock "cinder-quobyte-d9d8acbd-fd5a-4320-9713-ec97c60d0e54" released by "_copy_volume_from_snapshot" :: held 7.182s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 11:11:25 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-13f11eaf-fcd5-4b50-8d5a-ccbb3f840c3f tempest-SnapshotDependencyTests-443959516 None] Lock "cinder-quobyte-112c226c-ef73-405c-95db-91b9002200a9-d9d8acbd-fd5a-4320-9713-ec97c60d0e54" released by "_create_volume_from_snapshot" :: held 7.243s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 11:11:25 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-13f11eaf-fcd5-4b50-8d5a-ccbb3f840c3f tempest-SnapshotDependencyTests-443959516 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.259s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 11:11:25 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-c9848cfc-829b-4816-90ef-a79ed661250e tempest-ProjectMemberTests-186486462 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.858s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 11:11:25 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-c9848cfc-829b-4816-90ef-a79ed661250e tempest-ProjectMemberTests-186486462 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T10:11:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-487802396',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb4c61a6-bb88-4f34-971e-c7a35987c877,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8457b114a6264c47af483fad6a8bf18b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T10:11:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T10:11:20Z,use_quota=True,user_id='70a59e5f7c684c0b88977c66a4e36afb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8989e4f-21e3-4f0a-9584-0d818784e883),volume_type_id=f8989e4f-21e3-4f0a-9584-0d818784e883)}" {{(pid=87272) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 04 11:11:25 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.remotefs [None req-c9848cfc-829b-4816-90ef-a79ed661250e tempest-ProjectMemberTests-186486462 None] Creating volume cb4c61a6-bb88-4f34-971e-c7a35987c877 {{(pid=87272) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 11:11:25 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-c9848cfc-829b-4816-90ef-a79ed661250e tempest-ProjectMemberTests-186486462 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 11:11:25 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-c9848cfc-829b-4816-90ef-a79ed661250e tempest-ProjectMemberTests-186486462 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 11:11:25 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-c9848cfc-829b-4816-90ef-a79ed661250e tempest-ProjectMemberTests-186486462 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898': None} {{(pid=87272) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 11:11:25 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-c9848cfc-829b-4816-90ef-a79ed661250e tempest-ProjectMemberTests-186486462 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'] {{(pid=87272) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 11:11:25 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-c9848cfc-829b-4816-90ef-a79ed661250e tempest-ProjectMemberTests-186486462 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 11:11:25 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-c9848cfc-829b-4816-90ef-a79ed661250e tempest-ProjectMemberTests-186486462 None] Selected osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898 as target Quobyte volume. {{(pid=87272) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 11:11:25 devstack cinder-volume[87272]: INFO cinder.volume.drivers.remotefs [None req-c9848cfc-829b-4816-90ef-a79ed661250e tempest-ProjectMemberTests-186486462 None] casted to osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898 Nov 04 11:11:25 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-c9848cfc-829b-4816-90ef-a79ed661250e tempest-ProjectMemberTests-186486462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-cb4c61a6-bb88-4f34-971e-c7a35987c877 1073741824 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:11:25 devstack sudo[107775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-cb4c61a6-bb88-4f34-971e-c7a35987c877 1073741824 Nov 04 11:11:25 devstack sudo[107775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:11:25 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-13f11eaf-fcd5-4b50-8d5a-ccbb3f840c3f tempest-SnapshotDependencyTests-443959516 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e873ced-51ec-486c-9aae-3bfc03571c52) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d9d8acbd-fd5a-4320-9713-ec97c60d0e54', 'volume_size': 1, 'snapshot_id': '112c226c-ef73-405c-95db-91b9002200a9'}' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:11:25 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-13f11eaf-fcd5-4b50-8d5a-ccbb3f840c3f tempest-SnapshotDependencyTests-443959516 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (11704c17-6fb2-4fd5-8c58-5af1d1db2b26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:11:25 devstack cinder-volume[87272]: INFO cinder.volume.flows.manager.create_volume [None req-13f11eaf-fcd5-4b50-8d5a-ccbb3f840c3f tempest-SnapshotDependencyTests-443959516 None] Volume volume-d9d8acbd-fd5a-4320-9713-ec97c60d0e54 (d9d8acbd-fd5a-4320-9713-ec97c60d0e54): created successfully Nov 04 11:11:25 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-13f11eaf-fcd5-4b50-8d5a-ccbb3f840c3f tempest-SnapshotDependencyTests-443959516 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (11704c17-6fb2-4fd5-8c58-5af1d1db2b26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:11:25 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-13f11eaf-fcd5-4b50-8d5a-ccbb3f840c3f tempest-SnapshotDependencyTests-443959516 None] Flow 'volume_create_manager' (7b816ff3-425b-4521-9640-3b97abf6f39b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87272) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 11:11:25 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-13f11eaf-fcd5-4b50-8d5a-ccbb3f840c3f tempest-SnapshotDependencyTests-443959516 None] Created volume successfully. Nov 04 11:11:26 devstack sudo[107775]: pam_unix(sudo:session): session closed for user root Nov 04 11:11:26 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-c9848cfc-829b-4816-90ef-a79ed661250e tempest-ProjectMemberTests-186486462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-cb4c61a6-bb88-4f34-971e-c7a35987c877 1073741824" returned: 0 in 0.409s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:11:26 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-c9848cfc-829b-4816-90ef-a79ed661250e tempest-ProjectMemberTests-186486462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-cb4c61a6-bb88-4f34-971e-c7a35987c877 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:11:26 devstack sudo[107781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-cb4c61a6-bb88-4f34-971e-c7a35987c877 Nov 04 11:11:26 devstack sudo[107781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:11:26 devstack sudo[107781]: pam_unix(sudo:session): session closed for user root Nov 04 11:11:26 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-c9848cfc-829b-4816-90ef-a79ed661250e tempest-ProjectMemberTests-186486462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-cb4c61a6-bb88-4f34-971e-c7a35987c877" returned: 0 in 0.229s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:11:26 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-c9848cfc-829b-4816-90ef-a79ed661250e tempest-ProjectMemberTests-186486462 None] <== create_volume: return (673ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'} {{(pid=87272) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 04 11:11:26 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-c9848cfc-829b-4816-90ef-a79ed661250e tempest-ProjectMemberTests-186486462 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.675s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 11:11:26 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-c9848cfc-829b-4816-90ef-a79ed661250e tempest-ProjectMemberTests-186486462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58ee82de-f9c9-45f7-a3c2-fccf1eb84bff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cb4c61a6-bb88-4f34-971e-c7a35987c877', 'volume_size': 1}' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:11:26 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-c9848cfc-829b-4816-90ef-a79ed661250e tempest-ProjectMemberTests-186486462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a1d44bd-3f92-48b6-9293-4a63405da8cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:11:26 devstack cinder-volume[87272]: INFO cinder.volume.flows.manager.create_volume [None req-c9848cfc-829b-4816-90ef-a79ed661250e tempest-ProjectMemberTests-186486462 None] Volume volume-cb4c61a6-bb88-4f34-971e-c7a35987c877 (cb4c61a6-bb88-4f34-971e-c7a35987c877): created successfully Nov 04 11:11:26 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-c9848cfc-829b-4816-90ef-a79ed661250e tempest-ProjectMemberTests-186486462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a1d44bd-3f92-48b6-9293-4a63405da8cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:11:26 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-c9848cfc-829b-4816-90ef-a79ed661250e tempest-ProjectMemberTests-186486462 None] Flow 'volume_create_manager' (283d34dd-5e13-4324-ab4a-c45a70359f75) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87272) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 11:11:26 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-c9848cfc-829b-4816-90ef-a79ed661250e tempest-ProjectMemberTests-186486462 None] Created volume successfully. Nov 04 11:11:27 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-6a41b63c-7789-47a1-915e-b3b058e14a71 tempest-SnapshotDependencyTests-443959516 None] Acquiring lock "cinder-112c226c-ef73-405c-95db-91b9002200a9-delete_snapshot" by "delete_snapshot" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 11:11:27 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-6a41b63c-7789-47a1-915e-b3b058e14a71 tempest-SnapshotDependencyTests-443959516 None] Lock "cinder-112c226c-ef73-405c-95db-91b9002200a9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 11:11:27 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-6a41b63c-7789-47a1-915e-b3b058e14a71 tempest-SnapshotDependencyTests-443959516 None] Acquiring lock "cinder-quobyte-9bbb0157-8288-4324-bf66-4246f1a52040" by "delete_snapshot" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 11:11:27 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-6a41b63c-7789-47a1-915e-b3b058e14a71 tempest-SnapshotDependencyTests-443959516 None] Lock "cinder-quobyte-9bbb0157-8288-4324-bf66-4246f1a52040" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 11:11:27 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-6a41b63c-7789-47a1-915e-b3b058e14a71 tempest-SnapshotDependencyTests-443959516 None] Acquiring lock "cinder-quobyte-112c226c-ef73-405c-95db-91b9002200a9" by "_delete_snapshot" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 11:11:27 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-6a41b63c-7789-47a1-915e-b3b058e14a71 tempest-SnapshotDependencyTests-443959516 None] Lock "cinder-quobyte-112c226c-ef73-405c-95db-91b9002200a9" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 11:11:27 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.remotefs [None req-6a41b63c-7789-47a1-915e-b3b058e14a71 tempest-SnapshotDependencyTests-443959516 None] Deleting offline snapshot 112c226c-ef73-405c-95db-91b9002200a9 of volume 9bbb0157-8288-4324-bf66-4246f1a52040 {{(pid=87272) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 04 11:11:27 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.remotefs [None req-6a41b63c-7789-47a1-915e-b3b058e14a71 tempest-SnapshotDependencyTests-443959516 None] snapshot_file for this snap is: volume-9bbb0157-8288-4324-bf66-4246f1a52040.112c226c-ef73-405c-95db-91b9002200a9 {{(pid=87272) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 04 11:11:27 devstack cinder-volume[87272]: DEBUG oslo.privsep.daemon [-] privsep: reply[a56f1527-9f9c-480e-a193-e6090039bed6]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 11:11:27 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-6a41b63c-7789-47a1-915e-b3b058e14a71 tempest-SnapshotDependencyTests-443959516 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-9bbb0157-8288-4324-bf66-4246f1a52040.112c226c-ef73-405c-95db-91b9002200a9 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:11:27 devstack sudo[107785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-9bbb0157-8288-4324-bf66-4246f1a52040.112c226c-ef73-405c-95db-91b9002200a9 Nov 04 11:11:27 devstack sudo[107785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:11:27 devstack sudo[107785]: pam_unix(sudo:session): session closed for user root Nov 04 11:11:27 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-6a41b63c-7789-47a1-915e-b3b058e14a71 tempest-SnapshotDependencyTests-443959516 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-9bbb0157-8288-4324-bf66-4246f1a52040.112c226c-ef73-405c-95db-91b9002200a9" returned: 0 in 0.391s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:11:27 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.remotefs [None req-6a41b63c-7789-47a1-915e-b3b058e14a71 tempest-SnapshotDependencyTests-443959516 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9bbb0157-8288-4324-bf66-4246f1a52040(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87272) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 11:11:27 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-5d9a244e-0ab4-4249-be46-4d747273042d tempest-ProjectMemberTests-186486462 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 11:11:27 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-5d9a244e-0ab4-4249-be46-4d747273042d tempest-ProjectMemberTests-186486462 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 11:11:27 devstack cinder-volume[87272]: DEBUG oslo.privsep.daemon [-] privsep: reply[87c5ad81-fc0f-472f-b8cd-77cfdb17594e]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 11:11:27 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-6a41b63c-7789-47a1-915e-b3b058e14a71 tempest-SnapshotDependencyTests-443959516 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-9bbb0157-8288-4324-bf66-4246f1a52040 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:11:27 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.remotefs [None req-5d9a244e-0ab4-4249-be46-4d747273042d tempest-ProjectMemberTests-186486462 None] Creating offline snapshot 5d0e2089-5fab-494d-a911-94c721d309bb of volume cb4c61a6-bb88-4f34-971e-c7a35987c877 {{(pid=87272) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 04 11:11:27 devstack cinder-volume[87272]: DEBUG oslo.privsep.daemon [-] privsep: reply[842b3135-eaf0-4a14-92b6-5a54a54683e9]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 11:11:27 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-5d9a244e-0ab4-4249-be46-4d747273042d tempest-ProjectMemberTests-186486462 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-cb4c61a6-bb88-4f34-971e-c7a35987c877 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:11:27 devstack sudo[107790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-9bbb0157-8288-4324-bf66-4246f1a52040 Nov 04 11:11:27 devstack sudo[107790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:11:27 devstack sudo[107791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-cb4c61a6-bb88-4f34-971e-c7a35987c877 Nov 04 11:11:27 devstack sudo[107791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:11:27 devstack sudo[107791]: pam_unix(sudo:session): session closed for user root Nov 04 11:11:27 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-5d9a244e-0ab4-4249-be46-4d747273042d tempest-ProjectMemberTests-186486462 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-cb4c61a6-bb88-4f34-971e-c7a35987c877" returned: 0 in 0.354s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:11:27 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-5d9a244e-0ab4-4249-be46-4d747273042d tempest-ProjectMemberTests-186486462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-cb4c61a6-bb88-4f34-971e-c7a35987c877,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-cb4c61a6-bb88-4f34-971e-c7a35987c877.5d0e2089-5fab-494d-a911-94c721d309bb 1G {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:11:27 devstack sudo[107800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-cb4c61a6-bb88-4f34-971e-c7a35987c877,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-cb4c61a6-bb88-4f34-971e-c7a35987c877.5d0e2089-5fab-494d-a911-94c721d309bb 1G Nov 04 11:11:27 devstack sudo[107800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:11:28 devstack sudo[107790]: pam_unix(sudo:session): session closed for user root Nov 04 11:11:28 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-6a41b63c-7789-47a1-915e-b3b058e14a71 tempest-SnapshotDependencyTests-443959516 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-9bbb0157-8288-4324-bf66-4246f1a52040" returned: 0 in 0.538s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:11:28 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-6a41b63c-7789-47a1-915e-b3b058e14a71 tempest-SnapshotDependencyTests-443959516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-9bbb0157-8288-4324-bf66-4246f1a52040.112c226c-ef73-405c-95db-91b9002200a9 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:11:28 devstack sudo[107803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-9bbb0157-8288-4324-bf66-4246f1a52040.112c226c-ef73-405c-95db-91b9002200a9 Nov 04 11:11:28 devstack sudo[107803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:11:28 devstack sudo[107800]: pam_unix(sudo:session): session closed for user root Nov 04 11:11:28 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-5d9a244e-0ab4-4249-be46-4d747273042d tempest-ProjectMemberTests-186486462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-cb4c61a6-bb88-4f34-971e-c7a35987c877,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-cb4c61a6-bb88-4f34-971e-c7a35987c877.5d0e2089-5fab-494d-a911-94c721d309bb 1G" returned: 0 in 0.419s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:11:28 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-5d9a244e-0ab4-4249-be46-4d747273042d tempest-ProjectMemberTests-186486462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cb4c61a6-bb88-4f34-971e-c7a35987c877 -F qcow2 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-cb4c61a6-bb88-4f34-971e-c7a35987c877.5d0e2089-5fab-494d-a911-94c721d309bb {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:11:28 devstack sudo[107811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cb4c61a6-bb88-4f34-971e-c7a35987c877 -F qcow2 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-cb4c61a6-bb88-4f34-971e-c7a35987c877.5d0e2089-5fab-494d-a911-94c721d309bb Nov 04 11:11:28 devstack sudo[107811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:11:28 devstack sudo[107803]: pam_unix(sudo:session): session closed for user root Nov 04 11:11:28 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-6a41b63c-7789-47a1-915e-b3b058e14a71 tempest-SnapshotDependencyTests-443959516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-9bbb0157-8288-4324-bf66-4246f1a52040.112c226c-ef73-405c-95db-91b9002200a9" returned: 0 in 0.343s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:11:28 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-6a41b63c-7789-47a1-915e-b3b058e14a71 tempest-SnapshotDependencyTests-443959516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-9bbb0157-8288-4324-bf66-4246f1a52040.112c226c-ef73-405c-95db-91b9002200a9 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:11:28 devstack sudo[107813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-9bbb0157-8288-4324-bf66-4246f1a52040.112c226c-ef73-405c-95db-91b9002200a9 Nov 04 11:11:28 devstack sudo[107813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:11:28 devstack sudo[107811]: pam_unix(sudo:session): session closed for user root Nov 04 11:11:28 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-5d9a244e-0ab4-4249-be46-4d747273042d tempest-ProjectMemberTests-186486462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cb4c61a6-bb88-4f34-971e-c7a35987c877 -F qcow2 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-cb4c61a6-bb88-4f34-971e-c7a35987c877.5d0e2089-5fab-494d-a911-94c721d309bb" returned: 0 in 0.295s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:11:28 devstack cinder-volume[87272]: WARNING cinder.volume.drivers.remotefs [None req-5d9a244e-0ab4-4249-be46-4d747273042d tempest-ProjectMemberTests-186486462 None] /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-cb4c61a6-bb88-4f34-971e-c7a35987c877.5d0e2089-5fab-494d-a911-94c721d309bb is being set with open permissions: ugo+rw Nov 04 11:11:28 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-5d9a244e-0ab4-4249-be46-4d747273042d tempest-ProjectMemberTests-186486462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-cb4c61a6-bb88-4f34-971e-c7a35987c877.5d0e2089-5fab-494d-a911-94c721d309bb {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:11:28 devstack sudo[107819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-cb4c61a6-bb88-4f34-971e-c7a35987c877.5d0e2089-5fab-494d-a911-94c721d309bb Nov 04 11:11:28 devstack sudo[107819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:11:28 devstack sudo[107813]: pam_unix(sudo:session): session closed for user root Nov 04 11:11:28 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-6a41b63c-7789-47a1-915e-b3b058e14a71 tempest-SnapshotDependencyTests-443959516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-9bbb0157-8288-4324-bf66-4246f1a52040.112c226c-ef73-405c-95db-91b9002200a9" returned: 0 in 0.268s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:11:28 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-6a41b63c-7789-47a1-915e-b3b058e14a71 tempest-SnapshotDependencyTests-443959516 None] Lock "cinder-quobyte-112c226c-ef73-405c-95db-91b9002200a9" released by "_delete_snapshot" :: held 1.657s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 11:11:28 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-6a41b63c-7789-47a1-915e-b3b058e14a71 tempest-SnapshotDependencyTests-443959516 None] Lock "cinder-quobyte-9bbb0157-8288-4324-bf66-4246f1a52040" released by "delete_snapshot" :: held 1.677s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 11:11:28 devstack cinder-volume[87272]: DEBUG cinder.quota [None req-6a41b63c-7789-47a1-915e-b3b058e14a71 tempest-SnapshotDependencyTests-443959516 None] Created reservations ['784d71f4-5e04-4524-8aff-38730c31b74b', '0cac2b6a-b17d-48e5-ab70-28125ca6bd85', 'c1615a82-5b18-45a8-a1d7-2bf950854c5b', '0599464f-30c9-4ac0-a879-40a7aa83a31e'] {{(pid=87272) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 11:11:28 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-6a41b63c-7789-47a1-915e-b3b058e14a71 tempest-SnapshotDependencyTests-443959516 None] Delete snapshot completed successfully. Nov 04 11:11:28 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-6a41b63c-7789-47a1-915e-b3b058e14a71 tempest-SnapshotDependencyTests-443959516 None] Lock "cinder-112c226c-ef73-405c-95db-91b9002200a9-delete_snapshot" released by "delete_snapshot" :: held 1.808s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 11:11:28 devstack sudo[107819]: pam_unix(sudo:session): session closed for user root Nov 04 11:11:28 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-5d9a244e-0ab4-4249-be46-4d747273042d tempest-ProjectMemberTests-186486462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-cb4c61a6-bb88-4f34-971e-c7a35987c877.5d0e2089-5fab-494d-a911-94c721d309bb" returned: 0 in 0.247s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:11:28 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-5d9a244e-0ab4-4249-be46-4d747273042d tempest-ProjectMemberTests-186486462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-cb4c61a6-bb88-4f34-971e-c7a35987c877.info {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:11:28 devstack sudo[107822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-cb4c61a6-bb88-4f34-971e-c7a35987c877.info Nov 04 11:11:28 devstack sudo[107822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:11:29 devstack sudo[107822]: pam_unix(sudo:session): session closed for user root Nov 04 11:11:29 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-5d9a244e-0ab4-4249-be46-4d747273042d tempest-ProjectMemberTests-186486462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-cb4c61a6-bb88-4f34-971e-c7a35987c877.info" returned: 0 in 0.234s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:11:29 devstack cinder-volume[87272]: WARNING cinder.volume.drivers.remotefs [None req-5d9a244e-0ab4-4249-be46-4d747273042d tempest-ProjectMemberTests-186486462 None] /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-cb4c61a6-bb88-4f34-971e-c7a35987c877.info is being set with open permissions: ugo+rw Nov 04 11:11:29 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-5d9a244e-0ab4-4249-be46-4d747273042d tempest-ProjectMemberTests-186486462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-cb4c61a6-bb88-4f34-971e-c7a35987c877.info {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:11:29 devstack sudo[107825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-cb4c61a6-bb88-4f34-971e-c7a35987c877.info Nov 04 11:11:29 devstack sudo[107825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:11:29 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-e326bfc8-85ed-4a31-a9d0-ceba89e06899 tempest-SnapshotDependencyTests-443959516 None] Acquiring lock "cinder-9bbb0157-8288-4324-bf66-4246f1a52040-delete_volume" by "delete_volume" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 11:11:29 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-e326bfc8-85ed-4a31-a9d0-ceba89e06899 tempest-SnapshotDependencyTests-443959516 None] Lock "cinder-9bbb0157-8288-4324-bf66-4246f1a52040-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 11:11:29 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-e326bfc8-85ed-4a31-a9d0-ceba89e06899 tempest-SnapshotDependencyTests-443959516 None] Acquiring lock "cinder-quobyte-9bbb0157-8288-4324-bf66-4246f1a52040" by "delete_volume" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 11:11:29 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-e326bfc8-85ed-4a31-a9d0-ceba89e06899 tempest-SnapshotDependencyTests-443959516 None] Lock "cinder-quobyte-9bbb0157-8288-4324-bf66-4246f1a52040" acquired by "delete_volume" :: waited 0.024s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 11:11:29 devstack cinder-volume[87272]: DEBUG oslo.privsep.daemon [-] privsep: reply[148126ec-56b2-4423-a38e-0bdcc4064157]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 11:11:29 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-e326bfc8-85ed-4a31-a9d0-ceba89e06899 tempest-SnapshotDependencyTests-443959516 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-9bbb0157-8288-4324-bf66-4246f1a52040 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:11:29 devstack sudo[107825]: pam_unix(sudo:session): session closed for user root Nov 04 11:11:29 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-5d9a244e-0ab4-4249-be46-4d747273042d tempest-ProjectMemberTests-186486462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-cb4c61a6-bb88-4f34-971e-c7a35987c877.info" returned: 0 in 0.244s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:11:29 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-5d9a244e-0ab4-4249-be46-4d747273042d tempest-ProjectMemberTests-186486462 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.884s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 11:11:29 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-5d9a244e-0ab4-4249-be46-4d747273042d tempest-ProjectMemberTests-186486462 None] Create snapshot completed successfully Nov 04 11:11:29 devstack sudo[107827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-9bbb0157-8288-4324-bf66-4246f1a52040 Nov 04 11:11:29 devstack sudo[107827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:11:29 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-30ff05ac-9721-4576-a1f5-0a5189039633 tempest-ProjectMemberTests-186486462 None] Acquiring lock "cinder-5d0e2089-5fab-494d-a911-94c721d309bb-delete_snapshot" by "delete_snapshot" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 11:11:29 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-30ff05ac-9721-4576-a1f5-0a5189039633 tempest-ProjectMemberTests-186486462 None] Lock "cinder-5d0e2089-5fab-494d-a911-94c721d309bb-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 11:11:29 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-30ff05ac-9721-4576-a1f5-0a5189039633 tempest-ProjectMemberTests-186486462 None] Acquiring lock "cinder-quobyte-cb4c61a6-bb88-4f34-971e-c7a35987c877" by "delete_snapshot" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 11:11:29 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-30ff05ac-9721-4576-a1f5-0a5189039633 tempest-ProjectMemberTests-186486462 None] Lock "cinder-quobyte-cb4c61a6-bb88-4f34-971e-c7a35987c877" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 11:11:29 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-30ff05ac-9721-4576-a1f5-0a5189039633 tempest-ProjectMemberTests-186486462 None] Acquiring lock "cinder-quobyte-5d0e2089-5fab-494d-a911-94c721d309bb" by "_delete_snapshot" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 11:11:29 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-30ff05ac-9721-4576-a1f5-0a5189039633 tempest-ProjectMemberTests-186486462 None] Lock "cinder-quobyte-5d0e2089-5fab-494d-a911-94c721d309bb" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 11:11:29 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.remotefs [None req-30ff05ac-9721-4576-a1f5-0a5189039633 tempest-ProjectMemberTests-186486462 None] Deleting offline snapshot 5d0e2089-5fab-494d-a911-94c721d309bb of volume cb4c61a6-bb88-4f34-971e-c7a35987c877 {{(pid=87272) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 04 11:11:29 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.remotefs [None req-30ff05ac-9721-4576-a1f5-0a5189039633 tempest-ProjectMemberTests-186486462 None] snapshot_file for this snap is: volume-cb4c61a6-bb88-4f34-971e-c7a35987c877.5d0e2089-5fab-494d-a911-94c721d309bb {{(pid=87272) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 04 11:11:29 devstack sudo[107827]: pam_unix(sudo:session): session closed for user root Nov 04 11:11:29 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-e326bfc8-85ed-4a31-a9d0-ceba89e06899 tempest-SnapshotDependencyTests-443959516 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-9bbb0157-8288-4324-bf66-4246f1a52040" returned: 0 in 0.411s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:11:29 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-e326bfc8-85ed-4a31-a9d0-ceba89e06899 tempest-SnapshotDependencyTests-443959516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-9bbb0157-8288-4324-bf66-4246f1a52040 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:11:29 devstack cinder-volume[87272]: DEBUG oslo.privsep.daemon [-] privsep: reply[fefac857-5f3b-4cbc-9d4b-638f10f8555f]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 11:11:29 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-30ff05ac-9721-4576-a1f5-0a5189039633 tempest-ProjectMemberTests-186486462 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-cb4c61a6-bb88-4f34-971e-c7a35987c877.5d0e2089-5fab-494d-a911-94c721d309bb {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:11:29 devstack sudo[107833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-9bbb0157-8288-4324-bf66-4246f1a52040 Nov 04 11:11:29 devstack sudo[107833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:11:29 devstack sudo[107834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-cb4c61a6-bb88-4f34-971e-c7a35987c877.5d0e2089-5fab-494d-a911-94c721d309bb Nov 04 11:11:29 devstack sudo[107834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:11:29 devstack sudo[107833]: pam_unix(sudo:session): session closed for user root Nov 04 11:11:29 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-e326bfc8-85ed-4a31-a9d0-ceba89e06899 tempest-SnapshotDependencyTests-443959516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-9bbb0157-8288-4324-bf66-4246f1a52040" returned: 0 in 0.257s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:11:29 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-e326bfc8-85ed-4a31-a9d0-ceba89e06899 tempest-SnapshotDependencyTests-443959516 None] Lock "cinder-quobyte-9bbb0157-8288-4324-bf66-4246f1a52040" released by "delete_volume" :: held 0.736s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 11:11:30 devstack cinder-volume[87272]: DEBUG cinder.quota [None req-e326bfc8-85ed-4a31-a9d0-ceba89e06899 tempest-SnapshotDependencyTests-443959516 None] Created reservations ['87918bba-1c78-40f1-850e-71247e7036c3', 'a3690538-00c4-41bf-839b-15669258ffba', 'adb08262-3432-4fb9-9661-16172368c643', 'b29a1b9e-0562-4f1b-9bbb-f741abfdb5eb'] {{(pid=87272) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 11:11:30 devstack sudo[107834]: pam_unix(sudo:session): session closed for user root Nov 04 11:11:30 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-30ff05ac-9721-4576-a1f5-0a5189039633 tempest-ProjectMemberTests-186486462 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-cb4c61a6-bb88-4f34-971e-c7a35987c877.5d0e2089-5fab-494d-a911-94c721d309bb" returned: 0 in 0.365s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:11:30 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.remotefs [None req-30ff05ac-9721-4576-a1f5-0a5189039633 tempest-ProjectMemberTests-186486462 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cb4c61a6-bb88-4f34-971e-c7a35987c877(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87272) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 11:11:30 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-e326bfc8-85ed-4a31-a9d0-ceba89e06899 tempest-SnapshotDependencyTests-443959516 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 11:11:30 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-e326bfc8-85ed-4a31-a9d0-ceba89e06899 tempest-SnapshotDependencyTests-443959516 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 11:11:30 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-e326bfc8-85ed-4a31-a9d0-ceba89e06899 tempest-SnapshotDependencyTests-443959516 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898': None} {{(pid=87272) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 11:11:30 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-e326bfc8-85ed-4a31-a9d0-ceba89e06899 tempest-SnapshotDependencyTests-443959516 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'] {{(pid=87272) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 11:11:30 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-e326bfc8-85ed-4a31-a9d0-ceba89e06899 tempest-SnapshotDependencyTests-443959516 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 11:11:30 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-e326bfc8-85ed-4a31-a9d0-ceba89e06899 tempest-SnapshotDependencyTests-443959516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:11:30 devstack cinder-volume[87272]: DEBUG oslo.privsep.daemon [-] privsep: reply[a487c627-336a-42ac-935c-1d72936e8b87]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 11:11:30 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-30ff05ac-9721-4576-a1f5-0a5189039633 tempest-ProjectMemberTests-186486462 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-cb4c61a6-bb88-4f34-971e-c7a35987c877 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:11:30 devstack sudo[107841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1 Nov 04 11:11:30 devstack sudo[107841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:11:30 devstack sudo[107842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-cb4c61a6-bb88-4f34-971e-c7a35987c877 Nov 04 11:11:30 devstack sudo[107842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:11:30 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-6a6e0383-2cd0-4b0c-8053-9a10d56881f5 tempest-SnapshotDependencyTests-443959516 None] Acquiring lock "cinder-d9d8acbd-fd5a-4320-9713-ec97c60d0e54-delete_volume" by "delete_volume" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 11:11:30 devstack sudo[107841]: pam_unix(sudo:session): session closed for user root Nov 04 11:11:30 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-6a6e0383-2cd0-4b0c-8053-9a10d56881f5 tempest-SnapshotDependencyTests-443959516 None] Lock "cinder-d9d8acbd-fd5a-4320-9713-ec97c60d0e54-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 11:11:30 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-e326bfc8-85ed-4a31-a9d0-ceba89e06899 tempest-SnapshotDependencyTests-443959516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1" returned: 0 in 0.251s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:11:30 devstack cinder-volume[87272]: DEBUG cinder.manager [None req-e326bfc8-85ed-4a31-a9d0-ceba89e06899 tempest-SnapshotDependencyTests-443959516 None] Notifying Schedulers of capabilities ... {{(pid=87272) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 11:11:30 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-e326bfc8-85ed-4a31-a9d0-ceba89e06899 tempest-SnapshotDependencyTests-443959516 None] Deleted volume successfully. Nov 04 11:11:30 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-e326bfc8-85ed-4a31-a9d0-ceba89e06899 tempest-SnapshotDependencyTests-443959516 None] Lock "cinder-9bbb0157-8288-4324-bf66-4246f1a52040-delete_volume" released by "delete_volume" :: held 1.225s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 11:11:30 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-6a6e0383-2cd0-4b0c-8053-9a10d56881f5 tempest-SnapshotDependencyTests-443959516 None] Acquiring lock "cinder-quobyte-d9d8acbd-fd5a-4320-9713-ec97c60d0e54" by "delete_volume" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 11:11:30 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-6a6e0383-2cd0-4b0c-8053-9a10d56881f5 tempest-SnapshotDependencyTests-443959516 None] Lock "cinder-quobyte-d9d8acbd-fd5a-4320-9713-ec97c60d0e54" acquired by "delete_volume" :: waited 0.014s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 11:11:30 devstack cinder-volume[87272]: DEBUG oslo.privsep.daemon [-] privsep: reply[a898db7d-add1-4bf6-b4a3-06228f5e88de]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 11:11:30 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-6a6e0383-2cd0-4b0c-8053-9a10d56881f5 tempest-SnapshotDependencyTests-443959516 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-d9d8acbd-fd5a-4320-9713-ec97c60d0e54 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:11:30 devstack sudo[107842]: pam_unix(sudo:session): session closed for user root Nov 04 11:11:30 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-30ff05ac-9721-4576-a1f5-0a5189039633 tempest-ProjectMemberTests-186486462 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-cb4c61a6-bb88-4f34-971e-c7a35987c877" returned: 0 in 0.422s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:11:30 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-30ff05ac-9721-4576-a1f5-0a5189039633 tempest-ProjectMemberTests-186486462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-cb4c61a6-bb88-4f34-971e-c7a35987c877.5d0e2089-5fab-494d-a911-94c721d309bb {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:11:30 devstack sudo[107851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-cb4c61a6-bb88-4f34-971e-c7a35987c877.5d0e2089-5fab-494d-a911-94c721d309bb Nov 04 11:11:30 devstack sudo[107851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:11:30 devstack sudo[107847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-d9d8acbd-fd5a-4320-9713-ec97c60d0e54 Nov 04 11:11:30 devstack sudo[107847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:11:30 devstack sudo[107847]: pam_unix(sudo:session): session closed for user root Nov 04 11:11:30 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-6a6e0383-2cd0-4b0c-8053-9a10d56881f5 tempest-SnapshotDependencyTests-443959516 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-d9d8acbd-fd5a-4320-9713-ec97c60d0e54" returned: 0 in 0.379s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:11:30 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-6a6e0383-2cd0-4b0c-8053-9a10d56881f5 tempest-SnapshotDependencyTests-443959516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-d9d8acbd-fd5a-4320-9713-ec97c60d0e54 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:11:30 devstack sudo[107860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-d9d8acbd-fd5a-4320-9713-ec97c60d0e54 Nov 04 11:11:30 devstack sudo[107860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:11:30 devstack sudo[107851]: pam_unix(sudo:session): session closed for user root Nov 04 11:11:30 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-30ff05ac-9721-4576-a1f5-0a5189039633 tempest-ProjectMemberTests-186486462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-cb4c61a6-bb88-4f34-971e-c7a35987c877.5d0e2089-5fab-494d-a911-94c721d309bb" returned: 0 in 0.358s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:11:30 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-30ff05ac-9721-4576-a1f5-0a5189039633 tempest-ProjectMemberTests-186486462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-cb4c61a6-bb88-4f34-971e-c7a35987c877.5d0e2089-5fab-494d-a911-94c721d309bb {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:11:30 devstack sudo[107862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-cb4c61a6-bb88-4f34-971e-c7a35987c877.5d0e2089-5fab-494d-a911-94c721d309bb Nov 04 11:11:30 devstack sudo[107862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:11:31 devstack sudo[107860]: pam_unix(sudo:session): session closed for user root Nov 04 11:11:31 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-6a6e0383-2cd0-4b0c-8053-9a10d56881f5 tempest-SnapshotDependencyTests-443959516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-d9d8acbd-fd5a-4320-9713-ec97c60d0e54" returned: 0 in 0.251s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:11:31 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-6a6e0383-2cd0-4b0c-8053-9a10d56881f5 tempest-SnapshotDependencyTests-443959516 None] Lock "cinder-quobyte-d9d8acbd-fd5a-4320-9713-ec97c60d0e54" released by "delete_volume" :: held 0.678s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 11:11:31 devstack cinder-volume[87272]: DEBUG cinder.quota [None req-6a6e0383-2cd0-4b0c-8053-9a10d56881f5 tempest-SnapshotDependencyTests-443959516 None] Created reservations ['c1cd2913-314e-4a2c-932a-e6767b35b886', 'e1856598-466e-448f-9d2b-baf54be2c3aa', '0f27251c-d095-4538-bbe1-6205f5026085', 'ccccad55-3c09-4dbe-95f6-01b8a8b0cb39'] {{(pid=87272) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 11:11:31 devstack sudo[107862]: pam_unix(sudo:session): session closed for user root Nov 04 11:11:31 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-30ff05ac-9721-4576-a1f5-0a5189039633 tempest-ProjectMemberTests-186486462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-cb4c61a6-bb88-4f34-971e-c7a35987c877.5d0e2089-5fab-494d-a911-94c721d309bb" returned: 0 in 0.263s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:11:31 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-30ff05ac-9721-4576-a1f5-0a5189039633 tempest-ProjectMemberTests-186486462 None] Lock "cinder-quobyte-5d0e2089-5fab-494d-a911-94c721d309bb" released by "_delete_snapshot" :: held 1.533s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 11:11:31 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-30ff05ac-9721-4576-a1f5-0a5189039633 tempest-ProjectMemberTests-186486462 None] Lock "cinder-quobyte-cb4c61a6-bb88-4f34-971e-c7a35987c877" released by "delete_snapshot" :: held 1.562s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 11:11:31 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-6a6e0383-2cd0-4b0c-8053-9a10d56881f5 tempest-SnapshotDependencyTests-443959516 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 11:11:31 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-6a6e0383-2cd0-4b0c-8053-9a10d56881f5 tempest-SnapshotDependencyTests-443959516 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 11:11:31 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-6a6e0383-2cd0-4b0c-8053-9a10d56881f5 tempest-SnapshotDependencyTests-443959516 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898': None} {{(pid=87272) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 11:11:31 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-6a6e0383-2cd0-4b0c-8053-9a10d56881f5 tempest-SnapshotDependencyTests-443959516 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'] {{(pid=87272) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 11:11:31 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-6a6e0383-2cd0-4b0c-8053-9a10d56881f5 tempest-SnapshotDependencyTests-443959516 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 11:11:31 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-6a6e0383-2cd0-4b0c-8053-9a10d56881f5 tempest-SnapshotDependencyTests-443959516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:11:31 devstack sudo[107866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1 Nov 04 11:11:31 devstack sudo[107866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:11:31 devstack cinder-volume[87272]: DEBUG cinder.quota [None req-30ff05ac-9721-4576-a1f5-0a5189039633 tempest-ProjectMemberTests-186486462 None] Created reservations ['dd0d6530-00a4-4504-923a-984098c453a9', '215050fd-cd2a-4a22-8a75-9142f8b31392', '63c5e53d-fbd2-4629-8249-83eedc39c7f6', '2ddb1b03-01bc-4403-aa5f-82083227b468'] {{(pid=87272) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 11:11:31 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-30ff05ac-9721-4576-a1f5-0a5189039633 tempest-ProjectMemberTests-186486462 None] Delete snapshot completed successfully. Nov 04 11:11:31 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-30ff05ac-9721-4576-a1f5-0a5189039633 tempest-ProjectMemberTests-186486462 None] Lock "cinder-5d0e2089-5fab-494d-a911-94c721d309bb-delete_snapshot" released by "delete_snapshot" :: held 1.742s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 11:11:31 devstack sudo[107866]: pam_unix(sudo:session): session closed for user root Nov 04 11:11:31 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-6a6e0383-2cd0-4b0c-8053-9a10d56881f5 tempest-SnapshotDependencyTests-443959516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1" returned: 0 in 0.269s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:11:31 devstack cinder-volume[87272]: DEBUG cinder.manager [None req-6a6e0383-2cd0-4b0c-8053-9a10d56881f5 tempest-SnapshotDependencyTests-443959516 None] Notifying Schedulers of capabilities ... {{(pid=87272) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 11:11:31 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-6a6e0383-2cd0-4b0c-8053-9a10d56881f5 tempest-SnapshotDependencyTests-443959516 None] Deleted volume successfully. Nov 04 11:11:31 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-6a6e0383-2cd0-4b0c-8053-9a10d56881f5 tempest-SnapshotDependencyTests-443959516 None] Lock "cinder-d9d8acbd-fd5a-4320-9713-ec97c60d0e54-delete_volume" released by "delete_volume" :: held 1.213s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 11:11:31 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-0183ac18-f0fa-41c1-ae2e-1459d176942e tempest-ProjectMemberTests-186486462 None] Acquiring lock "cinder-cb4c61a6-bb88-4f34-971e-c7a35987c877-delete_volume" by "delete_volume" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 11:11:31 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-0183ac18-f0fa-41c1-ae2e-1459d176942e tempest-ProjectMemberTests-186486462 None] Lock "cinder-cb4c61a6-bb88-4f34-971e-c7a35987c877-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 11:11:31 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-0183ac18-f0fa-41c1-ae2e-1459d176942e tempest-ProjectMemberTests-186486462 None] Acquiring lock "cinder-quobyte-cb4c61a6-bb88-4f34-971e-c7a35987c877" by "delete_volume" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 11:11:31 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-0183ac18-f0fa-41c1-ae2e-1459d176942e tempest-ProjectMemberTests-186486462 None] Lock "cinder-quobyte-cb4c61a6-bb88-4f34-971e-c7a35987c877" acquired by "delete_volume" :: waited 0.023s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 11:11:31 devstack cinder-volume[87272]: DEBUG oslo.privsep.daemon [-] privsep: reply[851380f8-12be-4652-81cc-13f8f6bb6207]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 11:11:31 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-0183ac18-f0fa-41c1-ae2e-1459d176942e tempest-ProjectMemberTests-186486462 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-cb4c61a6-bb88-4f34-971e-c7a35987c877 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:11:31 devstack sudo[107869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-cb4c61a6-bb88-4f34-971e-c7a35987c877 Nov 04 11:11:31 devstack sudo[107869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:11:32 devstack sudo[107869]: pam_unix(sudo:session): session closed for user root Nov 04 11:11:32 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-0183ac18-f0fa-41c1-ae2e-1459d176942e tempest-ProjectMemberTests-186486462 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-cb4c61a6-bb88-4f34-971e-c7a35987c877" returned: 0 in 0.358s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:11:32 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-0183ac18-f0fa-41c1-ae2e-1459d176942e tempest-ProjectMemberTests-186486462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-cb4c61a6-bb88-4f34-971e-c7a35987c877 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:11:32 devstack sudo[107874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-cb4c61a6-bb88-4f34-971e-c7a35987c877 Nov 04 11:11:32 devstack sudo[107874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:11:32 devstack sudo[107874]: pam_unix(sudo:session): session closed for user root Nov 04 11:11:32 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-0183ac18-f0fa-41c1-ae2e-1459d176942e tempest-ProjectMemberTests-186486462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-cb4c61a6-bb88-4f34-971e-c7a35987c877" returned: 0 in 0.263s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:11:32 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-0183ac18-f0fa-41c1-ae2e-1459d176942e tempest-ProjectMemberTests-186486462 None] Lock "cinder-quobyte-cb4c61a6-bb88-4f34-971e-c7a35987c877" released by "delete_volume" :: held 0.687s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 11:11:32 devstack cinder-volume[87272]: DEBUG cinder.quota [None req-0183ac18-f0fa-41c1-ae2e-1459d176942e tempest-ProjectMemberTests-186486462 None] Created reservations ['386c5c43-e839-4874-aecc-4c1d3a06550a', 'c8713d94-8032-418a-95f6-2cc96ecf6182', 'dcab140d-b68b-476c-9782-6fedaf5ab3b4', 'c73b20c1-55b1-444a-8573-ba20047f3d8e'] {{(pid=87272) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 11:11:32 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-0183ac18-f0fa-41c1-ae2e-1459d176942e tempest-ProjectMemberTests-186486462 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 11:11:32 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-0183ac18-f0fa-41c1-ae2e-1459d176942e tempest-ProjectMemberTests-186486462 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 11:11:32 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-0183ac18-f0fa-41c1-ae2e-1459d176942e tempest-ProjectMemberTests-186486462 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898': None} {{(pid=87272) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 11:11:32 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-0183ac18-f0fa-41c1-ae2e-1459d176942e tempest-ProjectMemberTests-186486462 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'] {{(pid=87272) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 11:11:32 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-0183ac18-f0fa-41c1-ae2e-1459d176942e tempest-ProjectMemberTests-186486462 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 11:11:32 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-0183ac18-f0fa-41c1-ae2e-1459d176942e tempest-ProjectMemberTests-186486462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:11:32 devstack sudo[107877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1 Nov 04 11:11:32 devstack sudo[107877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:11:32 devstack sudo[107877]: pam_unix(sudo:session): session closed for user root Nov 04 11:11:32 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-0183ac18-f0fa-41c1-ae2e-1459d176942e tempest-ProjectMemberTests-186486462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1" returned: 0 in 0.271s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:11:32 devstack cinder-volume[87272]: DEBUG cinder.manager [None req-0183ac18-f0fa-41c1-ae2e-1459d176942e tempest-ProjectMemberTests-186486462 None] Notifying Schedulers of capabilities ... {{(pid=87272) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 11:11:32 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-0183ac18-f0fa-41c1-ae2e-1459d176942e tempest-ProjectMemberTests-186486462 None] Deleted volume successfully. Nov 04 11:11:32 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-0183ac18-f0fa-41c1-ae2e-1459d176942e tempest-ProjectMemberTests-186486462 None] Lock "cinder-cb4c61a6-bb88-4f34-971e-c7a35987c877-delete_volume" released by "delete_volume" :: held 1.200s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 11:11:33 devstack cinder-volume[87272]: DEBUG cinder.volume.flows.manager.create_volume [None req-51ce2fca-2c0b-48be-bcdb-42cfb326df0f tempest-ProjectMemberTests-186486462 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87272) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 11:11:33 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-51ce2fca-2c0b-48be-bcdb-42cfb326df0f tempest-ProjectMemberTests-186486462 None] Flow 'volume_create_manager' (a3fe7532-425b-4c7f-896b-634827f3d87d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 11:11:33 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-51ce2fca-2c0b-48be-bcdb-42cfb326df0f tempest-ProjectMemberTests-186486462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11aa17ef-1688-4df2-83fc-2081f0323e98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:11:33 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-51ce2fca-2c0b-48be-bcdb-42cfb326df0f tempest-ProjectMemberTests-186486462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11aa17ef-1688-4df2-83fc-2081f0323e98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T10:11:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-672255759',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=befc0baf-98e9-4365-97a9-f2ae989301f4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8457b114a6264c47af483fad6a8bf18b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T10:11:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T10:11:33Z,use_quota=True,user_id='70a59e5f7c684c0b88977c66a4e36afb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8989e4f-21e3-4f0a-9584-0d818784e883),volume_type_id=f8989e4f-21e3-4f0a-9584-0d818784e883)' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:11:33 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-51ce2fca-2c0b-48be-bcdb-42cfb326df0f tempest-ProjectMemberTests-186486462 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea401b06-64cc-4524-abfe-00bbdc33bc8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:11:33 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-51ce2fca-2c0b-48be-bcdb-42cfb326df0f tempest-ProjectMemberTests-186486462 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea401b06-64cc-4524-abfe-00bbdc33bc8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:11:33 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-51ce2fca-2c0b-48be-bcdb-42cfb326df0f tempest-ProjectMemberTests-186486462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b1c9ceab-bdbc-4767-a4f5-702cc478e047) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:11:33 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-51ce2fca-2c0b-48be-bcdb-42cfb326df0f tempest-ProjectMemberTests-186486462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b1c9ceab-bdbc-4767-a4f5-702cc478e047) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'befc0baf-98e9-4365-97a9-f2ae989301f4', 'volume_name': 'volume-befc0baf-98e9-4365-97a9-f2ae989301f4', 'volume_size': 1}' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:11:33 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-51ce2fca-2c0b-48be-bcdb-42cfb326df0f tempest-ProjectMemberTests-186486462 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (126e083c-f347-47ec-a3a6-ab8399563e15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:11:33 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-51ce2fca-2c0b-48be-bcdb-42cfb326df0f tempest-ProjectMemberTests-186486462 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (126e083c-f347-47ec-a3a6-ab8399563e15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:11:33 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-51ce2fca-2c0b-48be-bcdb-42cfb326df0f tempest-ProjectMemberTests-186486462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d258a31-2d3e-4e30-b625-b304c5d55920) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:11:33 devstack cinder-volume[87272]: INFO cinder.volume.flows.manager.create_volume [None req-51ce2fca-2c0b-48be-bcdb-42cfb326df0f tempest-ProjectMemberTests-186486462 None] Volume befc0baf-98e9-4365-97a9-f2ae989301f4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-befc0baf-98e9-4365-97a9-f2ae989301f4', 'volume_size': 1} Nov 04 11:11:33 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-51ce2fca-2c0b-48be-bcdb-42cfb326df0f tempest-ProjectMemberTests-186486462 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 11:11:33 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-51ce2fca-2c0b-48be-bcdb-42cfb326df0f tempest-ProjectMemberTests-186486462 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 11:11:33 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-51ce2fca-2c0b-48be-bcdb-42cfb326df0f tempest-ProjectMemberTests-186486462 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T10:11:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-672255759',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=befc0baf-98e9-4365-97a9-f2ae989301f4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8457b114a6264c47af483fad6a8bf18b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T10:11:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T10:11:33Z,use_quota=True,user_id='70a59e5f7c684c0b88977c66a4e36afb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8989e4f-21e3-4f0a-9584-0d818784e883),volume_type_id=f8989e4f-21e3-4f0a-9584-0d818784e883)}" {{(pid=87272) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 04 11:11:33 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.remotefs [None req-51ce2fca-2c0b-48be-bcdb-42cfb326df0f tempest-ProjectMemberTests-186486462 None] Creating volume befc0baf-98e9-4365-97a9-f2ae989301f4 {{(pid=87272) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 11:11:33 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-51ce2fca-2c0b-48be-bcdb-42cfb326df0f tempest-ProjectMemberTests-186486462 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 11:11:33 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-51ce2fca-2c0b-48be-bcdb-42cfb326df0f tempest-ProjectMemberTests-186486462 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 11:11:33 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-51ce2fca-2c0b-48be-bcdb-42cfb326df0f tempest-ProjectMemberTests-186486462 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898': None} {{(pid=87272) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 11:11:33 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-51ce2fca-2c0b-48be-bcdb-42cfb326df0f tempest-ProjectMemberTests-186486462 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'] {{(pid=87272) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 11:11:33 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-51ce2fca-2c0b-48be-bcdb-42cfb326df0f tempest-ProjectMemberTests-186486462 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 11:11:33 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-51ce2fca-2c0b-48be-bcdb-42cfb326df0f tempest-ProjectMemberTests-186486462 None] Selected osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898 as target Quobyte volume. {{(pid=87272) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 11:11:33 devstack cinder-volume[87272]: INFO cinder.volume.drivers.remotefs [None req-51ce2fca-2c0b-48be-bcdb-42cfb326df0f tempest-ProjectMemberTests-186486462 None] casted to osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898 Nov 04 11:11:33 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-51ce2fca-2c0b-48be-bcdb-42cfb326df0f tempest-ProjectMemberTests-186486462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-befc0baf-98e9-4365-97a9-f2ae989301f4 1073741824 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:11:33 devstack sudo[107881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-befc0baf-98e9-4365-97a9-f2ae989301f4 1073741824 Nov 04 11:11:33 devstack sudo[107881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:11:34 devstack sudo[107881]: pam_unix(sudo:session): session closed for user root Nov 04 11:11:34 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-51ce2fca-2c0b-48be-bcdb-42cfb326df0f tempest-ProjectMemberTests-186486462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-befc0baf-98e9-4365-97a9-f2ae989301f4 1073741824" returned: 0 in 0.527s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:11:34 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-51ce2fca-2c0b-48be-bcdb-42cfb326df0f tempest-ProjectMemberTests-186486462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-befc0baf-98e9-4365-97a9-f2ae989301f4 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:11:34 devstack sudo[107925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-befc0baf-98e9-4365-97a9-f2ae989301f4 Nov 04 11:11:34 devstack sudo[107925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:11:34 devstack sudo[107925]: pam_unix(sudo:session): session closed for user root Nov 04 11:11:34 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-51ce2fca-2c0b-48be-bcdb-42cfb326df0f tempest-ProjectMemberTests-186486462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-befc0baf-98e9-4365-97a9-f2ae989301f4" returned: 0 in 0.268s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:11:34 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-51ce2fca-2c0b-48be-bcdb-42cfb326df0f tempest-ProjectMemberTests-186486462 None] <== create_volume: return (844ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'} {{(pid=87272) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 04 11:11:34 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-51ce2fca-2c0b-48be-bcdb-42cfb326df0f tempest-ProjectMemberTests-186486462 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.847s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 11:11:34 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-51ce2fca-2c0b-48be-bcdb-42cfb326df0f tempest-ProjectMemberTests-186486462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d258a31-2d3e-4e30-b625-b304c5d55920) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-befc0baf-98e9-4365-97a9-f2ae989301f4', 'volume_size': 1}' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:11:34 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-51ce2fca-2c0b-48be-bcdb-42cfb326df0f tempest-ProjectMemberTests-186486462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d0ed819-2f39-4e6f-a0ae-ae4773cd8629) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:11:34 devstack cinder-volume[87272]: INFO cinder.volume.flows.manager.create_volume [None req-51ce2fca-2c0b-48be-bcdb-42cfb326df0f tempest-ProjectMemberTests-186486462 None] Volume volume-befc0baf-98e9-4365-97a9-f2ae989301f4 (befc0baf-98e9-4365-97a9-f2ae989301f4): created successfully Nov 04 11:11:34 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-51ce2fca-2c0b-48be-bcdb-42cfb326df0f tempest-ProjectMemberTests-186486462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d0ed819-2f39-4e6f-a0ae-ae4773cd8629) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:11:34 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-51ce2fca-2c0b-48be-bcdb-42cfb326df0f tempest-ProjectMemberTests-186486462 None] Flow 'volume_create_manager' (a3fe7532-425b-4c7f-896b-634827f3d87d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87272) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 11:11:34 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-51ce2fca-2c0b-48be-bcdb-42cfb326df0f tempest-ProjectMemberTests-186486462 None] Created volume successfully. Nov 04 11:11:35 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-61c21cbe-e14c-45b6-bbbb-5c7468ecf97b tempest-ProjectMemberTests-186486462 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 11:11:35 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-61c21cbe-e14c-45b6-bbbb-5c7468ecf97b tempest-ProjectMemberTests-186486462 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 11:11:35 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.remotefs [None req-61c21cbe-e14c-45b6-bbbb-5c7468ecf97b tempest-ProjectMemberTests-186486462 None] Creating offline snapshot 54f720be-8246-4021-8c58-106dcf8adc28 of volume befc0baf-98e9-4365-97a9-f2ae989301f4 {{(pid=87272) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 04 11:11:35 devstack cinder-volume[87272]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1538dd4-57b1-4ec1-a957-92e59dc5305f]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 11:11:35 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-61c21cbe-e14c-45b6-bbbb-5c7468ecf97b tempest-ProjectMemberTests-186486462 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-befc0baf-98e9-4365-97a9-f2ae989301f4 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:11:35 devstack sudo[107929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-befc0baf-98e9-4365-97a9-f2ae989301f4 Nov 04 11:11:35 devstack sudo[107929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:11:36 devstack sudo[107929]: pam_unix(sudo:session): session closed for user root Nov 04 11:11:36 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-61c21cbe-e14c-45b6-bbbb-5c7468ecf97b tempest-ProjectMemberTests-186486462 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-befc0baf-98e9-4365-97a9-f2ae989301f4" returned: 0 in 0.374s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:11:36 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-61c21cbe-e14c-45b6-bbbb-5c7468ecf97b tempest-ProjectMemberTests-186486462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-befc0baf-98e9-4365-97a9-f2ae989301f4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-befc0baf-98e9-4365-97a9-f2ae989301f4.54f720be-8246-4021-8c58-106dcf8adc28 1G {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:11:36 devstack sudo[107935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-befc0baf-98e9-4365-97a9-f2ae989301f4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-befc0baf-98e9-4365-97a9-f2ae989301f4.54f720be-8246-4021-8c58-106dcf8adc28 1G Nov 04 11:11:36 devstack sudo[107935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:11:36 devstack sudo[107935]: pam_unix(sudo:session): session closed for user root Nov 04 11:11:36 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-61c21cbe-e14c-45b6-bbbb-5c7468ecf97b tempest-ProjectMemberTests-186486462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-befc0baf-98e9-4365-97a9-f2ae989301f4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-befc0baf-98e9-4365-97a9-f2ae989301f4.54f720be-8246-4021-8c58-106dcf8adc28 1G" returned: 0 in 0.490s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:11:36 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-61c21cbe-e14c-45b6-bbbb-5c7468ecf97b tempest-ProjectMemberTests-186486462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-befc0baf-98e9-4365-97a9-f2ae989301f4 -F qcow2 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-befc0baf-98e9-4365-97a9-f2ae989301f4.54f720be-8246-4021-8c58-106dcf8adc28 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:11:36 devstack sudo[107941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-befc0baf-98e9-4365-97a9-f2ae989301f4 -F qcow2 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-befc0baf-98e9-4365-97a9-f2ae989301f4.54f720be-8246-4021-8c58-106dcf8adc28 Nov 04 11:11:36 devstack sudo[107941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:11:36 devstack sudo[107941]: pam_unix(sudo:session): session closed for user root Nov 04 11:11:36 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-61c21cbe-e14c-45b6-bbbb-5c7468ecf97b tempest-ProjectMemberTests-186486462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-befc0baf-98e9-4365-97a9-f2ae989301f4 -F qcow2 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-befc0baf-98e9-4365-97a9-f2ae989301f4.54f720be-8246-4021-8c58-106dcf8adc28" returned: 0 in 0.319s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:11:36 devstack cinder-volume[87272]: WARNING cinder.volume.drivers.remotefs [None req-61c21cbe-e14c-45b6-bbbb-5c7468ecf97b tempest-ProjectMemberTests-186486462 None] /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-befc0baf-98e9-4365-97a9-f2ae989301f4.54f720be-8246-4021-8c58-106dcf8adc28 is being set with open permissions: ugo+rw Nov 04 11:11:36 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-61c21cbe-e14c-45b6-bbbb-5c7468ecf97b tempest-ProjectMemberTests-186486462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-befc0baf-98e9-4365-97a9-f2ae989301f4.54f720be-8246-4021-8c58-106dcf8adc28 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:11:36 devstack sudo[107947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-befc0baf-98e9-4365-97a9-f2ae989301f4.54f720be-8246-4021-8c58-106dcf8adc28 Nov 04 11:11:36 devstack sudo[107947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:11:37 devstack sudo[107947]: pam_unix(sudo:session): session closed for user root Nov 04 11:11:37 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-61c21cbe-e14c-45b6-bbbb-5c7468ecf97b tempest-ProjectMemberTests-186486462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-befc0baf-98e9-4365-97a9-f2ae989301f4.54f720be-8246-4021-8c58-106dcf8adc28" returned: 0 in 0.253s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:11:37 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-61c21cbe-e14c-45b6-bbbb-5c7468ecf97b tempest-ProjectMemberTests-186486462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-befc0baf-98e9-4365-97a9-f2ae989301f4.info {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:11:37 devstack sudo[107950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-befc0baf-98e9-4365-97a9-f2ae989301f4.info Nov 04 11:11:37 devstack sudo[107950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:11:37 devstack sudo[107950]: pam_unix(sudo:session): session closed for user root Nov 04 11:11:37 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-61c21cbe-e14c-45b6-bbbb-5c7468ecf97b tempest-ProjectMemberTests-186486462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-befc0baf-98e9-4365-97a9-f2ae989301f4.info" returned: 0 in 0.254s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:11:37 devstack cinder-volume[87272]: WARNING cinder.volume.drivers.remotefs [None req-61c21cbe-e14c-45b6-bbbb-5c7468ecf97b tempest-ProjectMemberTests-186486462 None] /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-befc0baf-98e9-4365-97a9-f2ae989301f4.info is being set with open permissions: ugo+rw Nov 04 11:11:37 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-61c21cbe-e14c-45b6-bbbb-5c7468ecf97b tempest-ProjectMemberTests-186486462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-befc0baf-98e9-4365-97a9-f2ae989301f4.info {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:11:37 devstack sudo[107953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-befc0baf-98e9-4365-97a9-f2ae989301f4.info Nov 04 11:11:37 devstack sudo[107953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:11:37 devstack sudo[107953]: pam_unix(sudo:session): session closed for user root Nov 04 11:11:37 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-61c21cbe-e14c-45b6-bbbb-5c7468ecf97b tempest-ProjectMemberTests-186486462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-befc0baf-98e9-4365-97a9-f2ae989301f4.info" returned: 0 in 0.267s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:11:37 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-61c21cbe-e14c-45b6-bbbb-5c7468ecf97b tempest-ProjectMemberTests-186486462 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.051s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 11:11:37 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-61c21cbe-e14c-45b6-bbbb-5c7468ecf97b tempest-ProjectMemberTests-186486462 None] Create snapshot completed successfully Nov 04 11:11:38 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-d98d4198-0ff6-49a2-a672-ba03dbcc3517 tempest-ProjectMemberTests-186486462 None] Acquiring lock "cinder-54f720be-8246-4021-8c58-106dcf8adc28-delete_snapshot" by "delete_snapshot" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 11:11:38 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-d98d4198-0ff6-49a2-a672-ba03dbcc3517 tempest-ProjectMemberTests-186486462 None] Lock "cinder-54f720be-8246-4021-8c58-106dcf8adc28-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 11:11:38 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-d98d4198-0ff6-49a2-a672-ba03dbcc3517 tempest-ProjectMemberTests-186486462 None] Acquiring lock "cinder-quobyte-befc0baf-98e9-4365-97a9-f2ae989301f4" by "delete_snapshot" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 11:11:38 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-d98d4198-0ff6-49a2-a672-ba03dbcc3517 tempest-ProjectMemberTests-186486462 None] Lock "cinder-quobyte-befc0baf-98e9-4365-97a9-f2ae989301f4" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 11:11:38 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-d98d4198-0ff6-49a2-a672-ba03dbcc3517 tempest-ProjectMemberTests-186486462 None] Acquiring lock "cinder-quobyte-54f720be-8246-4021-8c58-106dcf8adc28" by "_delete_snapshot" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 11:11:38 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-d98d4198-0ff6-49a2-a672-ba03dbcc3517 tempest-ProjectMemberTests-186486462 None] Lock "cinder-quobyte-54f720be-8246-4021-8c58-106dcf8adc28" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 11:11:38 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.remotefs [None req-d98d4198-0ff6-49a2-a672-ba03dbcc3517 tempest-ProjectMemberTests-186486462 None] Deleting offline snapshot 54f720be-8246-4021-8c58-106dcf8adc28 of volume befc0baf-98e9-4365-97a9-f2ae989301f4 {{(pid=87272) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 04 11:11:38 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.remotefs [None req-d98d4198-0ff6-49a2-a672-ba03dbcc3517 tempest-ProjectMemberTests-186486462 None] snapshot_file for this snap is: volume-befc0baf-98e9-4365-97a9-f2ae989301f4.54f720be-8246-4021-8c58-106dcf8adc28 {{(pid=87272) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 04 11:11:38 devstack cinder-volume[87272]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c1eb0b7-ab6d-49b3-8cd5-9e5c729e5052]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 11:11:38 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-d98d4198-0ff6-49a2-a672-ba03dbcc3517 tempest-ProjectMemberTests-186486462 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-befc0baf-98e9-4365-97a9-f2ae989301f4.54f720be-8246-4021-8c58-106dcf8adc28 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:11:39 devstack sudo[107957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-befc0baf-98e9-4365-97a9-f2ae989301f4.54f720be-8246-4021-8c58-106dcf8adc28 Nov 04 11:11:39 devstack sudo[107957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:11:39 devstack sudo[107957]: pam_unix(sudo:session): session closed for user root Nov 04 11:11:39 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-d98d4198-0ff6-49a2-a672-ba03dbcc3517 tempest-ProjectMemberTests-186486462 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-befc0baf-98e9-4365-97a9-f2ae989301f4.54f720be-8246-4021-8c58-106dcf8adc28" returned: 0 in 0.365s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:11:39 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.remotefs [None req-d98d4198-0ff6-49a2-a672-ba03dbcc3517 tempest-ProjectMemberTests-186486462 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-befc0baf-98e9-4365-97a9-f2ae989301f4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87272) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 11:11:39 devstack cinder-volume[87272]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a73c011-d38d-4357-ba46-a0d6a9ffbad2]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 11:11:39 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-d98d4198-0ff6-49a2-a672-ba03dbcc3517 tempest-ProjectMemberTests-186486462 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-befc0baf-98e9-4365-97a9-f2ae989301f4 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:11:39 devstack sudo[107962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-befc0baf-98e9-4365-97a9-f2ae989301f4 Nov 04 11:11:39 devstack sudo[107962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:11:39 devstack sudo[107962]: pam_unix(sudo:session): session closed for user root Nov 04 11:11:39 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-d98d4198-0ff6-49a2-a672-ba03dbcc3517 tempest-ProjectMemberTests-186486462 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-befc0baf-98e9-4365-97a9-f2ae989301f4" returned: 0 in 0.413s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:11:39 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-d98d4198-0ff6-49a2-a672-ba03dbcc3517 tempest-ProjectMemberTests-186486462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-befc0baf-98e9-4365-97a9-f2ae989301f4.54f720be-8246-4021-8c58-106dcf8adc28 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:11:39 devstack sudo[107967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-befc0baf-98e9-4365-97a9-f2ae989301f4.54f720be-8246-4021-8c58-106dcf8adc28 Nov 04 11:11:39 devstack sudo[107967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:11:40 devstack sudo[107967]: pam_unix(sudo:session): session closed for user root Nov 04 11:11:40 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-d98d4198-0ff6-49a2-a672-ba03dbcc3517 tempest-ProjectMemberTests-186486462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-befc0baf-98e9-4365-97a9-f2ae989301f4.54f720be-8246-4021-8c58-106dcf8adc28" returned: 0 in 0.358s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:11:40 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-d98d4198-0ff6-49a2-a672-ba03dbcc3517 tempest-ProjectMemberTests-186486462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-befc0baf-98e9-4365-97a9-f2ae989301f4.54f720be-8246-4021-8c58-106dcf8adc28 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:11:40 devstack sudo[107973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-befc0baf-98e9-4365-97a9-f2ae989301f4.54f720be-8246-4021-8c58-106dcf8adc28 Nov 04 11:11:40 devstack sudo[107973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:11:40 devstack sudo[107973]: pam_unix(sudo:session): session closed for user root Nov 04 11:11:40 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-d98d4198-0ff6-49a2-a672-ba03dbcc3517 tempest-ProjectMemberTests-186486462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-befc0baf-98e9-4365-97a9-f2ae989301f4.54f720be-8246-4021-8c58-106dcf8adc28" returned: 0 in 0.293s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:11:40 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-d98d4198-0ff6-49a2-a672-ba03dbcc3517 tempest-ProjectMemberTests-186486462 None] Lock "cinder-quobyte-54f720be-8246-4021-8c58-106dcf8adc28" released by "_delete_snapshot" :: held 1.531s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 11:11:40 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-d98d4198-0ff6-49a2-a672-ba03dbcc3517 tempest-ProjectMemberTests-186486462 None] Lock "cinder-quobyte-befc0baf-98e9-4365-97a9-f2ae989301f4" released by "delete_snapshot" :: held 1.555s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 11:11:40 devstack cinder-volume[87272]: DEBUG cinder.quota [None req-d98d4198-0ff6-49a2-a672-ba03dbcc3517 tempest-ProjectMemberTests-186486462 None] Created reservations ['19ee8c8a-62e2-4dff-8e8a-5ea1a9e28f06', '1ea9e313-1497-4a13-83a8-934fb1a8c49b', 'e38ec642-8f0e-4b09-b10a-780c495db571', 'e6a3b7cf-a1ed-4601-a529-b1341b41f4d8'] {{(pid=87272) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 11:11:40 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-d98d4198-0ff6-49a2-a672-ba03dbcc3517 tempest-ProjectMemberTests-186486462 None] Delete snapshot completed successfully. Nov 04 11:11:40 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-d98d4198-0ff6-49a2-a672-ba03dbcc3517 tempest-ProjectMemberTests-186486462 None] Lock "cinder-54f720be-8246-4021-8c58-106dcf8adc28-delete_snapshot" released by "delete_snapshot" :: held 1.697s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 11:11:41 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-33235f16-81b0-4654-9185-603b97bb3056 tempest-ProjectMemberTests-186486462 None] Acquiring lock "cinder-befc0baf-98e9-4365-97a9-f2ae989301f4-delete_volume" by "delete_volume" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 11:11:41 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-33235f16-81b0-4654-9185-603b97bb3056 tempest-ProjectMemberTests-186486462 None] Lock "cinder-befc0baf-98e9-4365-97a9-f2ae989301f4-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 11:11:41 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-33235f16-81b0-4654-9185-603b97bb3056 tempest-ProjectMemberTests-186486462 None] Acquiring lock "cinder-quobyte-befc0baf-98e9-4365-97a9-f2ae989301f4" by "delete_volume" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 11:11:41 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-33235f16-81b0-4654-9185-603b97bb3056 tempest-ProjectMemberTests-186486462 None] Lock "cinder-quobyte-befc0baf-98e9-4365-97a9-f2ae989301f4" acquired by "delete_volume" :: waited 0.017s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 11:11:41 devstack cinder-volume[87272]: DEBUG oslo.privsep.daemon [-] privsep: reply[05af0ffc-357f-4613-91ff-587242f16999]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 11:11:41 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-33235f16-81b0-4654-9185-603b97bb3056 tempest-ProjectMemberTests-186486462 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-befc0baf-98e9-4365-97a9-f2ae989301f4 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:11:41 devstack sudo[107977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-befc0baf-98e9-4365-97a9-f2ae989301f4 Nov 04 11:11:41 devstack sudo[107977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:11:41 devstack sudo[107977]: pam_unix(sudo:session): session closed for user root Nov 04 11:11:41 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-33235f16-81b0-4654-9185-603b97bb3056 tempest-ProjectMemberTests-186486462 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-befc0baf-98e9-4365-97a9-f2ae989301f4" returned: 0 in 0.393s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:11:41 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-33235f16-81b0-4654-9185-603b97bb3056 tempest-ProjectMemberTests-186486462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-befc0baf-98e9-4365-97a9-f2ae989301f4 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:11:41 devstack sudo[107982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-befc0baf-98e9-4365-97a9-f2ae989301f4 Nov 04 11:11:41 devstack sudo[107982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:11:41 devstack sudo[107982]: pam_unix(sudo:session): session closed for user root Nov 04 11:11:41 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-33235f16-81b0-4654-9185-603b97bb3056 tempest-ProjectMemberTests-186486462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-befc0baf-98e9-4365-97a9-f2ae989301f4" returned: 0 in 0.247s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:11:41 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-33235f16-81b0-4654-9185-603b97bb3056 tempest-ProjectMemberTests-186486462 None] Lock "cinder-quobyte-befc0baf-98e9-4365-97a9-f2ae989301f4" released by "delete_volume" :: held 0.716s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 11:11:41 devstack cinder-volume[87272]: DEBUG cinder.quota [None req-33235f16-81b0-4654-9185-603b97bb3056 tempest-ProjectMemberTests-186486462 None] Created reservations ['eeb31a60-71c8-4347-beaf-a9a76210e558', 'ecb8decb-6e49-4cd7-a3de-c6262abe6d88', '1fe6bfd9-9b05-4f27-874b-c2e35fd010eb', '9e2ba1da-ba0c-41fc-80a8-1e889b141f42'] {{(pid=87272) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 11:11:41 devstack cinder-volume[87272]: DEBUG dbcounter [-] [87272] Writing DB stats cinder:UPDATE=178,cinder:DELETE=17,cinder:SELECT=148,cinder:INSERT=48 {{(pid=87272) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 11:11:41 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-33235f16-81b0-4654-9185-603b97bb3056 tempest-ProjectMemberTests-186486462 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 11:11:41 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-33235f16-81b0-4654-9185-603b97bb3056 tempest-ProjectMemberTests-186486462 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 11:11:41 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-33235f16-81b0-4654-9185-603b97bb3056 tempest-ProjectMemberTests-186486462 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898': None} {{(pid=87272) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 11:11:41 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-33235f16-81b0-4654-9185-603b97bb3056 tempest-ProjectMemberTests-186486462 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'] {{(pid=87272) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 11:11:41 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-33235f16-81b0-4654-9185-603b97bb3056 tempest-ProjectMemberTests-186486462 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 11:11:41 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-33235f16-81b0-4654-9185-603b97bb3056 tempest-ProjectMemberTests-186486462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:11:42 devstack sudo[107985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1 Nov 04 11:11:42 devstack sudo[107985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:11:42 devstack sudo[107985]: pam_unix(sudo:session): session closed for user root Nov 04 11:11:42 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-33235f16-81b0-4654-9185-603b97bb3056 tempest-ProjectMemberTests-186486462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1" returned: 0 in 0.257s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:11:42 devstack cinder-volume[87272]: DEBUG cinder.manager [None req-33235f16-81b0-4654-9185-603b97bb3056 tempest-ProjectMemberTests-186486462 None] Notifying Schedulers of capabilities ... {{(pid=87272) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 11:11:42 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-33235f16-81b0-4654-9185-603b97bb3056 tempest-ProjectMemberTests-186486462 None] Deleted volume successfully. Nov 04 11:11:42 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-33235f16-81b0-4654-9185-603b97bb3056 tempest-ProjectMemberTests-186486462 None] Lock "cinder-befc0baf-98e9-4365-97a9-f2ae989301f4-delete_volume" released by "delete_volume" :: held 1.196s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 11:11:42 devstack cinder-volume[87272]: DEBUG dbcounter [-] [87272] Writing DB stats cinder:SELECT=134,cinder:INSERT=50,cinder:UPDATE=198,cinder:DELETE=14 {{(pid=87272) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 11:11:42 devstack cinder-volume[87272]: DEBUG cinder.volume.flows.manager.create_volume [None req-6019a23d-66ef-4867-8c2f-3fa6e4c61b89 tempest-ProjectMemberTests-186486462 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87272) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 11:11:42 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-6019a23d-66ef-4867-8c2f-3fa6e4c61b89 tempest-ProjectMemberTests-186486462 None] Flow 'volume_create_manager' (5185f452-a70f-43ab-8eb9-136ddbbb1b63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 11:11:42 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-6019a23d-66ef-4867-8c2f-3fa6e4c61b89 tempest-ProjectMemberTests-186486462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e1ad2d5-7af8-4b0c-8ce0-4204fed10e92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:11:42 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-6019a23d-66ef-4867-8c2f-3fa6e4c61b89 tempest-ProjectMemberTests-186486462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e1ad2d5-7af8-4b0c-8ce0-4204fed10e92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T10:11:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1364969466',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=14707650-4a5a-400c-9f36-04463a9060bc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8457b114a6264c47af483fad6a8bf18b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T10:11:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T10:11:43Z,use_quota=True,user_id='70a59e5f7c684c0b88977c66a4e36afb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8989e4f-21e3-4f0a-9584-0d818784e883),volume_type_id=f8989e4f-21e3-4f0a-9584-0d818784e883)' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:11:42 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-6019a23d-66ef-4867-8c2f-3fa6e4c61b89 tempest-ProjectMemberTests-186486462 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6cbd7605-e8f7-4a27-8b28-0373058b5f4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:11:42 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-6019a23d-66ef-4867-8c2f-3fa6e4c61b89 tempest-ProjectMemberTests-186486462 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6cbd7605-e8f7-4a27-8b28-0373058b5f4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:11:42 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-6019a23d-66ef-4867-8c2f-3fa6e4c61b89 tempest-ProjectMemberTests-186486462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb451225-47ad-4804-afab-a6e493df660e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:11:42 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-6019a23d-66ef-4867-8c2f-3fa6e4c61b89 tempest-ProjectMemberTests-186486462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb451225-47ad-4804-afab-a6e493df660e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '14707650-4a5a-400c-9f36-04463a9060bc', 'volume_name': 'volume-14707650-4a5a-400c-9f36-04463a9060bc', 'volume_size': 1}' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:11:42 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-6019a23d-66ef-4867-8c2f-3fa6e4c61b89 tempest-ProjectMemberTests-186486462 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a77f27c-633a-43ab-a0be-efef6cb4fc82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:11:42 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-6019a23d-66ef-4867-8c2f-3fa6e4c61b89 tempest-ProjectMemberTests-186486462 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a77f27c-633a-43ab-a0be-efef6cb4fc82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:11:42 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-6019a23d-66ef-4867-8c2f-3fa6e4c61b89 tempest-ProjectMemberTests-186486462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95154fc7-d327-4429-b4a3-12442abfb6a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:11:42 devstack cinder-volume[87272]: INFO cinder.volume.flows.manager.create_volume [None req-6019a23d-66ef-4867-8c2f-3fa6e4c61b89 tempest-ProjectMemberTests-186486462 None] Volume 14707650-4a5a-400c-9f36-04463a9060bc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-14707650-4a5a-400c-9f36-04463a9060bc', 'volume_size': 1} Nov 04 11:11:42 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-6019a23d-66ef-4867-8c2f-3fa6e4c61b89 tempest-ProjectMemberTests-186486462 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 11:11:42 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-6019a23d-66ef-4867-8c2f-3fa6e4c61b89 tempest-ProjectMemberTests-186486462 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 11:11:42 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-6019a23d-66ef-4867-8c2f-3fa6e4c61b89 tempest-ProjectMemberTests-186486462 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T10:11:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1364969466',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=14707650-4a5a-400c-9f36-04463a9060bc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8457b114a6264c47af483fad6a8bf18b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T10:11:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T10:11:43Z,use_quota=True,user_id='70a59e5f7c684c0b88977c66a4e36afb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8989e4f-21e3-4f0a-9584-0d818784e883),volume_type_id=f8989e4f-21e3-4f0a-9584-0d818784e883)}" {{(pid=87272) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 04 11:11:42 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.remotefs [None req-6019a23d-66ef-4867-8c2f-3fa6e4c61b89 tempest-ProjectMemberTests-186486462 None] Creating volume 14707650-4a5a-400c-9f36-04463a9060bc {{(pid=87272) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 11:11:42 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-6019a23d-66ef-4867-8c2f-3fa6e4c61b89 tempest-ProjectMemberTests-186486462 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 11:11:42 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-6019a23d-66ef-4867-8c2f-3fa6e4c61b89 tempest-ProjectMemberTests-186486462 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 11:11:42 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-6019a23d-66ef-4867-8c2f-3fa6e4c61b89 tempest-ProjectMemberTests-186486462 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898': None} {{(pid=87272) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 11:11:42 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-6019a23d-66ef-4867-8c2f-3fa6e4c61b89 tempest-ProjectMemberTests-186486462 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'] {{(pid=87272) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 11:11:42 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-6019a23d-66ef-4867-8c2f-3fa6e4c61b89 tempest-ProjectMemberTests-186486462 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 11:11:42 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-6019a23d-66ef-4867-8c2f-3fa6e4c61b89 tempest-ProjectMemberTests-186486462 None] Selected osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898 as target Quobyte volume. {{(pid=87272) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 11:11:42 devstack cinder-volume[87272]: INFO cinder.volume.drivers.remotefs [None req-6019a23d-66ef-4867-8c2f-3fa6e4c61b89 tempest-ProjectMemberTests-186486462 None] casted to osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898 Nov 04 11:11:42 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-6019a23d-66ef-4867-8c2f-3fa6e4c61b89 tempest-ProjectMemberTests-186486462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-14707650-4a5a-400c-9f36-04463a9060bc 1073741824 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:11:42 devstack sudo[107988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-14707650-4a5a-400c-9f36-04463a9060bc 1073741824 Nov 04 11:11:42 devstack sudo[107988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:11:43 devstack sudo[107988]: pam_unix(sudo:session): session closed for user root Nov 04 11:11:43 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-6019a23d-66ef-4867-8c2f-3fa6e4c61b89 tempest-ProjectMemberTests-186486462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-14707650-4a5a-400c-9f36-04463a9060bc 1073741824" returned: 0 in 0.395s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:11:43 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-6019a23d-66ef-4867-8c2f-3fa6e4c61b89 tempest-ProjectMemberTests-186486462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-14707650-4a5a-400c-9f36-04463a9060bc {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:11:43 devstack sudo[107994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-14707650-4a5a-400c-9f36-04463a9060bc Nov 04 11:11:43 devstack sudo[107994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:11:43 devstack sudo[107994]: pam_unix(sudo:session): session closed for user root Nov 04 11:11:43 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-6019a23d-66ef-4867-8c2f-3fa6e4c61b89 tempest-ProjectMemberTests-186486462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-14707650-4a5a-400c-9f36-04463a9060bc" returned: 0 in 0.231s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:11:43 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-6019a23d-66ef-4867-8c2f-3fa6e4c61b89 tempest-ProjectMemberTests-186486462 None] <== create_volume: return (663ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'} {{(pid=87272) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 04 11:11:43 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-6019a23d-66ef-4867-8c2f-3fa6e4c61b89 tempest-ProjectMemberTests-186486462 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.665s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 11:11:43 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-6019a23d-66ef-4867-8c2f-3fa6e4c61b89 tempest-ProjectMemberTests-186486462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95154fc7-d327-4429-b4a3-12442abfb6a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-14707650-4a5a-400c-9f36-04463a9060bc', 'volume_size': 1}' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:11:43 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-6019a23d-66ef-4867-8c2f-3fa6e4c61b89 tempest-ProjectMemberTests-186486462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d5b10e4-25b7-41bf-8028-a30f09b07d77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:11:43 devstack cinder-volume[87272]: INFO cinder.volume.flows.manager.create_volume [None req-6019a23d-66ef-4867-8c2f-3fa6e4c61b89 tempest-ProjectMemberTests-186486462 None] Volume volume-14707650-4a5a-400c-9f36-04463a9060bc (14707650-4a5a-400c-9f36-04463a9060bc): created successfully Nov 04 11:11:43 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-6019a23d-66ef-4867-8c2f-3fa6e4c61b89 tempest-ProjectMemberTests-186486462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d5b10e4-25b7-41bf-8028-a30f09b07d77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:11:43 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-6019a23d-66ef-4867-8c2f-3fa6e4c61b89 tempest-ProjectMemberTests-186486462 None] Flow 'volume_create_manager' (5185f452-a70f-43ab-8eb9-136ddbbb1b63) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87272) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 11:11:43 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-6019a23d-66ef-4867-8c2f-3fa6e4c61b89 tempest-ProjectMemberTests-186486462 None] Created volume successfully. Nov 04 11:11:43 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-a8b87c21-bf30-4fa0-ba31-e3dd4c1b1d2a tempest-ProjectMemberTests-186486462 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 11:11:43 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-a8b87c21-bf30-4fa0-ba31-e3dd4c1b1d2a tempest-ProjectMemberTests-186486462 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 11:11:43 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.remotefs [None req-a8b87c21-bf30-4fa0-ba31-e3dd4c1b1d2a tempest-ProjectMemberTests-186486462 None] Creating offline snapshot 3dd9f025-3cfc-4239-8b2f-b5870472980c of volume 14707650-4a5a-400c-9f36-04463a9060bc {{(pid=87272) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 04 11:11:43 devstack cinder-volume[87272]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e319d3b-eb33-42cb-9f8e-e7fc5473f3e1]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 11:11:43 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-a8b87c21-bf30-4fa0-ba31-e3dd4c1b1d2a tempest-ProjectMemberTests-186486462 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-14707650-4a5a-400c-9f36-04463a9060bc {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:11:43 devstack sudo[107997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-14707650-4a5a-400c-9f36-04463a9060bc Nov 04 11:11:43 devstack sudo[107997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:11:44 devstack sudo[107997]: pam_unix(sudo:session): session closed for user root Nov 04 11:11:44 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-a8b87c21-bf30-4fa0-ba31-e3dd4c1b1d2a tempest-ProjectMemberTests-186486462 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-14707650-4a5a-400c-9f36-04463a9060bc" returned: 0 in 0.343s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:11:44 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-a8b87c21-bf30-4fa0-ba31-e3dd4c1b1d2a tempest-ProjectMemberTests-186486462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-14707650-4a5a-400c-9f36-04463a9060bc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-14707650-4a5a-400c-9f36-04463a9060bc.3dd9f025-3cfc-4239-8b2f-b5870472980c 1G {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:11:44 devstack sudo[108002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-14707650-4a5a-400c-9f36-04463a9060bc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-14707650-4a5a-400c-9f36-04463a9060bc.3dd9f025-3cfc-4239-8b2f-b5870472980c 1G Nov 04 11:11:44 devstack sudo[108002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:11:44 devstack sudo[108002]: pam_unix(sudo:session): session closed for user root Nov 04 11:11:44 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-a8b87c21-bf30-4fa0-ba31-e3dd4c1b1d2a tempest-ProjectMemberTests-186486462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-14707650-4a5a-400c-9f36-04463a9060bc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-14707650-4a5a-400c-9f36-04463a9060bc.3dd9f025-3cfc-4239-8b2f-b5870472980c 1G" returned: 0 in 0.386s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:11:44 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-a8b87c21-bf30-4fa0-ba31-e3dd4c1b1d2a tempest-ProjectMemberTests-186486462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-14707650-4a5a-400c-9f36-04463a9060bc -F qcow2 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-14707650-4a5a-400c-9f36-04463a9060bc.3dd9f025-3cfc-4239-8b2f-b5870472980c {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:11:44 devstack sudo[108008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-14707650-4a5a-400c-9f36-04463a9060bc -F qcow2 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-14707650-4a5a-400c-9f36-04463a9060bc.3dd9f025-3cfc-4239-8b2f-b5870472980c Nov 04 11:11:44 devstack sudo[108008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:11:44 devstack sudo[108008]: pam_unix(sudo:session): session closed for user root Nov 04 11:11:44 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-a8b87c21-bf30-4fa0-ba31-e3dd4c1b1d2a tempest-ProjectMemberTests-186486462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-14707650-4a5a-400c-9f36-04463a9060bc -F qcow2 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-14707650-4a5a-400c-9f36-04463a9060bc.3dd9f025-3cfc-4239-8b2f-b5870472980c" returned: 0 in 0.294s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:11:44 devstack cinder-volume[87272]: WARNING cinder.volume.drivers.remotefs [None req-a8b87c21-bf30-4fa0-ba31-e3dd4c1b1d2a tempest-ProjectMemberTests-186486462 None] /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-14707650-4a5a-400c-9f36-04463a9060bc.3dd9f025-3cfc-4239-8b2f-b5870472980c is being set with open permissions: ugo+rw Nov 04 11:11:44 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-a8b87c21-bf30-4fa0-ba31-e3dd4c1b1d2a tempest-ProjectMemberTests-186486462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-14707650-4a5a-400c-9f36-04463a9060bc.3dd9f025-3cfc-4239-8b2f-b5870472980c {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:11:44 devstack sudo[108013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-14707650-4a5a-400c-9f36-04463a9060bc.3dd9f025-3cfc-4239-8b2f-b5870472980c Nov 04 11:11:44 devstack sudo[108013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:11:45 devstack sudo[108013]: pam_unix(sudo:session): session closed for user root Nov 04 11:11:45 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-a8b87c21-bf30-4fa0-ba31-e3dd4c1b1d2a tempest-ProjectMemberTests-186486462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-14707650-4a5a-400c-9f36-04463a9060bc.3dd9f025-3cfc-4239-8b2f-b5870472980c" returned: 0 in 0.240s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:11:45 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-a8b87c21-bf30-4fa0-ba31-e3dd4c1b1d2a tempest-ProjectMemberTests-186486462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-14707650-4a5a-400c-9f36-04463a9060bc.info {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:11:45 devstack sudo[108016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-14707650-4a5a-400c-9f36-04463a9060bc.info Nov 04 11:11:45 devstack sudo[108016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:11:45 devstack sudo[108016]: pam_unix(sudo:session): session closed for user root Nov 04 11:11:45 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-a8b87c21-bf30-4fa0-ba31-e3dd4c1b1d2a tempest-ProjectMemberTests-186486462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-14707650-4a5a-400c-9f36-04463a9060bc.info" returned: 0 in 0.250s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:11:45 devstack cinder-volume[87272]: WARNING cinder.volume.drivers.remotefs [None req-a8b87c21-bf30-4fa0-ba31-e3dd4c1b1d2a tempest-ProjectMemberTests-186486462 None] /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-14707650-4a5a-400c-9f36-04463a9060bc.info is being set with open permissions: ugo+rw Nov 04 11:11:45 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-a8b87c21-bf30-4fa0-ba31-e3dd4c1b1d2a tempest-ProjectMemberTests-186486462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-14707650-4a5a-400c-9f36-04463a9060bc.info {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:11:45 devstack sudo[108019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-14707650-4a5a-400c-9f36-04463a9060bc.info Nov 04 11:11:45 devstack sudo[108019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:11:45 devstack sudo[108019]: pam_unix(sudo:session): session closed for user root Nov 04 11:11:45 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-a8b87c21-bf30-4fa0-ba31-e3dd4c1b1d2a tempest-ProjectMemberTests-186486462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-14707650-4a5a-400c-9f36-04463a9060bc.info" returned: 0 in 0.237s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:11:45 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-a8b87c21-bf30-4fa0-ba31-e3dd4c1b1d2a tempest-ProjectMemberTests-186486462 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.831s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 11:11:45 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-a8b87c21-bf30-4fa0-ba31-e3dd4c1b1d2a tempest-ProjectMemberTests-186486462 None] Create snapshot completed successfully Nov 04 11:11:45 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-66864e7a-bd67-4f8c-909e-bf16b6c44ad9 tempest-ProjectMemberTests-186486462 None] Acquiring lock "cinder-3dd9f025-3cfc-4239-8b2f-b5870472980c-delete_snapshot" by "delete_snapshot" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 11:11:45 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-66864e7a-bd67-4f8c-909e-bf16b6c44ad9 tempest-ProjectMemberTests-186486462 None] Lock "cinder-3dd9f025-3cfc-4239-8b2f-b5870472980c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 11:11:45 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-66864e7a-bd67-4f8c-909e-bf16b6c44ad9 tempest-ProjectMemberTests-186486462 None] Acquiring lock "cinder-quobyte-14707650-4a5a-400c-9f36-04463a9060bc" by "delete_snapshot" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 11:11:45 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-66864e7a-bd67-4f8c-909e-bf16b6c44ad9 tempest-ProjectMemberTests-186486462 None] Lock "cinder-quobyte-14707650-4a5a-400c-9f36-04463a9060bc" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 11:11:46 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-66864e7a-bd67-4f8c-909e-bf16b6c44ad9 tempest-ProjectMemberTests-186486462 None] Acquiring lock "cinder-quobyte-3dd9f025-3cfc-4239-8b2f-b5870472980c" by "_delete_snapshot" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 11:11:46 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-66864e7a-bd67-4f8c-909e-bf16b6c44ad9 tempest-ProjectMemberTests-186486462 None] Lock "cinder-quobyte-3dd9f025-3cfc-4239-8b2f-b5870472980c" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 11:11:46 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.remotefs [None req-66864e7a-bd67-4f8c-909e-bf16b6c44ad9 tempest-ProjectMemberTests-186486462 None] Deleting offline snapshot 3dd9f025-3cfc-4239-8b2f-b5870472980c of volume 14707650-4a5a-400c-9f36-04463a9060bc {{(pid=87272) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 04 11:11:46 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.remotefs [None req-66864e7a-bd67-4f8c-909e-bf16b6c44ad9 tempest-ProjectMemberTests-186486462 None] snapshot_file for this snap is: volume-14707650-4a5a-400c-9f36-04463a9060bc.3dd9f025-3cfc-4239-8b2f-b5870472980c {{(pid=87272) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 04 11:11:46 devstack cinder-volume[87272]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a4c1fbe-d9ff-4c79-84aa-90aa13a4763e]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 11:11:46 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-66864e7a-bd67-4f8c-909e-bf16b6c44ad9 tempest-ProjectMemberTests-186486462 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-14707650-4a5a-400c-9f36-04463a9060bc.3dd9f025-3cfc-4239-8b2f-b5870472980c {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:11:46 devstack sudo[108022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-14707650-4a5a-400c-9f36-04463a9060bc.3dd9f025-3cfc-4239-8b2f-b5870472980c Nov 04 11:11:46 devstack sudo[108022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:11:46 devstack sudo[108022]: pam_unix(sudo:session): session closed for user root Nov 04 11:11:46 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-66864e7a-bd67-4f8c-909e-bf16b6c44ad9 tempest-ProjectMemberTests-186486462 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-14707650-4a5a-400c-9f36-04463a9060bc.3dd9f025-3cfc-4239-8b2f-b5870472980c" returned: 0 in 0.353s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:11:46 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.remotefs [None req-66864e7a-bd67-4f8c-909e-bf16b6c44ad9 tempest-ProjectMemberTests-186486462 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-14707650-4a5a-400c-9f36-04463a9060bc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87272) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 11:11:46 devstack cinder-volume[87272]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb26aa7e-1dd2-4e0b-aa17-8bbe41caed6f]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 11:11:46 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-66864e7a-bd67-4f8c-909e-bf16b6c44ad9 tempest-ProjectMemberTests-186486462 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-14707650-4a5a-400c-9f36-04463a9060bc {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:11:46 devstack sudo[108027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-14707650-4a5a-400c-9f36-04463a9060bc Nov 04 11:11:46 devstack sudo[108027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:11:46 devstack sudo[108027]: pam_unix(sudo:session): session closed for user root Nov 04 11:11:46 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-66864e7a-bd67-4f8c-909e-bf16b6c44ad9 tempest-ProjectMemberTests-186486462 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-14707650-4a5a-400c-9f36-04463a9060bc" returned: 0 in 0.343s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:11:46 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-66864e7a-bd67-4f8c-909e-bf16b6c44ad9 tempest-ProjectMemberTests-186486462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-14707650-4a5a-400c-9f36-04463a9060bc.3dd9f025-3cfc-4239-8b2f-b5870472980c {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:11:46 devstack sudo[108033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-14707650-4a5a-400c-9f36-04463a9060bc.3dd9f025-3cfc-4239-8b2f-b5870472980c Nov 04 11:11:46 devstack sudo[108033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:11:47 devstack sudo[108033]: pam_unix(sudo:session): session closed for user root Nov 04 11:11:47 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-66864e7a-bd67-4f8c-909e-bf16b6c44ad9 tempest-ProjectMemberTests-186486462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-14707650-4a5a-400c-9f36-04463a9060bc.3dd9f025-3cfc-4239-8b2f-b5870472980c" returned: 0 in 0.334s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:11:47 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-66864e7a-bd67-4f8c-909e-bf16b6c44ad9 tempest-ProjectMemberTests-186486462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-14707650-4a5a-400c-9f36-04463a9060bc.3dd9f025-3cfc-4239-8b2f-b5870472980c {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:11:47 devstack sudo[108038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-14707650-4a5a-400c-9f36-04463a9060bc.3dd9f025-3cfc-4239-8b2f-b5870472980c Nov 04 11:11:47 devstack sudo[108038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:11:47 devstack sudo[108038]: pam_unix(sudo:session): session closed for user root Nov 04 11:11:47 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-66864e7a-bd67-4f8c-909e-bf16b6c44ad9 tempest-ProjectMemberTests-186486462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-14707650-4a5a-400c-9f36-04463a9060bc.3dd9f025-3cfc-4239-8b2f-b5870472980c" returned: 0 in 0.235s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:11:47 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-66864e7a-bd67-4f8c-909e-bf16b6c44ad9 tempest-ProjectMemberTests-186486462 None] Lock "cinder-quobyte-3dd9f025-3cfc-4239-8b2f-b5870472980c" released by "_delete_snapshot" :: held 1.358s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 11:11:47 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-66864e7a-bd67-4f8c-909e-bf16b6c44ad9 tempest-ProjectMemberTests-186486462 None] Lock "cinder-quobyte-14707650-4a5a-400c-9f36-04463a9060bc" released by "delete_snapshot" :: held 1.378s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 11:11:47 devstack cinder-volume[87272]: DEBUG cinder.quota [None req-66864e7a-bd67-4f8c-909e-bf16b6c44ad9 tempest-ProjectMemberTests-186486462 None] Created reservations ['05749cbd-1486-458c-98fe-0a3804a03212', '4dd1c99e-1cf1-4e9a-92a8-9b6611c11088', '121eccc2-5242-4350-8326-1a505fff20fd', '9761648c-84e2-4e70-8b30-f464d74696e2'] {{(pid=87272) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 11:11:47 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-66864e7a-bd67-4f8c-909e-bf16b6c44ad9 tempest-ProjectMemberTests-186486462 None] Delete snapshot completed successfully. Nov 04 11:11:47 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-66864e7a-bd67-4f8c-909e-bf16b6c44ad9 tempest-ProjectMemberTests-186486462 None] Lock "cinder-3dd9f025-3cfc-4239-8b2f-b5870472980c-delete_snapshot" released by "delete_snapshot" :: held 1.504s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 11:11:48 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-3412d2e6-b9aa-4829-b8a6-004045ca907a tempest-ProjectMemberTests-186486462 None] Acquiring lock "cinder-14707650-4a5a-400c-9f36-04463a9060bc-delete_volume" by "delete_volume" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 11:11:48 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-3412d2e6-b9aa-4829-b8a6-004045ca907a tempest-ProjectMemberTests-186486462 None] Lock "cinder-14707650-4a5a-400c-9f36-04463a9060bc-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 11:11:48 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-3412d2e6-b9aa-4829-b8a6-004045ca907a tempest-ProjectMemberTests-186486462 None] Acquiring lock "cinder-quobyte-14707650-4a5a-400c-9f36-04463a9060bc" by "delete_volume" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 11:11:48 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-3412d2e6-b9aa-4829-b8a6-004045ca907a tempest-ProjectMemberTests-186486462 None] Lock "cinder-quobyte-14707650-4a5a-400c-9f36-04463a9060bc" acquired by "delete_volume" :: waited 0.016s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 11:11:48 devstack cinder-volume[87272]: DEBUG oslo.privsep.daemon [-] privsep: reply[e929a76f-2c01-4854-b361-28a93d3f984f]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 11:11:48 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-3412d2e6-b9aa-4829-b8a6-004045ca907a tempest-ProjectMemberTests-186486462 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-14707650-4a5a-400c-9f36-04463a9060bc {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:11:48 devstack sudo[108041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-14707650-4a5a-400c-9f36-04463a9060bc Nov 04 11:11:48 devstack sudo[108041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:11:48 devstack sudo[108041]: pam_unix(sudo:session): session closed for user root Nov 04 11:11:48 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-3412d2e6-b9aa-4829-b8a6-004045ca907a tempest-ProjectMemberTests-186486462 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-14707650-4a5a-400c-9f36-04463a9060bc" returned: 0 in 0.346s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:11:48 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-3412d2e6-b9aa-4829-b8a6-004045ca907a tempest-ProjectMemberTests-186486462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-14707650-4a5a-400c-9f36-04463a9060bc {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:11:48 devstack sudo[108046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-14707650-4a5a-400c-9f36-04463a9060bc Nov 04 11:11:48 devstack sudo[108046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:11:48 devstack sudo[108046]: pam_unix(sudo:session): session closed for user root Nov 04 11:11:48 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-3412d2e6-b9aa-4829-b8a6-004045ca907a tempest-ProjectMemberTests-186486462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-14707650-4a5a-400c-9f36-04463a9060bc" returned: 0 in 0.251s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:11:48 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-3412d2e6-b9aa-4829-b8a6-004045ca907a tempest-ProjectMemberTests-186486462 None] Lock "cinder-quobyte-14707650-4a5a-400c-9f36-04463a9060bc" released by "delete_volume" :: held 0.657s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 11:11:48 devstack cinder-volume[87272]: DEBUG cinder.quota [None req-3412d2e6-b9aa-4829-b8a6-004045ca907a tempest-ProjectMemberTests-186486462 None] Created reservations ['c23d96e2-191a-48d9-97eb-216fda1c78fe', 'db658deb-c3d6-4c2f-800d-10476ae90c4c', 'f2cd38ad-9cd4-4ebb-b2ad-bcb5e3b17f0f', '4a91800b-a4d1-472b-ba83-772c8b070f1f'] {{(pid=87272) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 11:11:48 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-3412d2e6-b9aa-4829-b8a6-004045ca907a tempest-ProjectMemberTests-186486462 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 11:11:48 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-3412d2e6-b9aa-4829-b8a6-004045ca907a tempest-ProjectMemberTests-186486462 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 11:11:48 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-3412d2e6-b9aa-4829-b8a6-004045ca907a tempest-ProjectMemberTests-186486462 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898': None} {{(pid=87272) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 11:11:48 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-3412d2e6-b9aa-4829-b8a6-004045ca907a tempest-ProjectMemberTests-186486462 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'] {{(pid=87272) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 11:11:48 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-3412d2e6-b9aa-4829-b8a6-004045ca907a tempest-ProjectMemberTests-186486462 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 11:11:48 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-3412d2e6-b9aa-4829-b8a6-004045ca907a tempest-ProjectMemberTests-186486462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:11:48 devstack sudo[108049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1 Nov 04 11:11:48 devstack sudo[108049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:11:49 devstack sudo[108049]: pam_unix(sudo:session): session closed for user root Nov 04 11:11:49 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-3412d2e6-b9aa-4829-b8a6-004045ca907a tempest-ProjectMemberTests-186486462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1" returned: 0 in 0.232s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:11:49 devstack cinder-volume[87272]: DEBUG cinder.manager [None req-3412d2e6-b9aa-4829-b8a6-004045ca907a tempest-ProjectMemberTests-186486462 None] Notifying Schedulers of capabilities ... {{(pid=87272) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 11:11:49 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-3412d2e6-b9aa-4829-b8a6-004045ca907a tempest-ProjectMemberTests-186486462 None] Deleted volume successfully. Nov 04 11:11:49 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-3412d2e6-b9aa-4829-b8a6-004045ca907a tempest-ProjectMemberTests-186486462 None] Lock "cinder-14707650-4a5a-400c-9f36-04463a9060bc-delete_volume" released by "delete_volume" :: held 1.077s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 11:11:49 devstack cinder-volume[87272]: DEBUG cinder.volume.flows.manager.create_volume [None req-007ed00b-6aec-41c6-871d-fa4a943c707a tempest-ProjectMemberTests-186486462 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87272) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 11:11:49 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-007ed00b-6aec-41c6-871d-fa4a943c707a tempest-ProjectMemberTests-186486462 None] Flow 'volume_create_manager' (6773b95d-e3cc-4570-9858-5a1f2fdecb41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 11:11:49 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-007ed00b-6aec-41c6-871d-fa4a943c707a tempest-ProjectMemberTests-186486462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (114df7fc-abda-4c00-aef9-ef458bb7b703) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:11:49 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-007ed00b-6aec-41c6-871d-fa4a943c707a tempest-ProjectMemberTests-186486462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (114df7fc-abda-4c00-aef9-ef458bb7b703) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T10:11:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1176093542',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da14b09c-c9d1-4038-b9fd-b78ef9d29cbf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8457b114a6264c47af483fad6a8bf18b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T10:11:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T10:11:50Z,use_quota=True,user_id='70a59e5f7c684c0b88977c66a4e36afb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8989e4f-21e3-4f0a-9584-0d818784e883),volume_type_id=f8989e4f-21e3-4f0a-9584-0d818784e883)' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:11:49 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-007ed00b-6aec-41c6-871d-fa4a943c707a tempest-ProjectMemberTests-186486462 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d7797dc-5b1e-4b27-9298-305ceaa56756) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:11:49 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-007ed00b-6aec-41c6-871d-fa4a943c707a tempest-ProjectMemberTests-186486462 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d7797dc-5b1e-4b27-9298-305ceaa56756) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:11:49 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-007ed00b-6aec-41c6-871d-fa4a943c707a tempest-ProjectMemberTests-186486462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04fe61ef-be6b-4350-93d7-d7766b9ef2e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:11:49 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-007ed00b-6aec-41c6-871d-fa4a943c707a tempest-ProjectMemberTests-186486462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04fe61ef-be6b-4350-93d7-d7766b9ef2e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'da14b09c-c9d1-4038-b9fd-b78ef9d29cbf', 'volume_name': 'volume-da14b09c-c9d1-4038-b9fd-b78ef9d29cbf', 'volume_size': 1}' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:11:49 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-007ed00b-6aec-41c6-871d-fa4a943c707a tempest-ProjectMemberTests-186486462 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f2a0a65-7917-4e86-a0c9-e1b6c8da386c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:11:49 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-007ed00b-6aec-41c6-871d-fa4a943c707a tempest-ProjectMemberTests-186486462 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f2a0a65-7917-4e86-a0c9-e1b6c8da386c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:11:49 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-007ed00b-6aec-41c6-871d-fa4a943c707a tempest-ProjectMemberTests-186486462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e71d1050-dd43-47b1-bcff-86e4575dc818) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:11:49 devstack cinder-volume[87272]: INFO cinder.volume.flows.manager.create_volume [None req-007ed00b-6aec-41c6-871d-fa4a943c707a tempest-ProjectMemberTests-186486462 None] Volume da14b09c-c9d1-4038-b9fd-b78ef9d29cbf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-da14b09c-c9d1-4038-b9fd-b78ef9d29cbf', 'volume_size': 1} Nov 04 11:11:49 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-007ed00b-6aec-41c6-871d-fa4a943c707a tempest-ProjectMemberTests-186486462 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 11:11:49 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-007ed00b-6aec-41c6-871d-fa4a943c707a tempest-ProjectMemberTests-186486462 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 11:11:49 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-007ed00b-6aec-41c6-871d-fa4a943c707a tempest-ProjectMemberTests-186486462 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T10:11:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1176093542',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da14b09c-c9d1-4038-b9fd-b78ef9d29cbf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8457b114a6264c47af483fad6a8bf18b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T10:11:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T10:11:50Z,use_quota=True,user_id='70a59e5f7c684c0b88977c66a4e36afb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8989e4f-21e3-4f0a-9584-0d818784e883),volume_type_id=f8989e4f-21e3-4f0a-9584-0d818784e883)}" {{(pid=87272) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 04 11:11:49 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.remotefs [None req-007ed00b-6aec-41c6-871d-fa4a943c707a tempest-ProjectMemberTests-186486462 None] Creating volume da14b09c-c9d1-4038-b9fd-b78ef9d29cbf {{(pid=87272) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 11:11:49 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-007ed00b-6aec-41c6-871d-fa4a943c707a tempest-ProjectMemberTests-186486462 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 11:11:49 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-007ed00b-6aec-41c6-871d-fa4a943c707a tempest-ProjectMemberTests-186486462 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 11:11:49 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-007ed00b-6aec-41c6-871d-fa4a943c707a tempest-ProjectMemberTests-186486462 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898': None} {{(pid=87272) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 11:11:49 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-007ed00b-6aec-41c6-871d-fa4a943c707a tempest-ProjectMemberTests-186486462 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'] {{(pid=87272) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 11:11:49 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-007ed00b-6aec-41c6-871d-fa4a943c707a tempest-ProjectMemberTests-186486462 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 11:11:49 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-007ed00b-6aec-41c6-871d-fa4a943c707a tempest-ProjectMemberTests-186486462 None] Selected osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898 as target Quobyte volume. {{(pid=87272) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 11:11:49 devstack cinder-volume[87272]: INFO cinder.volume.drivers.remotefs [None req-007ed00b-6aec-41c6-871d-fa4a943c707a tempest-ProjectMemberTests-186486462 None] casted to osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898 Nov 04 11:11:49 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-007ed00b-6aec-41c6-871d-fa4a943c707a tempest-ProjectMemberTests-186486462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-da14b09c-c9d1-4038-b9fd-b78ef9d29cbf 1073741824 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:11:49 devstack sudo[108052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-da14b09c-c9d1-4038-b9fd-b78ef9d29cbf 1073741824 Nov 04 11:11:49 devstack sudo[108052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:11:50 devstack sudo[108052]: pam_unix(sudo:session): session closed for user root Nov 04 11:11:50 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-007ed00b-6aec-41c6-871d-fa4a943c707a tempest-ProjectMemberTests-186486462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-da14b09c-c9d1-4038-b9fd-b78ef9d29cbf 1073741824" returned: 0 in 0.415s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:11:50 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-007ed00b-6aec-41c6-871d-fa4a943c707a tempest-ProjectMemberTests-186486462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-da14b09c-c9d1-4038-b9fd-b78ef9d29cbf {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:11:50 devstack sudo[108057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-da14b09c-c9d1-4038-b9fd-b78ef9d29cbf Nov 04 11:11:50 devstack sudo[108057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:11:50 devstack sudo[108057]: pam_unix(sudo:session): session closed for user root Nov 04 11:11:50 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-007ed00b-6aec-41c6-871d-fa4a943c707a tempest-ProjectMemberTests-186486462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-da14b09c-c9d1-4038-b9fd-b78ef9d29cbf" returned: 0 in 0.243s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:11:50 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-007ed00b-6aec-41c6-871d-fa4a943c707a tempest-ProjectMemberTests-186486462 None] <== create_volume: return (699ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'} {{(pid=87272) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 04 11:11:50 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-007ed00b-6aec-41c6-871d-fa4a943c707a tempest-ProjectMemberTests-186486462 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.702s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 11:11:50 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-007ed00b-6aec-41c6-871d-fa4a943c707a tempest-ProjectMemberTests-186486462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e71d1050-dd43-47b1-bcff-86e4575dc818) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-da14b09c-c9d1-4038-b9fd-b78ef9d29cbf', 'volume_size': 1}' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:11:50 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-007ed00b-6aec-41c6-871d-fa4a943c707a tempest-ProjectMemberTests-186486462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (26ca1ac4-85dc-4cf2-abbe-1355dde3ab2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:11:50 devstack cinder-volume[87272]: INFO cinder.volume.flows.manager.create_volume [None req-007ed00b-6aec-41c6-871d-fa4a943c707a tempest-ProjectMemberTests-186486462 None] Volume volume-da14b09c-c9d1-4038-b9fd-b78ef9d29cbf (da14b09c-c9d1-4038-b9fd-b78ef9d29cbf): created successfully Nov 04 11:11:50 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-007ed00b-6aec-41c6-871d-fa4a943c707a tempest-ProjectMemberTests-186486462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (26ca1ac4-85dc-4cf2-abbe-1355dde3ab2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:11:50 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-007ed00b-6aec-41c6-871d-fa4a943c707a tempest-ProjectMemberTests-186486462 None] Flow 'volume_create_manager' (6773b95d-e3cc-4570-9858-5a1f2fdecb41) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87272) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 11:11:50 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-007ed00b-6aec-41c6-871d-fa4a943c707a tempest-ProjectMemberTests-186486462 None] Created volume successfully. Nov 04 11:11:50 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-db27ac38-f5a0-4ae6-868d-fa1828b5c3c0 tempest-ProjectMemberTests-186486462 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 11:11:50 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-db27ac38-f5a0-4ae6-868d-fa1828b5c3c0 tempest-ProjectMemberTests-186486462 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 11:11:50 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.remotefs [None req-db27ac38-f5a0-4ae6-868d-fa1828b5c3c0 tempest-ProjectMemberTests-186486462 None] Creating offline snapshot d261a098-f749-4242-b0fd-1e907bd99c26 of volume da14b09c-c9d1-4038-b9fd-b78ef9d29cbf {{(pid=87272) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 04 11:11:50 devstack cinder-volume[87272]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dd40744-fd53-4b40-b109-08cf66c3d217]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 11:11:50 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-db27ac38-f5a0-4ae6-868d-fa1828b5c3c0 tempest-ProjectMemberTests-186486462 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-da14b09c-c9d1-4038-b9fd-b78ef9d29cbf {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:11:50 devstack sudo[108060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-da14b09c-c9d1-4038-b9fd-b78ef9d29cbf Nov 04 11:11:50 devstack sudo[108060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:11:51 devstack sudo[108060]: pam_unix(sudo:session): session closed for user root Nov 04 11:11:51 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-db27ac38-f5a0-4ae6-868d-fa1828b5c3c0 tempest-ProjectMemberTests-186486462 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-da14b09c-c9d1-4038-b9fd-b78ef9d29cbf" returned: 0 in 0.354s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:11:51 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-db27ac38-f5a0-4ae6-868d-fa1828b5c3c0 tempest-ProjectMemberTests-186486462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-da14b09c-c9d1-4038-b9fd-b78ef9d29cbf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-da14b09c-c9d1-4038-b9fd-b78ef9d29cbf.d261a098-f749-4242-b0fd-1e907bd99c26 1G {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:11:51 devstack sudo[108065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-da14b09c-c9d1-4038-b9fd-b78ef9d29cbf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-da14b09c-c9d1-4038-b9fd-b78ef9d29cbf.d261a098-f749-4242-b0fd-1e907bd99c26 1G Nov 04 11:11:51 devstack sudo[108065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:11:51 devstack sudo[108065]: pam_unix(sudo:session): session closed for user root Nov 04 11:11:51 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-db27ac38-f5a0-4ae6-868d-fa1828b5c3c0 tempest-ProjectMemberTests-186486462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-da14b09c-c9d1-4038-b9fd-b78ef9d29cbf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-da14b09c-c9d1-4038-b9fd-b78ef9d29cbf.d261a098-f749-4242-b0fd-1e907bd99c26 1G" returned: 0 in 0.377s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:11:51 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-db27ac38-f5a0-4ae6-868d-fa1828b5c3c0 tempest-ProjectMemberTests-186486462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-da14b09c-c9d1-4038-b9fd-b78ef9d29cbf -F qcow2 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-da14b09c-c9d1-4038-b9fd-b78ef9d29cbf.d261a098-f749-4242-b0fd-1e907bd99c26 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:11:51 devstack sudo[108071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-da14b09c-c9d1-4038-b9fd-b78ef9d29cbf -F qcow2 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-da14b09c-c9d1-4038-b9fd-b78ef9d29cbf.d261a098-f749-4242-b0fd-1e907bd99c26 Nov 04 11:11:51 devstack sudo[108071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:11:51 devstack sudo[108071]: pam_unix(sudo:session): session closed for user root Nov 04 11:11:51 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-db27ac38-f5a0-4ae6-868d-fa1828b5c3c0 tempest-ProjectMemberTests-186486462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-da14b09c-c9d1-4038-b9fd-b78ef9d29cbf -F qcow2 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-da14b09c-c9d1-4038-b9fd-b78ef9d29cbf.d261a098-f749-4242-b0fd-1e907bd99c26" returned: 0 in 0.299s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:11:51 devstack cinder-volume[87272]: WARNING cinder.volume.drivers.remotefs [None req-db27ac38-f5a0-4ae6-868d-fa1828b5c3c0 tempest-ProjectMemberTests-186486462 None] /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-da14b09c-c9d1-4038-b9fd-b78ef9d29cbf.d261a098-f749-4242-b0fd-1e907bd99c26 is being set with open permissions: ugo+rw Nov 04 11:11:51 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-db27ac38-f5a0-4ae6-868d-fa1828b5c3c0 tempest-ProjectMemberTests-186486462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-da14b09c-c9d1-4038-b9fd-b78ef9d29cbf.d261a098-f749-4242-b0fd-1e907bd99c26 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:11:51 devstack sudo[108076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-da14b09c-c9d1-4038-b9fd-b78ef9d29cbf.d261a098-f749-4242-b0fd-1e907bd99c26 Nov 04 11:11:51 devstack sudo[108076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:11:52 devstack sudo[108076]: pam_unix(sudo:session): session closed for user root Nov 04 11:11:52 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-db27ac38-f5a0-4ae6-868d-fa1828b5c3c0 tempest-ProjectMemberTests-186486462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-da14b09c-c9d1-4038-b9fd-b78ef9d29cbf.d261a098-f749-4242-b0fd-1e907bd99c26" returned: 0 in 0.234s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:11:52 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-db27ac38-f5a0-4ae6-868d-fa1828b5c3c0 tempest-ProjectMemberTests-186486462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-da14b09c-c9d1-4038-b9fd-b78ef9d29cbf.info {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:11:52 devstack sudo[108079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-da14b09c-c9d1-4038-b9fd-b78ef9d29cbf.info Nov 04 11:11:52 devstack sudo[108079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:11:52 devstack sudo[108079]: pam_unix(sudo:session): session closed for user root Nov 04 11:11:52 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-db27ac38-f5a0-4ae6-868d-fa1828b5c3c0 tempest-ProjectMemberTests-186486462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-da14b09c-c9d1-4038-b9fd-b78ef9d29cbf.info" returned: 0 in 0.249s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:11:52 devstack cinder-volume[87272]: WARNING cinder.volume.drivers.remotefs [None req-db27ac38-f5a0-4ae6-868d-fa1828b5c3c0 tempest-ProjectMemberTests-186486462 None] /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-da14b09c-c9d1-4038-b9fd-b78ef9d29cbf.info is being set with open permissions: ugo+rw Nov 04 11:11:52 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-db27ac38-f5a0-4ae6-868d-fa1828b5c3c0 tempest-ProjectMemberTests-186486462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-da14b09c-c9d1-4038-b9fd-b78ef9d29cbf.info {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:11:52 devstack sudo[108082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-da14b09c-c9d1-4038-b9fd-b78ef9d29cbf.info Nov 04 11:11:52 devstack sudo[108082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:11:52 devstack sudo[108082]: pam_unix(sudo:session): session closed for user root Nov 04 11:11:52 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-db27ac38-f5a0-4ae6-868d-fa1828b5c3c0 tempest-ProjectMemberTests-186486462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-da14b09c-c9d1-4038-b9fd-b78ef9d29cbf.info" returned: 0 in 0.237s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:11:52 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-db27ac38-f5a0-4ae6-868d-fa1828b5c3c0 tempest-ProjectMemberTests-186486462 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.825s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 11:11:52 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-db27ac38-f5a0-4ae6-868d-fa1828b5c3c0 tempest-ProjectMemberTests-186486462 None] Create snapshot completed successfully Nov 04 11:11:52 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-0e637379-b333-494b-a44e-d1380625e1b5 tempest-ProjectMemberTests-186486462 None] Acquiring lock "cinder-d261a098-f749-4242-b0fd-1e907bd99c26-delete_snapshot" by "delete_snapshot" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 11:11:53 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-0e637379-b333-494b-a44e-d1380625e1b5 tempest-ProjectMemberTests-186486462 None] Lock "cinder-d261a098-f749-4242-b0fd-1e907bd99c26-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 11:11:53 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-0e637379-b333-494b-a44e-d1380625e1b5 tempest-ProjectMemberTests-186486462 None] Acquiring lock "cinder-quobyte-da14b09c-c9d1-4038-b9fd-b78ef9d29cbf" by "delete_snapshot" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 11:11:53 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-0e637379-b333-494b-a44e-d1380625e1b5 tempest-ProjectMemberTests-186486462 None] Lock "cinder-quobyte-da14b09c-c9d1-4038-b9fd-b78ef9d29cbf" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 11:11:53 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-0e637379-b333-494b-a44e-d1380625e1b5 tempest-ProjectMemberTests-186486462 None] Acquiring lock "cinder-quobyte-d261a098-f749-4242-b0fd-1e907bd99c26" by "_delete_snapshot" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 11:11:53 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-0e637379-b333-494b-a44e-d1380625e1b5 tempest-ProjectMemberTests-186486462 None] Lock "cinder-quobyte-d261a098-f749-4242-b0fd-1e907bd99c26" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 11:11:53 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.remotefs [None req-0e637379-b333-494b-a44e-d1380625e1b5 tempest-ProjectMemberTests-186486462 None] Deleting offline snapshot d261a098-f749-4242-b0fd-1e907bd99c26 of volume da14b09c-c9d1-4038-b9fd-b78ef9d29cbf {{(pid=87272) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 04 11:11:53 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.remotefs [None req-0e637379-b333-494b-a44e-d1380625e1b5 tempest-ProjectMemberTests-186486462 None] snapshot_file for this snap is: volume-da14b09c-c9d1-4038-b9fd-b78ef9d29cbf.d261a098-f749-4242-b0fd-1e907bd99c26 {{(pid=87272) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 04 11:11:53 devstack cinder-volume[87272]: DEBUG oslo.privsep.daemon [-] privsep: reply[763729cd-5ebd-445e-859a-848093c5e04c]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 11:11:53 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-0e637379-b333-494b-a44e-d1380625e1b5 tempest-ProjectMemberTests-186486462 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-da14b09c-c9d1-4038-b9fd-b78ef9d29cbf.d261a098-f749-4242-b0fd-1e907bd99c26 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:11:53 devstack sudo[108085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-da14b09c-c9d1-4038-b9fd-b78ef9d29cbf.d261a098-f749-4242-b0fd-1e907bd99c26 Nov 04 11:11:53 devstack sudo[108085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:11:53 devstack sudo[108085]: pam_unix(sudo:session): session closed for user root Nov 04 11:11:53 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-0e637379-b333-494b-a44e-d1380625e1b5 tempest-ProjectMemberTests-186486462 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-da14b09c-c9d1-4038-b9fd-b78ef9d29cbf.d261a098-f749-4242-b0fd-1e907bd99c26" returned: 0 in 0.367s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:11:53 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.remotefs [None req-0e637379-b333-494b-a44e-d1380625e1b5 tempest-ProjectMemberTests-186486462 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-da14b09c-c9d1-4038-b9fd-b78ef9d29cbf(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87272) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 11:11:53 devstack cinder-volume[87272]: DEBUG oslo.privsep.daemon [-] privsep: reply[c422e9fe-9d00-45e3-b0e5-bfccce205508]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 11:11:53 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-0e637379-b333-494b-a44e-d1380625e1b5 tempest-ProjectMemberTests-186486462 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-da14b09c-c9d1-4038-b9fd-b78ef9d29cbf {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:11:53 devstack sudo[108090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-da14b09c-c9d1-4038-b9fd-b78ef9d29cbf Nov 04 11:11:53 devstack sudo[108090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:11:53 devstack sudo[108090]: pam_unix(sudo:session): session closed for user root Nov 04 11:11:53 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-0e637379-b333-494b-a44e-d1380625e1b5 tempest-ProjectMemberTests-186486462 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-da14b09c-c9d1-4038-b9fd-b78ef9d29cbf" returned: 0 in 0.349s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:11:53 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-0e637379-b333-494b-a44e-d1380625e1b5 tempest-ProjectMemberTests-186486462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-da14b09c-c9d1-4038-b9fd-b78ef9d29cbf.d261a098-f749-4242-b0fd-1e907bd99c26 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:11:53 devstack sudo[108095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-da14b09c-c9d1-4038-b9fd-b78ef9d29cbf.d261a098-f749-4242-b0fd-1e907bd99c26 Nov 04 11:11:53 devstack sudo[108095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:11:54 devstack sudo[108095]: pam_unix(sudo:session): session closed for user root Nov 04 11:11:54 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-0e637379-b333-494b-a44e-d1380625e1b5 tempest-ProjectMemberTests-186486462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-da14b09c-c9d1-4038-b9fd-b78ef9d29cbf.d261a098-f749-4242-b0fd-1e907bd99c26" returned: 0 in 0.321s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:11:54 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-0e637379-b333-494b-a44e-d1380625e1b5 tempest-ProjectMemberTests-186486462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-da14b09c-c9d1-4038-b9fd-b78ef9d29cbf.d261a098-f749-4242-b0fd-1e907bd99c26 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:11:54 devstack sudo[108100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-da14b09c-c9d1-4038-b9fd-b78ef9d29cbf.d261a098-f749-4242-b0fd-1e907bd99c26 Nov 04 11:11:54 devstack sudo[108100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:11:54 devstack sudo[108100]: pam_unix(sudo:session): session closed for user root Nov 04 11:11:54 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-0e637379-b333-494b-a44e-d1380625e1b5 tempest-ProjectMemberTests-186486462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-da14b09c-c9d1-4038-b9fd-b78ef9d29cbf.d261a098-f749-4242-b0fd-1e907bd99c26" returned: 0 in 0.237s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:11:54 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-0e637379-b333-494b-a44e-d1380625e1b5 tempest-ProjectMemberTests-186486462 None] Lock "cinder-quobyte-d261a098-f749-4242-b0fd-1e907bd99c26" released by "_delete_snapshot" :: held 1.368s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 11:11:54 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-0e637379-b333-494b-a44e-d1380625e1b5 tempest-ProjectMemberTests-186486462 None] Lock "cinder-quobyte-da14b09c-c9d1-4038-b9fd-b78ef9d29cbf" released by "delete_snapshot" :: held 1.391s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 11:11:54 devstack cinder-volume[87272]: DEBUG cinder.quota [None req-0e637379-b333-494b-a44e-d1380625e1b5 tempest-ProjectMemberTests-186486462 None] Created reservations ['ff97cc72-911c-4e18-b71e-8b3b8cd1cf10', '778fe79b-0f5a-4fb4-9c22-167323f2d47e', '2682e93d-94c0-4ccf-bdbd-3a63dbd82e04', 'c2681188-8671-44de-8b4a-d4a32c2c8172'] {{(pid=87272) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 11:11:54 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-0e637379-b333-494b-a44e-d1380625e1b5 tempest-ProjectMemberTests-186486462 None] Delete snapshot completed successfully. Nov 04 11:11:54 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-0e637379-b333-494b-a44e-d1380625e1b5 tempest-ProjectMemberTests-186486462 None] Lock "cinder-d261a098-f749-4242-b0fd-1e907bd99c26-delete_snapshot" released by "delete_snapshot" :: held 1.513s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 11:11:55 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-d36310be-dd83-4020-9504-876dc9e1afb1 tempest-ProjectMemberTests-186486462 None] Acquiring lock "cinder-da14b09c-c9d1-4038-b9fd-b78ef9d29cbf-delete_volume" by "delete_volume" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 11:11:55 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-d36310be-dd83-4020-9504-876dc9e1afb1 tempest-ProjectMemberTests-186486462 None] Lock "cinder-da14b09c-c9d1-4038-b9fd-b78ef9d29cbf-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 11:11:55 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-d36310be-dd83-4020-9504-876dc9e1afb1 tempest-ProjectMemberTests-186486462 None] Acquiring lock "cinder-quobyte-da14b09c-c9d1-4038-b9fd-b78ef9d29cbf" by "delete_volume" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 11:11:55 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-d36310be-dd83-4020-9504-876dc9e1afb1 tempest-ProjectMemberTests-186486462 None] Lock "cinder-quobyte-da14b09c-c9d1-4038-b9fd-b78ef9d29cbf" acquired by "delete_volume" :: waited 0.014s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 11:11:55 devstack cinder-volume[87272]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f8ba8db-840d-4d0c-ba53-f8c2fde9f3e4]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 11:11:55 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-d36310be-dd83-4020-9504-876dc9e1afb1 tempest-ProjectMemberTests-186486462 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-da14b09c-c9d1-4038-b9fd-b78ef9d29cbf {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:11:55 devstack sudo[108103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-da14b09c-c9d1-4038-b9fd-b78ef9d29cbf Nov 04 11:11:55 devstack sudo[108103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:11:55 devstack sudo[108103]: pam_unix(sudo:session): session closed for user root Nov 04 11:11:55 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-d36310be-dd83-4020-9504-876dc9e1afb1 tempest-ProjectMemberTests-186486462 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-da14b09c-c9d1-4038-b9fd-b78ef9d29cbf" returned: 0 in 0.364s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:11:55 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-d36310be-dd83-4020-9504-876dc9e1afb1 tempest-ProjectMemberTests-186486462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-da14b09c-c9d1-4038-b9fd-b78ef9d29cbf {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:11:55 devstack sudo[108108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-da14b09c-c9d1-4038-b9fd-b78ef9d29cbf Nov 04 11:11:55 devstack sudo[108108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:11:55 devstack sudo[108108]: pam_unix(sudo:session): session closed for user root Nov 04 11:11:55 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-d36310be-dd83-4020-9504-876dc9e1afb1 tempest-ProjectMemberTests-186486462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-da14b09c-c9d1-4038-b9fd-b78ef9d29cbf" returned: 0 in 0.238s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:11:55 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-d36310be-dd83-4020-9504-876dc9e1afb1 tempest-ProjectMemberTests-186486462 None] Lock "cinder-quobyte-da14b09c-c9d1-4038-b9fd-b78ef9d29cbf" released by "delete_volume" :: held 0.663s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 11:11:55 devstack cinder-volume[87272]: DEBUG cinder.quota [None req-d36310be-dd83-4020-9504-876dc9e1afb1 tempest-ProjectMemberTests-186486462 None] Created reservations ['a38875ee-0dcd-44e4-b9f2-8562560c342a', '15ef1785-8737-4ac5-a612-1e54afd46e44', '0e741a5b-caba-48aa-8a7f-89e55c4b15f1', '7160fbf2-476b-46c9-9ee6-1fdb05efea69'] {{(pid=87272) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 11:11:55 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-d36310be-dd83-4020-9504-876dc9e1afb1 tempest-ProjectMemberTests-186486462 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 11:11:55 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-d36310be-dd83-4020-9504-876dc9e1afb1 tempest-ProjectMemberTests-186486462 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 11:11:55 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-d36310be-dd83-4020-9504-876dc9e1afb1 tempest-ProjectMemberTests-186486462 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898': None} {{(pid=87272) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 11:11:55 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-d36310be-dd83-4020-9504-876dc9e1afb1 tempest-ProjectMemberTests-186486462 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'] {{(pid=87272) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 11:11:55 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-d36310be-dd83-4020-9504-876dc9e1afb1 tempest-ProjectMemberTests-186486462 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 11:11:55 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-d36310be-dd83-4020-9504-876dc9e1afb1 tempest-ProjectMemberTests-186486462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:11:56 devstack sudo[108111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1 Nov 04 11:11:56 devstack sudo[108111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:11:56 devstack sudo[108111]: pam_unix(sudo:session): session closed for user root Nov 04 11:11:56 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-d36310be-dd83-4020-9504-876dc9e1afb1 tempest-ProjectMemberTests-186486462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1" returned: 0 in 0.243s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:11:56 devstack cinder-volume[87272]: DEBUG cinder.manager [None req-d36310be-dd83-4020-9504-876dc9e1afb1 tempest-ProjectMemberTests-186486462 None] Notifying Schedulers of capabilities ... {{(pid=87272) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 11:11:56 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-d36310be-dd83-4020-9504-876dc9e1afb1 tempest-ProjectMemberTests-186486462 None] Deleted volume successfully. Nov 04 11:11:56 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-d36310be-dd83-4020-9504-876dc9e1afb1 tempest-ProjectMemberTests-186486462 None] Lock "cinder-da14b09c-c9d1-4038-b9fd-b78ef9d29cbf-delete_volume" released by "delete_volume" :: held 1.093s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 11:11:56 devstack cinder-volume[87272]: DEBUG cinder.volume.flows.manager.create_volume [None req-11ee0c89-88e4-4f9d-8baf-2650e57e306c tempest-ProjectMemberTests-186486462 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87272) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 11:11:56 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-11ee0c89-88e4-4f9d-8baf-2650e57e306c tempest-ProjectMemberTests-186486462 None] Flow 'volume_create_manager' (2279cabb-06f5-4a30-a7b3-4e15b6725fbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 11:11:56 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-11ee0c89-88e4-4f9d-8baf-2650e57e306c tempest-ProjectMemberTests-186486462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36850644-2b7a-4ba3-9e46-2f04e05b02e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:11:56 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-11ee0c89-88e4-4f9d-8baf-2650e57e306c tempest-ProjectMemberTests-186486462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36850644-2b7a-4ba3-9e46-2f04e05b02e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T10:11:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-45507499',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba32bb13-ed5b-4f7e-b0a6-674bda9bca84,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8457b114a6264c47af483fad6a8bf18b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T10:11:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T10:11:57Z,use_quota=True,user_id='70a59e5f7c684c0b88977c66a4e36afb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8989e4f-21e3-4f0a-9584-0d818784e883),volume_type_id=f8989e4f-21e3-4f0a-9584-0d818784e883)' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:11:56 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-11ee0c89-88e4-4f9d-8baf-2650e57e306c tempest-ProjectMemberTests-186486462 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8a0d28a-050d-412f-b070-3aa697e77988) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:11:56 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-11ee0c89-88e4-4f9d-8baf-2650e57e306c tempest-ProjectMemberTests-186486462 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8a0d28a-050d-412f-b070-3aa697e77988) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:11:56 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-11ee0c89-88e4-4f9d-8baf-2650e57e306c tempest-ProjectMemberTests-186486462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb98bfcc-13e6-4033-9301-ed8ad2e39195) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:11:56 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-11ee0c89-88e4-4f9d-8baf-2650e57e306c tempest-ProjectMemberTests-186486462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb98bfcc-13e6-4033-9301-ed8ad2e39195) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ba32bb13-ed5b-4f7e-b0a6-674bda9bca84', 'volume_name': 'volume-ba32bb13-ed5b-4f7e-b0a6-674bda9bca84', 'volume_size': 1}' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:11:56 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-11ee0c89-88e4-4f9d-8baf-2650e57e306c tempest-ProjectMemberTests-186486462 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea1806cd-4566-4c04-8c1d-03c20b4643ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:11:56 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-11ee0c89-88e4-4f9d-8baf-2650e57e306c tempest-ProjectMemberTests-186486462 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea1806cd-4566-4c04-8c1d-03c20b4643ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:11:56 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-11ee0c89-88e4-4f9d-8baf-2650e57e306c tempest-ProjectMemberTests-186486462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (86464d4d-8b3e-4bd6-822b-0e261852c2b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:11:56 devstack cinder-volume[87272]: INFO cinder.volume.flows.manager.create_volume [None req-11ee0c89-88e4-4f9d-8baf-2650e57e306c tempest-ProjectMemberTests-186486462 None] Volume ba32bb13-ed5b-4f7e-b0a6-674bda9bca84: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ba32bb13-ed5b-4f7e-b0a6-674bda9bca84', 'volume_size': 1} Nov 04 11:11:56 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-11ee0c89-88e4-4f9d-8baf-2650e57e306c tempest-ProjectMemberTests-186486462 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 11:11:56 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-11ee0c89-88e4-4f9d-8baf-2650e57e306c tempest-ProjectMemberTests-186486462 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 11:11:56 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-11ee0c89-88e4-4f9d-8baf-2650e57e306c tempest-ProjectMemberTests-186486462 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T10:11:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-45507499',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba32bb13-ed5b-4f7e-b0a6-674bda9bca84,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8457b114a6264c47af483fad6a8bf18b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T10:11:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T10:11:57Z,use_quota=True,user_id='70a59e5f7c684c0b88977c66a4e36afb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8989e4f-21e3-4f0a-9584-0d818784e883),volume_type_id=f8989e4f-21e3-4f0a-9584-0d818784e883)}" {{(pid=87272) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 04 11:11:56 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.remotefs [None req-11ee0c89-88e4-4f9d-8baf-2650e57e306c tempest-ProjectMemberTests-186486462 None] Creating volume ba32bb13-ed5b-4f7e-b0a6-674bda9bca84 {{(pid=87272) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 11:11:56 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-11ee0c89-88e4-4f9d-8baf-2650e57e306c tempest-ProjectMemberTests-186486462 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 11:11:56 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-11ee0c89-88e4-4f9d-8baf-2650e57e306c tempest-ProjectMemberTests-186486462 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 11:11:56 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-11ee0c89-88e4-4f9d-8baf-2650e57e306c tempest-ProjectMemberTests-186486462 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898': None} {{(pid=87272) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 11:11:56 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-11ee0c89-88e4-4f9d-8baf-2650e57e306c tempest-ProjectMemberTests-186486462 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'] {{(pid=87272) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 11:11:56 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-11ee0c89-88e4-4f9d-8baf-2650e57e306c tempest-ProjectMemberTests-186486462 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 11:11:56 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-11ee0c89-88e4-4f9d-8baf-2650e57e306c tempest-ProjectMemberTests-186486462 None] Selected osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898 as target Quobyte volume. {{(pid=87272) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 11:11:56 devstack cinder-volume[87272]: INFO cinder.volume.drivers.remotefs [None req-11ee0c89-88e4-4f9d-8baf-2650e57e306c tempest-ProjectMemberTests-186486462 None] casted to osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898 Nov 04 11:11:56 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-11ee0c89-88e4-4f9d-8baf-2650e57e306c tempest-ProjectMemberTests-186486462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-ba32bb13-ed5b-4f7e-b0a6-674bda9bca84 1073741824 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:11:56 devstack sudo[108115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-ba32bb13-ed5b-4f7e-b0a6-674bda9bca84 1073741824 Nov 04 11:11:56 devstack sudo[108115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:11:57 devstack sudo[108115]: pam_unix(sudo:session): session closed for user root Nov 04 11:11:57 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-11ee0c89-88e4-4f9d-8baf-2650e57e306c tempest-ProjectMemberTests-186486462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-ba32bb13-ed5b-4f7e-b0a6-674bda9bca84 1073741824" returned: 0 in 0.413s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:11:57 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-11ee0c89-88e4-4f9d-8baf-2650e57e306c tempest-ProjectMemberTests-186486462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-ba32bb13-ed5b-4f7e-b0a6-674bda9bca84 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:11:57 devstack sudo[108120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-ba32bb13-ed5b-4f7e-b0a6-674bda9bca84 Nov 04 11:11:57 devstack sudo[108120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:11:57 devstack sudo[108120]: pam_unix(sudo:session): session closed for user root Nov 04 11:11:57 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-11ee0c89-88e4-4f9d-8baf-2650e57e306c tempest-ProjectMemberTests-186486462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-ba32bb13-ed5b-4f7e-b0a6-674bda9bca84" returned: 0 in 0.250s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:11:57 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-11ee0c89-88e4-4f9d-8baf-2650e57e306c tempest-ProjectMemberTests-186486462 None] <== create_volume: return (719ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'} {{(pid=87272) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 04 11:11:57 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-11ee0c89-88e4-4f9d-8baf-2650e57e306c tempest-ProjectMemberTests-186486462 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.722s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 11:11:57 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-11ee0c89-88e4-4f9d-8baf-2650e57e306c tempest-ProjectMemberTests-186486462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (86464d4d-8b3e-4bd6-822b-0e261852c2b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ba32bb13-ed5b-4f7e-b0a6-674bda9bca84', 'volume_size': 1}' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:11:57 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-11ee0c89-88e4-4f9d-8baf-2650e57e306c tempest-ProjectMemberTests-186486462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e793a0b9-5404-4984-baeb-c256af915bc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:11:57 devstack cinder-volume[87272]: INFO cinder.volume.flows.manager.create_volume [None req-11ee0c89-88e4-4f9d-8baf-2650e57e306c tempest-ProjectMemberTests-186486462 None] Volume volume-ba32bb13-ed5b-4f7e-b0a6-674bda9bca84 (ba32bb13-ed5b-4f7e-b0a6-674bda9bca84): created successfully Nov 04 11:11:57 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-11ee0c89-88e4-4f9d-8baf-2650e57e306c tempest-ProjectMemberTests-186486462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e793a0b9-5404-4984-baeb-c256af915bc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:11:57 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-11ee0c89-88e4-4f9d-8baf-2650e57e306c tempest-ProjectMemberTests-186486462 None] Flow 'volume_create_manager' (2279cabb-06f5-4a30-a7b3-4e15b6725fbd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87272) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 11:11:57 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-11ee0c89-88e4-4f9d-8baf-2650e57e306c tempest-ProjectMemberTests-186486462 None] Created volume successfully. Nov 04 11:11:57 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-1fc3bea6-d93e-4564-a09a-3d8c4eb3d64e tempest-ProjectMemberTests-186486462 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 11:11:57 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-1fc3bea6-d93e-4564-a09a-3d8c4eb3d64e tempest-ProjectMemberTests-186486462 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 11:11:57 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.remotefs [None req-1fc3bea6-d93e-4564-a09a-3d8c4eb3d64e tempest-ProjectMemberTests-186486462 None] Creating offline snapshot 89b9ab20-c819-48b4-a625-2fff4a4e2597 of volume ba32bb13-ed5b-4f7e-b0a6-674bda9bca84 {{(pid=87272) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 04 11:11:57 devstack cinder-volume[87272]: DEBUG oslo.privsep.daemon [-] privsep: reply[193a48f2-4101-48df-8b4d-1af29b93d031]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 11:11:57 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-1fc3bea6-d93e-4564-a09a-3d8c4eb3d64e tempest-ProjectMemberTests-186486462 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-ba32bb13-ed5b-4f7e-b0a6-674bda9bca84 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:11:58 devstack sudo[108123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-ba32bb13-ed5b-4f7e-b0a6-674bda9bca84 Nov 04 11:11:58 devstack sudo[108123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:11:58 devstack sudo[108123]: pam_unix(sudo:session): session closed for user root Nov 04 11:11:58 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-1fc3bea6-d93e-4564-a09a-3d8c4eb3d64e tempest-ProjectMemberTests-186486462 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-ba32bb13-ed5b-4f7e-b0a6-674bda9bca84" returned: 0 in 0.358s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:11:58 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-1fc3bea6-d93e-4564-a09a-3d8c4eb3d64e tempest-ProjectMemberTests-186486462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-ba32bb13-ed5b-4f7e-b0a6-674bda9bca84,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-ba32bb13-ed5b-4f7e-b0a6-674bda9bca84.89b9ab20-c819-48b4-a625-2fff4a4e2597 1G {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:11:58 devstack sudo[108128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-ba32bb13-ed5b-4f7e-b0a6-674bda9bca84,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-ba32bb13-ed5b-4f7e-b0a6-674bda9bca84.89b9ab20-c819-48b4-a625-2fff4a4e2597 1G Nov 04 11:11:58 devstack sudo[108128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:11:58 devstack sudo[108128]: pam_unix(sudo:session): session closed for user root Nov 04 11:11:58 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-1fc3bea6-d93e-4564-a09a-3d8c4eb3d64e tempest-ProjectMemberTests-186486462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-ba32bb13-ed5b-4f7e-b0a6-674bda9bca84,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-ba32bb13-ed5b-4f7e-b0a6-674bda9bca84.89b9ab20-c819-48b4-a625-2fff4a4e2597 1G" returned: 0 in 0.381s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:11:58 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-1fc3bea6-d93e-4564-a09a-3d8c4eb3d64e tempest-ProjectMemberTests-186486462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ba32bb13-ed5b-4f7e-b0a6-674bda9bca84 -F qcow2 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-ba32bb13-ed5b-4f7e-b0a6-674bda9bca84.89b9ab20-c819-48b4-a625-2fff4a4e2597 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:11:58 devstack sudo[108133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ba32bb13-ed5b-4f7e-b0a6-674bda9bca84 -F qcow2 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-ba32bb13-ed5b-4f7e-b0a6-674bda9bca84.89b9ab20-c819-48b4-a625-2fff4a4e2597 Nov 04 11:11:58 devstack sudo[108133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:11:58 devstack sudo[108133]: pam_unix(sudo:session): session closed for user root Nov 04 11:11:58 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-1fc3bea6-d93e-4564-a09a-3d8c4eb3d64e tempest-ProjectMemberTests-186486462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ba32bb13-ed5b-4f7e-b0a6-674bda9bca84 -F qcow2 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-ba32bb13-ed5b-4f7e-b0a6-674bda9bca84.89b9ab20-c819-48b4-a625-2fff4a4e2597" returned: 0 in 0.287s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:11:58 devstack cinder-volume[87272]: WARNING cinder.volume.drivers.remotefs [None req-1fc3bea6-d93e-4564-a09a-3d8c4eb3d64e tempest-ProjectMemberTests-186486462 None] /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-ba32bb13-ed5b-4f7e-b0a6-674bda9bca84.89b9ab20-c819-48b4-a625-2fff4a4e2597 is being set with open permissions: ugo+rw Nov 04 11:11:58 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-1fc3bea6-d93e-4564-a09a-3d8c4eb3d64e tempest-ProjectMemberTests-186486462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-ba32bb13-ed5b-4f7e-b0a6-674bda9bca84.89b9ab20-c819-48b4-a625-2fff4a4e2597 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:11:58 devstack sudo[108138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-ba32bb13-ed5b-4f7e-b0a6-674bda9bca84.89b9ab20-c819-48b4-a625-2fff4a4e2597 Nov 04 11:11:58 devstack sudo[108138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:11:59 devstack sudo[108138]: pam_unix(sudo:session): session closed for user root Nov 04 11:11:59 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-1fc3bea6-d93e-4564-a09a-3d8c4eb3d64e tempest-ProjectMemberTests-186486462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-ba32bb13-ed5b-4f7e-b0a6-674bda9bca84.89b9ab20-c819-48b4-a625-2fff4a4e2597" returned: 0 in 0.231s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:11:59 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-1fc3bea6-d93e-4564-a09a-3d8c4eb3d64e tempest-ProjectMemberTests-186486462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-ba32bb13-ed5b-4f7e-b0a6-674bda9bca84.info {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:11:59 devstack sudo[108141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-ba32bb13-ed5b-4f7e-b0a6-674bda9bca84.info Nov 04 11:11:59 devstack sudo[108141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:11:59 devstack sudo[108141]: pam_unix(sudo:session): session closed for user root Nov 04 11:11:59 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-1fc3bea6-d93e-4564-a09a-3d8c4eb3d64e tempest-ProjectMemberTests-186486462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-ba32bb13-ed5b-4f7e-b0a6-674bda9bca84.info" returned: 0 in 0.252s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:11:59 devstack cinder-volume[87272]: WARNING cinder.volume.drivers.remotefs [None req-1fc3bea6-d93e-4564-a09a-3d8c4eb3d64e tempest-ProjectMemberTests-186486462 None] /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-ba32bb13-ed5b-4f7e-b0a6-674bda9bca84.info is being set with open permissions: ugo+rw Nov 04 11:11:59 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-1fc3bea6-d93e-4564-a09a-3d8c4eb3d64e tempest-ProjectMemberTests-186486462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-ba32bb13-ed5b-4f7e-b0a6-674bda9bca84.info {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:11:59 devstack sudo[108144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-ba32bb13-ed5b-4f7e-b0a6-674bda9bca84.info Nov 04 11:11:59 devstack sudo[108144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:11:59 devstack sudo[108144]: pam_unix(sudo:session): session closed for user root Nov 04 11:11:59 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-1fc3bea6-d93e-4564-a09a-3d8c4eb3d64e tempest-ProjectMemberTests-186486462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-ba32bb13-ed5b-4f7e-b0a6-674bda9bca84.info" returned: 0 in 0.235s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:11:59 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-1fc3bea6-d93e-4564-a09a-3d8c4eb3d64e tempest-ProjectMemberTests-186486462 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.828s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 11:11:59 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-1fc3bea6-d93e-4564-a09a-3d8c4eb3d64e tempest-ProjectMemberTests-186486462 None] Create snapshot completed successfully Nov 04 11:12:00 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-e8665437-7cfd-4a83-9d16-8f7c26237828 tempest-ProjectMemberTests-186486462 None] Acquiring lock "cinder-89b9ab20-c819-48b4-a625-2fff4a4e2597-delete_snapshot" by "delete_snapshot" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 11:12:00 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-e8665437-7cfd-4a83-9d16-8f7c26237828 tempest-ProjectMemberTests-186486462 None] Lock "cinder-89b9ab20-c819-48b4-a625-2fff4a4e2597-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 11:12:00 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-e8665437-7cfd-4a83-9d16-8f7c26237828 tempest-ProjectMemberTests-186486462 None] Acquiring lock "cinder-quobyte-ba32bb13-ed5b-4f7e-b0a6-674bda9bca84" by "delete_snapshot" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 11:12:00 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-e8665437-7cfd-4a83-9d16-8f7c26237828 tempest-ProjectMemberTests-186486462 None] Lock "cinder-quobyte-ba32bb13-ed5b-4f7e-b0a6-674bda9bca84" acquired by "delete_snapshot" :: waited 0.014s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 11:12:00 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-e8665437-7cfd-4a83-9d16-8f7c26237828 tempest-ProjectMemberTests-186486462 None] Acquiring lock "cinder-quobyte-89b9ab20-c819-48b4-a625-2fff4a4e2597" by "_delete_snapshot" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 11:12:00 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-e8665437-7cfd-4a83-9d16-8f7c26237828 tempest-ProjectMemberTests-186486462 None] Lock "cinder-quobyte-89b9ab20-c819-48b4-a625-2fff4a4e2597" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 11:12:00 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.remotefs [None req-e8665437-7cfd-4a83-9d16-8f7c26237828 tempest-ProjectMemberTests-186486462 None] Deleting offline snapshot 89b9ab20-c819-48b4-a625-2fff4a4e2597 of volume ba32bb13-ed5b-4f7e-b0a6-674bda9bca84 {{(pid=87272) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 04 11:12:00 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.remotefs [None req-e8665437-7cfd-4a83-9d16-8f7c26237828 tempest-ProjectMemberTests-186486462 None] snapshot_file for this snap is: volume-ba32bb13-ed5b-4f7e-b0a6-674bda9bca84.89b9ab20-c819-48b4-a625-2fff4a4e2597 {{(pid=87272) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 04 11:12:00 devstack cinder-volume[87272]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7ceabe5-f3f4-40d8-a058-69a13a0002a7]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 11:12:00 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-e8665437-7cfd-4a83-9d16-8f7c26237828 tempest-ProjectMemberTests-186486462 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-ba32bb13-ed5b-4f7e-b0a6-674bda9bca84.89b9ab20-c819-48b4-a625-2fff4a4e2597 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:12:00 devstack sudo[108148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-ba32bb13-ed5b-4f7e-b0a6-674bda9bca84.89b9ab20-c819-48b4-a625-2fff4a4e2597 Nov 04 11:12:00 devstack sudo[108148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:12:00 devstack sudo[108148]: pam_unix(sudo:session): session closed for user root Nov 04 11:12:00 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-e8665437-7cfd-4a83-9d16-8f7c26237828 tempest-ProjectMemberTests-186486462 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-ba32bb13-ed5b-4f7e-b0a6-674bda9bca84.89b9ab20-c819-48b4-a625-2fff4a4e2597" returned: 0 in 0.348s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:12:00 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.remotefs [None req-e8665437-7cfd-4a83-9d16-8f7c26237828 tempest-ProjectMemberTests-186486462 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ba32bb13-ed5b-4f7e-b0a6-674bda9bca84(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87272) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 11:12:00 devstack cinder-volume[87272]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d9b7995-03c9-426e-bbbf-693e5f607683]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 11:12:00 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-e8665437-7cfd-4a83-9d16-8f7c26237828 tempest-ProjectMemberTests-186486462 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-ba32bb13-ed5b-4f7e-b0a6-674bda9bca84 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:12:00 devstack sudo[108153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-ba32bb13-ed5b-4f7e-b0a6-674bda9bca84 Nov 04 11:12:00 devstack sudo[108153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:12:00 devstack sudo[108153]: pam_unix(sudo:session): session closed for user root Nov 04 11:12:00 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-e8665437-7cfd-4a83-9d16-8f7c26237828 tempest-ProjectMemberTests-186486462 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-ba32bb13-ed5b-4f7e-b0a6-674bda9bca84" returned: 0 in 0.360s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:12:00 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-e8665437-7cfd-4a83-9d16-8f7c26237828 tempest-ProjectMemberTests-186486462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-ba32bb13-ed5b-4f7e-b0a6-674bda9bca84.89b9ab20-c819-48b4-a625-2fff4a4e2597 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:12:00 devstack sudo[108159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-ba32bb13-ed5b-4f7e-b0a6-674bda9bca84.89b9ab20-c819-48b4-a625-2fff4a4e2597 Nov 04 11:12:00 devstack sudo[108159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:12:01 devstack sudo[108159]: pam_unix(sudo:session): session closed for user root Nov 04 11:12:01 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-e8665437-7cfd-4a83-9d16-8f7c26237828 tempest-ProjectMemberTests-186486462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-ba32bb13-ed5b-4f7e-b0a6-674bda9bca84.89b9ab20-c819-48b4-a625-2fff4a4e2597" returned: 0 in 0.329s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:12:01 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-e8665437-7cfd-4a83-9d16-8f7c26237828 tempest-ProjectMemberTests-186486462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-ba32bb13-ed5b-4f7e-b0a6-674bda9bca84.89b9ab20-c819-48b4-a625-2fff4a4e2597 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:12:01 devstack sudo[108164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-ba32bb13-ed5b-4f7e-b0a6-674bda9bca84.89b9ab20-c819-48b4-a625-2fff4a4e2597 Nov 04 11:12:01 devstack sudo[108164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:12:01 devstack sudo[108164]: pam_unix(sudo:session): session closed for user root Nov 04 11:12:01 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-e8665437-7cfd-4a83-9d16-8f7c26237828 tempest-ProjectMemberTests-186486462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-ba32bb13-ed5b-4f7e-b0a6-674bda9bca84.89b9ab20-c819-48b4-a625-2fff4a4e2597" returned: 0 in 0.245s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:12:01 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-e8665437-7cfd-4a83-9d16-8f7c26237828 tempest-ProjectMemberTests-186486462 None] Lock "cinder-quobyte-89b9ab20-c819-48b4-a625-2fff4a4e2597" released by "_delete_snapshot" :: held 1.377s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 11:12:01 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-e8665437-7cfd-4a83-9d16-8f7c26237828 tempest-ProjectMemberTests-186486462 None] Lock "cinder-quobyte-ba32bb13-ed5b-4f7e-b0a6-674bda9bca84" released by "delete_snapshot" :: held 1.398s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 11:12:01 devstack cinder-volume[87272]: DEBUG cinder.quota [None req-e8665437-7cfd-4a83-9d16-8f7c26237828 tempest-ProjectMemberTests-186486462 None] Created reservations ['812494ea-d8c4-46df-a49b-e7301647ea07', 'b75698fb-ac0d-4358-a942-a5f737323549', '8fb87114-5b78-4953-a8b2-7c02b8dab43d', 'd2a2b094-a6b8-43bc-806e-49f251793eb0'] {{(pid=87272) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 11:12:01 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-e8665437-7cfd-4a83-9d16-8f7c26237828 tempest-ProjectMemberTests-186486462 None] Delete snapshot completed successfully. Nov 04 11:12:01 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-e8665437-7cfd-4a83-9d16-8f7c26237828 tempest-ProjectMemberTests-186486462 None] Lock "cinder-89b9ab20-c819-48b4-a625-2fff4a4e2597-delete_snapshot" released by "delete_snapshot" :: held 1.525s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 11:12:02 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-d3330cda-62d8-4ab3-ac35-a0d7340f4ad8 tempest-ProjectMemberTests-186486462 None] Acquiring lock "cinder-ba32bb13-ed5b-4f7e-b0a6-674bda9bca84-delete_volume" by "delete_volume" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 11:12:02 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-d3330cda-62d8-4ab3-ac35-a0d7340f4ad8 tempest-ProjectMemberTests-186486462 None] Lock "cinder-ba32bb13-ed5b-4f7e-b0a6-674bda9bca84-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 11:12:02 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-d3330cda-62d8-4ab3-ac35-a0d7340f4ad8 tempest-ProjectMemberTests-186486462 None] Acquiring lock "cinder-quobyte-ba32bb13-ed5b-4f7e-b0a6-674bda9bca84" by "delete_volume" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 11:12:02 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-d3330cda-62d8-4ab3-ac35-a0d7340f4ad8 tempest-ProjectMemberTests-186486462 None] Lock "cinder-quobyte-ba32bb13-ed5b-4f7e-b0a6-674bda9bca84" acquired by "delete_volume" :: waited 0.020s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 11:12:02 devstack cinder-volume[87272]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d319cfd-99ef-417f-b46b-1b65f5cec989]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 11:12:02 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-d3330cda-62d8-4ab3-ac35-a0d7340f4ad8 tempest-ProjectMemberTests-186486462 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-ba32bb13-ed5b-4f7e-b0a6-674bda9bca84 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:12:02 devstack sudo[108167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-ba32bb13-ed5b-4f7e-b0a6-674bda9bca84 Nov 04 11:12:02 devstack sudo[108167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:12:02 devstack sudo[108167]: pam_unix(sudo:session): session closed for user root Nov 04 11:12:02 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-d3330cda-62d8-4ab3-ac35-a0d7340f4ad8 tempest-ProjectMemberTests-186486462 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-ba32bb13-ed5b-4f7e-b0a6-674bda9bca84" returned: 0 in 0.351s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:12:02 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-d3330cda-62d8-4ab3-ac35-a0d7340f4ad8 tempest-ProjectMemberTests-186486462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-ba32bb13-ed5b-4f7e-b0a6-674bda9bca84 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:12:02 devstack sudo[108172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-ba32bb13-ed5b-4f7e-b0a6-674bda9bca84 Nov 04 11:12:02 devstack sudo[108172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:12:02 devstack sudo[108172]: pam_unix(sudo:session): session closed for user root Nov 04 11:12:02 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-d3330cda-62d8-4ab3-ac35-a0d7340f4ad8 tempest-ProjectMemberTests-186486462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-ba32bb13-ed5b-4f7e-b0a6-674bda9bca84" returned: 0 in 0.243s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:12:02 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-d3330cda-62d8-4ab3-ac35-a0d7340f4ad8 tempest-ProjectMemberTests-186486462 None] Lock "cinder-quobyte-ba32bb13-ed5b-4f7e-b0a6-674bda9bca84" released by "delete_volume" :: held 0.657s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 11:12:03 devstack cinder-volume[87272]: DEBUG cinder.quota [None req-d3330cda-62d8-4ab3-ac35-a0d7340f4ad8 tempest-ProjectMemberTests-186486462 None] Created reservations ['09a6782e-f987-475e-86a4-cad6da6dcbd8', '899181ac-bdf9-4c2d-b186-16c8ec2559a0', 'e343097e-ca60-4986-ab86-143eab2a2aba', '08f18457-d7f9-462c-bfda-7dab09f0b5bc'] {{(pid=87272) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 11:12:03 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-d3330cda-62d8-4ab3-ac35-a0d7340f4ad8 tempest-ProjectMemberTests-186486462 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 11:12:03 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-d3330cda-62d8-4ab3-ac35-a0d7340f4ad8 tempest-ProjectMemberTests-186486462 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 11:12:03 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-d3330cda-62d8-4ab3-ac35-a0d7340f4ad8 tempest-ProjectMemberTests-186486462 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898': None} {{(pid=87272) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 11:12:03 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-d3330cda-62d8-4ab3-ac35-a0d7340f4ad8 tempest-ProjectMemberTests-186486462 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'] {{(pid=87272) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 11:12:03 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-d3330cda-62d8-4ab3-ac35-a0d7340f4ad8 tempest-ProjectMemberTests-186486462 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 11:12:03 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-d3330cda-62d8-4ab3-ac35-a0d7340f4ad8 tempest-ProjectMemberTests-186486462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:12:03 devstack sudo[108175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1 Nov 04 11:12:03 devstack sudo[108175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:12:03 devstack sudo[108175]: pam_unix(sudo:session): session closed for user root Nov 04 11:12:03 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-d3330cda-62d8-4ab3-ac35-a0d7340f4ad8 tempest-ProjectMemberTests-186486462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1" returned: 0 in 0.242s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:12:03 devstack cinder-volume[87272]: DEBUG cinder.manager [None req-d3330cda-62d8-4ab3-ac35-a0d7340f4ad8 tempest-ProjectMemberTests-186486462 None] Notifying Schedulers of capabilities ... {{(pid=87272) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 11:12:03 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-d3330cda-62d8-4ab3-ac35-a0d7340f4ad8 tempest-ProjectMemberTests-186486462 None] Deleted volume successfully. Nov 04 11:12:03 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-d3330cda-62d8-4ab3-ac35-a0d7340f4ad8 tempest-ProjectMemberTests-186486462 None] Lock "cinder-ba32bb13-ed5b-4f7e-b0a6-674bda9bca84-delete_volume" released by "delete_volume" :: held 1.122s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 11:12:06 devstack cinder-volume[87272]: DEBUG cinder.volume.flows.manager.create_volume [None req-b1910e1b-5527-4722-89d8-55d6cdfddfd1 tempest-ProjectReaderTests-542466594 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87272) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 11:12:06 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-b1910e1b-5527-4722-89d8-55d6cdfddfd1 tempest-ProjectReaderTests-542466594 None] Flow 'volume_create_manager' (ee1a783f-8c3c-4321-96f4-1daff4dfd074) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 11:12:06 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-b1910e1b-5527-4722-89d8-55d6cdfddfd1 tempest-ProjectReaderTests-542466594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c67dea1-e97a-4687-8503-e46e20ae5bfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:12:06 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-b1910e1b-5527-4722-89d8-55d6cdfddfd1 tempest-ProjectReaderTests-542466594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c67dea1-e97a-4687-8503-e46e20ae5bfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T10:12:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-177747536',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=81027597-cdc4-46ee-b6fd-3b7794b3e0d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a12254d8bdd2413b82690e2b65f023f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T10:12:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T10:12:07Z,use_quota=True,user_id='4a028e18f6344ebc9f927f7c76a6c4bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8989e4f-21e3-4f0a-9584-0d818784e883),volume_type_id=f8989e4f-21e3-4f0a-9584-0d818784e883)' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:12:06 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-b1910e1b-5527-4722-89d8-55d6cdfddfd1 tempest-ProjectReaderTests-542466594 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12c3f6f3-3a92-4531-b40e-218d4aaad7ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:12:06 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-b1910e1b-5527-4722-89d8-55d6cdfddfd1 tempest-ProjectReaderTests-542466594 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12c3f6f3-3a92-4531-b40e-218d4aaad7ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:12:06 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-b1910e1b-5527-4722-89d8-55d6cdfddfd1 tempest-ProjectReaderTests-542466594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (003d70b3-3e83-4a0d-8f48-51cd7417bec2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:12:06 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-b1910e1b-5527-4722-89d8-55d6cdfddfd1 tempest-ProjectReaderTests-542466594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (003d70b3-3e83-4a0d-8f48-51cd7417bec2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '81027597-cdc4-46ee-b6fd-3b7794b3e0d7', 'volume_name': 'volume-81027597-cdc4-46ee-b6fd-3b7794b3e0d7', 'volume_size': 1}' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:12:06 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-b1910e1b-5527-4722-89d8-55d6cdfddfd1 tempest-ProjectReaderTests-542466594 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51617195-8add-49dd-b50e-46cadd088f2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:12:06 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-b1910e1b-5527-4722-89d8-55d6cdfddfd1 tempest-ProjectReaderTests-542466594 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51617195-8add-49dd-b50e-46cadd088f2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:12:06 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-b1910e1b-5527-4722-89d8-55d6cdfddfd1 tempest-ProjectReaderTests-542466594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e0d4b20-3ab9-467e-a92d-3ac1f25748c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:12:06 devstack cinder-volume[87272]: INFO cinder.volume.flows.manager.create_volume [None req-b1910e1b-5527-4722-89d8-55d6cdfddfd1 tempest-ProjectReaderTests-542466594 None] Volume 81027597-cdc4-46ee-b6fd-3b7794b3e0d7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-81027597-cdc4-46ee-b6fd-3b7794b3e0d7', 'volume_size': 1} Nov 04 11:12:06 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-b1910e1b-5527-4722-89d8-55d6cdfddfd1 tempest-ProjectReaderTests-542466594 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 11:12:06 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-b1910e1b-5527-4722-89d8-55d6cdfddfd1 tempest-ProjectReaderTests-542466594 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 11:12:06 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-b1910e1b-5527-4722-89d8-55d6cdfddfd1 tempest-ProjectReaderTests-542466594 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T10:12:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-177747536',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=81027597-cdc4-46ee-b6fd-3b7794b3e0d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a12254d8bdd2413b82690e2b65f023f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T10:12:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T10:12:07Z,use_quota=True,user_id='4a028e18f6344ebc9f927f7c76a6c4bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8989e4f-21e3-4f0a-9584-0d818784e883),volume_type_id=f8989e4f-21e3-4f0a-9584-0d818784e883)}" {{(pid=87272) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 04 11:12:06 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.remotefs [None req-b1910e1b-5527-4722-89d8-55d6cdfddfd1 tempest-ProjectReaderTests-542466594 None] Creating volume 81027597-cdc4-46ee-b6fd-3b7794b3e0d7 {{(pid=87272) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 11:12:06 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-b1910e1b-5527-4722-89d8-55d6cdfddfd1 tempest-ProjectReaderTests-542466594 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 11:12:06 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-b1910e1b-5527-4722-89d8-55d6cdfddfd1 tempest-ProjectReaderTests-542466594 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 11:12:06 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-b1910e1b-5527-4722-89d8-55d6cdfddfd1 tempest-ProjectReaderTests-542466594 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898': None} {{(pid=87272) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 11:12:06 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-b1910e1b-5527-4722-89d8-55d6cdfddfd1 tempest-ProjectReaderTests-542466594 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'] {{(pid=87272) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 11:12:06 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-b1910e1b-5527-4722-89d8-55d6cdfddfd1 tempest-ProjectReaderTests-542466594 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 11:12:06 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-b1910e1b-5527-4722-89d8-55d6cdfddfd1 tempest-ProjectReaderTests-542466594 None] Selected osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898 as target Quobyte volume. {{(pid=87272) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 11:12:06 devstack cinder-volume[87272]: INFO cinder.volume.drivers.remotefs [None req-b1910e1b-5527-4722-89d8-55d6cdfddfd1 tempest-ProjectReaderTests-542466594 None] casted to osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898 Nov 04 11:12:06 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-b1910e1b-5527-4722-89d8-55d6cdfddfd1 tempest-ProjectReaderTests-542466594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-81027597-cdc4-46ee-b6fd-3b7794b3e0d7 1073741824 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:12:06 devstack sudo[108179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-81027597-cdc4-46ee-b6fd-3b7794b3e0d7 1073741824 Nov 04 11:12:06 devstack sudo[108179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:12:07 devstack sudo[108179]: pam_unix(sudo:session): session closed for user root Nov 04 11:12:07 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-b1910e1b-5527-4722-89d8-55d6cdfddfd1 tempest-ProjectReaderTests-542466594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-81027597-cdc4-46ee-b6fd-3b7794b3e0d7 1073741824" returned: 0 in 0.399s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:12:07 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-b1910e1b-5527-4722-89d8-55d6cdfddfd1 tempest-ProjectReaderTests-542466594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-81027597-cdc4-46ee-b6fd-3b7794b3e0d7 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:12:07 devstack sudo[108184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-81027597-cdc4-46ee-b6fd-3b7794b3e0d7 Nov 04 11:12:07 devstack sudo[108184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:12:07 devstack sudo[108184]: pam_unix(sudo:session): session closed for user root Nov 04 11:12:07 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-b1910e1b-5527-4722-89d8-55d6cdfddfd1 tempest-ProjectReaderTests-542466594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-81027597-cdc4-46ee-b6fd-3b7794b3e0d7" returned: 0 in 0.231s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:12:07 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-b1910e1b-5527-4722-89d8-55d6cdfddfd1 tempest-ProjectReaderTests-542466594 None] <== create_volume: return (670ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'} {{(pid=87272) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 04 11:12:07 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-b1910e1b-5527-4722-89d8-55d6cdfddfd1 tempest-ProjectReaderTests-542466594 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.673s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 11:12:07 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-b1910e1b-5527-4722-89d8-55d6cdfddfd1 tempest-ProjectReaderTests-542466594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e0d4b20-3ab9-467e-a92d-3ac1f25748c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-81027597-cdc4-46ee-b6fd-3b7794b3e0d7', 'volume_size': 1}' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:12:07 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-b1910e1b-5527-4722-89d8-55d6cdfddfd1 tempest-ProjectReaderTests-542466594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48024aed-dfb6-4aaf-a7de-1ed1b7b27f1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:12:07 devstack cinder-volume[87272]: INFO cinder.volume.flows.manager.create_volume [None req-b1910e1b-5527-4722-89d8-55d6cdfddfd1 tempest-ProjectReaderTests-542466594 None] Volume volume-81027597-cdc4-46ee-b6fd-3b7794b3e0d7 (81027597-cdc4-46ee-b6fd-3b7794b3e0d7): created successfully Nov 04 11:12:07 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-b1910e1b-5527-4722-89d8-55d6cdfddfd1 tempest-ProjectReaderTests-542466594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48024aed-dfb6-4aaf-a7de-1ed1b7b27f1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:12:07 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-b1910e1b-5527-4722-89d8-55d6cdfddfd1 tempest-ProjectReaderTests-542466594 None] Flow 'volume_create_manager' (ee1a783f-8c3c-4321-96f4-1daff4dfd074) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87272) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 11:12:07 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-b1910e1b-5527-4722-89d8-55d6cdfddfd1 tempest-ProjectReaderTests-542466594 None] Created volume successfully. Nov 04 11:12:07 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-4c1d6fa8-007e-422f-9428-e4e9572ae35c tempest-ProjectReaderTests-542466594 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 11:12:07 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-4c1d6fa8-007e-422f-9428-e4e9572ae35c tempest-ProjectReaderTests-542466594 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 11:12:07 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.remotefs [None req-4c1d6fa8-007e-422f-9428-e4e9572ae35c tempest-ProjectReaderTests-542466594 None] Creating offline snapshot 748e9187-92b9-487d-bccf-a2a280701234 of volume 81027597-cdc4-46ee-b6fd-3b7794b3e0d7 {{(pid=87272) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 04 11:12:07 devstack cinder-volume[87272]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d53c5f1-889f-452f-bfaa-8eb9aa9a16f3]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 11:12:07 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-4c1d6fa8-007e-422f-9428-e4e9572ae35c tempest-ProjectReaderTests-542466594 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-81027597-cdc4-46ee-b6fd-3b7794b3e0d7 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:12:08 devstack sudo[108187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-81027597-cdc4-46ee-b6fd-3b7794b3e0d7 Nov 04 11:12:08 devstack sudo[108187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:12:08 devstack sudo[108187]: pam_unix(sudo:session): session closed for user root Nov 04 11:12:08 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-4c1d6fa8-007e-422f-9428-e4e9572ae35c tempest-ProjectReaderTests-542466594 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-81027597-cdc4-46ee-b6fd-3b7794b3e0d7" returned: 0 in 0.355s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:12:08 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-4c1d6fa8-007e-422f-9428-e4e9572ae35c tempest-ProjectReaderTests-542466594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-81027597-cdc4-46ee-b6fd-3b7794b3e0d7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-81027597-cdc4-46ee-b6fd-3b7794b3e0d7.748e9187-92b9-487d-bccf-a2a280701234 1G {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:12:08 devstack sudo[108192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-81027597-cdc4-46ee-b6fd-3b7794b3e0d7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-81027597-cdc4-46ee-b6fd-3b7794b3e0d7.748e9187-92b9-487d-bccf-a2a280701234 1G Nov 04 11:12:08 devstack sudo[108192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:12:08 devstack sudo[108192]: pam_unix(sudo:session): session closed for user root Nov 04 11:12:08 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-4c1d6fa8-007e-422f-9428-e4e9572ae35c tempest-ProjectReaderTests-542466594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-81027597-cdc4-46ee-b6fd-3b7794b3e0d7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-81027597-cdc4-46ee-b6fd-3b7794b3e0d7.748e9187-92b9-487d-bccf-a2a280701234 1G" returned: 0 in 0.380s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:12:08 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-4c1d6fa8-007e-422f-9428-e4e9572ae35c tempest-ProjectReaderTests-542466594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-81027597-cdc4-46ee-b6fd-3b7794b3e0d7 -F qcow2 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-81027597-cdc4-46ee-b6fd-3b7794b3e0d7.748e9187-92b9-487d-bccf-a2a280701234 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:12:08 devstack sudo[108197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-81027597-cdc4-46ee-b6fd-3b7794b3e0d7 -F qcow2 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-81027597-cdc4-46ee-b6fd-3b7794b3e0d7.748e9187-92b9-487d-bccf-a2a280701234 Nov 04 11:12:08 devstack sudo[108197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:12:09 devstack sudo[108197]: pam_unix(sudo:session): session closed for user root Nov 04 11:12:09 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-4c1d6fa8-007e-422f-9428-e4e9572ae35c tempest-ProjectReaderTests-542466594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-81027597-cdc4-46ee-b6fd-3b7794b3e0d7 -F qcow2 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-81027597-cdc4-46ee-b6fd-3b7794b3e0d7.748e9187-92b9-487d-bccf-a2a280701234" returned: 0 in 0.289s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:12:09 devstack cinder-volume[87272]: WARNING cinder.volume.drivers.remotefs [None req-4c1d6fa8-007e-422f-9428-e4e9572ae35c tempest-ProjectReaderTests-542466594 None] /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-81027597-cdc4-46ee-b6fd-3b7794b3e0d7.748e9187-92b9-487d-bccf-a2a280701234 is being set with open permissions: ugo+rw Nov 04 11:12:09 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-4c1d6fa8-007e-422f-9428-e4e9572ae35c tempest-ProjectReaderTests-542466594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-81027597-cdc4-46ee-b6fd-3b7794b3e0d7.748e9187-92b9-487d-bccf-a2a280701234 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:12:09 devstack sudo[108203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-81027597-cdc4-46ee-b6fd-3b7794b3e0d7.748e9187-92b9-487d-bccf-a2a280701234 Nov 04 11:12:09 devstack sudo[108203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:12:09 devstack sudo[108203]: pam_unix(sudo:session): session closed for user root Nov 04 11:12:09 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-4c1d6fa8-007e-422f-9428-e4e9572ae35c tempest-ProjectReaderTests-542466594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-81027597-cdc4-46ee-b6fd-3b7794b3e0d7.748e9187-92b9-487d-bccf-a2a280701234" returned: 0 in 0.241s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:12:09 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-4c1d6fa8-007e-422f-9428-e4e9572ae35c tempest-ProjectReaderTests-542466594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-81027597-cdc4-46ee-b6fd-3b7794b3e0d7.info {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:12:09 devstack sudo[108206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-81027597-cdc4-46ee-b6fd-3b7794b3e0d7.info Nov 04 11:12:09 devstack sudo[108206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:12:09 devstack sudo[108206]: pam_unix(sudo:session): session closed for user root Nov 04 11:12:09 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-4c1d6fa8-007e-422f-9428-e4e9572ae35c tempest-ProjectReaderTests-542466594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-81027597-cdc4-46ee-b6fd-3b7794b3e0d7.info" returned: 0 in 0.243s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:12:09 devstack cinder-volume[87272]: WARNING cinder.volume.drivers.remotefs [None req-4c1d6fa8-007e-422f-9428-e4e9572ae35c tempest-ProjectReaderTests-542466594 None] /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-81027597-cdc4-46ee-b6fd-3b7794b3e0d7.info is being set with open permissions: ugo+rw Nov 04 11:12:09 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-4c1d6fa8-007e-422f-9428-e4e9572ae35c tempest-ProjectReaderTests-542466594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-81027597-cdc4-46ee-b6fd-3b7794b3e0d7.info {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:12:09 devstack sudo[108209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-81027597-cdc4-46ee-b6fd-3b7794b3e0d7.info Nov 04 11:12:09 devstack sudo[108209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:12:09 devstack sudo[108209]: pam_unix(sudo:session): session closed for user root Nov 04 11:12:09 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-4c1d6fa8-007e-422f-9428-e4e9572ae35c tempest-ProjectReaderTests-542466594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-81027597-cdc4-46ee-b6fd-3b7794b3e0d7.info" returned: 0 in 0.227s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:12:09 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-4c1d6fa8-007e-422f-9428-e4e9572ae35c tempest-ProjectReaderTests-542466594 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.814s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 11:12:09 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-4c1d6fa8-007e-422f-9428-e4e9572ae35c tempest-ProjectReaderTests-542466594 None] Create snapshot completed successfully Nov 04 11:12:10 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-b37992a9-133d-40e0-b963-febc1c2f71c3 tempest-ProjectReaderTests-542466594 None] Acquiring lock "cinder-748e9187-92b9-487d-bccf-a2a280701234-delete_snapshot" by "delete_snapshot" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 11:12:10 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-b37992a9-133d-40e0-b963-febc1c2f71c3 tempest-ProjectReaderTests-542466594 None] Lock "cinder-748e9187-92b9-487d-bccf-a2a280701234-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 11:12:10 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-b37992a9-133d-40e0-b963-febc1c2f71c3 tempest-ProjectReaderTests-542466594 None] Acquiring lock "cinder-quobyte-81027597-cdc4-46ee-b6fd-3b7794b3e0d7" by "delete_snapshot" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 11:12:10 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-b37992a9-133d-40e0-b963-febc1c2f71c3 tempest-ProjectReaderTests-542466594 None] Lock "cinder-quobyte-81027597-cdc4-46ee-b6fd-3b7794b3e0d7" acquired by "delete_snapshot" :: waited 0.013s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 11:12:10 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-b37992a9-133d-40e0-b963-febc1c2f71c3 tempest-ProjectReaderTests-542466594 None] Acquiring lock "cinder-quobyte-748e9187-92b9-487d-bccf-a2a280701234" by "_delete_snapshot" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 11:12:10 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-b37992a9-133d-40e0-b963-febc1c2f71c3 tempest-ProjectReaderTests-542466594 None] Lock "cinder-quobyte-748e9187-92b9-487d-bccf-a2a280701234" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 11:12:10 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.remotefs [None req-b37992a9-133d-40e0-b963-febc1c2f71c3 tempest-ProjectReaderTests-542466594 None] Deleting offline snapshot 748e9187-92b9-487d-bccf-a2a280701234 of volume 81027597-cdc4-46ee-b6fd-3b7794b3e0d7 {{(pid=87272) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 04 11:12:10 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.remotefs [None req-b37992a9-133d-40e0-b963-febc1c2f71c3 tempest-ProjectReaderTests-542466594 None] snapshot_file for this snap is: volume-81027597-cdc4-46ee-b6fd-3b7794b3e0d7.748e9187-92b9-487d-bccf-a2a280701234 {{(pid=87272) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 04 11:12:10 devstack cinder-volume[87272]: DEBUG oslo.privsep.daemon [-] privsep: reply[582e1c2c-c28d-4fe3-af06-b3f3848b6da4]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 11:12:10 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-b37992a9-133d-40e0-b963-febc1c2f71c3 tempest-ProjectReaderTests-542466594 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-81027597-cdc4-46ee-b6fd-3b7794b3e0d7.748e9187-92b9-487d-bccf-a2a280701234 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:12:10 devstack sudo[108212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-81027597-cdc4-46ee-b6fd-3b7794b3e0d7.748e9187-92b9-487d-bccf-a2a280701234 Nov 04 11:12:10 devstack sudo[108212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:12:10 devstack sudo[108212]: pam_unix(sudo:session): session closed for user root Nov 04 11:12:10 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-b37992a9-133d-40e0-b963-febc1c2f71c3 tempest-ProjectReaderTests-542466594 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-81027597-cdc4-46ee-b6fd-3b7794b3e0d7.748e9187-92b9-487d-bccf-a2a280701234" returned: 0 in 0.347s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:12:10 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.remotefs [None req-b37992a9-133d-40e0-b963-febc1c2f71c3 tempest-ProjectReaderTests-542466594 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-81027597-cdc4-46ee-b6fd-3b7794b3e0d7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87272) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 11:12:10 devstack cinder-volume[87272]: DEBUG oslo.privsep.daemon [-] privsep: reply[29544195-5777-4120-92af-dcfaf2d25e17]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 11:12:10 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-b37992a9-133d-40e0-b963-febc1c2f71c3 tempest-ProjectReaderTests-542466594 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-81027597-cdc4-46ee-b6fd-3b7794b3e0d7 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:12:10 devstack sudo[108217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-81027597-cdc4-46ee-b6fd-3b7794b3e0d7 Nov 04 11:12:10 devstack sudo[108217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:12:10 devstack sudo[108217]: pam_unix(sudo:session): session closed for user root Nov 04 11:12:10 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-b37992a9-133d-40e0-b963-febc1c2f71c3 tempest-ProjectReaderTests-542466594 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-81027597-cdc4-46ee-b6fd-3b7794b3e0d7" returned: 0 in 0.354s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:12:10 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-b37992a9-133d-40e0-b963-febc1c2f71c3 tempest-ProjectReaderTests-542466594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-81027597-cdc4-46ee-b6fd-3b7794b3e0d7.748e9187-92b9-487d-bccf-a2a280701234 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:12:11 devstack sudo[108222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-81027597-cdc4-46ee-b6fd-3b7794b3e0d7.748e9187-92b9-487d-bccf-a2a280701234 Nov 04 11:12:11 devstack sudo[108222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:12:11 devstack sudo[108222]: pam_unix(sudo:session): session closed for user root Nov 04 11:12:11 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-b37992a9-133d-40e0-b963-febc1c2f71c3 tempest-ProjectReaderTests-542466594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-81027597-cdc4-46ee-b6fd-3b7794b3e0d7.748e9187-92b9-487d-bccf-a2a280701234" returned: 0 in 0.319s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:12:11 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-b37992a9-133d-40e0-b963-febc1c2f71c3 tempest-ProjectReaderTests-542466594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-81027597-cdc4-46ee-b6fd-3b7794b3e0d7.748e9187-92b9-487d-bccf-a2a280701234 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:12:11 devstack sudo[108228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-81027597-cdc4-46ee-b6fd-3b7794b3e0d7.748e9187-92b9-487d-bccf-a2a280701234 Nov 04 11:12:11 devstack sudo[108228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:12:11 devstack sudo[108228]: pam_unix(sudo:session): session closed for user root Nov 04 11:12:11 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-b37992a9-133d-40e0-b963-febc1c2f71c3 tempest-ProjectReaderTests-542466594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-81027597-cdc4-46ee-b6fd-3b7794b3e0d7.748e9187-92b9-487d-bccf-a2a280701234" returned: 0 in 0.245s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:12:11 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-b37992a9-133d-40e0-b963-febc1c2f71c3 tempest-ProjectReaderTests-542466594 None] Lock "cinder-quobyte-748e9187-92b9-487d-bccf-a2a280701234" released by "_delete_snapshot" :: held 1.364s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 11:12:11 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-b37992a9-133d-40e0-b963-febc1c2f71c3 tempest-ProjectReaderTests-542466594 None] Lock "cinder-quobyte-81027597-cdc4-46ee-b6fd-3b7794b3e0d7" released by "delete_snapshot" :: held 1.386s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 11:12:11 devstack cinder-volume[87272]: DEBUG cinder.quota [None req-b37992a9-133d-40e0-b963-febc1c2f71c3 tempest-ProjectReaderTests-542466594 None] Created reservations ['8858c687-be53-4109-9bea-adb434921ac0', '0cd57d7b-869e-4e20-8404-fbfc1f7faf55', 'd08c1417-448b-4b28-9669-3a8c763c2234', '4fed8cf3-3b21-4143-80e1-634604f2d19d'] {{(pid=87272) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 11:12:11 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-b37992a9-133d-40e0-b963-febc1c2f71c3 tempest-ProjectReaderTests-542466594 None] Delete snapshot completed successfully. Nov 04 11:12:11 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-b37992a9-133d-40e0-b963-febc1c2f71c3 tempest-ProjectReaderTests-542466594 None] Lock "cinder-748e9187-92b9-487d-bccf-a2a280701234-delete_snapshot" released by "delete_snapshot" :: held 1.513s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 11:12:12 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-1f49380f-dc57-4abd-8bbe-0df1efd2e004 tempest-ProjectReaderTests-542466594 None] Acquiring lock "cinder-81027597-cdc4-46ee-b6fd-3b7794b3e0d7-delete_volume" by "delete_volume" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 11:12:12 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-1f49380f-dc57-4abd-8bbe-0df1efd2e004 tempest-ProjectReaderTests-542466594 None] Lock "cinder-81027597-cdc4-46ee-b6fd-3b7794b3e0d7-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 11:12:12 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-1f49380f-dc57-4abd-8bbe-0df1efd2e004 tempest-ProjectReaderTests-542466594 None] Acquiring lock "cinder-quobyte-81027597-cdc4-46ee-b6fd-3b7794b3e0d7" by "delete_volume" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 11:12:12 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-1f49380f-dc57-4abd-8bbe-0df1efd2e004 tempest-ProjectReaderTests-542466594 None] Lock "cinder-quobyte-81027597-cdc4-46ee-b6fd-3b7794b3e0d7" acquired by "delete_volume" :: waited 0.014s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 11:12:12 devstack cinder-volume[87272]: DEBUG oslo.privsep.daemon [-] privsep: reply[f16d3812-6510-4366-8e4c-fcdfea138d6f]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 11:12:12 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-1f49380f-dc57-4abd-8bbe-0df1efd2e004 tempest-ProjectReaderTests-542466594 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-81027597-cdc4-46ee-b6fd-3b7794b3e0d7 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:12:12 devstack sudo[108231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-81027597-cdc4-46ee-b6fd-3b7794b3e0d7 Nov 04 11:12:12 devstack sudo[108231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:12:12 devstack sudo[108231]: pam_unix(sudo:session): session closed for user root Nov 04 11:12:12 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-1f49380f-dc57-4abd-8bbe-0df1efd2e004 tempest-ProjectReaderTests-542466594 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-81027597-cdc4-46ee-b6fd-3b7794b3e0d7" returned: 0 in 0.356s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:12:12 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-1f49380f-dc57-4abd-8bbe-0df1efd2e004 tempest-ProjectReaderTests-542466594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-81027597-cdc4-46ee-b6fd-3b7794b3e0d7 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:12:12 devstack sudo[108236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-81027597-cdc4-46ee-b6fd-3b7794b3e0d7 Nov 04 11:12:12 devstack sudo[108236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:12:13 devstack sudo[108236]: pam_unix(sudo:session): session closed for user root Nov 04 11:12:13 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-1f49380f-dc57-4abd-8bbe-0df1efd2e004 tempest-ProjectReaderTests-542466594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-81027597-cdc4-46ee-b6fd-3b7794b3e0d7" returned: 0 in 0.243s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:12:13 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-1f49380f-dc57-4abd-8bbe-0df1efd2e004 tempest-ProjectReaderTests-542466594 None] Lock "cinder-quobyte-81027597-cdc4-46ee-b6fd-3b7794b3e0d7" released by "delete_volume" :: held 0.656s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 11:12:13 devstack cinder-volume[87272]: DEBUG cinder.quota [None req-1f49380f-dc57-4abd-8bbe-0df1efd2e004 tempest-ProjectReaderTests-542466594 None] Created reservations ['1106b965-fda7-41b9-8c01-5784585694fc', '39ca997d-7332-4b92-b93e-50121e9f1db1', '2eaf293b-ec6d-4f24-99db-c17f0dd2e8ac', '9b6ecddc-7908-40a2-971a-616939925e27'] {{(pid=87272) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 11:12:13 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-1f49380f-dc57-4abd-8bbe-0df1efd2e004 tempest-ProjectReaderTests-542466594 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 11:12:13 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-1f49380f-dc57-4abd-8bbe-0df1efd2e004 tempest-ProjectReaderTests-542466594 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 11:12:13 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-1f49380f-dc57-4abd-8bbe-0df1efd2e004 tempest-ProjectReaderTests-542466594 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898': None} {{(pid=87272) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 11:12:13 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-1f49380f-dc57-4abd-8bbe-0df1efd2e004 tempest-ProjectReaderTests-542466594 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'] {{(pid=87272) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 11:12:13 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-1f49380f-dc57-4abd-8bbe-0df1efd2e004 tempest-ProjectReaderTests-542466594 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 11:12:13 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-1f49380f-dc57-4abd-8bbe-0df1efd2e004 tempest-ProjectReaderTests-542466594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:12:13 devstack sudo[108239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1 Nov 04 11:12:13 devstack sudo[108239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:12:13 devstack sudo[108239]: pam_unix(sudo:session): session closed for user root Nov 04 11:12:13 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-1f49380f-dc57-4abd-8bbe-0df1efd2e004 tempest-ProjectReaderTests-542466594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1" returned: 0 in 0.240s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:12:13 devstack cinder-volume[87272]: DEBUG cinder.manager [None req-1f49380f-dc57-4abd-8bbe-0df1efd2e004 tempest-ProjectReaderTests-542466594 None] Notifying Schedulers of capabilities ... {{(pid=87272) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 11:12:13 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-1f49380f-dc57-4abd-8bbe-0df1efd2e004 tempest-ProjectReaderTests-542466594 None] Deleted volume successfully. Nov 04 11:12:13 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-1f49380f-dc57-4abd-8bbe-0df1efd2e004 tempest-ProjectReaderTests-542466594 None] Lock "cinder-81027597-cdc4-46ee-b6fd-3b7794b3e0d7-delete_volume" released by "delete_volume" :: held 1.079s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 11:12:13 devstack cinder-volume[87272]: DEBUG cinder.volume.flows.manager.create_volume [None req-68a37ab1-f838-4bbe-923f-14657f5da294 tempest-ProjectReaderTests-542466594 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87272) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 11:12:13 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-68a37ab1-f838-4bbe-923f-14657f5da294 tempest-ProjectReaderTests-542466594 None] Flow 'volume_create_manager' (4e73e184-6060-403b-8375-2b437d0d94df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 11:12:13 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-68a37ab1-f838-4bbe-923f-14657f5da294 tempest-ProjectReaderTests-542466594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71c56e1c-0549-4c4a-9710-c2bac233b7f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:12:13 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-68a37ab1-f838-4bbe-923f-14657f5da294 tempest-ProjectReaderTests-542466594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71c56e1c-0549-4c4a-9710-c2bac233b7f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T10:12:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2141551286',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7572681f-baac-41ba-84e5-a8286c04e9bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a12254d8bdd2413b82690e2b65f023f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T10:12:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T10:12:14Z,use_quota=True,user_id='4a028e18f6344ebc9f927f7c76a6c4bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8989e4f-21e3-4f0a-9584-0d818784e883),volume_type_id=f8989e4f-21e3-4f0a-9584-0d818784e883)' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:12:13 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-68a37ab1-f838-4bbe-923f-14657f5da294 tempest-ProjectReaderTests-542466594 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aaa5c652-57e1-4d8c-90ea-0c67eaacd9a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:12:13 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-68a37ab1-f838-4bbe-923f-14657f5da294 tempest-ProjectReaderTests-542466594 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aaa5c652-57e1-4d8c-90ea-0c67eaacd9a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:12:13 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-68a37ab1-f838-4bbe-923f-14657f5da294 tempest-ProjectReaderTests-542466594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dcd45bc0-0539-4bc8-a069-a92823e8c7cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:12:13 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-68a37ab1-f838-4bbe-923f-14657f5da294 tempest-ProjectReaderTests-542466594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dcd45bc0-0539-4bc8-a069-a92823e8c7cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7572681f-baac-41ba-84e5-a8286c04e9bd', 'volume_name': 'volume-7572681f-baac-41ba-84e5-a8286c04e9bd', 'volume_size': 1}' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:12:13 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-68a37ab1-f838-4bbe-923f-14657f5da294 tempest-ProjectReaderTests-542466594 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b9195b4-ce8d-478c-a508-cf26134c32e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:12:13 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-68a37ab1-f838-4bbe-923f-14657f5da294 tempest-ProjectReaderTests-542466594 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b9195b4-ce8d-478c-a508-cf26134c32e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:12:13 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-68a37ab1-f838-4bbe-923f-14657f5da294 tempest-ProjectReaderTests-542466594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7391ff29-18b6-4649-912d-85ab3d88148f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:12:13 devstack cinder-volume[87272]: INFO cinder.volume.flows.manager.create_volume [None req-68a37ab1-f838-4bbe-923f-14657f5da294 tempest-ProjectReaderTests-542466594 None] Volume 7572681f-baac-41ba-84e5-a8286c04e9bd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7572681f-baac-41ba-84e5-a8286c04e9bd', 'volume_size': 1} Nov 04 11:12:13 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-68a37ab1-f838-4bbe-923f-14657f5da294 tempest-ProjectReaderTests-542466594 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 11:12:13 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-68a37ab1-f838-4bbe-923f-14657f5da294 tempest-ProjectReaderTests-542466594 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 11:12:13 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-68a37ab1-f838-4bbe-923f-14657f5da294 tempest-ProjectReaderTests-542466594 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T10:12:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2141551286',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7572681f-baac-41ba-84e5-a8286c04e9bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a12254d8bdd2413b82690e2b65f023f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T10:12:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T10:12:14Z,use_quota=True,user_id='4a028e18f6344ebc9f927f7c76a6c4bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8989e4f-21e3-4f0a-9584-0d818784e883),volume_type_id=f8989e4f-21e3-4f0a-9584-0d818784e883)}" {{(pid=87272) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 04 11:12:13 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.remotefs [None req-68a37ab1-f838-4bbe-923f-14657f5da294 tempest-ProjectReaderTests-542466594 None] Creating volume 7572681f-baac-41ba-84e5-a8286c04e9bd {{(pid=87272) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 11:12:13 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-68a37ab1-f838-4bbe-923f-14657f5da294 tempest-ProjectReaderTests-542466594 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 11:12:13 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-68a37ab1-f838-4bbe-923f-14657f5da294 tempest-ProjectReaderTests-542466594 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 11:12:13 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-68a37ab1-f838-4bbe-923f-14657f5da294 tempest-ProjectReaderTests-542466594 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898': None} {{(pid=87272) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 11:12:14 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-68a37ab1-f838-4bbe-923f-14657f5da294 tempest-ProjectReaderTests-542466594 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'] {{(pid=87272) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 11:12:14 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-68a37ab1-f838-4bbe-923f-14657f5da294 tempest-ProjectReaderTests-542466594 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 11:12:14 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-68a37ab1-f838-4bbe-923f-14657f5da294 tempest-ProjectReaderTests-542466594 None] Selected osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898 as target Quobyte volume. {{(pid=87272) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 11:12:14 devstack cinder-volume[87272]: INFO cinder.volume.drivers.remotefs [None req-68a37ab1-f838-4bbe-923f-14657f5da294 tempest-ProjectReaderTests-542466594 None] casted to osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898 Nov 04 11:12:14 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-68a37ab1-f838-4bbe-923f-14657f5da294 tempest-ProjectReaderTests-542466594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-7572681f-baac-41ba-84e5-a8286c04e9bd 1073741824 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:12:14 devstack sudo[108242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-7572681f-baac-41ba-84e5-a8286c04e9bd 1073741824 Nov 04 11:12:14 devstack sudo[108242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:12:14 devstack cinder-volume[87272]: DEBUG oslo_service.periodic_task [None req-236af0be-7f9d-4c80-b3d7-d645a9cd0dd1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87272) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 04 11:12:14 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-236af0be-7f9d-4c80-b3d7-d645a9cd0dd1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 11:12:14 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-236af0be-7f9d-4c80-b3d7-d645a9cd0dd1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 11:12:14 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-236af0be-7f9d-4c80-b3d7-d645a9cd0dd1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898': None} {{(pid=87272) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 11:12:14 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-236af0be-7f9d-4c80-b3d7-d645a9cd0dd1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'] {{(pid=87272) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 11:12:14 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-236af0be-7f9d-4c80-b3d7-d645a9cd0dd1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 11:12:14 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-236af0be-7f9d-4c80-b3d7-d645a9cd0dd1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:12:14 devstack sudo[108244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1 Nov 04 11:12:14 devstack sudo[108244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:12:14 devstack sudo[108244]: pam_unix(sudo:session): session closed for user root Nov 04 11:12:14 devstack sudo[108242]: pam_unix(sudo:session): session closed for user root Nov 04 11:12:14 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-236af0be-7f9d-4c80-b3d7-d645a9cd0dd1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1" returned: 0 in 0.293s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:12:14 devstack cinder-volume[87272]: DEBUG cinder.manager [None req-236af0be-7f9d-4c80-b3d7-d645a9cd0dd1 None None] Notifying Schedulers of capabilities ... {{(pid=87272) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 11:12:14 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-68a37ab1-f838-4bbe-923f-14657f5da294 tempest-ProjectReaderTests-542466594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-7572681f-baac-41ba-84e5-a8286c04e9bd 1073741824" returned: 0 in 0.445s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:12:14 devstack cinder-volume[87272]: DEBUG oslo_service.periodic_task [None req-236af0be-7f9d-4c80-b3d7-d645a9cd0dd1 None None] Running periodic task VolumeManager._thread_info {{(pid=87272) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 04 11:12:14 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-236af0be-7f9d-4c80-b3d7-d645a9cd0dd1 None None] thread count: 28 {{(pid=87272) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 04 11:12:14 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-236af0be-7f9d-4c80-b3d7-d645a9cd0dd1 None None] thread info: [<_MainThread(MainThread, started 127085713244288)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87272) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 04 11:12:14 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-68a37ab1-f838-4bbe-923f-14657f5da294 tempest-ProjectReaderTests-542466594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-7572681f-baac-41ba-84e5-a8286c04e9bd {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:12:14 devstack sudo[108250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-7572681f-baac-41ba-84e5-a8286c04e9bd Nov 04 11:12:14 devstack sudo[108250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:12:14 devstack sudo[108250]: pam_unix(sudo:session): session closed for user root Nov 04 11:12:14 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-68a37ab1-f838-4bbe-923f-14657f5da294 tempest-ProjectReaderTests-542466594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-7572681f-baac-41ba-84e5-a8286c04e9bd" returned: 0 in 0.251s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:12:14 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-68a37ab1-f838-4bbe-923f-14657f5da294 tempest-ProjectReaderTests-542466594 None] <== create_volume: return (737ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'} {{(pid=87272) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 04 11:12:14 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-68a37ab1-f838-4bbe-923f-14657f5da294 tempest-ProjectReaderTests-542466594 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.740s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 11:12:14 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-68a37ab1-f838-4bbe-923f-14657f5da294 tempest-ProjectReaderTests-542466594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7391ff29-18b6-4649-912d-85ab3d88148f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7572681f-baac-41ba-84e5-a8286c04e9bd', 'volume_size': 1}' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:12:14 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-68a37ab1-f838-4bbe-923f-14657f5da294 tempest-ProjectReaderTests-542466594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f3d78ea4-aaa5-4983-88f8-db8e4b647006) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:12:14 devstack cinder-volume[87272]: INFO cinder.volume.flows.manager.create_volume [None req-68a37ab1-f838-4bbe-923f-14657f5da294 tempest-ProjectReaderTests-542466594 None] Volume volume-7572681f-baac-41ba-84e5-a8286c04e9bd (7572681f-baac-41ba-84e5-a8286c04e9bd): created successfully Nov 04 11:12:14 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-68a37ab1-f838-4bbe-923f-14657f5da294 tempest-ProjectReaderTests-542466594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f3d78ea4-aaa5-4983-88f8-db8e4b647006) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:12:14 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-68a37ab1-f838-4bbe-923f-14657f5da294 tempest-ProjectReaderTests-542466594 None] Flow 'volume_create_manager' (4e73e184-6060-403b-8375-2b437d0d94df) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87272) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 11:12:14 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-68a37ab1-f838-4bbe-923f-14657f5da294 tempest-ProjectReaderTests-542466594 None] Created volume successfully. Nov 04 11:12:15 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-72d6de0d-0978-457e-ac1f-261c2f248dcc tempest-ProjectReaderTests-542466594 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 11:12:15 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-72d6de0d-0978-457e-ac1f-261c2f248dcc tempest-ProjectReaderTests-542466594 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 11:12:15 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.remotefs [None req-72d6de0d-0978-457e-ac1f-261c2f248dcc tempest-ProjectReaderTests-542466594 None] Creating offline snapshot 1463480c-556c-4099-a5da-c1940f740b4b of volume 7572681f-baac-41ba-84e5-a8286c04e9bd {{(pid=87272) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 04 11:12:15 devstack cinder-volume[87272]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1e1046d-7f6d-4c4a-ad52-56fb3e4004de]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 11:12:15 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-72d6de0d-0978-457e-ac1f-261c2f248dcc tempest-ProjectReaderTests-542466594 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-7572681f-baac-41ba-84e5-a8286c04e9bd {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:12:15 devstack sudo[108253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-7572681f-baac-41ba-84e5-a8286c04e9bd Nov 04 11:12:15 devstack sudo[108253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:12:15 devstack sudo[108253]: pam_unix(sudo:session): session closed for user root Nov 04 11:12:15 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-72d6de0d-0978-457e-ac1f-261c2f248dcc tempest-ProjectReaderTests-542466594 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-7572681f-baac-41ba-84e5-a8286c04e9bd" returned: 0 in 0.360s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:12:15 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-72d6de0d-0978-457e-ac1f-261c2f248dcc tempest-ProjectReaderTests-542466594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-7572681f-baac-41ba-84e5-a8286c04e9bd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-7572681f-baac-41ba-84e5-a8286c04e9bd.1463480c-556c-4099-a5da-c1940f740b4b 1G {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:12:15 devstack sudo[108258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-7572681f-baac-41ba-84e5-a8286c04e9bd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-7572681f-baac-41ba-84e5-a8286c04e9bd.1463480c-556c-4099-a5da-c1940f740b4b 1G Nov 04 11:12:15 devstack sudo[108258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:12:15 devstack sudo[108258]: pam_unix(sudo:session): session closed for user root Nov 04 11:12:15 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-72d6de0d-0978-457e-ac1f-261c2f248dcc tempest-ProjectReaderTests-542466594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-7572681f-baac-41ba-84e5-a8286c04e9bd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-7572681f-baac-41ba-84e5-a8286c04e9bd.1463480c-556c-4099-a5da-c1940f740b4b 1G" returned: 0 in 0.387s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:12:15 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-72d6de0d-0978-457e-ac1f-261c2f248dcc tempest-ProjectReaderTests-542466594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7572681f-baac-41ba-84e5-a8286c04e9bd -F qcow2 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-7572681f-baac-41ba-84e5-a8286c04e9bd.1463480c-556c-4099-a5da-c1940f740b4b {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:12:15 devstack sudo[108263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7572681f-baac-41ba-84e5-a8286c04e9bd -F qcow2 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-7572681f-baac-41ba-84e5-a8286c04e9bd.1463480c-556c-4099-a5da-c1940f740b4b Nov 04 11:12:15 devstack sudo[108263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:12:16 devstack sudo[108263]: pam_unix(sudo:session): session closed for user root Nov 04 11:12:16 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-72d6de0d-0978-457e-ac1f-261c2f248dcc tempest-ProjectReaderTests-542466594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7572681f-baac-41ba-84e5-a8286c04e9bd -F qcow2 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-7572681f-baac-41ba-84e5-a8286c04e9bd.1463480c-556c-4099-a5da-c1940f740b4b" returned: 0 in 0.276s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:12:16 devstack cinder-volume[87272]: WARNING cinder.volume.drivers.remotefs [None req-72d6de0d-0978-457e-ac1f-261c2f248dcc tempest-ProjectReaderTests-542466594 None] /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-7572681f-baac-41ba-84e5-a8286c04e9bd.1463480c-556c-4099-a5da-c1940f740b4b is being set with open permissions: ugo+rw Nov 04 11:12:16 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-72d6de0d-0978-457e-ac1f-261c2f248dcc tempest-ProjectReaderTests-542466594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-7572681f-baac-41ba-84e5-a8286c04e9bd.1463480c-556c-4099-a5da-c1940f740b4b {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:12:16 devstack sudo[108269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-7572681f-baac-41ba-84e5-a8286c04e9bd.1463480c-556c-4099-a5da-c1940f740b4b Nov 04 11:12:16 devstack sudo[108269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:12:16 devstack sudo[108269]: pam_unix(sudo:session): session closed for user root Nov 04 11:12:16 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-72d6de0d-0978-457e-ac1f-261c2f248dcc tempest-ProjectReaderTests-542466594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-7572681f-baac-41ba-84e5-a8286c04e9bd.1463480c-556c-4099-a5da-c1940f740b4b" returned: 0 in 0.235s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:12:16 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-72d6de0d-0978-457e-ac1f-261c2f248dcc tempest-ProjectReaderTests-542466594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-7572681f-baac-41ba-84e5-a8286c04e9bd.info {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:12:16 devstack sudo[108272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-7572681f-baac-41ba-84e5-a8286c04e9bd.info Nov 04 11:12:16 devstack sudo[108272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:12:16 devstack sudo[108272]: pam_unix(sudo:session): session closed for user root Nov 04 11:12:16 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-72d6de0d-0978-457e-ac1f-261c2f248dcc tempest-ProjectReaderTests-542466594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-7572681f-baac-41ba-84e5-a8286c04e9bd.info" returned: 0 in 0.242s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:12:16 devstack cinder-volume[87272]: WARNING cinder.volume.drivers.remotefs [None req-72d6de0d-0978-457e-ac1f-261c2f248dcc tempest-ProjectReaderTests-542466594 None] /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-7572681f-baac-41ba-84e5-a8286c04e9bd.info is being set with open permissions: ugo+rw Nov 04 11:12:16 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-72d6de0d-0978-457e-ac1f-261c2f248dcc tempest-ProjectReaderTests-542466594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-7572681f-baac-41ba-84e5-a8286c04e9bd.info {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:12:16 devstack sudo[108275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-7572681f-baac-41ba-84e5-a8286c04e9bd.info Nov 04 11:12:16 devstack sudo[108275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:12:16 devstack sudo[108275]: pam_unix(sudo:session): session closed for user root Nov 04 11:12:16 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-72d6de0d-0978-457e-ac1f-261c2f248dcc tempest-ProjectReaderTests-542466594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-7572681f-baac-41ba-84e5-a8286c04e9bd.info" returned: 0 in 0.234s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:12:16 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-72d6de0d-0978-457e-ac1f-261c2f248dcc tempest-ProjectReaderTests-542466594 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.812s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 11:12:16 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-72d6de0d-0978-457e-ac1f-261c2f248dcc tempest-ProjectReaderTests-542466594 None] Create snapshot completed successfully Nov 04 11:12:17 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-73470c19-5d43-45f5-9584-cd6703a2565e tempest-ProjectReaderTests-542466594 None] Acquiring lock "cinder-1463480c-556c-4099-a5da-c1940f740b4b-delete_snapshot" by "delete_snapshot" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 11:12:17 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-73470c19-5d43-45f5-9584-cd6703a2565e tempest-ProjectReaderTests-542466594 None] Lock "cinder-1463480c-556c-4099-a5da-c1940f740b4b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 11:12:17 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-73470c19-5d43-45f5-9584-cd6703a2565e tempest-ProjectReaderTests-542466594 None] Acquiring lock "cinder-quobyte-7572681f-baac-41ba-84e5-a8286c04e9bd" by "delete_snapshot" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 11:12:17 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-73470c19-5d43-45f5-9584-cd6703a2565e tempest-ProjectReaderTests-542466594 None] Lock "cinder-quobyte-7572681f-baac-41ba-84e5-a8286c04e9bd" acquired by "delete_snapshot" :: waited 0.014s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 11:12:17 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-73470c19-5d43-45f5-9584-cd6703a2565e tempest-ProjectReaderTests-542466594 None] Acquiring lock "cinder-quobyte-1463480c-556c-4099-a5da-c1940f740b4b" by "_delete_snapshot" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 11:12:17 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-73470c19-5d43-45f5-9584-cd6703a2565e tempest-ProjectReaderTests-542466594 None] Lock "cinder-quobyte-1463480c-556c-4099-a5da-c1940f740b4b" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 11:12:17 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.remotefs [None req-73470c19-5d43-45f5-9584-cd6703a2565e tempest-ProjectReaderTests-542466594 None] Deleting offline snapshot 1463480c-556c-4099-a5da-c1940f740b4b of volume 7572681f-baac-41ba-84e5-a8286c04e9bd {{(pid=87272) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 04 11:12:17 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.remotefs [None req-73470c19-5d43-45f5-9584-cd6703a2565e tempest-ProjectReaderTests-542466594 None] snapshot_file for this snap is: volume-7572681f-baac-41ba-84e5-a8286c04e9bd.1463480c-556c-4099-a5da-c1940f740b4b {{(pid=87272) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 04 11:12:17 devstack cinder-volume[87272]: DEBUG oslo.privsep.daemon [-] privsep: reply[e58ffb72-7ce3-43d5-a32d-d3a6efc3a197]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 11:12:17 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-73470c19-5d43-45f5-9584-cd6703a2565e tempest-ProjectReaderTests-542466594 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-7572681f-baac-41ba-84e5-a8286c04e9bd.1463480c-556c-4099-a5da-c1940f740b4b {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:12:17 devstack sudo[108279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-7572681f-baac-41ba-84e5-a8286c04e9bd.1463480c-556c-4099-a5da-c1940f740b4b Nov 04 11:12:17 devstack sudo[108279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:12:17 devstack sudo[108279]: pam_unix(sudo:session): session closed for user root Nov 04 11:12:17 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-73470c19-5d43-45f5-9584-cd6703a2565e tempest-ProjectReaderTests-542466594 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-7572681f-baac-41ba-84e5-a8286c04e9bd.1463480c-556c-4099-a5da-c1940f740b4b" returned: 0 in 0.357s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:12:17 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.remotefs [None req-73470c19-5d43-45f5-9584-cd6703a2565e tempest-ProjectReaderTests-542466594 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7572681f-baac-41ba-84e5-a8286c04e9bd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87272) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 11:12:17 devstack cinder-volume[87272]: DEBUG oslo.privsep.daemon [-] privsep: reply[263d8f3c-7022-4413-9dea-ed4601a4f1c3]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 11:12:17 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-73470c19-5d43-45f5-9584-cd6703a2565e tempest-ProjectReaderTests-542466594 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-7572681f-baac-41ba-84e5-a8286c04e9bd {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:12:17 devstack sudo[108284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-7572681f-baac-41ba-84e5-a8286c04e9bd Nov 04 11:12:17 devstack sudo[108284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:12:17 devstack sudo[108284]: pam_unix(sudo:session): session closed for user root Nov 04 11:12:18 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-73470c19-5d43-45f5-9584-cd6703a2565e tempest-ProjectReaderTests-542466594 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-7572681f-baac-41ba-84e5-a8286c04e9bd" returned: 0 in 0.356s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:12:18 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-73470c19-5d43-45f5-9584-cd6703a2565e tempest-ProjectReaderTests-542466594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-7572681f-baac-41ba-84e5-a8286c04e9bd.1463480c-556c-4099-a5da-c1940f740b4b {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:12:18 devstack sudo[108289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-7572681f-baac-41ba-84e5-a8286c04e9bd.1463480c-556c-4099-a5da-c1940f740b4b Nov 04 11:12:18 devstack sudo[108289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:12:18 devstack sudo[108289]: pam_unix(sudo:session): session closed for user root Nov 04 11:12:18 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-73470c19-5d43-45f5-9584-cd6703a2565e tempest-ProjectReaderTests-542466594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-7572681f-baac-41ba-84e5-a8286c04e9bd.1463480c-556c-4099-a5da-c1940f740b4b" returned: 0 in 0.329s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:12:18 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-73470c19-5d43-45f5-9584-cd6703a2565e tempest-ProjectReaderTests-542466594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-7572681f-baac-41ba-84e5-a8286c04e9bd.1463480c-556c-4099-a5da-c1940f740b4b {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:12:18 devstack sudo[108295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-7572681f-baac-41ba-84e5-a8286c04e9bd.1463480c-556c-4099-a5da-c1940f740b4b Nov 04 11:12:18 devstack sudo[108295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:12:18 devstack sudo[108295]: pam_unix(sudo:session): session closed for user root Nov 04 11:12:18 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-73470c19-5d43-45f5-9584-cd6703a2565e tempest-ProjectReaderTests-542466594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-7572681f-baac-41ba-84e5-a8286c04e9bd.1463480c-556c-4099-a5da-c1940f740b4b" returned: 0 in 0.239s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:12:18 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-73470c19-5d43-45f5-9584-cd6703a2565e tempest-ProjectReaderTests-542466594 None] Lock "cinder-quobyte-1463480c-556c-4099-a5da-c1940f740b4b" released by "_delete_snapshot" :: held 1.369s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 11:12:18 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-73470c19-5d43-45f5-9584-cd6703a2565e tempest-ProjectReaderTests-542466594 None] Lock "cinder-quobyte-7572681f-baac-41ba-84e5-a8286c04e9bd" released by "delete_snapshot" :: held 1.391s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 11:12:18 devstack cinder-volume[87272]: DEBUG cinder.quota [None req-73470c19-5d43-45f5-9584-cd6703a2565e tempest-ProjectReaderTests-542466594 None] Created reservations ['64105144-4c2a-4a21-96b4-a1a46649e943', '2b4f5cac-57bb-41ad-a8e3-536b943433ff', 'c1455a5a-e223-48a9-b338-359b5479c506', 'c423571d-d5e4-455c-86e5-bc140aa48354'] {{(pid=87272) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 11:12:18 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-73470c19-5d43-45f5-9584-cd6703a2565e tempest-ProjectReaderTests-542466594 None] Delete snapshot completed successfully. Nov 04 11:12:18 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-73470c19-5d43-45f5-9584-cd6703a2565e tempest-ProjectReaderTests-542466594 None] Lock "cinder-1463480c-556c-4099-a5da-c1940f740b4b-delete_snapshot" released by "delete_snapshot" :: held 1.513s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 11:12:19 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-ab150e28-d851-4121-aa30-6d506d42ed20 tempest-ProjectReaderTests-542466594 None] Acquiring lock "cinder-7572681f-baac-41ba-84e5-a8286c04e9bd-delete_volume" by "delete_volume" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 11:12:19 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-ab150e28-d851-4121-aa30-6d506d42ed20 tempest-ProjectReaderTests-542466594 None] Lock "cinder-7572681f-baac-41ba-84e5-a8286c04e9bd-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 11:12:19 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-ab150e28-d851-4121-aa30-6d506d42ed20 tempest-ProjectReaderTests-542466594 None] Acquiring lock "cinder-quobyte-7572681f-baac-41ba-84e5-a8286c04e9bd" by "delete_volume" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 11:12:19 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-ab150e28-d851-4121-aa30-6d506d42ed20 tempest-ProjectReaderTests-542466594 None] Lock "cinder-quobyte-7572681f-baac-41ba-84e5-a8286c04e9bd" acquired by "delete_volume" :: waited 0.014s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 11:12:19 devstack cinder-volume[87272]: DEBUG oslo.privsep.daemon [-] privsep: reply[90ce73dd-9163-4bd4-9f97-ccc5a380f280]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 11:12:19 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-ab150e28-d851-4121-aa30-6d506d42ed20 tempest-ProjectReaderTests-542466594 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-7572681f-baac-41ba-84e5-a8286c04e9bd {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:12:19 devstack sudo[108298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-7572681f-baac-41ba-84e5-a8286c04e9bd Nov 04 11:12:19 devstack sudo[108298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:12:19 devstack sudo[108298]: pam_unix(sudo:session): session closed for user root Nov 04 11:12:19 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-ab150e28-d851-4121-aa30-6d506d42ed20 tempest-ProjectReaderTests-542466594 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-7572681f-baac-41ba-84e5-a8286c04e9bd" returned: 0 in 0.353s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:12:19 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-ab150e28-d851-4121-aa30-6d506d42ed20 tempest-ProjectReaderTests-542466594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-7572681f-baac-41ba-84e5-a8286c04e9bd {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:12:19 devstack sudo[108303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-7572681f-baac-41ba-84e5-a8286c04e9bd Nov 04 11:12:19 devstack sudo[108303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:12:20 devstack sudo[108303]: pam_unix(sudo:session): session closed for user root Nov 04 11:12:20 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-ab150e28-d851-4121-aa30-6d506d42ed20 tempest-ProjectReaderTests-542466594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-7572681f-baac-41ba-84e5-a8286c04e9bd" returned: 0 in 0.251s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:12:20 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-ab150e28-d851-4121-aa30-6d506d42ed20 tempest-ProjectReaderTests-542466594 None] Lock "cinder-quobyte-7572681f-baac-41ba-84e5-a8286c04e9bd" released by "delete_volume" :: held 0.659s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 11:12:20 devstack cinder-volume[87272]: DEBUG cinder.quota [None req-ab150e28-d851-4121-aa30-6d506d42ed20 tempest-ProjectReaderTests-542466594 None] Created reservations ['5dcad657-2a0a-4d87-92be-d12a2d76ca2a', 'd0870f94-ac6e-43a0-a6f3-cf0a1c35d5bc', '88798212-10b4-4680-8a79-a532b7b550c4', '43f1e1f9-2019-4902-9941-2f515de399c5'] {{(pid=87272) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 11:12:20 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-ab150e28-d851-4121-aa30-6d506d42ed20 tempest-ProjectReaderTests-542466594 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 11:12:20 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-ab150e28-d851-4121-aa30-6d506d42ed20 tempest-ProjectReaderTests-542466594 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 11:12:20 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-ab150e28-d851-4121-aa30-6d506d42ed20 tempest-ProjectReaderTests-542466594 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898': None} {{(pid=87272) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 11:12:20 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-ab150e28-d851-4121-aa30-6d506d42ed20 tempest-ProjectReaderTests-542466594 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'] {{(pid=87272) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 11:12:20 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-ab150e28-d851-4121-aa30-6d506d42ed20 tempest-ProjectReaderTests-542466594 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 11:12:20 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-ab150e28-d851-4121-aa30-6d506d42ed20 tempest-ProjectReaderTests-542466594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:12:20 devstack sudo[108306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1 Nov 04 11:12:20 devstack sudo[108306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:12:20 devstack sudo[108306]: pam_unix(sudo:session): session closed for user root Nov 04 11:12:20 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-ab150e28-d851-4121-aa30-6d506d42ed20 tempest-ProjectReaderTests-542466594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1" returned: 0 in 0.236s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:12:20 devstack cinder-volume[87272]: DEBUG cinder.manager [None req-ab150e28-d851-4121-aa30-6d506d42ed20 tempest-ProjectReaderTests-542466594 None] Notifying Schedulers of capabilities ... {{(pid=87272) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 11:12:20 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-ab150e28-d851-4121-aa30-6d506d42ed20 tempest-ProjectReaderTests-542466594 None] Deleted volume successfully. Nov 04 11:12:20 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-ab150e28-d851-4121-aa30-6d506d42ed20 tempest-ProjectReaderTests-542466594 None] Lock "cinder-7572681f-baac-41ba-84e5-a8286c04e9bd-delete_volume" released by "delete_volume" :: held 1.090s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 11:12:20 devstack cinder-volume[87272]: DEBUG cinder.volume.flows.manager.create_volume [None req-6591e0bf-844b-48bb-9376-06f0523cb376 tempest-ProjectReaderTests-542466594 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87272) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 11:12:20 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-6591e0bf-844b-48bb-9376-06f0523cb376 tempest-ProjectReaderTests-542466594 None] Flow 'volume_create_manager' (b468af16-7e02-4fe6-880f-19a56fea607d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 11:12:20 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-6591e0bf-844b-48bb-9376-06f0523cb376 tempest-ProjectReaderTests-542466594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a55a4c35-6aee-483a-bb21-0ead9bad99d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:12:20 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-6591e0bf-844b-48bb-9376-06f0523cb376 tempest-ProjectReaderTests-542466594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a55a4c35-6aee-483a-bb21-0ead9bad99d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T10:12:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1659772345',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=35d6d51d-c712-47e7-ba14-109cfd0d27d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a12254d8bdd2413b82690e2b65f023f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T10:12:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T10:12:21Z,use_quota=True,user_id='4a028e18f6344ebc9f927f7c76a6c4bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8989e4f-21e3-4f0a-9584-0d818784e883),volume_type_id=f8989e4f-21e3-4f0a-9584-0d818784e883)' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:12:20 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-6591e0bf-844b-48bb-9376-06f0523cb376 tempest-ProjectReaderTests-542466594 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (46793bb2-9e4b-4418-907f-e6d40d01357f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:12:20 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-6591e0bf-844b-48bb-9376-06f0523cb376 tempest-ProjectReaderTests-542466594 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (46793bb2-9e4b-4418-907f-e6d40d01357f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:12:20 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-6591e0bf-844b-48bb-9376-06f0523cb376 tempest-ProjectReaderTests-542466594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (19ec7893-ea16-4b9e-9aab-73b14fda442f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:12:20 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-6591e0bf-844b-48bb-9376-06f0523cb376 tempest-ProjectReaderTests-542466594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (19ec7893-ea16-4b9e-9aab-73b14fda442f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '35d6d51d-c712-47e7-ba14-109cfd0d27d8', 'volume_name': 'volume-35d6d51d-c712-47e7-ba14-109cfd0d27d8', 'volume_size': 1}' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:12:20 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-6591e0bf-844b-48bb-9376-06f0523cb376 tempest-ProjectReaderTests-542466594 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e35a5338-6740-49d9-ae9e-853514559f40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:12:20 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-6591e0bf-844b-48bb-9376-06f0523cb376 tempest-ProjectReaderTests-542466594 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e35a5338-6740-49d9-ae9e-853514559f40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:12:20 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-6591e0bf-844b-48bb-9376-06f0523cb376 tempest-ProjectReaderTests-542466594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa89bacd-277e-4525-8915-96f78ce4203c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:12:20 devstack cinder-volume[87272]: INFO cinder.volume.flows.manager.create_volume [None req-6591e0bf-844b-48bb-9376-06f0523cb376 tempest-ProjectReaderTests-542466594 None] Volume 35d6d51d-c712-47e7-ba14-109cfd0d27d8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-35d6d51d-c712-47e7-ba14-109cfd0d27d8', 'volume_size': 1} Nov 04 11:12:20 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-6591e0bf-844b-48bb-9376-06f0523cb376 tempest-ProjectReaderTests-542466594 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 11:12:20 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-6591e0bf-844b-48bb-9376-06f0523cb376 tempest-ProjectReaderTests-542466594 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 11:12:20 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-6591e0bf-844b-48bb-9376-06f0523cb376 tempest-ProjectReaderTests-542466594 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T10:12:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1659772345',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=35d6d51d-c712-47e7-ba14-109cfd0d27d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a12254d8bdd2413b82690e2b65f023f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T10:12:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T10:12:21Z,use_quota=True,user_id='4a028e18f6344ebc9f927f7c76a6c4bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8989e4f-21e3-4f0a-9584-0d818784e883),volume_type_id=f8989e4f-21e3-4f0a-9584-0d818784e883)}" {{(pid=87272) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 04 11:12:20 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.remotefs [None req-6591e0bf-844b-48bb-9376-06f0523cb376 tempest-ProjectReaderTests-542466594 None] Creating volume 35d6d51d-c712-47e7-ba14-109cfd0d27d8 {{(pid=87272) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 11:12:20 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-6591e0bf-844b-48bb-9376-06f0523cb376 tempest-ProjectReaderTests-542466594 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 11:12:20 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-6591e0bf-844b-48bb-9376-06f0523cb376 tempest-ProjectReaderTests-542466594 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 11:12:20 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-6591e0bf-844b-48bb-9376-06f0523cb376 tempest-ProjectReaderTests-542466594 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898': None} {{(pid=87272) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 11:12:20 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-6591e0bf-844b-48bb-9376-06f0523cb376 tempest-ProjectReaderTests-542466594 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'] {{(pid=87272) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 11:12:20 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-6591e0bf-844b-48bb-9376-06f0523cb376 tempest-ProjectReaderTests-542466594 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 11:12:20 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-6591e0bf-844b-48bb-9376-06f0523cb376 tempest-ProjectReaderTests-542466594 None] Selected osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898 as target Quobyte volume. {{(pid=87272) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 11:12:20 devstack cinder-volume[87272]: INFO cinder.volume.drivers.remotefs [None req-6591e0bf-844b-48bb-9376-06f0523cb376 tempest-ProjectReaderTests-542466594 None] casted to osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898 Nov 04 11:12:20 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-6591e0bf-844b-48bb-9376-06f0523cb376 tempest-ProjectReaderTests-542466594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-35d6d51d-c712-47e7-ba14-109cfd0d27d8 1073741824 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:12:21 devstack sudo[108309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-35d6d51d-c712-47e7-ba14-109cfd0d27d8 1073741824 Nov 04 11:12:21 devstack sudo[108309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:12:21 devstack sudo[108309]: pam_unix(sudo:session): session closed for user root Nov 04 11:12:21 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-6591e0bf-844b-48bb-9376-06f0523cb376 tempest-ProjectReaderTests-542466594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-35d6d51d-c712-47e7-ba14-109cfd0d27d8 1073741824" returned: 0 in 0.397s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:12:21 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-6591e0bf-844b-48bb-9376-06f0523cb376 tempest-ProjectReaderTests-542466594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-35d6d51d-c712-47e7-ba14-109cfd0d27d8 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:12:21 devstack sudo[108314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-35d6d51d-c712-47e7-ba14-109cfd0d27d8 Nov 04 11:12:21 devstack sudo[108314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:12:21 devstack sudo[108314]: pam_unix(sudo:session): session closed for user root Nov 04 11:12:21 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-6591e0bf-844b-48bb-9376-06f0523cb376 tempest-ProjectReaderTests-542466594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-35d6d51d-c712-47e7-ba14-109cfd0d27d8" returned: 0 in 0.244s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:12:21 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-6591e0bf-844b-48bb-9376-06f0523cb376 tempest-ProjectReaderTests-542466594 None] <== create_volume: return (680ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'} {{(pid=87272) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 04 11:12:21 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-6591e0bf-844b-48bb-9376-06f0523cb376 tempest-ProjectReaderTests-542466594 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.684s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 11:12:21 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-6591e0bf-844b-48bb-9376-06f0523cb376 tempest-ProjectReaderTests-542466594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa89bacd-277e-4525-8915-96f78ce4203c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-35d6d51d-c712-47e7-ba14-109cfd0d27d8', 'volume_size': 1}' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:12:21 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-6591e0bf-844b-48bb-9376-06f0523cb376 tempest-ProjectReaderTests-542466594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e8283ac-2005-4eca-b769-4f092fc58fd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:12:21 devstack cinder-volume[87272]: INFO cinder.volume.flows.manager.create_volume [None req-6591e0bf-844b-48bb-9376-06f0523cb376 tempest-ProjectReaderTests-542466594 None] Volume volume-35d6d51d-c712-47e7-ba14-109cfd0d27d8 (35d6d51d-c712-47e7-ba14-109cfd0d27d8): created successfully Nov 04 11:12:21 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-6591e0bf-844b-48bb-9376-06f0523cb376 tempest-ProjectReaderTests-542466594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e8283ac-2005-4eca-b769-4f092fc58fd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:12:21 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-6591e0bf-844b-48bb-9376-06f0523cb376 tempest-ProjectReaderTests-542466594 None] Flow 'volume_create_manager' (b468af16-7e02-4fe6-880f-19a56fea607d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87272) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 11:12:21 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-6591e0bf-844b-48bb-9376-06f0523cb376 tempest-ProjectReaderTests-542466594 None] Created volume successfully. Nov 04 11:12:22 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-ebf59f33-1188-4d63-aff4-84a22613096f tempest-ProjectReaderTests-542466594 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 11:12:22 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-ebf59f33-1188-4d63-aff4-84a22613096f tempest-ProjectReaderTests-542466594 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 11:12:22 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.remotefs [None req-ebf59f33-1188-4d63-aff4-84a22613096f tempest-ProjectReaderTests-542466594 None] Creating offline snapshot a2bc415d-d899-4962-a195-0826a76c3de2 of volume 35d6d51d-c712-47e7-ba14-109cfd0d27d8 {{(pid=87272) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 04 11:12:22 devstack cinder-volume[87272]: DEBUG oslo.privsep.daemon [-] privsep: reply[20c79a9c-e154-4196-8c74-9d150067f340]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 11:12:22 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-ebf59f33-1188-4d63-aff4-84a22613096f tempest-ProjectReaderTests-542466594 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-35d6d51d-c712-47e7-ba14-109cfd0d27d8 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:12:22 devstack sudo[108323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-35d6d51d-c712-47e7-ba14-109cfd0d27d8 Nov 04 11:12:22 devstack sudo[108323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:12:22 devstack sudo[108323]: pam_unix(sudo:session): session closed for user root Nov 04 11:12:22 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-ebf59f33-1188-4d63-aff4-84a22613096f tempest-ProjectReaderTests-542466594 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-35d6d51d-c712-47e7-ba14-109cfd0d27d8" returned: 0 in 0.360s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:12:22 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-ebf59f33-1188-4d63-aff4-84a22613096f tempest-ProjectReaderTests-542466594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-35d6d51d-c712-47e7-ba14-109cfd0d27d8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-35d6d51d-c712-47e7-ba14-109cfd0d27d8.a2bc415d-d899-4962-a195-0826a76c3de2 1G {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:12:22 devstack sudo[108328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-35d6d51d-c712-47e7-ba14-109cfd0d27d8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-35d6d51d-c712-47e7-ba14-109cfd0d27d8.a2bc415d-d899-4962-a195-0826a76c3de2 1G Nov 04 11:12:22 devstack sudo[108328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:12:22 devstack sudo[108328]: pam_unix(sudo:session): session closed for user root Nov 04 11:12:22 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-ebf59f33-1188-4d63-aff4-84a22613096f tempest-ProjectReaderTests-542466594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-35d6d51d-c712-47e7-ba14-109cfd0d27d8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-35d6d51d-c712-47e7-ba14-109cfd0d27d8.a2bc415d-d899-4962-a195-0826a76c3de2 1G" returned: 0 in 0.374s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:12:22 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-ebf59f33-1188-4d63-aff4-84a22613096f tempest-ProjectReaderTests-542466594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-35d6d51d-c712-47e7-ba14-109cfd0d27d8 -F qcow2 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-35d6d51d-c712-47e7-ba14-109cfd0d27d8.a2bc415d-d899-4962-a195-0826a76c3de2 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:12:22 devstack sudo[108334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-35d6d51d-c712-47e7-ba14-109cfd0d27d8 -F qcow2 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-35d6d51d-c712-47e7-ba14-109cfd0d27d8.a2bc415d-d899-4962-a195-0826a76c3de2 Nov 04 11:12:22 devstack sudo[108334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:12:23 devstack sudo[108334]: pam_unix(sudo:session): session closed for user root Nov 04 11:12:23 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-ebf59f33-1188-4d63-aff4-84a22613096f tempest-ProjectReaderTests-542466594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-35d6d51d-c712-47e7-ba14-109cfd0d27d8 -F qcow2 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-35d6d51d-c712-47e7-ba14-109cfd0d27d8.a2bc415d-d899-4962-a195-0826a76c3de2" returned: 0 in 0.291s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:12:23 devstack cinder-volume[87272]: WARNING cinder.volume.drivers.remotefs [None req-ebf59f33-1188-4d63-aff4-84a22613096f tempest-ProjectReaderTests-542466594 None] /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-35d6d51d-c712-47e7-ba14-109cfd0d27d8.a2bc415d-d899-4962-a195-0826a76c3de2 is being set with open permissions: ugo+rw Nov 04 11:12:23 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-ebf59f33-1188-4d63-aff4-84a22613096f tempest-ProjectReaderTests-542466594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-35d6d51d-c712-47e7-ba14-109cfd0d27d8.a2bc415d-d899-4962-a195-0826a76c3de2 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:12:23 devstack sudo[108340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-35d6d51d-c712-47e7-ba14-109cfd0d27d8.a2bc415d-d899-4962-a195-0826a76c3de2 Nov 04 11:12:23 devstack sudo[108340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:12:23 devstack sudo[108340]: pam_unix(sudo:session): session closed for user root Nov 04 11:12:23 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-ebf59f33-1188-4d63-aff4-84a22613096f tempest-ProjectReaderTests-542466594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-35d6d51d-c712-47e7-ba14-109cfd0d27d8.a2bc415d-d899-4962-a195-0826a76c3de2" returned: 0 in 0.236s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:12:23 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-ebf59f33-1188-4d63-aff4-84a22613096f tempest-ProjectReaderTests-542466594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-35d6d51d-c712-47e7-ba14-109cfd0d27d8.info {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:12:23 devstack sudo[108343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-35d6d51d-c712-47e7-ba14-109cfd0d27d8.info Nov 04 11:12:23 devstack sudo[108343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:12:23 devstack sudo[108343]: pam_unix(sudo:session): session closed for user root Nov 04 11:12:23 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-ebf59f33-1188-4d63-aff4-84a22613096f tempest-ProjectReaderTests-542466594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-35d6d51d-c712-47e7-ba14-109cfd0d27d8.info" returned: 0 in 0.248s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:12:23 devstack cinder-volume[87272]: WARNING cinder.volume.drivers.remotefs [None req-ebf59f33-1188-4d63-aff4-84a22613096f tempest-ProjectReaderTests-542466594 None] /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-35d6d51d-c712-47e7-ba14-109cfd0d27d8.info is being set with open permissions: ugo+rw Nov 04 11:12:23 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-ebf59f33-1188-4d63-aff4-84a22613096f tempest-ProjectReaderTests-542466594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-35d6d51d-c712-47e7-ba14-109cfd0d27d8.info {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:12:23 devstack sudo[108346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-35d6d51d-c712-47e7-ba14-109cfd0d27d8.info Nov 04 11:12:23 devstack sudo[108346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:12:23 devstack sudo[108346]: pam_unix(sudo:session): session closed for user root Nov 04 11:12:23 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-ebf59f33-1188-4d63-aff4-84a22613096f tempest-ProjectReaderTests-542466594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-35d6d51d-c712-47e7-ba14-109cfd0d27d8.info" returned: 0 in 0.232s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:12:23 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-ebf59f33-1188-4d63-aff4-84a22613096f tempest-ProjectReaderTests-542466594 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.818s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 11:12:23 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-ebf59f33-1188-4d63-aff4-84a22613096f tempest-ProjectReaderTests-542466594 None] Create snapshot completed successfully Nov 04 11:12:24 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-0b90461c-7da7-4f09-be1c-a83098abc69f tempest-ProjectReaderTests-542466594 None] Acquiring lock "cinder-a2bc415d-d899-4962-a195-0826a76c3de2-delete_snapshot" by "delete_snapshot" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 11:12:24 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-0b90461c-7da7-4f09-be1c-a83098abc69f tempest-ProjectReaderTests-542466594 None] Lock "cinder-a2bc415d-d899-4962-a195-0826a76c3de2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 11:12:24 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-0b90461c-7da7-4f09-be1c-a83098abc69f tempest-ProjectReaderTests-542466594 None] Acquiring lock "cinder-quobyte-35d6d51d-c712-47e7-ba14-109cfd0d27d8" by "delete_snapshot" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 11:12:24 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-0b90461c-7da7-4f09-be1c-a83098abc69f tempest-ProjectReaderTests-542466594 None] Lock "cinder-quobyte-35d6d51d-c712-47e7-ba14-109cfd0d27d8" acquired by "delete_snapshot" :: waited 0.014s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 11:12:24 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-0b90461c-7da7-4f09-be1c-a83098abc69f tempest-ProjectReaderTests-542466594 None] Acquiring lock "cinder-quobyte-a2bc415d-d899-4962-a195-0826a76c3de2" by "_delete_snapshot" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 11:12:24 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-0b90461c-7da7-4f09-be1c-a83098abc69f tempest-ProjectReaderTests-542466594 None] Lock "cinder-quobyte-a2bc415d-d899-4962-a195-0826a76c3de2" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 11:12:24 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.remotefs [None req-0b90461c-7da7-4f09-be1c-a83098abc69f tempest-ProjectReaderTests-542466594 None] Deleting offline snapshot a2bc415d-d899-4962-a195-0826a76c3de2 of volume 35d6d51d-c712-47e7-ba14-109cfd0d27d8 {{(pid=87272) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 04 11:12:24 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.remotefs [None req-0b90461c-7da7-4f09-be1c-a83098abc69f tempest-ProjectReaderTests-542466594 None] snapshot_file for this snap is: volume-35d6d51d-c712-47e7-ba14-109cfd0d27d8.a2bc415d-d899-4962-a195-0826a76c3de2 {{(pid=87272) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 04 11:12:24 devstack cinder-volume[87272]: DEBUG oslo.privsep.daemon [-] privsep: reply[2db47ec5-f056-412a-8d81-6b14d01548e5]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 11:12:24 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-0b90461c-7da7-4f09-be1c-a83098abc69f tempest-ProjectReaderTests-542466594 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-35d6d51d-c712-47e7-ba14-109cfd0d27d8.a2bc415d-d899-4962-a195-0826a76c3de2 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:12:24 devstack sudo[108349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-35d6d51d-c712-47e7-ba14-109cfd0d27d8.a2bc415d-d899-4962-a195-0826a76c3de2 Nov 04 11:12:24 devstack sudo[108349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:12:24 devstack sudo[108349]: pam_unix(sudo:session): session closed for user root Nov 04 11:12:24 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-0b90461c-7da7-4f09-be1c-a83098abc69f tempest-ProjectReaderTests-542466594 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-35d6d51d-c712-47e7-ba14-109cfd0d27d8.a2bc415d-d899-4962-a195-0826a76c3de2" returned: 0 in 0.345s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:12:24 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.remotefs [None req-0b90461c-7da7-4f09-be1c-a83098abc69f tempest-ProjectReaderTests-542466594 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-35d6d51d-c712-47e7-ba14-109cfd0d27d8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87272) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 11:12:24 devstack cinder-volume[87272]: DEBUG oslo.privsep.daemon [-] privsep: reply[366fa81b-2c35-4c77-b45a-7c1ce05ae144]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 11:12:24 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-0b90461c-7da7-4f09-be1c-a83098abc69f tempest-ProjectReaderTests-542466594 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-35d6d51d-c712-47e7-ba14-109cfd0d27d8 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:12:24 devstack sudo[108354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-35d6d51d-c712-47e7-ba14-109cfd0d27d8 Nov 04 11:12:24 devstack sudo[108354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:12:24 devstack sudo[108354]: pam_unix(sudo:session): session closed for user root Nov 04 11:12:24 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-0b90461c-7da7-4f09-be1c-a83098abc69f tempest-ProjectReaderTests-542466594 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-35d6d51d-c712-47e7-ba14-109cfd0d27d8" returned: 0 in 0.358s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:12:24 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-0b90461c-7da7-4f09-be1c-a83098abc69f tempest-ProjectReaderTests-542466594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-35d6d51d-c712-47e7-ba14-109cfd0d27d8.a2bc415d-d899-4962-a195-0826a76c3de2 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:12:25 devstack sudo[108359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-35d6d51d-c712-47e7-ba14-109cfd0d27d8.a2bc415d-d899-4962-a195-0826a76c3de2 Nov 04 11:12:25 devstack sudo[108359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:12:25 devstack sudo[108359]: pam_unix(sudo:session): session closed for user root Nov 04 11:12:25 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-0b90461c-7da7-4f09-be1c-a83098abc69f tempest-ProjectReaderTests-542466594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-35d6d51d-c712-47e7-ba14-109cfd0d27d8.a2bc415d-d899-4962-a195-0826a76c3de2" returned: 0 in 0.329s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:12:25 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-0b90461c-7da7-4f09-be1c-a83098abc69f tempest-ProjectReaderTests-542466594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-35d6d51d-c712-47e7-ba14-109cfd0d27d8.a2bc415d-d899-4962-a195-0826a76c3de2 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:12:25 devstack sudo[108364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-35d6d51d-c712-47e7-ba14-109cfd0d27d8.a2bc415d-d899-4962-a195-0826a76c3de2 Nov 04 11:12:25 devstack sudo[108364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:12:25 devstack sudo[108364]: pam_unix(sudo:session): session closed for user root Nov 04 11:12:25 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-0b90461c-7da7-4f09-be1c-a83098abc69f tempest-ProjectReaderTests-542466594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-35d6d51d-c712-47e7-ba14-109cfd0d27d8.a2bc415d-d899-4962-a195-0826a76c3de2" returned: 0 in 0.232s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:12:25 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-0b90461c-7da7-4f09-be1c-a83098abc69f tempest-ProjectReaderTests-542466594 None] Lock "cinder-quobyte-a2bc415d-d899-4962-a195-0826a76c3de2" released by "_delete_snapshot" :: held 1.358s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 11:12:25 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-0b90461c-7da7-4f09-be1c-a83098abc69f tempest-ProjectReaderTests-542466594 None] Lock "cinder-quobyte-35d6d51d-c712-47e7-ba14-109cfd0d27d8" released by "delete_snapshot" :: held 1.378s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 11:12:25 devstack cinder-volume[87272]: DEBUG cinder.quota [None req-0b90461c-7da7-4f09-be1c-a83098abc69f tempest-ProjectReaderTests-542466594 None] Created reservations ['87b35f8f-d98f-4aaf-a551-549aad072d44', '9ca8da6a-9bbb-415c-982f-4a722f3189e2', '399885a2-7e4d-470b-aafd-e0f5e2b8f381', '86d8a9a4-0b4d-477d-b69e-f0c13e5b188c'] {{(pid=87272) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 11:12:25 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-0b90461c-7da7-4f09-be1c-a83098abc69f tempest-ProjectReaderTests-542466594 None] Delete snapshot completed successfully. Nov 04 11:12:25 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-0b90461c-7da7-4f09-be1c-a83098abc69f tempest-ProjectReaderTests-542466594 None] Lock "cinder-a2bc415d-d899-4962-a195-0826a76c3de2-delete_snapshot" released by "delete_snapshot" :: held 1.506s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 11:12:26 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-aca5083e-009e-4b86-bb7e-76854dfb781b tempest-ProjectReaderTests-542466594 None] Acquiring lock "cinder-35d6d51d-c712-47e7-ba14-109cfd0d27d8-delete_volume" by "delete_volume" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 11:12:26 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-aca5083e-009e-4b86-bb7e-76854dfb781b tempest-ProjectReaderTests-542466594 None] Lock "cinder-35d6d51d-c712-47e7-ba14-109cfd0d27d8-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 11:12:26 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-aca5083e-009e-4b86-bb7e-76854dfb781b tempest-ProjectReaderTests-542466594 None] Acquiring lock "cinder-quobyte-35d6d51d-c712-47e7-ba14-109cfd0d27d8" by "delete_volume" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 11:12:26 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-aca5083e-009e-4b86-bb7e-76854dfb781b tempest-ProjectReaderTests-542466594 None] Lock "cinder-quobyte-35d6d51d-c712-47e7-ba14-109cfd0d27d8" acquired by "delete_volume" :: waited 0.018s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 11:12:26 devstack cinder-volume[87272]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a0415c3-d591-4f9c-b706-b97c230921c1]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 11:12:26 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-aca5083e-009e-4b86-bb7e-76854dfb781b tempest-ProjectReaderTests-542466594 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-35d6d51d-c712-47e7-ba14-109cfd0d27d8 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:12:26 devstack sudo[108369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-35d6d51d-c712-47e7-ba14-109cfd0d27d8 Nov 04 11:12:26 devstack sudo[108369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:12:26 devstack sudo[108369]: pam_unix(sudo:session): session closed for user root Nov 04 11:12:26 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-aca5083e-009e-4b86-bb7e-76854dfb781b tempest-ProjectReaderTests-542466594 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-35d6d51d-c712-47e7-ba14-109cfd0d27d8" returned: 0 in 0.365s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:12:26 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-aca5083e-009e-4b86-bb7e-76854dfb781b tempest-ProjectReaderTests-542466594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-35d6d51d-c712-47e7-ba14-109cfd0d27d8 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:12:26 devstack sudo[108377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-35d6d51d-c712-47e7-ba14-109cfd0d27d8 Nov 04 11:12:26 devstack sudo[108377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:12:27 devstack sudo[108377]: pam_unix(sudo:session): session closed for user root Nov 04 11:12:27 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-aca5083e-009e-4b86-bb7e-76854dfb781b tempest-ProjectReaderTests-542466594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-35d6d51d-c712-47e7-ba14-109cfd0d27d8" returned: 0 in 0.232s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:12:27 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-aca5083e-009e-4b86-bb7e-76854dfb781b tempest-ProjectReaderTests-542466594 None] Lock "cinder-quobyte-35d6d51d-c712-47e7-ba14-109cfd0d27d8" released by "delete_volume" :: held 0.655s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 11:12:27 devstack cinder-volume[87272]: DEBUG cinder.quota [None req-aca5083e-009e-4b86-bb7e-76854dfb781b tempest-ProjectReaderTests-542466594 None] Created reservations ['c1975ef2-aeab-4bb5-a8d6-8e41994c9705', 'f16f0e69-26c2-48cf-9fcf-feba7f96ad7b', '5d0fa962-a242-417d-abd0-c2ada071e26e', 'f9bf1dcf-77ee-4a15-acfc-1703ee730f85'] {{(pid=87272) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 11:12:27 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-aca5083e-009e-4b86-bb7e-76854dfb781b tempest-ProjectReaderTests-542466594 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 11:12:27 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-aca5083e-009e-4b86-bb7e-76854dfb781b tempest-ProjectReaderTests-542466594 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 11:12:27 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-aca5083e-009e-4b86-bb7e-76854dfb781b tempest-ProjectReaderTests-542466594 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898': None} {{(pid=87272) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 11:12:27 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-aca5083e-009e-4b86-bb7e-76854dfb781b tempest-ProjectReaderTests-542466594 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'] {{(pid=87272) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 11:12:27 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-aca5083e-009e-4b86-bb7e-76854dfb781b tempest-ProjectReaderTests-542466594 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 11:12:27 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-aca5083e-009e-4b86-bb7e-76854dfb781b tempest-ProjectReaderTests-542466594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:12:27 devstack sudo[108380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1 Nov 04 11:12:27 devstack sudo[108380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:12:27 devstack sudo[108380]: pam_unix(sudo:session): session closed for user root Nov 04 11:12:27 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-aca5083e-009e-4b86-bb7e-76854dfb781b tempest-ProjectReaderTests-542466594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1" returned: 0 in 0.245s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:12:27 devstack cinder-volume[87272]: DEBUG cinder.manager [None req-aca5083e-009e-4b86-bb7e-76854dfb781b tempest-ProjectReaderTests-542466594 None] Notifying Schedulers of capabilities ... {{(pid=87272) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 11:12:27 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-aca5083e-009e-4b86-bb7e-76854dfb781b tempest-ProjectReaderTests-542466594 None] Deleted volume successfully. Nov 04 11:12:27 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-aca5083e-009e-4b86-bb7e-76854dfb781b tempest-ProjectReaderTests-542466594 None] Lock "cinder-35d6d51d-c712-47e7-ba14-109cfd0d27d8-delete_volume" released by "delete_volume" :: held 1.093s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 11:12:27 devstack cinder-volume[87272]: DEBUG cinder.volume.flows.manager.create_volume [None req-64a165c4-94bb-49a6-aaa2-db930fe672c2 tempest-ProjectReaderTests-542466594 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87272) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 11:12:27 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-64a165c4-94bb-49a6-aaa2-db930fe672c2 tempest-ProjectReaderTests-542466594 None] Flow 'volume_create_manager' (a8b8707f-cfd9-4c1a-ab82-d7a4e24f1cdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 11:12:27 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-64a165c4-94bb-49a6-aaa2-db930fe672c2 tempest-ProjectReaderTests-542466594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4dd84cb9-e8ee-4f0f-bd62-5a5c6e37774b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:12:27 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-64a165c4-94bb-49a6-aaa2-db930fe672c2 tempest-ProjectReaderTests-542466594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4dd84cb9-e8ee-4f0f-bd62-5a5c6e37774b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T10:12:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-408252792',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48f70c86-ce2f-4709-a5c8-ff18588d797c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a12254d8bdd2413b82690e2b65f023f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T10:12:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T10:12:28Z,use_quota=True,user_id='4a028e18f6344ebc9f927f7c76a6c4bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8989e4f-21e3-4f0a-9584-0d818784e883),volume_type_id=f8989e4f-21e3-4f0a-9584-0d818784e883)' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:12:27 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-64a165c4-94bb-49a6-aaa2-db930fe672c2 tempest-ProjectReaderTests-542466594 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e28cf90f-2d0b-4090-916b-7772b99c843f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:12:27 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-64a165c4-94bb-49a6-aaa2-db930fe672c2 tempest-ProjectReaderTests-542466594 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e28cf90f-2d0b-4090-916b-7772b99c843f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:12:27 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-64a165c4-94bb-49a6-aaa2-db930fe672c2 tempest-ProjectReaderTests-542466594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f254deaf-028d-4254-b429-91217591af7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:12:27 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-64a165c4-94bb-49a6-aaa2-db930fe672c2 tempest-ProjectReaderTests-542466594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f254deaf-028d-4254-b429-91217591af7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '48f70c86-ce2f-4709-a5c8-ff18588d797c', 'volume_name': 'volume-48f70c86-ce2f-4709-a5c8-ff18588d797c', 'volume_size': 1}' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:12:27 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-64a165c4-94bb-49a6-aaa2-db930fe672c2 tempest-ProjectReaderTests-542466594 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (166d46a4-fb3b-4e14-aed0-7e61f6a4fe0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:12:27 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-64a165c4-94bb-49a6-aaa2-db930fe672c2 tempest-ProjectReaderTests-542466594 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (166d46a4-fb3b-4e14-aed0-7e61f6a4fe0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:12:27 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-64a165c4-94bb-49a6-aaa2-db930fe672c2 tempest-ProjectReaderTests-542466594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (309b8fe4-f863-4f1a-ac91-2016267766d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:12:27 devstack cinder-volume[87272]: INFO cinder.volume.flows.manager.create_volume [None req-64a165c4-94bb-49a6-aaa2-db930fe672c2 tempest-ProjectReaderTests-542466594 None] Volume 48f70c86-ce2f-4709-a5c8-ff18588d797c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-48f70c86-ce2f-4709-a5c8-ff18588d797c', 'volume_size': 1} Nov 04 11:12:27 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-64a165c4-94bb-49a6-aaa2-db930fe672c2 tempest-ProjectReaderTests-542466594 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 11:12:27 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-64a165c4-94bb-49a6-aaa2-db930fe672c2 tempest-ProjectReaderTests-542466594 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 11:12:27 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-64a165c4-94bb-49a6-aaa2-db930fe672c2 tempest-ProjectReaderTests-542466594 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T10:12:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-408252792',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48f70c86-ce2f-4709-a5c8-ff18588d797c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a12254d8bdd2413b82690e2b65f023f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T10:12:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T10:12:28Z,use_quota=True,user_id='4a028e18f6344ebc9f927f7c76a6c4bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8989e4f-21e3-4f0a-9584-0d818784e883),volume_type_id=f8989e4f-21e3-4f0a-9584-0d818784e883)}" {{(pid=87272) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 04 11:12:27 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.remotefs [None req-64a165c4-94bb-49a6-aaa2-db930fe672c2 tempest-ProjectReaderTests-542466594 None] Creating volume 48f70c86-ce2f-4709-a5c8-ff18588d797c {{(pid=87272) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 11:12:27 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-64a165c4-94bb-49a6-aaa2-db930fe672c2 tempest-ProjectReaderTests-542466594 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 11:12:27 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-64a165c4-94bb-49a6-aaa2-db930fe672c2 tempest-ProjectReaderTests-542466594 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 11:12:27 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-64a165c4-94bb-49a6-aaa2-db930fe672c2 tempest-ProjectReaderTests-542466594 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898': None} {{(pid=87272) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 11:12:27 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-64a165c4-94bb-49a6-aaa2-db930fe672c2 tempest-ProjectReaderTests-542466594 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'] {{(pid=87272) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 11:12:27 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-64a165c4-94bb-49a6-aaa2-db930fe672c2 tempest-ProjectReaderTests-542466594 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 11:12:27 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-64a165c4-94bb-49a6-aaa2-db930fe672c2 tempest-ProjectReaderTests-542466594 None] Selected osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898 as target Quobyte volume. {{(pid=87272) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 11:12:27 devstack cinder-volume[87272]: INFO cinder.volume.drivers.remotefs [None req-64a165c4-94bb-49a6-aaa2-db930fe672c2 tempest-ProjectReaderTests-542466594 None] casted to osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898 Nov 04 11:12:27 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-64a165c4-94bb-49a6-aaa2-db930fe672c2 tempest-ProjectReaderTests-542466594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-48f70c86-ce2f-4709-a5c8-ff18588d797c 1073741824 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:12:28 devstack sudo[108383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-48f70c86-ce2f-4709-a5c8-ff18588d797c 1073741824 Nov 04 11:12:28 devstack sudo[108383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:12:28 devstack sudo[108383]: pam_unix(sudo:session): session closed for user root Nov 04 11:12:28 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-64a165c4-94bb-49a6-aaa2-db930fe672c2 tempest-ProjectReaderTests-542466594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-48f70c86-ce2f-4709-a5c8-ff18588d797c 1073741824" returned: 0 in 0.407s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:12:28 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-64a165c4-94bb-49a6-aaa2-db930fe672c2 tempest-ProjectReaderTests-542466594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-48f70c86-ce2f-4709-a5c8-ff18588d797c {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:12:28 devstack sudo[108389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-48f70c86-ce2f-4709-a5c8-ff18588d797c Nov 04 11:12:28 devstack sudo[108389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:12:28 devstack sudo[108389]: pam_unix(sudo:session): session closed for user root Nov 04 11:12:28 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-64a165c4-94bb-49a6-aaa2-db930fe672c2 tempest-ProjectReaderTests-542466594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-48f70c86-ce2f-4709-a5c8-ff18588d797c" returned: 0 in 0.243s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:12:28 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-64a165c4-94bb-49a6-aaa2-db930fe672c2 tempest-ProjectReaderTests-542466594 None] <== create_volume: return (689ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'} {{(pid=87272) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 04 11:12:28 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-64a165c4-94bb-49a6-aaa2-db930fe672c2 tempest-ProjectReaderTests-542466594 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.691s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 11:12:28 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-64a165c4-94bb-49a6-aaa2-db930fe672c2 tempest-ProjectReaderTests-542466594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (309b8fe4-f863-4f1a-ac91-2016267766d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-48f70c86-ce2f-4709-a5c8-ff18588d797c', 'volume_size': 1}' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:12:28 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-64a165c4-94bb-49a6-aaa2-db930fe672c2 tempest-ProjectReaderTests-542466594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e870343c-7b48-4836-a98f-e9ed64bd3d13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:12:28 devstack cinder-volume[87272]: INFO cinder.volume.flows.manager.create_volume [None req-64a165c4-94bb-49a6-aaa2-db930fe672c2 tempest-ProjectReaderTests-542466594 None] Volume volume-48f70c86-ce2f-4709-a5c8-ff18588d797c (48f70c86-ce2f-4709-a5c8-ff18588d797c): created successfully Nov 04 11:12:28 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-64a165c4-94bb-49a6-aaa2-db930fe672c2 tempest-ProjectReaderTests-542466594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e870343c-7b48-4836-a98f-e9ed64bd3d13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:12:28 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-64a165c4-94bb-49a6-aaa2-db930fe672c2 tempest-ProjectReaderTests-542466594 None] Flow 'volume_create_manager' (a8b8707f-cfd9-4c1a-ab82-d7a4e24f1cdf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87272) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 11:12:28 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-64a165c4-94bb-49a6-aaa2-db930fe672c2 tempest-ProjectReaderTests-542466594 None] Created volume successfully. Nov 04 11:12:29 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-a747ae7c-0af8-49be-b52b-87fd07516bbf tempest-ProjectReaderTests-542466594 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 11:12:29 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-a747ae7c-0af8-49be-b52b-87fd07516bbf tempest-ProjectReaderTests-542466594 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 11:12:29 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.remotefs [None req-a747ae7c-0af8-49be-b52b-87fd07516bbf tempest-ProjectReaderTests-542466594 None] Creating offline snapshot 335af660-936b-47c5-9801-56be44ac02f7 of volume 48f70c86-ce2f-4709-a5c8-ff18588d797c {{(pid=87272) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 04 11:12:29 devstack cinder-volume[87272]: DEBUG oslo.privsep.daemon [-] privsep: reply[263bb91d-fdd8-43b7-bfa9-b3d89ae8c329]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 11:12:29 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-a747ae7c-0af8-49be-b52b-87fd07516bbf tempest-ProjectReaderTests-542466594 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-48f70c86-ce2f-4709-a5c8-ff18588d797c {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:12:29 devstack sudo[108392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-48f70c86-ce2f-4709-a5c8-ff18588d797c Nov 04 11:12:29 devstack sudo[108392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:12:29 devstack sudo[108392]: pam_unix(sudo:session): session closed for user root Nov 04 11:12:29 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-a747ae7c-0af8-49be-b52b-87fd07516bbf tempest-ProjectReaderTests-542466594 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-48f70c86-ce2f-4709-a5c8-ff18588d797c" returned: 0 in 0.343s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:12:29 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-a747ae7c-0af8-49be-b52b-87fd07516bbf tempest-ProjectReaderTests-542466594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-48f70c86-ce2f-4709-a5c8-ff18588d797c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-48f70c86-ce2f-4709-a5c8-ff18588d797c.335af660-936b-47c5-9801-56be44ac02f7 1G {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:12:29 devstack sudo[108397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-48f70c86-ce2f-4709-a5c8-ff18588d797c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-48f70c86-ce2f-4709-a5c8-ff18588d797c.335af660-936b-47c5-9801-56be44ac02f7 1G Nov 04 11:12:29 devstack sudo[108397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:12:29 devstack sudo[108397]: pam_unix(sudo:session): session closed for user root Nov 04 11:12:29 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-a747ae7c-0af8-49be-b52b-87fd07516bbf tempest-ProjectReaderTests-542466594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-48f70c86-ce2f-4709-a5c8-ff18588d797c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-48f70c86-ce2f-4709-a5c8-ff18588d797c.335af660-936b-47c5-9801-56be44ac02f7 1G" returned: 0 in 0.394s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:12:29 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-a747ae7c-0af8-49be-b52b-87fd07516bbf tempest-ProjectReaderTests-542466594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-48f70c86-ce2f-4709-a5c8-ff18588d797c -F qcow2 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-48f70c86-ce2f-4709-a5c8-ff18588d797c.335af660-936b-47c5-9801-56be44ac02f7 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:12:29 devstack sudo[108402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-48f70c86-ce2f-4709-a5c8-ff18588d797c -F qcow2 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-48f70c86-ce2f-4709-a5c8-ff18588d797c.335af660-936b-47c5-9801-56be44ac02f7 Nov 04 11:12:29 devstack sudo[108402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:12:30 devstack sudo[108402]: pam_unix(sudo:session): session closed for user root Nov 04 11:12:30 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-a747ae7c-0af8-49be-b52b-87fd07516bbf tempest-ProjectReaderTests-542466594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-48f70c86-ce2f-4709-a5c8-ff18588d797c -F qcow2 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-48f70c86-ce2f-4709-a5c8-ff18588d797c.335af660-936b-47c5-9801-56be44ac02f7" returned: 0 in 0.294s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:12:30 devstack cinder-volume[87272]: WARNING cinder.volume.drivers.remotefs [None req-a747ae7c-0af8-49be-b52b-87fd07516bbf tempest-ProjectReaderTests-542466594 None] /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-48f70c86-ce2f-4709-a5c8-ff18588d797c.335af660-936b-47c5-9801-56be44ac02f7 is being set with open permissions: ugo+rw Nov 04 11:12:30 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-a747ae7c-0af8-49be-b52b-87fd07516bbf tempest-ProjectReaderTests-542466594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-48f70c86-ce2f-4709-a5c8-ff18588d797c.335af660-936b-47c5-9801-56be44ac02f7 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:12:30 devstack sudo[108407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-48f70c86-ce2f-4709-a5c8-ff18588d797c.335af660-936b-47c5-9801-56be44ac02f7 Nov 04 11:12:30 devstack sudo[108407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:12:30 devstack sudo[108407]: pam_unix(sudo:session): session closed for user root Nov 04 11:12:30 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-a747ae7c-0af8-49be-b52b-87fd07516bbf tempest-ProjectReaderTests-542466594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-48f70c86-ce2f-4709-a5c8-ff18588d797c.335af660-936b-47c5-9801-56be44ac02f7" returned: 0 in 0.229s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:12:30 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-a747ae7c-0af8-49be-b52b-87fd07516bbf tempest-ProjectReaderTests-542466594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-48f70c86-ce2f-4709-a5c8-ff18588d797c.info {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:12:30 devstack sudo[108410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-48f70c86-ce2f-4709-a5c8-ff18588d797c.info Nov 04 11:12:30 devstack sudo[108410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:12:30 devstack sudo[108410]: pam_unix(sudo:session): session closed for user root Nov 04 11:12:30 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-a747ae7c-0af8-49be-b52b-87fd07516bbf tempest-ProjectReaderTests-542466594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-48f70c86-ce2f-4709-a5c8-ff18588d797c.info" returned: 0 in 0.244s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:12:30 devstack cinder-volume[87272]: WARNING cinder.volume.drivers.remotefs [None req-a747ae7c-0af8-49be-b52b-87fd07516bbf tempest-ProjectReaderTests-542466594 None] /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-48f70c86-ce2f-4709-a5c8-ff18588d797c.info is being set with open permissions: ugo+rw Nov 04 11:12:30 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-a747ae7c-0af8-49be-b52b-87fd07516bbf tempest-ProjectReaderTests-542466594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-48f70c86-ce2f-4709-a5c8-ff18588d797c.info {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:12:30 devstack sudo[108413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-48f70c86-ce2f-4709-a5c8-ff18588d797c.info Nov 04 11:12:30 devstack sudo[108413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:12:30 devstack sudo[108413]: pam_unix(sudo:session): session closed for user root Nov 04 11:12:30 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-a747ae7c-0af8-49be-b52b-87fd07516bbf tempest-ProjectReaderTests-542466594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-48f70c86-ce2f-4709-a5c8-ff18588d797c.info" returned: 0 in 0.230s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:12:30 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-a747ae7c-0af8-49be-b52b-87fd07516bbf tempest-ProjectReaderTests-542466594 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.816s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 11:12:30 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-a747ae7c-0af8-49be-b52b-87fd07516bbf tempest-ProjectReaderTests-542466594 None] Create snapshot completed successfully Nov 04 11:12:31 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-80aca0c0-d059-4b17-9724-64a0020fa232 tempest-ProjectReaderTests-542466594 None] Acquiring lock "cinder-335af660-936b-47c5-9801-56be44ac02f7-delete_snapshot" by "delete_snapshot" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 11:12:31 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-80aca0c0-d059-4b17-9724-64a0020fa232 tempest-ProjectReaderTests-542466594 None] Lock "cinder-335af660-936b-47c5-9801-56be44ac02f7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 11:12:31 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-80aca0c0-d059-4b17-9724-64a0020fa232 tempest-ProjectReaderTests-542466594 None] Acquiring lock "cinder-quobyte-48f70c86-ce2f-4709-a5c8-ff18588d797c" by "delete_snapshot" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 11:12:31 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-80aca0c0-d059-4b17-9724-64a0020fa232 tempest-ProjectReaderTests-542466594 None] Lock "cinder-quobyte-48f70c86-ce2f-4709-a5c8-ff18588d797c" acquired by "delete_snapshot" :: waited 0.013s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 11:12:31 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-80aca0c0-d059-4b17-9724-64a0020fa232 tempest-ProjectReaderTests-542466594 None] Acquiring lock "cinder-quobyte-335af660-936b-47c5-9801-56be44ac02f7" by "_delete_snapshot" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 11:12:31 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-80aca0c0-d059-4b17-9724-64a0020fa232 tempest-ProjectReaderTests-542466594 None] Lock "cinder-quobyte-335af660-936b-47c5-9801-56be44ac02f7" acquired by "_delete_snapshot" :: waited 0.011s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 11:12:31 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.remotefs [None req-80aca0c0-d059-4b17-9724-64a0020fa232 tempest-ProjectReaderTests-542466594 None] Deleting offline snapshot 335af660-936b-47c5-9801-56be44ac02f7 of volume 48f70c86-ce2f-4709-a5c8-ff18588d797c {{(pid=87272) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 04 11:12:31 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.remotefs [None req-80aca0c0-d059-4b17-9724-64a0020fa232 tempest-ProjectReaderTests-542466594 None] snapshot_file for this snap is: volume-48f70c86-ce2f-4709-a5c8-ff18588d797c.335af660-936b-47c5-9801-56be44ac02f7 {{(pid=87272) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 04 11:12:31 devstack cinder-volume[87272]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a84a059-7d90-417e-bc4e-41fcd890e28d]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 11:12:31 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-80aca0c0-d059-4b17-9724-64a0020fa232 tempest-ProjectReaderTests-542466594 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-48f70c86-ce2f-4709-a5c8-ff18588d797c.335af660-936b-47c5-9801-56be44ac02f7 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:12:31 devstack sudo[108416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-48f70c86-ce2f-4709-a5c8-ff18588d797c.335af660-936b-47c5-9801-56be44ac02f7 Nov 04 11:12:31 devstack sudo[108416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:12:31 devstack sudo[108416]: pam_unix(sudo:session): session closed for user root Nov 04 11:12:31 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-80aca0c0-d059-4b17-9724-64a0020fa232 tempest-ProjectReaderTests-542466594 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-48f70c86-ce2f-4709-a5c8-ff18588d797c.335af660-936b-47c5-9801-56be44ac02f7" returned: 0 in 0.372s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:12:31 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.remotefs [None req-80aca0c0-d059-4b17-9724-64a0020fa232 tempest-ProjectReaderTests-542466594 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-48f70c86-ce2f-4709-a5c8-ff18588d797c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87272) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 11:12:31 devstack cinder-volume[87272]: DEBUG oslo.privsep.daemon [-] privsep: reply[82c7b5ab-f373-41f7-9d6d-ca43c7547198]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 11:12:31 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-80aca0c0-d059-4b17-9724-64a0020fa232 tempest-ProjectReaderTests-542466594 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-48f70c86-ce2f-4709-a5c8-ff18588d797c {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:12:31 devstack sudo[108421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-48f70c86-ce2f-4709-a5c8-ff18588d797c Nov 04 11:12:31 devstack sudo[108421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:12:31 devstack sudo[108421]: pam_unix(sudo:session): session closed for user root Nov 04 11:12:31 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-80aca0c0-d059-4b17-9724-64a0020fa232 tempest-ProjectReaderTests-542466594 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-48f70c86-ce2f-4709-a5c8-ff18588d797c" returned: 0 in 0.343s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:12:31 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-80aca0c0-d059-4b17-9724-64a0020fa232 tempest-ProjectReaderTests-542466594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-48f70c86-ce2f-4709-a5c8-ff18588d797c.335af660-936b-47c5-9801-56be44ac02f7 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:12:31 devstack sudo[108426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-48f70c86-ce2f-4709-a5c8-ff18588d797c.335af660-936b-47c5-9801-56be44ac02f7 Nov 04 11:12:31 devstack sudo[108426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:12:32 devstack sudo[108426]: pam_unix(sudo:session): session closed for user root Nov 04 11:12:32 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-80aca0c0-d059-4b17-9724-64a0020fa232 tempest-ProjectReaderTests-542466594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-48f70c86-ce2f-4709-a5c8-ff18588d797c.335af660-936b-47c5-9801-56be44ac02f7" returned: 0 in 0.334s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:12:32 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-80aca0c0-d059-4b17-9724-64a0020fa232 tempest-ProjectReaderTests-542466594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-48f70c86-ce2f-4709-a5c8-ff18588d797c.335af660-936b-47c5-9801-56be44ac02f7 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:12:32 devstack sudo[108431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-48f70c86-ce2f-4709-a5c8-ff18588d797c.335af660-936b-47c5-9801-56be44ac02f7 Nov 04 11:12:32 devstack sudo[108431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:12:32 devstack sudo[108431]: pam_unix(sudo:session): session closed for user root Nov 04 11:12:32 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-80aca0c0-d059-4b17-9724-64a0020fa232 tempest-ProjectReaderTests-542466594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-48f70c86-ce2f-4709-a5c8-ff18588d797c.335af660-936b-47c5-9801-56be44ac02f7" returned: 0 in 0.241s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:12:32 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-80aca0c0-d059-4b17-9724-64a0020fa232 tempest-ProjectReaderTests-542466594 None] Lock "cinder-quobyte-335af660-936b-47c5-9801-56be44ac02f7" released by "_delete_snapshot" :: held 1.394s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 11:12:32 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-80aca0c0-d059-4b17-9724-64a0020fa232 tempest-ProjectReaderTests-542466594 None] Lock "cinder-quobyte-48f70c86-ce2f-4709-a5c8-ff18588d797c" released by "delete_snapshot" :: held 1.413s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 11:12:32 devstack cinder-volume[87272]: DEBUG cinder.quota [None req-80aca0c0-d059-4b17-9724-64a0020fa232 tempest-ProjectReaderTests-542466594 None] Created reservations ['36d11e5c-7d90-46ad-be8c-b0419d8480c8', '5a250455-ee60-4c57-be2e-a57fae5938a6', '61cfb087-3872-4ed0-8be3-8c875957724d', '06fa5c8c-6212-4abf-8862-078c98927104'] {{(pid=87272) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 11:12:32 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-80aca0c0-d059-4b17-9724-64a0020fa232 tempest-ProjectReaderTests-542466594 None] Delete snapshot completed successfully. Nov 04 11:12:32 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-80aca0c0-d059-4b17-9724-64a0020fa232 tempest-ProjectReaderTests-542466594 None] Lock "cinder-335af660-936b-47c5-9801-56be44ac02f7-delete_snapshot" released by "delete_snapshot" :: held 1.543s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 11:12:33 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-53a362fb-831b-4db4-9942-46edb97e11af tempest-ProjectReaderTests-542466594 None] Acquiring lock "cinder-48f70c86-ce2f-4709-a5c8-ff18588d797c-delete_volume" by "delete_volume" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 11:12:33 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-53a362fb-831b-4db4-9942-46edb97e11af tempest-ProjectReaderTests-542466594 None] Lock "cinder-48f70c86-ce2f-4709-a5c8-ff18588d797c-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 11:12:33 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-53a362fb-831b-4db4-9942-46edb97e11af tempest-ProjectReaderTests-542466594 None] Acquiring lock "cinder-quobyte-48f70c86-ce2f-4709-a5c8-ff18588d797c" by "delete_volume" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 11:12:33 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-53a362fb-831b-4db4-9942-46edb97e11af tempest-ProjectReaderTests-542466594 None] Lock "cinder-quobyte-48f70c86-ce2f-4709-a5c8-ff18588d797c" acquired by "delete_volume" :: waited 0.015s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 11:12:33 devstack cinder-volume[87272]: DEBUG oslo.privsep.daemon [-] privsep: reply[8273563d-5f76-4f5e-b1ba-c07452448702]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 11:12:33 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-53a362fb-831b-4db4-9942-46edb97e11af tempest-ProjectReaderTests-542466594 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-48f70c86-ce2f-4709-a5c8-ff18588d797c {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:12:33 devstack sudo[108434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-48f70c86-ce2f-4709-a5c8-ff18588d797c Nov 04 11:12:33 devstack sudo[108434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:12:33 devstack sudo[108434]: pam_unix(sudo:session): session closed for user root Nov 04 11:12:33 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-53a362fb-831b-4db4-9942-46edb97e11af tempest-ProjectReaderTests-542466594 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-48f70c86-ce2f-4709-a5c8-ff18588d797c" returned: 0 in 0.346s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:12:33 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-53a362fb-831b-4db4-9942-46edb97e11af tempest-ProjectReaderTests-542466594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-48f70c86-ce2f-4709-a5c8-ff18588d797c {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:12:33 devstack sudo[108439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-48f70c86-ce2f-4709-a5c8-ff18588d797c Nov 04 11:12:33 devstack sudo[108439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:12:33 devstack sudo[108439]: pam_unix(sudo:session): session closed for user root Nov 04 11:12:33 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-53a362fb-831b-4db4-9942-46edb97e11af tempest-ProjectReaderTests-542466594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-48f70c86-ce2f-4709-a5c8-ff18588d797c" returned: 0 in 0.235s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:12:34 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-53a362fb-831b-4db4-9942-46edb97e11af tempest-ProjectReaderTests-542466594 None] Lock "cinder-quobyte-48f70c86-ce2f-4709-a5c8-ff18588d797c" released by "delete_volume" :: held 0.639s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 11:12:34 devstack cinder-volume[87272]: DEBUG cinder.quota [None req-53a362fb-831b-4db4-9942-46edb97e11af tempest-ProjectReaderTests-542466594 None] Created reservations ['981a7fd5-9a1d-47f2-96f2-d676ee5eeff3', 'd6e9c7a6-eea0-4002-a60f-50076e9d67c7', '8a203014-f165-4de7-a01f-dafa0b141b97', '1d3f5119-c323-48af-894c-57cdcb7f60ea'] {{(pid=87272) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 11:12:34 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-53a362fb-831b-4db4-9942-46edb97e11af tempest-ProjectReaderTests-542466594 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 11:12:34 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-53a362fb-831b-4db4-9942-46edb97e11af tempest-ProjectReaderTests-542466594 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 11:12:34 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-53a362fb-831b-4db4-9942-46edb97e11af tempest-ProjectReaderTests-542466594 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898': None} {{(pid=87272) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 11:12:34 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-53a362fb-831b-4db4-9942-46edb97e11af tempest-ProjectReaderTests-542466594 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'] {{(pid=87272) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 11:12:34 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-53a362fb-831b-4db4-9942-46edb97e11af tempest-ProjectReaderTests-542466594 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 11:12:34 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-53a362fb-831b-4db4-9942-46edb97e11af tempest-ProjectReaderTests-542466594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:12:34 devstack sudo[108454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1 Nov 04 11:12:34 devstack sudo[108454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:12:34 devstack sudo[108454]: pam_unix(sudo:session): session closed for user root Nov 04 11:12:34 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-53a362fb-831b-4db4-9942-46edb97e11af tempest-ProjectReaderTests-542466594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1" returned: 0 in 0.264s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:12:34 devstack cinder-volume[87272]: DEBUG cinder.manager [None req-53a362fb-831b-4db4-9942-46edb97e11af tempest-ProjectReaderTests-542466594 None] Notifying Schedulers of capabilities ... {{(pid=87272) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 11:12:34 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-53a362fb-831b-4db4-9942-46edb97e11af tempest-ProjectReaderTests-542466594 None] Deleted volume successfully. Nov 04 11:12:34 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-53a362fb-831b-4db4-9942-46edb97e11af tempest-ProjectReaderTests-542466594 None] Lock "cinder-48f70c86-ce2f-4709-a5c8-ff18588d797c-delete_volume" released by "delete_volume" :: held 1.098s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 11:12:34 devstack cinder-volume[87272]: DEBUG cinder.volume.flows.manager.create_volume [None req-9cec53a1-4c85-4127-bd6e-26804c08db76 tempest-ProjectReaderTests-542466594 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87272) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 11:12:34 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-9cec53a1-4c85-4127-bd6e-26804c08db76 tempest-ProjectReaderTests-542466594 None] Flow 'volume_create_manager' (94a47fda-ec7e-43ba-baad-a1b0404791c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 11:12:34 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-9cec53a1-4c85-4127-bd6e-26804c08db76 tempest-ProjectReaderTests-542466594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91019c6b-b8e7-4f2b-98ba-a99dd6dbd266) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:12:34 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-9cec53a1-4c85-4127-bd6e-26804c08db76 tempest-ProjectReaderTests-542466594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91019c6b-b8e7-4f2b-98ba-a99dd6dbd266) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T10:12:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-44631882',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bbc9d4d5-710d-4897-9f3d-6dcfcb2ad469,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a12254d8bdd2413b82690e2b65f023f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T10:12:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T10:12:35Z,use_quota=True,user_id='4a028e18f6344ebc9f927f7c76a6c4bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8989e4f-21e3-4f0a-9584-0d818784e883),volume_type_id=f8989e4f-21e3-4f0a-9584-0d818784e883)' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:12:34 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-9cec53a1-4c85-4127-bd6e-26804c08db76 tempest-ProjectReaderTests-542466594 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2f65e7c-6fb8-4cd9-814e-b1fa60c37035) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:12:34 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-9cec53a1-4c85-4127-bd6e-26804c08db76 tempest-ProjectReaderTests-542466594 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2f65e7c-6fb8-4cd9-814e-b1fa60c37035) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:12:34 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-9cec53a1-4c85-4127-bd6e-26804c08db76 tempest-ProjectReaderTests-542466594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aed7d811-7c73-4e2c-a2ac-bac89f5b5045) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:12:34 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-9cec53a1-4c85-4127-bd6e-26804c08db76 tempest-ProjectReaderTests-542466594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aed7d811-7c73-4e2c-a2ac-bac89f5b5045) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bbc9d4d5-710d-4897-9f3d-6dcfcb2ad469', 'volume_name': 'volume-bbc9d4d5-710d-4897-9f3d-6dcfcb2ad469', 'volume_size': 1}' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:12:34 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-9cec53a1-4c85-4127-bd6e-26804c08db76 tempest-ProjectReaderTests-542466594 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da92011f-bd91-44fe-a05e-fef56da47145) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:12:34 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-9cec53a1-4c85-4127-bd6e-26804c08db76 tempest-ProjectReaderTests-542466594 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da92011f-bd91-44fe-a05e-fef56da47145) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:12:34 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-9cec53a1-4c85-4127-bd6e-26804c08db76 tempest-ProjectReaderTests-542466594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e51c1258-18d7-4251-8321-404e72fe3ea0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:12:34 devstack cinder-volume[87272]: INFO cinder.volume.flows.manager.create_volume [None req-9cec53a1-4c85-4127-bd6e-26804c08db76 tempest-ProjectReaderTests-542466594 None] Volume bbc9d4d5-710d-4897-9f3d-6dcfcb2ad469: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bbc9d4d5-710d-4897-9f3d-6dcfcb2ad469', 'volume_size': 1} Nov 04 11:12:34 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-9cec53a1-4c85-4127-bd6e-26804c08db76 tempest-ProjectReaderTests-542466594 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 11:12:34 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-9cec53a1-4c85-4127-bd6e-26804c08db76 tempest-ProjectReaderTests-542466594 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 11:12:34 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-9cec53a1-4c85-4127-bd6e-26804c08db76 tempest-ProjectReaderTests-542466594 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T10:12:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-44631882',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bbc9d4d5-710d-4897-9f3d-6dcfcb2ad469,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a12254d8bdd2413b82690e2b65f023f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T10:12:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T10:12:35Z,use_quota=True,user_id='4a028e18f6344ebc9f927f7c76a6c4bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8989e4f-21e3-4f0a-9584-0d818784e883),volume_type_id=f8989e4f-21e3-4f0a-9584-0d818784e883)}" {{(pid=87272) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 04 11:12:34 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.remotefs [None req-9cec53a1-4c85-4127-bd6e-26804c08db76 tempest-ProjectReaderTests-542466594 None] Creating volume bbc9d4d5-710d-4897-9f3d-6dcfcb2ad469 {{(pid=87272) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 11:12:34 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-9cec53a1-4c85-4127-bd6e-26804c08db76 tempest-ProjectReaderTests-542466594 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 11:12:34 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-9cec53a1-4c85-4127-bd6e-26804c08db76 tempest-ProjectReaderTests-542466594 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 11:12:34 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-9cec53a1-4c85-4127-bd6e-26804c08db76 tempest-ProjectReaderTests-542466594 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898': None} {{(pid=87272) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 11:12:34 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-9cec53a1-4c85-4127-bd6e-26804c08db76 tempest-ProjectReaderTests-542466594 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'] {{(pid=87272) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 11:12:34 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-9cec53a1-4c85-4127-bd6e-26804c08db76 tempest-ProjectReaderTests-542466594 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 11:12:34 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-9cec53a1-4c85-4127-bd6e-26804c08db76 tempest-ProjectReaderTests-542466594 None] Selected osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898 as target Quobyte volume. {{(pid=87272) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 11:12:34 devstack cinder-volume[87272]: INFO cinder.volume.drivers.remotefs [None req-9cec53a1-4c85-4127-bd6e-26804c08db76 tempest-ProjectReaderTests-542466594 None] casted to osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898 Nov 04 11:12:34 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-9cec53a1-4c85-4127-bd6e-26804c08db76 tempest-ProjectReaderTests-542466594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-bbc9d4d5-710d-4897-9f3d-6dcfcb2ad469 1073741824 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:12:34 devstack sudo[108481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-bbc9d4d5-710d-4897-9f3d-6dcfcb2ad469 1073741824 Nov 04 11:12:34 devstack sudo[108481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:12:35 devstack sudo[108481]: pam_unix(sudo:session): session closed for user root Nov 04 11:12:35 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-9cec53a1-4c85-4127-bd6e-26804c08db76 tempest-ProjectReaderTests-542466594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-bbc9d4d5-710d-4897-9f3d-6dcfcb2ad469 1073741824" returned: 0 in 0.416s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:12:35 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-9cec53a1-4c85-4127-bd6e-26804c08db76 tempest-ProjectReaderTests-542466594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-bbc9d4d5-710d-4897-9f3d-6dcfcb2ad469 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:12:35 devstack sudo[108487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-bbc9d4d5-710d-4897-9f3d-6dcfcb2ad469 Nov 04 11:12:35 devstack sudo[108487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:12:35 devstack sudo[108487]: pam_unix(sudo:session): session closed for user root Nov 04 11:12:35 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-9cec53a1-4c85-4127-bd6e-26804c08db76 tempest-ProjectReaderTests-542466594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-bbc9d4d5-710d-4897-9f3d-6dcfcb2ad469" returned: 0 in 0.252s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:12:35 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-9cec53a1-4c85-4127-bd6e-26804c08db76 tempest-ProjectReaderTests-542466594 None] <== create_volume: return (707ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'} {{(pid=87272) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 04 11:12:35 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-9cec53a1-4c85-4127-bd6e-26804c08db76 tempest-ProjectReaderTests-542466594 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.710s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 11:12:35 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-9cec53a1-4c85-4127-bd6e-26804c08db76 tempest-ProjectReaderTests-542466594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e51c1258-18d7-4251-8321-404e72fe3ea0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bbc9d4d5-710d-4897-9f3d-6dcfcb2ad469', 'volume_size': 1}' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:12:35 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-9cec53a1-4c85-4127-bd6e-26804c08db76 tempest-ProjectReaderTests-542466594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b976e53-f61d-4d50-99e2-1dda3f3b348b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 11:12:35 devstack cinder-volume[87272]: INFO cinder.volume.flows.manager.create_volume [None req-9cec53a1-4c85-4127-bd6e-26804c08db76 tempest-ProjectReaderTests-542466594 None] Volume volume-bbc9d4d5-710d-4897-9f3d-6dcfcb2ad469 (bbc9d4d5-710d-4897-9f3d-6dcfcb2ad469): created successfully Nov 04 11:12:35 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-9cec53a1-4c85-4127-bd6e-26804c08db76 tempest-ProjectReaderTests-542466594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b976e53-f61d-4d50-99e2-1dda3f3b348b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87272) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 11:12:35 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-9cec53a1-4c85-4127-bd6e-26804c08db76 tempest-ProjectReaderTests-542466594 None] Flow 'volume_create_manager' (94a47fda-ec7e-43ba-baad-a1b0404791c0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87272) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 11:12:35 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-9cec53a1-4c85-4127-bd6e-26804c08db76 tempest-ProjectReaderTests-542466594 None] Created volume successfully. Nov 04 11:12:36 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-75275a14-7688-4659-9f27-27a450c947f6 tempest-ProjectReaderTests-542466594 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 11:12:36 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-75275a14-7688-4659-9f27-27a450c947f6 tempest-ProjectReaderTests-542466594 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 11:12:36 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.remotefs [None req-75275a14-7688-4659-9f27-27a450c947f6 tempest-ProjectReaderTests-542466594 None] Creating offline snapshot c20347b9-c379-4d63-8f61-ecca0ef26990 of volume bbc9d4d5-710d-4897-9f3d-6dcfcb2ad469 {{(pid=87272) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 04 11:12:36 devstack cinder-volume[87272]: DEBUG oslo.privsep.daemon [-] privsep: reply[419080af-f55e-42df-b447-44977e227114]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 11:12:36 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-75275a14-7688-4659-9f27-27a450c947f6 tempest-ProjectReaderTests-542466594 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-bbc9d4d5-710d-4897-9f3d-6dcfcb2ad469 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:12:36 devstack sudo[108490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-bbc9d4d5-710d-4897-9f3d-6dcfcb2ad469 Nov 04 11:12:36 devstack sudo[108490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:12:36 devstack sudo[108490]: pam_unix(sudo:session): session closed for user root Nov 04 11:12:36 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-75275a14-7688-4659-9f27-27a450c947f6 tempest-ProjectReaderTests-542466594 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-bbc9d4d5-710d-4897-9f3d-6dcfcb2ad469" returned: 0 in 0.356s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:12:36 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-75275a14-7688-4659-9f27-27a450c947f6 tempest-ProjectReaderTests-542466594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-bbc9d4d5-710d-4897-9f3d-6dcfcb2ad469,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-bbc9d4d5-710d-4897-9f3d-6dcfcb2ad469.c20347b9-c379-4d63-8f61-ecca0ef26990 1G {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:12:36 devstack sudo[108495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-bbc9d4d5-710d-4897-9f3d-6dcfcb2ad469,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-bbc9d4d5-710d-4897-9f3d-6dcfcb2ad469.c20347b9-c379-4d63-8f61-ecca0ef26990 1G Nov 04 11:12:36 devstack sudo[108495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:12:36 devstack sudo[108495]: pam_unix(sudo:session): session closed for user root Nov 04 11:12:36 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-75275a14-7688-4659-9f27-27a450c947f6 tempest-ProjectReaderTests-542466594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-bbc9d4d5-710d-4897-9f3d-6dcfcb2ad469,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-bbc9d4d5-710d-4897-9f3d-6dcfcb2ad469.c20347b9-c379-4d63-8f61-ecca0ef26990 1G" returned: 0 in 0.387s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:12:36 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-75275a14-7688-4659-9f27-27a450c947f6 tempest-ProjectReaderTests-542466594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bbc9d4d5-710d-4897-9f3d-6dcfcb2ad469 -F qcow2 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-bbc9d4d5-710d-4897-9f3d-6dcfcb2ad469.c20347b9-c379-4d63-8f61-ecca0ef26990 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:12:36 devstack sudo[108501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bbc9d4d5-710d-4897-9f3d-6dcfcb2ad469 -F qcow2 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-bbc9d4d5-710d-4897-9f3d-6dcfcb2ad469.c20347b9-c379-4d63-8f61-ecca0ef26990 Nov 04 11:12:36 devstack sudo[108501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:12:37 devstack sudo[108501]: pam_unix(sudo:session): session closed for user root Nov 04 11:12:37 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-75275a14-7688-4659-9f27-27a450c947f6 tempest-ProjectReaderTests-542466594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bbc9d4d5-710d-4897-9f3d-6dcfcb2ad469 -F qcow2 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-bbc9d4d5-710d-4897-9f3d-6dcfcb2ad469.c20347b9-c379-4d63-8f61-ecca0ef26990" returned: 0 in 0.281s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:12:37 devstack cinder-volume[87272]: WARNING cinder.volume.drivers.remotefs [None req-75275a14-7688-4659-9f27-27a450c947f6 tempest-ProjectReaderTests-542466594 None] /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-bbc9d4d5-710d-4897-9f3d-6dcfcb2ad469.c20347b9-c379-4d63-8f61-ecca0ef26990 is being set with open permissions: ugo+rw Nov 04 11:12:37 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-75275a14-7688-4659-9f27-27a450c947f6 tempest-ProjectReaderTests-542466594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-bbc9d4d5-710d-4897-9f3d-6dcfcb2ad469.c20347b9-c379-4d63-8f61-ecca0ef26990 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:12:37 devstack sudo[108506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-bbc9d4d5-710d-4897-9f3d-6dcfcb2ad469.c20347b9-c379-4d63-8f61-ecca0ef26990 Nov 04 11:12:37 devstack sudo[108506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:12:37 devstack sudo[108506]: pam_unix(sudo:session): session closed for user root Nov 04 11:12:37 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-75275a14-7688-4659-9f27-27a450c947f6 tempest-ProjectReaderTests-542466594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-bbc9d4d5-710d-4897-9f3d-6dcfcb2ad469.c20347b9-c379-4d63-8f61-ecca0ef26990" returned: 0 in 0.242s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:12:37 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-75275a14-7688-4659-9f27-27a450c947f6 tempest-ProjectReaderTests-542466594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-bbc9d4d5-710d-4897-9f3d-6dcfcb2ad469.info {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:12:37 devstack sudo[108509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-bbc9d4d5-710d-4897-9f3d-6dcfcb2ad469.info Nov 04 11:12:37 devstack sudo[108509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:12:37 devstack sudo[108509]: pam_unix(sudo:session): session closed for user root Nov 04 11:12:37 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-75275a14-7688-4659-9f27-27a450c947f6 tempest-ProjectReaderTests-542466594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-bbc9d4d5-710d-4897-9f3d-6dcfcb2ad469.info" returned: 0 in 0.238s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:12:37 devstack cinder-volume[87272]: WARNING cinder.volume.drivers.remotefs [None req-75275a14-7688-4659-9f27-27a450c947f6 tempest-ProjectReaderTests-542466594 None] /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-bbc9d4d5-710d-4897-9f3d-6dcfcb2ad469.info is being set with open permissions: ugo+rw Nov 04 11:12:37 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-75275a14-7688-4659-9f27-27a450c947f6 tempest-ProjectReaderTests-542466594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-bbc9d4d5-710d-4897-9f3d-6dcfcb2ad469.info {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:12:37 devstack sudo[108512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-bbc9d4d5-710d-4897-9f3d-6dcfcb2ad469.info Nov 04 11:12:37 devstack sudo[108512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:12:37 devstack sudo[108512]: pam_unix(sudo:session): session closed for user root Nov 04 11:12:37 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-75275a14-7688-4659-9f27-27a450c947f6 tempest-ProjectReaderTests-542466594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-bbc9d4d5-710d-4897-9f3d-6dcfcb2ad469.info" returned: 0 in 0.245s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:12:37 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-75275a14-7688-4659-9f27-27a450c947f6 tempest-ProjectReaderTests-542466594 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.827s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 11:12:37 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-75275a14-7688-4659-9f27-27a450c947f6 tempest-ProjectReaderTests-542466594 None] Create snapshot completed successfully Nov 04 11:12:38 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-ae0aa0f5-9f2b-4511-b77e-53e1138549f8 tempest-ProjectReaderTests-542466594 None] Acquiring lock "cinder-c20347b9-c379-4d63-8f61-ecca0ef26990-delete_snapshot" by "delete_snapshot" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 11:12:38 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-ae0aa0f5-9f2b-4511-b77e-53e1138549f8 tempest-ProjectReaderTests-542466594 None] Lock "cinder-c20347b9-c379-4d63-8f61-ecca0ef26990-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 11:12:38 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-ae0aa0f5-9f2b-4511-b77e-53e1138549f8 tempest-ProjectReaderTests-542466594 None] Acquiring lock "cinder-quobyte-bbc9d4d5-710d-4897-9f3d-6dcfcb2ad469" by "delete_snapshot" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 11:12:38 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-ae0aa0f5-9f2b-4511-b77e-53e1138549f8 tempest-ProjectReaderTests-542466594 None] Lock "cinder-quobyte-bbc9d4d5-710d-4897-9f3d-6dcfcb2ad469" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 11:12:38 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-ae0aa0f5-9f2b-4511-b77e-53e1138549f8 tempest-ProjectReaderTests-542466594 None] Acquiring lock "cinder-quobyte-c20347b9-c379-4d63-8f61-ecca0ef26990" by "_delete_snapshot" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 11:12:38 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-ae0aa0f5-9f2b-4511-b77e-53e1138549f8 tempest-ProjectReaderTests-542466594 None] Lock "cinder-quobyte-c20347b9-c379-4d63-8f61-ecca0ef26990" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 11:12:38 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.remotefs [None req-ae0aa0f5-9f2b-4511-b77e-53e1138549f8 tempest-ProjectReaderTests-542466594 None] Deleting offline snapshot c20347b9-c379-4d63-8f61-ecca0ef26990 of volume bbc9d4d5-710d-4897-9f3d-6dcfcb2ad469 {{(pid=87272) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 04 11:12:38 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.remotefs [None req-ae0aa0f5-9f2b-4511-b77e-53e1138549f8 tempest-ProjectReaderTests-542466594 None] snapshot_file for this snap is: volume-bbc9d4d5-710d-4897-9f3d-6dcfcb2ad469.c20347b9-c379-4d63-8f61-ecca0ef26990 {{(pid=87272) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 04 11:12:38 devstack cinder-volume[87272]: DEBUG oslo.privsep.daemon [-] privsep: reply[35f3a4c1-2e8a-456b-aca6-b063f91e456b]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 11:12:38 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-ae0aa0f5-9f2b-4511-b77e-53e1138549f8 tempest-ProjectReaderTests-542466594 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-bbc9d4d5-710d-4897-9f3d-6dcfcb2ad469.c20347b9-c379-4d63-8f61-ecca0ef26990 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:12:38 devstack sudo[108515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-bbc9d4d5-710d-4897-9f3d-6dcfcb2ad469.c20347b9-c379-4d63-8f61-ecca0ef26990 Nov 04 11:12:38 devstack sudo[108515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:12:38 devstack sudo[108515]: pam_unix(sudo:session): session closed for user root Nov 04 11:12:38 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-ae0aa0f5-9f2b-4511-b77e-53e1138549f8 tempest-ProjectReaderTests-542466594 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-bbc9d4d5-710d-4897-9f3d-6dcfcb2ad469.c20347b9-c379-4d63-8f61-ecca0ef26990" returned: 0 in 0.350s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:12:38 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.remotefs [None req-ae0aa0f5-9f2b-4511-b77e-53e1138549f8 tempest-ProjectReaderTests-542466594 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bbc9d4d5-710d-4897-9f3d-6dcfcb2ad469(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87272) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 11:12:38 devstack cinder-volume[87272]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7f846ce-760d-4267-a31c-c52c2b3405d2]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 11:12:38 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-ae0aa0f5-9f2b-4511-b77e-53e1138549f8 tempest-ProjectReaderTests-542466594 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-bbc9d4d5-710d-4897-9f3d-6dcfcb2ad469 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:12:38 devstack sudo[108520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-bbc9d4d5-710d-4897-9f3d-6dcfcb2ad469 Nov 04 11:12:38 devstack sudo[108520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:12:38 devstack sudo[108520]: pam_unix(sudo:session): session closed for user root Nov 04 11:12:38 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-ae0aa0f5-9f2b-4511-b77e-53e1138549f8 tempest-ProjectReaderTests-542466594 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-bbc9d4d5-710d-4897-9f3d-6dcfcb2ad469" returned: 0 in 0.353s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:12:38 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-ae0aa0f5-9f2b-4511-b77e-53e1138549f8 tempest-ProjectReaderTests-542466594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-bbc9d4d5-710d-4897-9f3d-6dcfcb2ad469.c20347b9-c379-4d63-8f61-ecca0ef26990 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:12:39 devstack sudo[108525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-bbc9d4d5-710d-4897-9f3d-6dcfcb2ad469.c20347b9-c379-4d63-8f61-ecca0ef26990 Nov 04 11:12:39 devstack sudo[108525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:12:39 devstack sudo[108525]: pam_unix(sudo:session): session closed for user root Nov 04 11:12:39 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-ae0aa0f5-9f2b-4511-b77e-53e1138549f8 tempest-ProjectReaderTests-542466594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-bbc9d4d5-710d-4897-9f3d-6dcfcb2ad469.c20347b9-c379-4d63-8f61-ecca0ef26990" returned: 0 in 0.328s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:12:39 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-ae0aa0f5-9f2b-4511-b77e-53e1138549f8 tempest-ProjectReaderTests-542466594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-bbc9d4d5-710d-4897-9f3d-6dcfcb2ad469.c20347b9-c379-4d63-8f61-ecca0ef26990 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:12:39 devstack sudo[108531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-bbc9d4d5-710d-4897-9f3d-6dcfcb2ad469.c20347b9-c379-4d63-8f61-ecca0ef26990 Nov 04 11:12:39 devstack sudo[108531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:12:39 devstack sudo[108531]: pam_unix(sudo:session): session closed for user root Nov 04 11:12:39 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-ae0aa0f5-9f2b-4511-b77e-53e1138549f8 tempest-ProjectReaderTests-542466594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-bbc9d4d5-710d-4897-9f3d-6dcfcb2ad469.c20347b9-c379-4d63-8f61-ecca0ef26990" returned: 0 in 0.235s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:12:39 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-ae0aa0f5-9f2b-4511-b77e-53e1138549f8 tempest-ProjectReaderTests-542466594 None] Lock "cinder-quobyte-c20347b9-c379-4d63-8f61-ecca0ef26990" released by "_delete_snapshot" :: held 1.358s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 11:12:39 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-ae0aa0f5-9f2b-4511-b77e-53e1138549f8 tempest-ProjectReaderTests-542466594 None] Lock "cinder-quobyte-bbc9d4d5-710d-4897-9f3d-6dcfcb2ad469" released by "delete_snapshot" :: held 1.380s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 11:12:39 devstack cinder-volume[87272]: DEBUG cinder.quota [None req-ae0aa0f5-9f2b-4511-b77e-53e1138549f8 tempest-ProjectReaderTests-542466594 None] Created reservations ['314935a4-6f6b-4a23-84f3-f23067ffbdd0', '152fde3f-46d4-4cc4-a5f7-e8106e2b2c8a', 'c83cafc6-c0c5-42a7-a849-c7821cdfa18e', '426f676b-7ba4-417f-861d-f14804fd5e34'] {{(pid=87272) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 11:12:39 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-ae0aa0f5-9f2b-4511-b77e-53e1138549f8 tempest-ProjectReaderTests-542466594 None] Delete snapshot completed successfully. Nov 04 11:12:39 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-ae0aa0f5-9f2b-4511-b77e-53e1138549f8 tempest-ProjectReaderTests-542466594 None] Lock "cinder-c20347b9-c379-4d63-8f61-ecca0ef26990-delete_snapshot" released by "delete_snapshot" :: held 1.502s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 11:12:40 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-74eaf46d-a7e8-4b36-acbd-0cde4ee37e45 tempest-ProjectReaderTests-542466594 None] Acquiring lock "cinder-bbc9d4d5-710d-4897-9f3d-6dcfcb2ad469-delete_volume" by "delete_volume" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 11:12:40 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-74eaf46d-a7e8-4b36-acbd-0cde4ee37e45 tempest-ProjectReaderTests-542466594 None] Lock "cinder-bbc9d4d5-710d-4897-9f3d-6dcfcb2ad469-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 11:12:40 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-74eaf46d-a7e8-4b36-acbd-0cde4ee37e45 tempest-ProjectReaderTests-542466594 None] Acquiring lock "cinder-quobyte-bbc9d4d5-710d-4897-9f3d-6dcfcb2ad469" by "delete_volume" {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 11:12:40 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-74eaf46d-a7e8-4b36-acbd-0cde4ee37e45 tempest-ProjectReaderTests-542466594 None] Lock "cinder-quobyte-bbc9d4d5-710d-4897-9f3d-6dcfcb2ad469" acquired by "delete_volume" :: waited 0.014s {{(pid=87272) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 11:12:40 devstack cinder-volume[87272]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5343671-2c39-4694-bc02-bf1b5ef53ec2]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 11:12:40 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-74eaf46d-a7e8-4b36-acbd-0cde4ee37e45 tempest-ProjectReaderTests-542466594 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-bbc9d4d5-710d-4897-9f3d-6dcfcb2ad469 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:12:40 devstack sudo[108534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-bbc9d4d5-710d-4897-9f3d-6dcfcb2ad469 Nov 04 11:12:40 devstack sudo[108534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:12:40 devstack sudo[108534]: pam_unix(sudo:session): session closed for user root Nov 04 11:12:40 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-74eaf46d-a7e8-4b36-acbd-0cde4ee37e45 tempest-ProjectReaderTests-542466594 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-bbc9d4d5-710d-4897-9f3d-6dcfcb2ad469" returned: 0 in 0.364s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:12:40 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-74eaf46d-a7e8-4b36-acbd-0cde4ee37e45 tempest-ProjectReaderTests-542466594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-bbc9d4d5-710d-4897-9f3d-6dcfcb2ad469 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:12:40 devstack sudo[108539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-bbc9d4d5-710d-4897-9f3d-6dcfcb2ad469 Nov 04 11:12:40 devstack sudo[108539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:12:41 devstack sudo[108539]: pam_unix(sudo:session): session closed for user root Nov 04 11:12:41 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-74eaf46d-a7e8-4b36-acbd-0cde4ee37e45 tempest-ProjectReaderTests-542466594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1/volume-bbc9d4d5-710d-4897-9f3d-6dcfcb2ad469" returned: 0 in 0.244s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:12:41 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-74eaf46d-a7e8-4b36-acbd-0cde4ee37e45 tempest-ProjectReaderTests-542466594 None] Lock "cinder-quobyte-bbc9d4d5-710d-4897-9f3d-6dcfcb2ad469" released by "delete_volume" :: held 0.668s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 11:12:41 devstack cinder-volume[87272]: DEBUG cinder.quota [None req-74eaf46d-a7e8-4b36-acbd-0cde4ee37e45 tempest-ProjectReaderTests-542466594 None] Created reservations ['5c6aed8f-adcd-406a-ba82-c71d5e5fedc6', 'ac33ee33-6f32-401e-a0d8-d2a0fd054361', 'b3709765-fec3-4ab5-b90c-e79200df077c', 'd32f87a5-6b8c-4562-a936-9f121e0ba319'] {{(pid=87272) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 11:12:41 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-74eaf46d-a7e8-4b36-acbd-0cde4ee37e45 tempest-ProjectReaderTests-542466594 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 11:12:41 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-74eaf46d-a7e8-4b36-acbd-0cde4ee37e45 tempest-ProjectReaderTests-542466594 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 11:12:41 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-74eaf46d-a7e8-4b36-acbd-0cde4ee37e45 tempest-ProjectReaderTests-542466594 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898': None} {{(pid=87272) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 11:12:41 devstack cinder-volume[87272]: DEBUG cinder.volume.drivers.quobyte [None req-74eaf46d-a7e8-4b36-acbd-0cde4ee37e45 tempest-ProjectReaderTests-542466594 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8dc84261-5d0f-4588-bcd4-ac4bcd791898'] {{(pid=87272) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 11:12:41 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [None req-74eaf46d-a7e8-4b36-acbd-0cde4ee37e45 tempest-ProjectReaderTests-542466594 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87272) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 11:12:41 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-74eaf46d-a7e8-4b36-acbd-0cde4ee37e45 tempest-ProjectReaderTests-542466594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1 {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 11:12:41 devstack sudo[108542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1 Nov 04 11:12:41 devstack sudo[108542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 11:12:41 devstack sudo[108542]: pam_unix(sudo:session): session closed for user root Nov 04 11:12:41 devstack cinder-volume[87272]: DEBUG oslo_concurrency.processutils [None req-74eaf46d-a7e8-4b36-acbd-0cde4ee37e45 tempest-ProjectReaderTests-542466594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69039e512fda7225177d5ede8ceae9a1" returned: 0 in 0.268s {{(pid=87272) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 11:12:41 devstack cinder-volume[87272]: DEBUG cinder.manager [None req-74eaf46d-a7e8-4b36-acbd-0cde4ee37e45 tempest-ProjectReaderTests-542466594 None] Notifying Schedulers of capabilities ... {{(pid=87272) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 11:12:41 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-74eaf46d-a7e8-4b36-acbd-0cde4ee37e45 tempest-ProjectReaderTests-542466594 None] Deleted volume successfully. Nov 04 11:12:41 devstack cinder-volume[87272]: DEBUG cinder.coordination [None req-74eaf46d-a7e8-4b36-acbd-0cde4ee37e45 tempest-ProjectReaderTests-542466594 None] Lock "cinder-bbc9d4d5-710d-4897-9f3d-6dcfcb2ad469-delete_volume" released by "delete_volume" :: held 1.124s {{(pid=87272) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 11:12:46 devstack cinder-volume[87272]: DEBUG dbcounter [-] [87272] Writing DB stats cinder:DELETE=14,cinder:UPDATE=148,cinder:SELECT=112,cinder:INSERT=40 {{(pid=87272) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 11:12:46 devstack cinder-volume[87272]: DEBUG dbcounter [-] [87272] Writing DB stats cinder:INSERT=40,cinder:UPDATE=141,cinder:SELECT=112,cinder:DELETE=11 {{(pid=87272) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}